Nvidia, Oracle speed up AI cloud infrastructure for enterprise

The range of business-ready AI applications would include conversational AI chatbots, recommender engine systems, and computer vision.
19 October 2022

At Oracle CloudWorld 2022, the cloud services provider expanded its partnership with Nvidia to bring accelerated computing and AI infrastructure development to address business customer pain points, in what was announced to be a multi-year partnership.

A big part of the extended collaboration will entail the entire Nvidia hardware and software stack, including tens of thousands of GPUs like the A100 and the DGX H100 AI platform for enterprises that were revealed at Nvidia GTC last month, being introduced to Oracle Cloud Infrastructure.

According to Nvidia founder-CEO Jensen Huang and Oracle CEO Safra Catz, the growing partnership between the two digital leaders will make AI-centric cloud infrastructure more accessible and encourage innovative collaboration in key sectors, ranging from smart manufacturing and telecommunications to the healthcare and financial services industries.

Thanks to the Nvidia Hopper AI architecture and the powerful new Transformer Engine, H100 will allow enterprises to significantly reduce the cost of delivering AI applications, while providing the reliable high level of performance that business AI use cases require. With the Oracle partnership, AI workflows harnessing the Nvidia AI Enterprise software suite can be developed and deployed specifically on Oracle Cloud Infrastructure.

In fact with the full Nvidia AI stack being introduced to Oracle Cloud Infrastructure, data processing for end-to-end AI workflows can be greatly accelerated by leveraging NVIDIA Accelerated Apache Spark in OCI Data Flow, with alterations easily made with no-code– optimizing data processing resources, and managing unnecessary additional costs that used to be incurred by the enterprise customer.

Oracle partnered with Nvidia to bring accelerated cloud and AI infrastructure development to address business customer pain points

The NVIDIA A100 SXM. Source: NVIDIA

The additional processing power from the added-on GPU clusters (with up to 512 Nvidia GPUs per cluster) will be necessary to handle the high-performance AI file systems on Oracle Cloud Infrastructure such as WEKA, Lustre, GlusterFS or IBM Spectrum Scale – producing up to 2 terabytes of throughput per second, and capable of processing a variety of preconfigured or cost-optimized requirements.

With the Nvidia AI Enterprise suite enabling key abilities, including cloud-native management and AI and accelerated data science development tools on top of Oracle Cloud Infrastructure, ready-made AI frameworks and applications equipped with deployment capabilities for enterprises will be made available.

The range of business-ready AI applications would include conversational AI chatbots, recommender engine systems, and computer vision capabilities. And with a broad, certified partner ecosystem to integrate with, both development times and complexities can be dramatically cut down – always a major concern for companies. Additionally, the efficiency savings can then translate towards quicker turnaround on actual usage and data insights on performance that can be studied, and improved upon.

Along with the Oracle Cloud Infrastructure Data Flow layer accelerated with Apache Spark for more rapid data processing, Nvidia GPUs will also speed up TensorFlow acceleration for Spark natural language processing, machine learning and deep learning applications. Over those, a dedicated AI framework for healthcare and life sciences, Nvidia Clara on Oracle Cloud Infrastructure, has also been developed to advance AI research into medical devices, genomics analyses, medical imaging advancements, and advanced drug discovery studies.

“To drive long-term success in today’s business environment, organizations need answers and insight faster than ever,” commented Oracle CEO Safra Catz. “Our expanded alliance with NVIDIA will deliver the best of both companies’ expertise to help customers across industries — from healthcare and manufacturing to telecommunications and financial services — overcome the multitude of challenges they face.”

“Accelerated computing and AI are key to tackling rising costs in every aspect of operating businesses,” added Jensen Huang, the CEO and founder of Nvidia. “Enterprises are increasingly turning to cloud-first AI strategies that enable fast development and scalable deployment. Our partnership with Oracle will put NVIDIA AI within easy reach for thousands of companies.”