NVIDIA GTC 2024 AI and Cloud partnership rundown

Before you read this, we strongly recommend you check out the key product announcements to gain an understanding of the new offerings from NVIDIA.

AWS and NVIDIA advance generative AI innovations

With the new NVIDIA Blackwell GPU platform on offer, AWS has been quick to snap up plenty for itself and strengthen its longstanding partnership with NVIDIA.

Here’s what you need to know:

• AWS will introduce Amazon EC2 instances powered by the new NVIDIA Grace Blackwell GPUs and integrate NVIDIA DGX Cloud services, enhancing the capability to develop and execute inference processes on multi-trillion-parameter LLMs with improved performance.
• AWS Nitro System, Elastic Fabric Adapter encryption, and Key Management Service will be fully integrated with NVIDIA’s Blackwell encryption to offer customers improved end-to-end control and security for AI applications.
• AWS and NVIDIA have joined forces for Project Ceiba, deploying 20,736 GB200 Superchips with the capacity to handle 414 exaflops. This collaboration aims to construct one of the quickest AI supercomputers, operating solely on AWS via the DGX Cloud, dedicated to NVIDIA’s AI research and development.
• Integration of Amazon SageMaker with NVIDIA NIM inference microservices enables customers to enhance the cost-efficiency of foundational models executed on GPUs.
• AWS and NVIDIA to collaborate on AI innovation within the healthcare and life sciences sectors.

Find out more about the partnership, here.

Oracle and NVIDIA delivering sovereign AI globally

Oracle and NVIDIA have strengthened ties to deliver AI solutions globally whilst maintaining digital sovereignty in their offerings, as well as security.

Here’s what you need to know:

• Oracle and NVIDIA are partnering to provide accelerated computing and generative AI services, aiming to establish digital sovereignty and handle proprietary national and personal data securely.
• Orace is to integrate NVIDIA Grace Blackwell technology across its OCI Supercluster, OCI Compute, and NVIDIA DGX Cloud services on OCI.

Find out more about the partnership, here.

Google Cloud and NVIDIA expand their partnership for AI development

Google Cloud and NVIDIA have strengthened their collaboration to empower the machine learning (ML) community with advanced technology designed to streamline the development, scaling, and management of generative AI applications.

Here’s what you need to know:

• Google Cloud will adopt NVIDIA Grace Blackwell platform for a variety of internal deployments to provide its customers with one of the first Blackwell-powered services.
• Google plans to incorporate NVIDIA GB200 NVL72 systems into its cloud infrastructure, enhancing scalability and performance. These systems feature a combination of 72 Blackwell GPUs and 36 Grace CPUs, interconnected by the fifth-generation NVLink.
• Google Cloud and NVIDIA have partnered to extend the benefits of JAX to NVIDIA GPUs, broadening the availability of large-scale LLM training within the wider machine learning community.
• The NVIDIA NIM inference microservices, components of the NVIDIA AI Enterprise software platform, are set to be integrated with Google Kubernetes Engine (GKE).
• Google Cloud has simplified the deployment of the NVIDIA NeMo framework on its platform through the GKE and the Google Cloud HPC Toolkit.
• Google’s Vertex AI and Dataflow are being expanded to support Google Cloud A3 VMs powered by NVIDIA H100 GPUs and G2 VMs powered by NVIDIA L4 Tensor Core GPUs.

Find out more about the partnership, here.

Microsoft and NVIDIA to accelerate generative AI for enterprise

Microsoft and NVIDIA have expanded their partnership, leveraging the new solutions on offer by NVIDIA to bring more power to Microsoft’s enterprise services.

Here’s what you need to know:

• Microsoft will adopt NVIDIA Grace Blackwell Superchips for Azure, accelerating customer and first-party AI offerings.
• The native integration of NVIDIA DGX Cloud with Microsoft Fabric, designed to streamline the development of custom AI models using customers' own data.
• NVIDIA Omniverse Cloud APIs with be premiering on Azure, energising an ecosystem of industrial design and simulation tools.
• Microsoft Copilot is set to be enhanced with NVIDIA AI and its Grace Blackwell platform.
• Microsoft Azure AI will leverage NVIDIA’s generative AI microservices for enterprise, developer, and healthcare applications.

Found out more about the partnership, here.