NVIDIA AI workbench speeds adoption of custom generative AI

AI Workbench removes the complexity of getting started with an enterprise AI project. Accessed through a simplified interface running on a local system, it allows developers to customise models from popular repositories like Hugging Face, GitHub and NVIDIA NGC using custom data. The models can then be shared easily across multiple platforms.

“Enterprises around the world are racing to find the right infrastructure and build generative AI models and applications,” said Manuvir Das, Vice President of enterprise computing at NVIDIA. “NVIDIA AI Workbench provides a simplified path for cross-organisational teams to create the AI-based applications that are increasingly becoming essential in modern business.”

A new era for AI developers

While hundreds of thousands of pretrained models are now available, customising them with the many open-source tools can require hunting through multiple online repositories for the right framework, tools, and containers, and employing the right skills to customise a model for a specific use case.

With NVIDIA AI Workbench, developers can customise and run generative AI in just a few clicks. It allows them to pull together all necessary enterprise-grade models, frameworks, software development kits and libraries from open-source repositories and the NVIDIA AI platform into a unified developer toolkit.

Leading AI infrastructure providers – including Dell Technologies, Hewlett Packard Enterprise, HP Inc., Lambda, Lenovo and Supermicro – are embracing AI Workbench for its ability to augment their latest generation of multi-GPU-capable desktop workstations, high-end mobile workstations, and virtual workstations.

Developers with a Windows or Linux-based NVIDIA RTX PC or workstation will also be able to initiate, test and fine-tune enterprise-grade generative AI projects on their local RTX systems, and easily access data centre and Cloud computing resources to scale as needed.

New NVIDIA AI Enterprise 4.0 software advances AI deployment

To further accelerate the adoption of generative AI, NVIDIA announced the latest version of its enterprise software platform, NVIDIA AI Enterprise 4.0. It gives businesses the tools needed to adopt generative AI, while also offering the security and API stability required for reliable production deployments.

Newly supported software and tools in NVIDIA AI Enterprise that help streamline generative AI deployment include:

• NVIDIA NeMo, a Cloud-native framework to build, customise and deploy large language models. With NeMo, NVIDIA AI Enterprise provides end-to-end support for creating and customising LLM applications
• NVIDIA Triton Management Service, which helps automate and optimise production deployments. It allows enterprises to automatically deploy multiple NVIDIA Triton Inference Server instances in Kubernetes with model orchestration for efficient operation of scalable AI
• NVIDIA Base Command Manager Essentials cluster management software, which helps enterprises maximise performance and utilisation of AI servers across data centre, multi-Cloud and hybrid-Cloud environments
• NVIDIA AI Enterprise software – which lets users build and run NVIDIA AI-enabled solutions across the Cloud, data centre and edge – is certified to run on mainstream NVIDIA-Certified Systems, NVIDIA DGX systems, all major Cloud platforms and newly announced NVIDIA RTX workstations

Software companies ServiceNow and Snowflake, as well as infrastructure provider Dell Technologies, which offers Dell Generative AI Solutions, recently announced they are collaborating with NVIDIA to enable new generative AI solutions and services on their platforms. The integration of NVIDIA AI Enterprise 4.0 and NVIDIA NeMo provides a foundation for production-ready generative AI for customers.

NVIDIA AI Enterprise 4.0 will be integrated into partner marketplaces, including AWS Marketplace, Google Cloud and Microsoft Azure, as well as through NVIDIA Cloud partner Oracle Cloud Infrastructure.

Additionally, MLOps providers, including Azure Machine Learning, ClearML, Domino Data Lab, Run:AI, and Weights & Biases, are adding seamless integration with the NVIDIA AI platform to simplify production-grade generative AI model development.

Broad partner support

“Dell Technologies and NVIDIA are committed to helping enterprises build purpose-built AI models to access the immense opportunity of generative AI. With NVIDIA AI Workbench, developers can take advantage of the full Dell Generative AI Solutions portfolio to customise models on PCs, workstations, and data centre infrastructure,” said Meghana Patwardhan, Vice President of commercial client products at Dell Technologies.

“Most enterprises do not have the expertise, budget, and data centre resources to manage the high complexity of AI software and systems. We look forward to NVIDIA AI Workbench’s potential to simplify generative AI project creation with one-click training and deployment on the HPE GreenLake edge-to-cloud platform,” said Evan Sparks, Chief Product Officer for AI at HPE.

“As a workstation market leader offering the performance and efficiency needed for the most demanding data science and AI models, we have a long history collaborating with NVIDIA. HP is embracing the next generation of high-performance systems, coupled with NVIDIA RTX Ada Generation GPUs and NVIDIA AI Workbench, and bringing the power of generative AI to our enterprise customers and helping move AI workloads between the Cloud and locally,” said Jim Nottingham, Senior Vice President of advanced computing solutions at HP Inc.

“Lenovo and NVIDIA are helping customers overcome deployment complexities and more easily implement generative AI to deliver transformative services and products to the market. NVIDIA AI Workbench and the Lenovo AI-ready portfolio enable developers to leverage the power of their smart devices and scale across edge-to-cloud infrastructure,” said Rob Herman, Vice President, and General Manager of Lenovo Workstation & Client AI.

“The longstanding VMware and NVIDIA partnership has helped unlock the power of AI for every business by delivering an end-to-end enterprise platform optimised for AI workloads. Together, we are making generative AI more accessible and easier to implement in the enterprise. With AI Workbench, NVIDIA is giving developers a set of powerful tools to help enterprises accelerate gen AI adoption. With the new NVIDIA AI Workbench, development teams can seamlessly move AI workloads from the desktop to production,” said Chris Wolf, Vice President of VMware AI Labs.

Watch NVIDIA Founder and CEO Jensen Huang’s SIGGRAPH keynote address on demand to learn more about NVIDIA AI Workbench and NVIDIA AI Enterprise 4.0.

AI Workbench is coming soon in early access. Sign up to get notified when it is available.