NVIDIA sets path for future of edge AI and autonomous machines

Built on the NVIDIA Ampere architecture, Jetson AGX Orin provides 6x the processing power and maintains form factor and pin compatibility with its predecessor, Jetson AGX Xavier. It delivers 200 trillion operations per second, similar to that of a GPU-enabled server but in a size that fits in the palm of your hand.

The new Jetson computer accelerates the full NVIDIA AI software stack, allowing developers to deploy the largest, most complex models needed to solve edge AI and robotics challenges in natural language understanding, 3D perception, multisensor fusion and more.

“As robotics and embedded computing transform manufacturing, healthcare, retail, transportation, smart cities and other essential sectors of the economy, the demand for processing continues to surge,” said Deepu Talla, Vice President and General Manager of Embedded and Edge Computing at NVIDIA. “Jetson AGX Orin addresses this need, enabling the 850,000 Jetson developers and over 6,000 companies building commercial products on it to create and deploy autonomous machines and edge AI applications that once seemed impossible.”

Jetson AGX Orin features an NVIDIA Ampere architecture GPU and Arm Cortex-A78AE CPUs, along with next-generation deep learning and vision accelerators. High-speed interfaces, faster memory bandwidth and multimodal sensor support provide the ability to feed multiple concurrent AI application pipelines.

Comprehensive software and ecosystem support

Customers using the Jetson AGX Orin can leverage the NVIDIA CUDA-X accelerated computing stack, NVIDIA JetPack SDK and the latest NVIDIA tools for application development and optimisation, including cloud-native development workflows. Pretrained models from the NVIDIA NGC catalog are optimised and ready for fine-tuning with the NVIDIA TAO toolkit and customer datasets. This reduces time and cost for production-quality AI deployments, while cloud-native technologies allow seamless updates throughout a product’s lifetime.

The Jetson embedded computing partner ecosystem encompasses a broad range of services and products, including cameras and other multimodal sensors, carrier boards, hardware design services, AI and system software, developer tools and custom software development.

“Driven by the advancements in AI, the robotics market is growing exponentially,” said Jim McGregor, Principal Analyst at TIRIAS Research. “NVIDIA is the recognised leader in AI and continues to leverage this expertise to advance robotics through a robust ecosystem and complete end-to-end solutions, including a range of hardware platforms that leverage common tools and neural network models. The new Jetson platform brings the performance and versatility of the NVIDIA Ampere architecture to enable even further advancements in autonomous mobile robots for a wide range of applications ranging from agriculture and manufacturing to healthcare and smart cities.”

For specific use cases, software frameworks include NVIDIA Isaac Sim on Omniverse for robotics, NVIDIA Clara Holoscan SDK for healthcare, and NVIDIA DRIVE for autonomous driving. The latest Isaac release includes significant support for the Robot Operating System (ROS) developer community. NVIDIA has also released the new Omniverse Replicator for synthetic data generation and Isaac GEMs, hardware-accelerated software packages that make it easier for ROS developers to build high-performance AI-enabled robots on the Jetson platform.

Computing Platform for Real-Time Sensing Medical Instruments, Devices

NVIDIA AGX Orin powers NVIDIA Clara Holoscan, a new computing platform for the healthcare industry that allows developers to build software-defined medical devices which run low-latency streaming applications on the edge. This processing power is needed for devices such as robotic surgery, endoscopy and diagnostic imaging systems to process physics, imaging and visualization and enable real-time AI-decision support for doctors. Clara Holoscan gives developers a flexible platform to create AI microservices that run low-latency streaming applications on devices while passing more complex tasks to the data center.

New Era of Transportation Built on NVIDIA DRIVE Orin

DRIVE AGX Orin, also powered by the NVIDIA Ampere architecture like Jetson AGX Orin, is the platform of choice for the transportation industry. It is the advanced processor behind the newly announced NVIDIA DRIVE Concierge and DRIVE Chauffeur — two AI platforms dedicated to redefining the passenger experience inside the car through AI assistants, and to powering safe, autonomous driving, respectively. Numerous global auto and truck makers, new energy vehicle startups and shuttle companies are using its high-performance AI compute for their next generation of intelligent, software-defined mobility solutions.

Jetson AGX Orin Availability

The NVIDIA Jetson AGX Orin module and developer kit will be available in the first quarter of 2022. Register to be notified about availability, access detailed specifications and download the white paper.