Supermicro launches servers with AMD EPYC 9005 and Instinct MI325X for AI data centres

The new "Zen5" processor core architecture implements full data path AVX-512 vector instructions for CPU-based AI inference and provides 17% better instructions per cycle (IPC) than the previous 4th generation EPYC processor, enabling more performance per core.

Supermicro's new H14 family uses the latest 5th Gen AMD EPYC processors which enable up to 192 cores per CPU with up to 500W TDP (thermal design power). Supermicro has designed new H14 systems including the Hyper and FlexTwin systems which can accommodate the higher thermal requirements. The H14 family also includes three systems for AI training and inference workloads supporting up to 10GPUs which feature the AMD EPYC 9005 Series CPU as the host processor and two which support the AMD Instinct MI325X GPU.

"Supermicro's H14 servers have 2.44X faster SPECrate 2017_fp_base performance using the EPYC 9005 64 core CPU as compared with Supermicro’s H11 systems using the second generation EPYC 7002 Series CPUs," said Charles Liang, President and CEO, Supermicro. "This significant performance improvement allows customers to make their data centres more power efficient by reducing the total data centre footprint by at least two-thirds2 while also adding new AI processing capabilities. The H14 server family provides the highest performance, density, and power efficiency available through Supermicro’s liquid and air-cooling options, wide selection of system designs, and proven Building Block Solutions."

"Supermicro's 'Building Block Solutions' has enabled it to consistently deliver time-to-market solutions powered by AMD across a variety of compelling system designs," said Forrest Norrod, Executive Vice President and General Manager, Data Centre Solutions Group, AMD. "Our collaboration with Supermicro, along with their in-house engineering design and manufacturing capabilities worldwide combined with their rack-scale integration capability for both air and liquid-cooled systems enables customers of any scale to generate time-to-value from AMD EPYC CPUs and Instinct GPUs."

Supermicro's H14 server line-up consists of the following product families:

• Hyper: Supermicro's flagship enterprise server supports maximum performance from two EPYC 9005 CPUs with up to the maximum 192 cores per CPU at 500W and up to 9TB memory in 24 DIMM slots. With either a 1U chassis with up to 12 2.5" NVMe/SATA bays or a 2U chassis with up to 24 2.5" NVMe/SATA bays, the Hyper's advanced cooling design accommodates the highest performance CPUs for use in demanding AI inference, enterprise, or cloud workloads.
• CloudDC: this versatile system is optimised for use in Cloud Data Centres and features a single EPYC 9005 CPU with up to 12 2.5" NVMe/SATA drive bays in a 1U chassis. It's designed using the OCP (Open Compute Platform) DC-MHS specification (Data Centre Modular Hardware System) which ensures compatibility with OCP standards.
• GrandTwin: the GrandTwin is a four-node compute platform using single EPYC 9005 CPU in a very dense 2U form-factor. This system is often used in multi-server cluster applications such as object storage, virtualisation, and HPC applications.
• FlexTwin: the FlexTwin is a 2U four-node high-performance high-density compute system with dual EPYC 9005 CPUs per node. The advanced liquid-cooling provides high power efficiency and allows the operation of the highest performance EPYC 9005 CPUs for use in HPC, EDA, and other demanding workloads.
• 5U GPU system: Supermicro's EPYC CPU-based 5U PCIe GPU system supports up to 10 double-width accelerators for design and visualisation applications.
• 4U GPU System (liquid cooled): this highly dense EPYC CPU-based eight-way accelerators platform supports OAM accelerators in the most compact 4U form-factor using advanced liquid-cooling. It is designed for high-performance AI and HPC applications.
• 8U GPU System: yhis eight-way accelerator system uses the AMD Instinct MI325X GPU along with the EPYC 9005 CPU for large-scale LLM AI training. The 8U chassis allows deployment in any air-cooled data centre.

Supermicro H14 products with AMD EPYC CPUs are available for customer testing today through Supermicro's JumpStart programme.