NVIDIA AI Enterprise Expands with H200 NVL GPU Support
NVIDIA has announced a significant update to its NVIDIA AI Enterprise platform, now incorporating support for the NVIDIA H200 NVL GPU. This advancement is part of the latest release of the company’s infrastructure software, aimed at enhancing enterprise-level AI applications.
NVIDIA AI Enterprise Platform
The NVIDIA AI Enterprise platform is designed to facilitate the development and deployment of production-grade AI solutions. It consists of a comprehensive suite of software components that can be deployed on various hardware setups, including servers, edge systems, and workstations. The platform is divided into two main categories: the AI and Data Science software catalog and the infrastructure software collection.
Infrastructure Software Collection
The infrastructure software collection provides essential components for supporting AI and data science workloads on accelerated systems. This includes drivers for GPU, networking, and virtualization, as well as Kubernetes operators. Additionally, the Base Command Manager Essentials is available for efficient cluster management.
H200 NVL GPU Enhancements
The H200 NVL GPU is designed for data centers requiring lower-power, air-cooled enterprise rack designs. It offers flexible configurations to accelerate a wide range of AI workloads. The GPU boasts a 1.5x memory increase and a 1.2x bandwidth increase over its predecessor, the NVIDIA H100 NVL, delivering up to 1.7x faster inference performance.
Reference Architecture and Availability
NVIDIA has also introduced a reference architecture to streamline the deployment and configuration of AI systems. This architecture provides a flexible infrastructure stack for original equipment manufacturers (OEMs) and partners, ensuring consistent software components and adaptable hardware configurations.
For enterprises purchasing servers with the H200 NVL, NVIDIA AI Enterprise is immediately accessible, complete with a five-year subscription. Additionally, NVIDIA offers several ways to get started, including free access to NIM microservices for testing and a 90-day free evaluation license. The NVIDIA AI Enterprise Infrastructure Collection 6.0 is available for download from the NVIDIA NGC Catalog.
Conclusion
The addition of the H200 NVL GPU to NVIDIA AI Enterprise is a significant step forward in the development of enterprise-level AI applications. With its improved performance and efficiency, this update is expected to enhance the overall AI infrastructure, making it easier for organizations to deploy and manage AI workloads.
Frequently Asked Questions
- What is the NVIDIA AI Enterprise platform?
- The NVIDIA AI Enterprise platform is a comprehensive suite of software components designed to facilitate the development and deployment of production-grade AI solutions.
- What is the H200 NVL GPU?
- The H200 NVL GPU is a new addition to NVIDIA’s data center GPU lineup, designed for lower-power, air-cooled enterprise rack designs, offering flexible configurations to accelerate a wide range of AI workloads.
- When is the NVIDIA AI Enterprise Infrastructure Collection 6.0 available?
- The NVIDIA AI Enterprise Infrastructure Collection 6.0 is available for download from the NVIDIA NGC Catalog.
