The NVIDIA® A30 Tensor Core GPU delivers a versatile platform for mainstream enterprise workloads like AI inference, training, and high-performance computing (HPC). It combines 3rd Generation Tensor Cores with 24 GB of HBM2 memory in a dual-slot 10.5-inch PCI Express Gen4 form factor, with 165 W maximum board power. The card is passively cooled that requires system airflow to operate
within its thermal envelope.
Built on the latest NVIDIA Ampere architecture, the NVIDIA A30 brings innovations like Tensor Float 32 (TF32) and Tensor Core FP64, as well as end-to-end software stack solutions including the NVIDIA AI Enterprise suite, to ensure that mainstream AI and HPC jobs can be rapidly solved. In addition to these features, the A30 supports double precision (FP64), single precision (FP32), half precision (FP16), Brain Float 16 (BF16) and Integer (INT8) computations, unified virtual memory, and page migration engine capability. The Multi-Instance GPU (MIG) feature ensures quality of service (QoS) with secure, hardware-partitioned, right-sized GPUs across all compute workloads for a diverse set of users and maximizes the utilization of GPU resources.
The NVIDIA A30 ships with ECC enabled to protect the GPU’s memory interface and the on-board memories from detectable errors. A30’s HBM2 memory has native support for ECC with no ECC overhead, both in memory capacity and bandwidth. The card is designed to meet the requirements of NEBS Level 3 compliant servers and supports security features like secure boot and hardware root-of-trust.