NVIDIA HGX A100 (16-GPU) Professional Computing Solution

16x NVIDIA Tesla A100

Product status: Official | Last Update: 2022-11-08 | Report Error

Graphics Processor

GA100 ×16

NVIDIA HGX A100 (16-GPU)

Manufacturer

NVIDIA

Original Series

Data Center Ampere

Launch Date

May 14th, 2020

GPU Model

16× GA100

Architecture

Ampere

Fabrication Process

7 nm

Die Size

16× 826 mm²

Transistors Count

16× 54.2B

Transistors Density

65.6M ^TRAN/_mm²

CUDAs

16× 6912 (110592)

Tensor Cores

16× 432 (6912)

16× 108 (1728)

GPCs

16× 7 (112)

TMUs

16× 432 (6912)

Boost Clock

1410 MHz

Memory Clock

1215 MHz

Effective Memory Clock

2430 Mbps

Memory Size

16× 40960 (655360) MB

Memory Type

HBM2

Memory Bus Width

16× 5120 (81920)-bit

Memory Bandwidth

16× 1,555.2 (16) GB/s

Interface

SXM 4.0

TDP/TBP

13000 W

DirectX

12.2

Vulkan

1.2

OpenGL

4.6

OpenCL

2.1

Texture Fillrate

9.7 TTexel/s

Peak FP32

311.9 TFLOPS

Peak FP64

155.9 TFLOPS

FP32 Perf. per Watt

24 GFLOPS/W

FP32 Perf. per mm²

23.6 GFLOPS/mm²

Pictures

Angle
Other

Data Center Ampere Series18

Model	Cores	Boost Clock	Memory Clock	Memory Config.
NVIDIA HGX A100 (16-GPU)	110592	1410 MHz	2.4 Gbps	10240 GB HB2 5120b
NVIDIA DGX A100	55296	1410 MHz	2.4 Gbps	2560 GB HB2 5120b
NVIDIA HGX A100 (8-GPU)	55296	1410 MHz	2.4 Gbps	2560 GB HB2 5120b
NVIDIA HGX A100 (4-GPU)	27648	1410 MHz	2.4 Gbps	640 GB HB2 5120b
NVIDIA A16	5120	1755 MHz	12.5 Gbps	256 GB G6 128b
NVIDIA A40	10752	1740 MHz	14.5 Gbps	48 GB G6 384b
NVIDIA A10	9216	1695 MHz	12.5 Gbps	24 GB G6 384b
NVIDIA A100 SXM 80GB	6912	1410 MHz	3.2 Gbps	80 GB 5120b
NVIDIA A800 SXM 80GB	6912	1410 MHz	3.2 Gbps	80 GB 5120b
NVIDIA A100 PCIe 80GB	6912	1410 MHz	3 Gbps	80 GB 5120b
NVIDIA A800 PCIe 80GB	6912	1410 MHz	3 Gbps	80 GB 5120b
NVIDIA EGX A100	TBC	TBC	TBC	TBC
NVIDIA A100 SXM 40GB	6912	1410 MHz	2.4 Gbps	40 GB HB2 5120b
NVIDIA A100 PCIe 40GB	6912	1410 MHz	2.4 Gbps	40 GB HB2 5120b
NVIDIA A800 PCIe 40GB	6912	1410 MHz	2.4 Gbps	40 GB HB2 5120b
NVIDIA A800 PCIe 40GB Active	6912	1410 MHz	2.4 Gbps	40 GB HB2 5120b
NVIDIA A30	3584	1440 MHz	2.4 Gbps	24 GB HB2 3072b
NVIDIA A2	1280	1770 MHz	12.5 Gbps	16 GB G6 128b

GA100 GPU Cards15

Model	Cores	Boost Clock	Memory Clock	Memory Config.
NVIDIA HGX A100 (16-GPU)	110592	1410 MHz	2.4 GB/s	10240 GB HB2 5120b
NVIDIA DGX A100	55296	1410 MHz	2.4 GB/s	2560 GB HB2 5120b
NVIDIA HGX A100 (8-GPU)	55296	1410 MHz	2.4 GB/s	2560 GB HB2 5120b
NVIDIA HGX A100 (4-GPU)	27648	1410 MHz	2.4 GB/s	640 GB HB2 5120b
NVIDIA A100 SXM 80GB	6912	1410 MHz	3.2 GB/s	80 GB 5120b
NVIDIA A800 SXM 80GB	6912	1410 MHz	3.2 GB/s	80 GB 5120b
NVIDIA A100 PCIe 80GB	6912	1410 MHz	3 GB/s	80 GB 5120b
NVIDIA A800 PCIe 80GB	6912	1410 MHz	3 GB/s	80 GB 5120b
NVIDIA EGX A100	TBC	TBC	TBC	TBC
NVIDIA A100 SXM 40GB	6912	1410 MHz	2.4 GB/s	40 GB HB2 5120b
NVIDIA A100 PCIe 40GB	6912	1410 MHz	2.4 GB/s	40 GB HB2 5120b
NVIDIA A800 PCIe 40GB	6912	1410 MHz	2.4 GB/s	40 GB HB2 5120b
NVIDIA A800 PCIe 40GB Active	6912	1410 MHz	2.4 GB/s	40 GB HB2 5120b
NVIDIA CMP 170HX	4480	1410 MHz	2.9 GB/s	8 GB HB2 4096b
NVIDIA A30	3584	1440 MHz	2.4 GB/s	24 GB HB2 3072b