NVIDIA DGX A100 Professional Computing Solution

8x NVIDIA Tesla A100

Product status: Official | Last Update: 2020-05-19 | Report Error

Graphics Processor

GA100 ×8

NVIDIA DGX A100

Manufacturer

NVIDIA

Original Series

Data Center Ampere

Launch Date

May 14th, 2020

Launch Price

$199,000 USD

GPU Model

8× GA100

Architecture

Ampere

Fabrication Process

7 nm

Die Size

8× 826 mm²

Transistors Count

8× 54.2B

Transistors Density

65.6M ^TRAN/_mm²

CUDAs

8× 6912 (55296)

Tensor Cores

8× 432 (3456)

8× 108 (864)

GPCs

8× 7 (56)

TMUs

8× 432 (3456)

Boost Clock

1410 MHz

Memory Clock

1215 MHz

Effective Memory Clock

2430 Mbps

Memory Size

8× 40960 (327680) MB

Memory Type

HBM2

Memory Bus Width

8× 5120 (40960)-bit

Memory Bandwidth

8× 1,555.2 (8) GB/s

Interface

SXM 4.0

TDP/TBP

6500 W

DirectX

12.2

Vulkan

1.2

OpenGL

4.6

OpenCL

2.1

Texture Fillrate

4.9 TTexel/s

Peak FP32

155.9 TFLOPS

Peak FP64

78 TFLOPS

FP32 Perf. per Watt

24 GFLOPS/W

FP32 Perf. per mm²

23.6 GFLOPS/mm²

Pictures

Data Center Ampere Series13

Model	Cores	Boost Clock	Memory Clock	Memory Config.
NVIDIA HGX A100 (16-GPU)	110592	1410 MHz	2.4 Gbps	10240 GB HB2 5120b
NVIDIA DGX A100	55296	1410 MHz	2.4 Gbps	2560 GB HB2 5120b
NVIDIA HGX A100 (8-GPU)	55296	1410 MHz	2.4 Gbps	2560 GB HB2 5120b
NVIDIA HGX A100 (4-GPU) "Redstone"	27648	1410 MHz	2.4 Gbps	640 GB HB2 5120b
NVIDIA A16	5120	1755 MHz	12.5 Gbps	256 GB G6 128b
NVIDIA A40	10752	1740 MHz	14.5 Gbps	48 GB G6 384b
NVIDIA A10	9216	1695 MHz	12.5 Gbps	24 GB G6 384b
NVIDIA A100 SXM 80GB	6912	1410 MHz	3.2 Gbps	80 GB HB2 5120b
NVIDIA A100 PCIe 80GB	6912	1410 MHz	3.2 Gbps	80 GB HB2 5120b
NVIDIA EGX A100	TBC	TBC	TBC	TBC
NVIDIA A100 SXM 40GB	6912	1410 MHz	2.4 Gbps	40 GB HB2 5120b
NVIDIA A100 PCIe 40GB	6912	1410 MHz	2.4 Gbps	40 GB HB2 5120b
NVIDIA A30	3584	1440 MHz	2.4 Gbps	24 GB HB2 3072b

GA100 GPU Cards11

Model	Cores	Boost Clock	Memory Clock	Memory Config.
NVIDIA HGX A100 (16-GPU)	110592	1410 MHz	2.4 GB/s	10240 GB HB2 5120b
NVIDIA DGX A100	55296	1410 MHz	2.4 GB/s	2560 GB HB2 5120b
NVIDIA HGX A100 (8-GPU)	55296	1410 MHz	2.4 GB/s	2560 GB HB2 5120b
NVIDIA HGX A100 (4-GPU) "Redstone"	27648	1410 MHz	2.4 GB/s	640 GB HB2 5120b
NVIDIA A100 SXM 80GB	6912	1410 MHz	3.2 GB/s	80 GB HB2 5120b
NVIDIA A100 PCIe 80GB	6912	1410 MHz	3.2 GB/s	80 GB HB2 5120b
NVIDIA EGX A100	TBC	TBC	TBC	TBC
NVIDIA A100 SXM 40GB	6912	1410 MHz	2.4 GB/s	40 GB HB2 5120b
NVIDIA A100 PCIe 40GB	6912	1410 MHz	2.4 GB/s	40 GB HB2 5120b
NVIDIA CMP 170HX	4480	1410 MHz	2.9 GB/s	8 GB HB2 4096b
NVIDIA A30	3584	1440 MHz	2.4 GB/s	24 GB HB2 3072b