NVIDIA DGX A100 Professional Computing Solution

8x NVIDIA Tesla A100

Product status: Official | Last Update: 2020-05-19 | Report Error
Overview
Manufacturer
NVIDIA
Original Series
Data Center Ampere
Launch Date
May 14th, 2020
Launch Price
$199,000 USD
Graphics Processing Unit
GPU Model
8× GA100
Architecture
Ampere
Fabrication Process
7 nm
Die Size
8× 826 mm2
Transistors Count
8× 54.2B
Transistors Density
65.6M TRAN/mm2
CUDAs
8× 6912 (55296)
Tensor Cores
8× 432 (3456)
SM
8× 108 (864)
GPCs
8× 7 (56)
TMUs
8× 432 (3456)
Clocks
Boost Clock
1410 MHz
Memory Clock
1215 MHz
Effective Memory Clock
2430 Mbps
Memory Configuration
Memory Size
8× 40960 (327680) MB
Memory Type
HBM2
Memory Bus Width
8× 5120 (40960)-bit
Memory Bandwidth
8× 1,555.2 (8) GB/s
Physical
Interface
SXM 4.0
TDP/TBP
6500 W
API Support
DirectX
12.2
Vulkan
1.2
OpenGL
4.6
OpenCL
2.1

Performance
Texture Fillrate
4.9 TTexel/s
Peak FP32
155.9 TFLOPS
Peak FP64
78 TFLOPS
FP32 Perf. per Watt
24 GFLOPS/W
FP32 Perf. per mm2
23.6 GFLOPS/mm2




 ModelCoresBoost ClockMemory ClockMemory Config.
NVIDIA HGX A100 (16-GPU)
 
110592
 
1410 MHz
 
2.4 Gbps
 
10240 GB HB2 5120b
NVIDIA DGX A100
 
55296
 
1410 MHz
 
2.4 Gbps
 
2560 GB HB2 5120b
NVIDIA HGX A100 (8-GPU)
 
55296
 
1410 MHz
 
2.4 Gbps
 
2560 GB HB2 5120b
NVIDIA HGX A100 (4-GPU) "Redstone"
 
27648
 
1410 MHz
 
2.4 Gbps
 
640 GB HB2 5120b
Thumbnail
NVIDIA A16
 
5120
 
1755 MHz
 
12.5 Gbps
 
256 GB G6 128b
Thumbnail
NVIDIA A40
 
10752
 
1740 MHz
 
14.5 Gbps
 
48 GB G6 384b
Thumbnail
NVIDIA A10
 
9216
 
1695 MHz
 
12.5 Gbps
 
24 GB G6 384b
Thumbnail
NVIDIA A100 SXM 80GB
 
6912
 
1410 MHz
 
3.2 Gbps
 
80 GB HB2 5120b
Thumbnail
NVIDIA A100 PCIe 80GB
 
6912
 
1410 MHz
 
3.2 Gbps
 
80 GB HB2 5120b
NVIDIA EGX A100 TBC TBC TBC TBC
Thumbnail
NVIDIA A100 SXM 40GB
 
6912
 
1410 MHz
 
2.4 Gbps
 
40 GB HB2 5120b
Thumbnail
NVIDIA A100 PCIe 40GB
 
6912
 
1410 MHz
 
2.4 Gbps
 
40 GB HB2 5120b
Thumbnail
NVIDIA A30
 
3584
 
1440 MHz
 
2.4 Gbps
 
24 GB HB2 3072b
 ModelCoresBoost ClockMemory ClockMemory Config.
Thumbnail
NVIDIA HGX A100 (16-GPU)
 
110592
 
1410 MHz
 
2.4 GB/s
 
10240 GB HB2 5120b
Thumbnail
NVIDIA DGX A100
 
55296
 
1410 MHz
 
2.4 GB/s
 
2560 GB HB2 5120b
Thumbnail
NVIDIA HGX A100 (8-GPU)
 
55296
 
1410 MHz
 
2.4 GB/s
 
2560 GB HB2 5120b
Thumbnail
NVIDIA HGX A100 (4-GPU) "Redstone"
 
27648
 
1410 MHz
 
2.4 GB/s
 
640 GB HB2 5120b
Thumbnail
NVIDIA A100 SXM 80GB
 
6912
 
1410 MHz
 
3.2 GB/s
 
80 GB HB2 5120b
Thumbnail
NVIDIA A100 PCIe 80GB
 
6912
 
1410 MHz
 
3.2 GB/s
 
80 GB HB2 5120b
Thumbnail
NVIDIA EGX A100 TBC TBC TBC TBC
Thumbnail
NVIDIA A100 SXM 40GB
 
6912
 
1410 MHz
 
2.4 GB/s
 
40 GB HB2 5120b
Thumbnail
NVIDIA A100 PCIe 40GB
 
6912
 
1410 MHz
 
2.4 GB/s
 
40 GB HB2 5120b
Thumbnail
NVIDIA CMP 170HX
 
4480
 
1410 MHz
 
2.9 GB/s
 
8 GB HB2 4096b
Thumbnail
NVIDIA A30
 
3584
 
1440 MHz
 
2.4 GB/s
 
24 GB HB2 3072b