AWSASIC

Inferentia2

Based on Inferentia2 architecture. 32GB memory with 300W TDP.

FP16 Performance
380
TFLOPS
Memory Capacity
32
GB
Power Draw
300
Watts TDP
Performance per Dollar
0.10 TFLOPS / $
Based on list price
Subject to market fluctuation

Specifications

ManufacturerAWS
CategoryASIC
ArchitectureInferentia2
Process Node
Form Factor
Cooling
VRAM32 GB
VRAM Type
Interconnect Bandwidth
Tensor / Matrix Cores
Supported Precisions
TDP300 W
FP16 (Dense)380 TFLOPS
FP32 (Dense)190 TFLOPS
Release Date2023-04-01
Price (USD)$4,000