← Back to Models
Anthropictransformer
Claude 3.5 Sonnet
100B parameters • 55GB VRAM (Q4) • 200,000 context
Specifications
Parameters
100B
VRAM (Q4)
55 GB
VRAM (FP16)
200 GB
Context Window
200,000
Architecture
transformer
License
Commercial API
Finding cloud alternatives...
Run Claude 3.5 Sonnet on NVIDIA A16
~55GB VRAM needed at Q4. NVIDIA A16 has 64GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run Claude 3.5 Sonnet
Compatibility Lab — check every GPU × quantization combination