Anthropictransformer

Claude 3.5 Sonnet

100B parameters • 60.9GB VRAM (Q4 estimate) • 200,000 context

Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.

Specifications

Parameters

100B

VRAM (Q4 est.)

60.9 GB

VRAM (FP16)

200 GB

Context Window

200,000

Architecture

transformer

License

Commercial API

Finding cloud alternatives...

Run Claude 3.5 Sonnet on Radeon Instinct MI210

~60.9GB VRAM needed at Q4. Radeon Instinct MI210 has 64GB — buy hardware or rent cloud.

Amazon eBay Compare cloud prices

We may earn a commission from cloud and hardware partners at no extra cost to you.

Find the cheapest GPU that can run Claude 3.5 Sonnet

Compatibility Lab — check every GPU × quantization combination

→

Run Claude 3.5 Sonnet on...

GB200 NVL72✅ Fits Lambda Labs 1-Click Cluster (8x H100)✅ Fits Google Cloud A3 (8x H100)✅ Fits Azure ND H100 v5 (8x H100)✅ Fits AWS EC2 P5 Instance (8x H100)✅ Fits NVIDIA DGX H100✅ Fits

VRAM Calculator→GPU Comparison→Cloud GPU Pricing→

← Back to Models

Anthropictransformer

Claude 3.5 Sonnet

100B parameters • 60.9GB VRAM (Q4 estimate) • 200,000 context

Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.