← Back to Models
Anthropictransformer
Claude 3.5 Haiku
20B parameters • 11GB VRAM (Q4) • 200,000 context
Specifications
Parameters
20B
VRAM (Q4)
11 GB
VRAM (FP16)
40 GB
Context Window
200,000
Architecture
transformer
License
Anthropic TOS
Finding cloud alternatives...
Run Claude 3.5 Haiku on GeForce RTX 2080 Ti
~11GB VRAM needed at Q4. GeForce RTX 2080 Ti has 11GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run Claude 3.5 Haiku
Compatibility Lab — check every GPU × quantization combination