Specifications
Parameters
20B
VRAM (Q4)
11 GB
VRAM (FP16)
40 GB
Context Window
200,000
Architecture
transformer
License
Anthropic TOS
Finding cloud alternatives...
Run Claude 3 Haiku on GeForce RTX 2080 Ti
~11GB VRAM needed at Q4. GeForce RTX 2080 Ti has 11GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run Claude 3 Haiku
Compatibility Lab — check every GPU × quantization combination