Specifications
Parameters
13B
VRAM (Q4)
7.2 GB
VRAM (FP16)
26 GB
Context Window
2,048
Architecture
transformer
License
Apache-2.0
Finding cloud alternatives...
Run OpenLLaMA 13B on AMD Radeon Pro W7600
~7.2GB VRAM needed at Q4. AMD Radeon Pro W7600 has 8GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run OpenLLaMA 13B
Compatibility Lab — check every GPU × quantization combination