Specifications
Parameters
3B
VRAM (Q4)
1.7 GB
VRAM (FP16)
6 GB
Context Window
8,192
Architecture
transformer
License
Apache-2.0
Finding cloud alternatives...
Run Qwen2.5 3B Instruct on AMD Radeon RX 6500 XT
~1.7GB VRAM needed at Q4. AMD Radeon RX 6500 XT has 4GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run Qwen2.5 3B Instruct
Compatibility Lab — check every GPU × quantization combination