Specifications
Parameters
34B
VRAM (Q4)
18.7 GB
VRAM (FP16)
68 GB
Context Window
8,192
Architecture
transformer
License
Apache-2.0
Finding cloud alternatives...
Run Granite 34B Code on AMD Radeon RX 7900 XT
~18.7GB VRAM needed at Q4. AMD Radeon RX 7900 XT has 20GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run Granite 34B Code
Compatibility Lab — check every GPU × quantization combination