Specifications
Parameters
15B
VRAM (Q4)
8.3 GB
VRAM (FP16)
30 GB
Context Window
16,384
Architecture
transformer
License
BigCode-OpenRAIL-M
Finding cloud alternatives...
Run StarCoder2 15B on RTX 3080
~8.3GB VRAM needed at Q4. RTX 3080 has 10GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run StarCoder2 15B
Compatibility Lab — check every GPU × quantization combination