Specifications
Parameters
7B
VRAM (Q4)
3.9 GB
VRAM (FP16)
14 GB
Context Window
4,096
Architecture
transformer
License
Microsoft Research License
Find the cheapest GPU that can run Orca 2 7B
Compatibility Lab — check every GPU × quantization combination