Specifications
Parameters
70B
VRAM (Q4)
39 GB
VRAM (FP16)
140 GB
Context Window
127,000
Architecture
transformer
License
Perplexity TOS
Finding cloud alternatives...
Run Sonar Large on NVIDIA A100 40GB PCIe
~39GB VRAM needed at Q4. NVIDIA A100 40GB PCIe has 40GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run Sonar Large
Compatibility Lab — check every GPU × quantization combination