← Back to Models
Sentence Transformerstransformer
All-MiniLM-L6-v2
0.022B parameters • 0GB VRAM (Q4 estimate) • 256 context
Estimate · Q4_K_M · 4k context · batch 1. For dense 7B–70B this sits ~5–8% above the Q4_K_M GGUF file. Not peak runtime VRAM and not a measured bench.
Specifications
Parameters
0.022B
VRAM (Q4 est.)
0 GB
VRAM (FP16)
0.04 GB
Context Window
256
Architecture
transformer
License
Apache-2.0
Finding cloud alternatives...
Run All-MiniLM-L6-v2 on GTX 1050
~0GB VRAM needed at Q4. GTX 1050 has 2GB — buy hardware or rent cloud.
We may earn a commission from cloud and hardware partners at no extra cost to you.
Find the cheapest GPU that can run All-MiniLM-L6-v2
Compatibility Lab — check every GPU × quantization combination