The NVIDIA RTX 4080 packs 16GB VRAM. Llama 3.1 8B needs ~4.4GB. You're good to go.
If you don't own this GPU yet, check retail prices or rent cloud capacity for a trial run.
We may earn a commission from cloud and hardware partners at no extra cost to you.
ollama run llama3.1:8bRequires Ollama installed on your machine
View on OllamaMSRP: $1,199