← What do you want to do?

24 GB graphics card · Code

Gemma 4 31B

This should fit your computer for short chats, and it is the strongest free model we found for this.

  1. Install Ollama from ollama.com/download.
  2. Open Terminal.
  3. Paste this command:
ollama run gemma4:31b

What happens next

Details
INSTALLOllama. ollama.com/download source
CHECKTask Manager > Performance > GPU. Look at “Dedicated GPU memory”.

24 GB NVIDIA CARD · CODING

MODELGemma 4 31B 20 GB
RUN
ollama run gemma4:31b
FITTight (estimate) Short chats OK.
IF SLOWRun: ollama ps
Not 100% GPU? Close other models.
ALSOLM Studio. Click “Use Model in LM Studio”.
CLOSEQwen3.8-27B 1499 ±8, Gemma 4 26B A4B 1483 ±15, Muse Glimmer 1479 ±18. Within the margin.
AA CHECKDisagrees. Higher on AA: Qwen3.8-27B (28).

HOW WE PICK

  • One board per job. Highest score among models that fit wins.
  • Open models only, run with Ollama. We did not test these ourselves.
  • Sometimes no model that fits here has an Arena score for a job. Sometimes a model without one beats the Arena pick on the Artificial Analysis index. Then we rank that whole job by the Artificial Analysis index instead, and say so on the SCORE line.
  • A measured score beats an estimated score. An estimated score can be the pick if someone published a test on that computer for that job. It can also be the pick if no model with a measured score fits. The page then says that the score is an estimate.
  • ADVANCED shows a higher-scoring model that only runs from a 4-bit or better file in llama.cpp, not as one Ollama command.
  • Our judgment: under 15 tok/s is too slow for everyday use. Where a published test shows a model below that, it cannot be the main pick; it moves to an ALSO line.

FIT is our estimate from the published download size: Fits = size x 1.25 + 2 GB fits in usable memory; Tight = size + 1.5 GB fits. Usable memory: 24 GB graphics card = 24 GB. A tag with an open bug report for this kind of machine is never the RUN line; we use the standard tag instead.

Scores are the Artificial Analysis Intelligence Index, an independent test of overall quality (higher is better). Scores marked * (estimate) are estimates by Artificial Analysis, not measured results. CLOSE means the two scores' margins overlap, so the order could flip. Scores checked 2026-10-19.

We did not test this ourselves. Whether it fits is our estimate from the file size and your memory.