← What do you want to do?

12 GB graphics card · Read long documents

Qwen3.5 9B

This should run well on your computer, and it is the strongest free model we found for this.

  1. Install Ollama from ollama.com/download.
  2. Open Terminal.
  3. Paste this command:
ollama run qwen3.5:9b-q4_K_M

What happens next

Details
INSTALLOllama. ollama.com/download source
CHECKTask Manager > Performance > GPU. Look at “Dedicated GPU memory”.

12 GB NVIDIA CARD · LONG DOCS

MODELQwen3.5 9B 6.6 GB
RUN
ollama run qwen3.5:9b-q4_K_M
FITFits (estimate) Long chats OK.
IF IT FORGETSType: /set parameter num_ctx 32768
SCOREAA index 11 (Oct 19)
ESTIMATEGemma 4 12B: AA 14* (estimate). Not the pick: no published test on this computer for this job.
ESTIMATEQwen3.5 4B: AA 13* (estimate). Not the pick: no published test on this computer for this job.

HOW WE PICK

  • One board per job. Highest score among models that fit wins.
  • Open models only, run with Ollama. We did not test these ourselves.
  • Sometimes no model that fits here has an Arena score for a job. Sometimes a model without one beats the Arena pick on the Artificial Analysis index. Then we rank that whole job by the Artificial Analysis index instead, and say so on the SCORE line.
  • A measured score beats an estimated score. An estimated score can be the pick if someone published a test on that computer for that job. It can also be the pick if no model with a measured score fits. The page then says that the score is an estimate.
  • ADVANCED shows a higher-scoring model that only runs from a 4-bit or better file in llama.cpp, not as one Ollama command.
  • Our judgment: under 15 tok/s is too slow for everyday use. Where a published test shows a model below that, it cannot be the main pick; it moves to an ALSO line.

FIT is our estimate from the published download size: Fits = size x 1.25 + 2 GB fits in usable memory; Tight = size + 1.5 GB fits. Usable memory: 12 GB graphics card = 12 GB. A tag with an open bug report for this kind of machine is never the RUN line; we use the standard tag instead.

Scores are the Artificial Analysis Intelligence Index, an independent test of overall quality (higher is better). Scores marked * (estimate) are estimates by Artificial Analysis, not measured results. CLOSE means the two scores' margins overlap, so the order could flip. Scores checked 2026-10-19.

We did not test this ourselves. Whether it fits is our estimate from the file size and your memory.