Skip to content

Best open models

The most intelligent models you can download and run yourself, how fast they go on your hardware, and how much memory they need.

Your device

Best model for each task

Each task judged on its own benchmark: the best overall, and the best that loads on a 24 GB and a 12 GB card.

Coding

SWE-bench Verified · 6 measured
Any size
zaiGLM 5.279%
On 24 GB
None measured at this size yet
On 12 GB
None measured at this size yet

Scores are Epoch AI’s own evaluations (CC BY 4.0), the best of the settings it ran for each model. Coding is measured on few, mostly large models so far.

Best model for each memory size

The most intelligent scored models that load in that much graphics memory at Q4_K_M with an 8K context.

New this month

September 2026 · August 2026

All new models

Open vs. closed models

ECI gap to the best closed model

9.9

Kimi K3, the best open model, against Claude Opus 5.5.

How far behind open models are

4 months

The best open model scores what GPT-5.4 Pro did in March 2026.

Most intelligent on a 24 GB card

Qwen3.8 27B

ECI 149.4, 18 points below the best closed model.

Top closed models

  1. Claude Opus 5.5Anthropic · 167.3
  2. GPT-6 AstraOpenAI · 166.5
  3. GPT-6.1 SolOpenAI · 166.1
  4. Claude Sonnet 5.5Anthropic · 165
  5. Claude Fable 5.1Anthropic · 164.7

Top open models

  1. Kimi K3Moonshot AI · 157.5
  2. DeepSeek V4 Pro 0813DeepSeek · 155.3
  3. DeepSeek V4.1 FlashDeepSeek · 154.9
  4. DeepSeek V4 Flash 0731DeepSeek · 154.5
  5. GLM 5.3 FlashZ.ai · 151.9

Both sides on the same index (Epoch Capabilities Index, CC BY 4.0). Release dates are Epoch’s.

All scored open models

47 of 74 models in our catalog have an independent score so far. We don’t estimate the rest.

compare
1Moonshot AI Kimi K3157.51,584 GB…
2DeepSeek DeepSeek V4 Pro 0813155.3887 GB…
3DeepSeek DeepSeek V4.1 Flash154.9436 GB…
4DeepSeek DeepSeek V4 Flash 0731154.5161 GB…
5Z.ai GLM 5.3 Flash151.9176 GB…
6Z.ai GLM 5.2151.8424 GB…
7Moonshot AI Kimi K2.6151.1579 GB…
8T Inkling Small150.2149 GB…
9Moonshot AI Kimi K2.7 Code150579 GB…
10Z.ai GLM 5.1149.8429 GB…
11Qwen Qwen3.8 27B149.417 GB…
12DeepSeek DeepSeek V4 Pro149.1887 GB…
13T Inkling148.5534 GB…
14Moonshot AI Kimi K2.5148579 GB…
15MiniMax MiniMax M3147245 GB…
16MiniMax MiniMax M2.5146.7131 GB…
17Qwen Qwen3.5 397B A17B146.7228 GB…
18Qwen Qwen3.6 27B146.516 GB…
19DeepSeek DeepSeek V3.2146.3379 GB…
20NVIDIA Nemotron 3 Ultra 550B A55B146.2322 GB…
21DeepSeek DeepSeek V4 Flash146.1167 GB…
22Moonshot AI Kimi K2 Thinking146579 GB…
23MiniMax MiniMax M2.7145.9132 GB…
24Z.ai GLM 5145.8426 GB…
25DeepSeek DeepSeek V3.2 Exp145391 GB…
26Qwen Qwen3.6 35B A3B143.921 GB…
27Qwen Qwen3 235B A22B Thinking 2507143.9134 GB…
28Z.ai GLM 4.7143.5205 GB…
29Google Gemma 4 31B142.719 GB…
30Qwen Qwen3.5 35B A3B142.521 GB…
31Google Gemma 4 26B A4B141.917 GB…
32Mistral AI Mistral Medium 3.5 128B141.473 GB…
33Moonshot AI Kimi K2140.1579 GB…
34OpenAI gpt-oss 120b139.959 GB…
35DeepSeek DeepSeek V3.1139.9378 GB…
36Qwen Qwen3 30B A3B Thinking 2507139.618 GB…
37Qwen Qwen3.5 9B139.55.8 GB…
38Qwen Qwen3 235B A22B 2507138.9134 GB…
39OpenAI gpt-oss 20b137.811 GB…
40Qwen Qwen3 30B A3B 2507137.418 GB…
41Mistral AI Magistral Small 2506133.215 GB…
42Mistral AI Mistral Small 3.2 24B131.715 GB…
43Mistral AI Magistral Small 2509131.415 GB…
44Microsoft Phi-4 14B130.410 GB…
45Meta Llama 4 Scout 17B 16E129.663 GB…
46Meta Llama 3.3 70B127.342 GB…
47Meta Llama 3.1 8B116.65.9 GB…

Intelligence scores: Epoch Capabilities Index (ECI) by Epoch AI, CC BY 4.0, retrieved 2026-10-08. epoch.ai/benchmarks