All devices
80 GB VRAM · 2039 GB/s · CUDA
80 GB VRAM · 2039 GB/s · CUDAAI models for A100 80GB (SXM)
Here are the best open models for each job on the A100 80GB (SXM), and every model's grade below.
Your hardware
…
- Memory
- GB
- Bandwidth
- GB/s
- Context
Most intelligent on your …
Intelligence (ECI) of the most intelligent models that load · colour shows how well they run
Expected speed
Tokens per second on your … for the most intelligent models that run well
Models available with more memory
Open models that run well (grade B or better) at each memory size
Scores from Oct 8, 2026 · 0 new models in the last two months
Every model on the A100 80GB (SXM)
Q4_K_M, 8K context, 80 GB of memory. Change your setup above for exact numbers.
| Grade | Model | Memory | Speed |
|---|---|---|---|
| SExcellent |  gpt-oss 120b 116.8B | 59 GB | ~461 tok/s |
| SExcellent |  Llama 4 Scout 17B 16E 108.6B | 62.7 GB | ~121 tok/s |
| SExcellent |  Qwen3 Coder Next 79.7B | 45.7 GB | ~693 tok/s |
| SExcellent |  Kimi Linear 48B A3B 49.1B | 28.4 GB | ~715 tok/s |
| SExcellent | Qwen3.6 35B A3B 36B | 21.2 GB | ~687 tok/s |
| SExcellent | Qwen3.5 35B A3B 36B | 21 GB | ~695 tok/s |
| SExcellent |  Olmo 3.1 32B Think 32.2B | 19.7 GB | ~65 tok/s |
| SExcellent |  Nemotron 3.5 Lightning 30B A3B 31.6B | 24.1 GB | ~546 tok/s |
| SExcellent |  Gemma 4 31B 31.3B | 18.8 GB | ~69 tok/s |
| SExcellent |  GLM 4.7 Flash 31.2B | 17.8 GB | ~674 tok/s |
| SExcellent | Qwen3 30B A3B Thinking 2507 30.5B | 18.3 GB | ~555 tok/s |
| SExcellent | Qwen3 30B A3B Instruct 2507 30.5B | 18.3 GB | ~555 tok/s |
| SExcellent |  North Mini Code 1.0 30.5B | 18.2 GB | ~592 tok/s |
| SExcellent |  Granite 4.2 30B 29.3B | 19.1 GB | ~70 tok/s |
| SExcellent | Qwen3.8 27B 27.8B | 17 GB | ~75 tok/s |
| SExcellent | Qwen3.6 27B 27.8B | 16.5 GB | ~78 tok/s |
| SExcellent | Gemma 4 26B A4B 25.8B | 16.5 GB | ~477 tok/s |
| SExcellent |  Devstral Small 2 24B 24B | 14.9 GB | ~89 tok/s |
| SExcellent | Magistral Small 2509 24B | 14.9 GB | ~89 tok/s |
| SExcellent | Mistral Small 3.2 24B 24B | 14.9 GB | ~89 tok/s |
| SExcellent | Magistral Small 2506 23.6B | 14.9 GB | ~89 tok/s |
| SExcellent | gpt-oss 20b 20.9B | 11.3 GB | ~635 tok/s |
| SExcellent |  Phi-4 14B 14.7B | 10.1 GB | ~137 tok/s |
| SExcellent | Ministral 3 14B 14B | 9.2 GB | ~150 tok/s |
| SExcellent | Gemma 4 12B 12B | 7.4 GB | ~178 tok/s |
| SExcellent | Qwen3.5 9B 9.7B | 5.8 GB | ~230 tok/s |
| SExcellent | Ministral 3 8B 8.9B | 6.2 GB | ~232 tok/s |
| SExcellent | Granite 4.2 8B 8.8B | 6.7 GB | ~215 tok/s |
| SExcellent | Llama 3.1 8B Instruct 8B | 5.9 GB | ~245 tok/s |
| SExcellent | Gemma 4 E4B 8B | 5.1 GB | ~263 tok/s |
| SExcellent | Olmo 3 7B Instruct 7.3B | 7 GB | ~202 tok/s |
| SExcellent | Gemma 4 E2B 5.1B | 3.3 GB | ~424 tok/s |
| SExcellent | Qwen3.5 4B 4.7B | 3.1 GB | ~465 tok/s |
| SExcellent | Ministral 3 3B 3.9B | 3.1 GB | ~517 tok/s |
| SExcellent | Granite 4.2 3B 3.7B | 3.1 GB | ~504 tok/s |
| SExcellent | Llama 3.2 3B Instruct 3.2B | 3.1 GB | ~537 tok/s |
| SExcellent |  SmolLM3 3B 3.1B | 2.6 GB | ~602 tok/s |
| SExcellent |  LFM2.5 2.6B 2.7B | 2 GB | ~763 tok/s |
| SExcellent | Qwen3.5 2B 2.3B | 1.6 GB | ~1,004 tok/s |
| SExcellent | Qwen3.5 0.8B 0.9B | 0.9 GB | ~2,292 tok/s |
| AGood | Llama 3.3 70B Instruct 70.6B | 42.4 GB | ~30 tok/s |
| BUsable | Mistral Medium 3.5 128B 127.7B | 72.8 GB | ~17 tok/s |
| BUsable | Qwen3.5 122B A10B 125.1B | 71.8 GB | ~215 tok/s |
| BUsable | Mistral Small 4 119B 119.4B | 68.1 GB | ~330 tok/s |
30 models do not fit on the A100 80GB (SXM)
| Grade | Model | Memory | Speed |
|---|---|---|---|
| FDoesn't fit | Kimi K3 2.8T | 1,584.5 GB | — |
| FDoesn't fit |  DeepSeek V4 Pro 0813 1.7T | 886.8 GB | — |
| FDoesn't fit | DeepSeek V4 Pro 1.6T | 886.8 GB | — |
| FDoesn't fit | Kimi K2.6 1T | 578.8 GB | — |
| FDoesn't fit | Kimi K2.7 Code 1T | 578.8 GB | — |
| FDoesn't fit | Kimi K2.5 1T | 579.4 GB | — |
| FDoesn't fit | Kimi K2 Thinking 1T | 579.4 GB | — |
| FDoesn't fit | Kimi K2 Instruct 1T | 579 GB | — |
| FDoesn't fit | tInkling 952.4B | 534 GB | — |
| FDoesn't fit | DeepSeek V4.1 Flash 763.2B | 435.8 GB | — |
| FDoesn't fit | GLM 5.1 753.9B | 429.2 GB | — |
| FDoesn't fit | GLM 5 753.9B | 425.7 GB | — |
| FDoesn't fit | GLM 5.2 753.3B | 424.5 GB | — |
| FDoesn't fit | DeepSeek V3.2 Exp 685.4B | 391.5 GB | — |
| FDoesn't fit | DeepSeek V3.2 685.4B | 378.5 GB | — |
| FDoesn't fit | DeepSeek V3.1 684.5B | 378.4 GB | — |
| FDoesn't fit | Nemotron 3 Ultra 550B A55B 560.5B | 321.8 GB | — |
| FDoesn't fit |  MiniMax M3 427B | 244.6 GB | — |
| FDoesn't fit | Qwen3.5 397B A17B 403.4B | 227.9 GB | — |
| FDoesn't fit | GLM 4.7 358.3B | 204.8 GB | — |
| FDoesn't fit | GLM 5.3 Flash 321.3B | 176.1 GB | — |
| FDoesn't fit | DeepSeek V4 Flash 0731 304.2B | 161 GB | — |
| FDoesn't fit | DeepSeek V4 Flash 290.9B | 166.7 GB | — |
| FDoesn't fit | tInkling Small 266B | 149 GB | — |
| FDoesn't fit | Qwen3 235B A22B Thinking 2507 235.1B | 134.2 GB | — |
| FDoesn't fit | Qwen3 235B A22B Instruct 2507 235.1B | 134.2 GB | — |
| FDoesn't fit | MiniMax M2.5 228.7B | 131.1 GB | — |
| FDoesn't fit | MiniMax M2.7 228.7B | 131.5 GB | — |
| FDoesn't fit | Command A+ 218.8B | 126.7 GB | — |
| FDoesn't fit | Qwen3.8 Flash Next 180B | 111.9 GB | — |