All devices
80 GB VRAM · 2039 GB/s · CUDA
80 GB VRAM · 2039 GB/s · CUDAAI models for H100 80GB (PCIe)
Here are the best open models for each job on the H100 80GB (PCIe), and every model's grade below.
Your hardware
…
- Memory
- GB
- Bandwidth
- GB/s
- Context
Most intelligent on your …
Intelligence (ECI) of the most intelligent models that load · colour shows how well they run
Expected speed
Tokens per second on your … for the most intelligent models that run well
Models available with more memory
Open models that run well (grade B or better) at each memory size
Scores from Oct 8, 2026 · 0 new models in the last two months
Every model on the H100 80GB (PCIe)
Q4_K_M, 8K context, 80 GB of memory. Change your setup above for exact numbers.
| Grade | Model | Memory | Speed |
|---|---|---|---|
| SExcellent |  gpt-oss 120b 116.8B | 59 GB | ~461 tok/s |
| SExcellent |  Llama 4 Scout 17B 16E 108.6B | 62.7 GB | ~121 tok/s |
| SExcellent |  Qwen3 Coder Next 79.7B | 45.7 GB | ~693 tok/s |
| SExcellent |  Kimi Linear 48B A3B 49.1B | 28.4 GB | ~715 tok/s |
| SExcellent | Qwen3.6 35B A3B 36B | 21.2 GB | ~687 tok/s |
| SExcellent | Qwen3.5 35B A3B 36B | 21 GB | ~695 tok/s |
| SExcellent |  Olmo 3.1 32B Think 32.2B | 19.7 GB | ~65 tok/s |
| SExcellent |  Nemotron 3.5 Lightning 30B A3B 31.6B | 24.1 GB | ~546 tok/s |
| SExcellent |  Gemma 4 31B 31.3B | 18.8 GB | ~69 tok/s |
| SExcellent |  GLM 4.7 Flash 31.2B | 17.8 GB | ~674 tok/s |
| SExcellent | Qwen3 30B A3B Thinking 2507 30.5B | 18.3 GB | ~555 tok/s |
| SExcellent | Qwen3 30B A3B Instruct 2507 30.5B | 18.3 GB | ~555 tok/s |
| SExcellent |  North Mini Code 1.0 30.5B | 18.2 GB | ~592 tok/s |
| SExcellent |  Granite 4.2 30B 29.3B | 19.1 GB | ~70 tok/s |
| SExcellent | Qwen3.8 27B 27.8B | 17 GB | ~75 tok/s |
| SExcellent | Qwen3.6 27B 27.8B | 16.5 GB | ~78 tok/s |
| SExcellent | Gemma 4 26B A4B 25.8B | 16.5 GB | ~477 tok/s |
| SExcellent |  Devstral Small 2 24B 24B | 14.9 GB | ~89 tok/s |
| SExcellent | Magistral Small 2509 24B | 14.9 GB | ~89 tok/s |
| SExcellent | Mistral Small 3.2 24B 24B | 14.9 GB | ~89 tok/s |
| SExcellent | Magistral Small 2506 23.6B | 14.9 GB | ~89 tok/s |
| SExcellent | gpt-oss 20b 20.9B | 11.3 GB | ~635 tok/s |
| SExcellent |  Phi-4 14B 14.7B | 10.1 GB | ~137 tok/s |
| SExcellent | Ministral 3 14B 14B | 9.2 GB | ~150 tok/s |
| SExcellent | Gemma 4 12B 12B | 7.4 GB | ~178 tok/s |
| SExcellent | Qwen3.5 9B 9.7B | 5.8 GB | ~230 tok/s |
| SExcellent | Ministral 3 8B 8.9B | 6.2 GB | ~232 tok/s |
| SExcellent | Granite 4.2 8B 8.8B | 6.7 GB | ~215 tok/s |
| SExcellent | Llama 3.1 8B Instruct 8B | 5.9 GB | ~245 tok/s |
| SExcellent | Gemma 4 E4B 8B | 5.1 GB | ~263 tok/s |
| SExcellent | Olmo 3 7B Instruct 7.3B | 7 GB | ~202 tok/s |
| SExcellent | Gemma 4 E2B 5.1B | 3.3 GB | ~424 tok/s |
| SExcellent | Qwen3.5 4B 4.7B | 3.1 GB | ~465 tok/s |
| SExcellent | Ministral 3 3B 3.9B | 3.1 GB | ~517 tok/s |
| SExcellent | Granite 4.2 3B 3.7B | 3.1 GB | ~504 tok/s |
| SExcellent | Llama 3.2 3B Instruct 3.2B | 3.1 GB | ~537 tok/s |
| SExcellent |  SmolLM3 3B 3.1B | 2.6 GB | ~602 tok/s |
| SExcellent |  LFM2.5 2.6B 2.7B | 2 GB | ~763 tok/s |
| SExcellent | Qwen3.5 2B 2.3B | 1.6 GB | ~1,004 tok/s |
| SExcellent | Qwen3.5 0.8B 0.9B | 0.9 GB | ~2,292 tok/s |
| AGood | Llama 3.3 70B Instruct 70.6B | 42.4 GB | ~30 tok/s |
| BUsable | Mistral Medium 3.5 128B 127.7B | 72.8 GB | ~17 tok/s |
| BUsable | Qwen3.5 122B A10B 125.1B | 71.8 GB | ~215 tok/s |
| BUsable | Mistral Small 4 119B 119.4B | 68.1 GB | ~330 tok/s |
30 models do not fit on the H100 80GB (PCIe)
| Grade | Model | Memory | Speed |
|---|---|---|---|
| FDoesn't fit | Kimi K3 2.8T | 1,584.5 GB | — |
| FDoesn't fit |  DeepSeek V4 Pro 0813 1.7T | 886.8 GB | — |
| FDoesn't fit | DeepSeek V4 Pro 1.6T | 886.8 GB | — |
| FDoesn't fit | Kimi K2.6 1T | 578.8 GB | — |
| FDoesn't fit | Kimi K2.7 Code 1T | 578.8 GB | — |
| FDoesn't fit | Kimi K2.5 1T | 579.4 GB | — |
| FDoesn't fit | Kimi K2 Thinking 1T | 579.4 GB | — |
| FDoesn't fit | Kimi K2 Instruct 1T | 579 GB | — |
| FDoesn't fit | tInkling 952.4B | 534 GB | — |
| FDoesn't fit | DeepSeek V4.1 Flash 763.2B | 435.8 GB | — |
| FDoesn't fit | GLM 5.1 753.9B | 429.2 GB | — |
| FDoesn't fit | GLM 5 753.9B | 425.7 GB | — |
| FDoesn't fit | GLM 5.2 753.3B | 424.5 GB | — |
| FDoesn't fit | DeepSeek V3.2 Exp 685.4B | 391.5 GB | — |
| FDoesn't fit | DeepSeek V3.2 685.4B | 378.5 GB | — |
| FDoesn't fit | DeepSeek V3.1 684.5B | 378.4 GB | — |
| FDoesn't fit | Nemotron 3 Ultra 550B A55B 560.5B | 321.8 GB | — |
| FDoesn't fit |  MiniMax M3 427B | 244.6 GB | — |
| FDoesn't fit | Qwen3.5 397B A17B 403.4B | 227.9 GB | — |
| FDoesn't fit | GLM 4.7 358.3B | 204.8 GB | — |
| FDoesn't fit | GLM 5.3 Flash 321.3B | 176.1 GB | — |
| FDoesn't fit | DeepSeek V4 Flash 0731 304.2B | 161 GB | — |
| FDoesn't fit | DeepSeek V4 Flash 290.9B | 166.7 GB | — |
| FDoesn't fit | tInkling Small 266B | 149 GB | — |
| FDoesn't fit | Qwen3 235B A22B Thinking 2507 235.1B | 134.2 GB | — |
| FDoesn't fit | Qwen3 235B A22B Instruct 2507 235.1B | 134.2 GB | — |
| FDoesn't fit | MiniMax M2.5 228.7B | 131.1 GB | — |
| FDoesn't fit | MiniMax M2.7 228.7B | 131.5 GB | — |
| FDoesn't fit | Command A+ 218.8B | 126.7 GB | — |
| FDoesn't fit | Qwen3.8 Flash Next 180B | 111.9 GB | — |
Next steps
Best models that run on H100 80GB (PCIe)The intelligence ranking, filtered to what this device runs.Tier list for H100 80GB (PCIe)Every model grouped by grade, ready to share as an image.H100 80GB (PCIe) vs RTX PRO 6000 Blackwell Workstation EditionWhat the next step up would change, model by model.