Back to models
Mistral AI models you can run
9 open models from Mistral AI in our catalog, with the memory each needs at Q4_K_M.
mistral.ai · FR
| Model | Lab | Parameters | Memory (Q4_K_M, 8K) |
|---|---|---|---|
| Mistral AI | 3.9B | 3.1 GB | |
| Mistral AI | 8.9B | 6.2 GB | |
| Mistral AI | 14B | 9.2 GB | |
| Mistral AI | 23.6B | 14.9 GB | |
| Mistral AI | 24B | 14.9 GB | |
| Mistral AI | 24B | 14.9 GB | |
| Mistral AI | 24B | 14.9 GB | |
| Mistral AI | 119.4B (6.5B) | 68.1 GB | |
| Mistral AI | 127.7B | 72.8 GB |
Speed depends on your exact hardware. Grade them for your machine