Back to models
Meta models you can run
4 open models from Meta in our catalog, with the memory each needs at Q4_K_M.
ai.meta.com · US
| Model | Lab | Parameters | Memory (Q4_K_M, 8K) |
|---|---|---|---|
 Llama 3.2 3B Instruct | Meta | 3.2B | 3.1 GB |
| Llama 3.1 8B Instruct | Meta | 8B | 5.9 GB |
| Llama 3.3 70B Instruct | Meta | 70.6B | 42.4 GB |
| Llama 4 Scout 17B 16E | Meta | 108.6B (17B) | 62.7 GB |
Speed depends on your exact hardware. Grade them for your machine