Back to models
Qwen models you can run
16 open models from Qwen in our catalog, with the memory each needs at Q4_K_M.
qwen.ai · CN
| Model | Lab | Parameters | Memory (Q4_K_M, 8K) |
|---|---|---|---|
 Qwen3.5 0.8B | Qwen | 0.9B | 0.9 GB |
| Qwen3.5 2B | Qwen | 2.3B | 1.6 GB |
| Qwen3.5 4B | Qwen | 4.7B | 3.1 GB |
| Qwen3.5 9B | Qwen | 9.7B | 5.8 GB |
| Qwen3.6 27B | Qwen | 27.8B | 16.5 GB |
| Qwen3.8 27B | Qwen | 27.8B | 17 GB |
| Qwen3 30B A3B Thinking 2507 | Qwen | 30.5B (3.3B) | 18.3 GB |
| Qwen3 30B A3B Instruct 2507 | Qwen | 30.5B (3.3B) | 18.3 GB |
| Qwen3.5 35B A3B | Qwen | 36B (3B) | 21 GB |
| Qwen3.6 35B A3B | Qwen | 36B (3B) | 21.2 GB |
| Qwen3 Coder Next | Qwen | 79.7B (3B) | 45.7 GB |
| Qwen3.5 122B A10B | Qwen | 125.1B (10B) | 71.8 GB |
| Qwen3.8 Flash Next | Qwen | 180B (6B) | 111.9 GB |
| Qwen3 235B A22B Thinking 2507 | Qwen | 235.1B (22B) | 134.2 GB |
| Qwen3 235B A22B Instruct 2507 | Qwen | 235.1B (22B) | 134.2 GB |
| Qwen3.5 397B A17B | Qwen | 403.4B (17B) | 227.9 GB |
Speed depends on your exact hardware. Grade them for your machine