Back to models
NVIDIA models you can run
2 open models from NVIDIA in our catalog, with the memory each needs at Q4_K_M.
www.nvidia.com · US
| Model | Lab | Parameters | Memory (Q4_K_M, 8K) |
|---|---|---|---|
 Nemotron 3.5 Lightning 30B A3B | NVIDIA | 31.6B (3B) | 24.1 GB |
| Nemotron 3 Ultra 550B A55B | NVIDIA | 560.5B (55B) | 321.8 GB |
Speed depends on your exact hardware. Grade them for your machine