Back to models
Google models you can run
5 open models from Google in our catalog, with the memory each needs at Q4_K_M.
about.google · US
| Model | Lab | Parameters | Memory (Q4_K_M, 8K) |
|---|---|---|---|
| 5.1B | 3.3 GB | ||
| 8B | 5.1 GB | ||
| 12B | 7.4 GB | ||
| 25.8B (3.8B) | 16.5 GB | ||
| 31.3B | 18.8 GB |
Speed depends on your exact hardware. Grade them for your machine