Back to models
Allen Institute for AI models you can run
2 open models from Allen Institute for AI in our catalog, with the memory each needs at Q4_K_M.
allenai.org · US
| Model | Lab | Parameters | Memory (Q4_K_M, 8K) |
|---|---|---|---|
| Allen Institute for AI | 7.3B | 7 GB | |
| Allen Institute for AI | 32.2B | 19.7 GB |
Speed depends on your exact hardware. Grade them for your machine