Skip to content
Back to models

Cohere models you can run

2 open models from Cohere in our catalog, with the memory each needs at Q4_K_M.

cohere.com · CA

ModelLabParametersMemory (Q4_K_M, 8K)
CohereNorth Mini Code 1.0Cohere30.5B (3B)18.2 GB
CohereCommand A+Cohere218.8B (25B)126.7 GB

Speed depends on your exact hardware. Grade them for your machine