Skip to content
Back to models

IBM models you can run

3 open models from IBM in our catalog, with the memory each needs at Q4_K_M.

www.ibm.com · US

ModelLabParametersMemory (Q4_K_M, 8K)
IBMGranite 4.2 3BIBM3.7B3.1 GB
IBMGranite 4.2 8BIBM8.8B6.7 GB
IBMGranite 4.2 30BIBM29.3B19.1 GB

Speed depends on your exact hardware. Grade them for your machine