Hugging Face models you can run

1 open models from Hugging Face in our catalog, with the memory each needs at Q4_K_M.

Model	Lab	Parameters	Memory (Q4_K_M, 8K)
SmolLM3 3B	Hugging Face	3.1B	2.6 GB

Speed depends on your exact hardware. Grade them for your machine