Granite 4.0 Nano: Just how small can you go?

Back to Articles Granite 4.0 Nano: Just how small can you go? Enterprise Article Published October 28, 2025 Upvote 123 +117 Kate Soule katesoule Follow ibm-granite Rameswar Panda rpand002 Follow ibm-granite Today we are excited to share Granite 4.0 Nano, our smallest models yet, released as part of IBM's Granite 4.0 model family. Designed for the edge and on-device applications, these models demonstrate excellent performance for their size and represent IBM's continued commitment to develop powerful, useful, models that don't require hundreds of billions of parameters to get the job done. Like all Granite 4.0 models, the Nano models are released under an Apache 2.0 license with native architecture support on popular runtimes like vLLM, llama.cpp, and MLX. The models were trained with the same improved training methodologies, pipelines, and over 15T tokens of training data developed for the original Granite 4.0 models. This release includes variants benefiting from the Granite 4.0’s new, efficient hybrid architecture, and like all Granite language models, the Granite 4.0 Nano models also carry with them IBM's ISO 42001 certification for responsible model development, giving users added confidence that models are built and governed to global standards. Specifically, Granite 4.0 Nano comprises of 4 instruct models and their base model counterparts: Granite 4.0 H 1B – A ~1.5B parameter, dense LLM featuring a hybrid-SSM based architecture. Granite 4.0 H 350M – A ~350M parameter...