AI Models
IBM Granite 4.1 LLMs: Full Training Breakdown
IBM's Granite Team details the construction of Granite 4.1, a set of decoder-only LLMs in 3B, 8B, and 30B sizes trained on about 15 trillion tokens through five pre-training phases. The models receive supervised fine-tuning on 4.1 million curated samples and multi-stage reinforcement learning. The 8B instruct version equals or beats the prior Granite 4.0-H-Small 32B-A9B MoE model using a basic dense setup with fewer parameters. All models appear under Apache 2.0 license.
Apr 298 minNeura News
