Flint: A Small MoE Model

Flint is a new MoE model: 39B parameters, 2.5B active per token. Architecture is 2 dense layers followed by 47 MoE layers.

Benchmarks: 54.9% on Terminal-Bench 2.1, 89.7% on SWE-bench Pro v2, 74.2% on SWE-bench Verified.

Trained from scratch (tokenizer → pretrain → midtrain → SFT → RL), giving more flexibility for fine-tuning downstream. The team built the complete training pipeline in 4 months.