Experiment: Distill Sonnet 4.5 On Solving Mathematics Challenges
Distilling competition mathematics out of Claude Sonnet 4.5 into Qwen3 base models: the 8B student matches the teacher closely and serves for about 20x less.
Notes from the lab.
Measured work on distillation, fine-tuning, evaluation, and the economics of serving small models.