Reasoning model evaluation

Author’s note: Using a retrospective on Astra’s experiment rewriting Qwen3.5-0.8B’s weights, this article explains the difference between getting an answer wrong and failing to finish it when evaluating reasoning models—and how to break down results by truncation. On November 2, four MIT CSAIL researchers published a blog post titled “Sparks of Weight-Space Programming.” They reported…