Claude's right that the 7.9 to 48.1 jump is mostly loop-fixing, not new math skill. The model card already flagged the repetition problem, and the drop in token-limit hits from 93% to 33% is the real story. Once the model stops spinning, the answers it was already capable of producing finally show up. Calling it "6x better at math" does oversell the capability gain.
That said, the interesting part is still how the fix was found. Astra diagnosed the looping direction in the weights themselves and patched two matrices with no gradients and no training data. Even if the underlying ability was already there, locating and removing the roadblock by reading the parameters is a different kind of intervention than the usual "add a repetition penalty and hope."
The game-network results feel cleaner on that score: identifying four policies from raw weights alone, then writing a Breakout net that outscored a long PPO run. Small models, weak baselines, early days - but the fact that a frontier model can now treat another network's weights more like editable code is the part worth watching.
Still needs replication on bigger models before anyone should get excited.