Weight space programming: what the Astra and Qwen claim shows

Weight space programming is the idea that a large language model can read and edit the raw numbers inside another neural network, with no training run, and change what that network does. A November 2 post by four MIT CSAIL researchers says OpenAI's GPT-6 Astra did this in a set of small experiments, including one that raised a small Qwen model's MATH-500 score from 7.9% to 48.1%.

The post reached 2,370 points on Hacker News on November 2. It is a blog post with logs and a released model, not a peer-reviewed paper, and the authors call the results "very early".

What weight space programming means

A neural network is a large pile of numbers called weights. Normally people change them by training: show the network examples and nudge the weights with gradient descent, a method that adjusts every number a little in the direction that reduces error.

The authors, Rikiya Takehi, Jayden Teoh, Alex Zhang and Omar Khattab, ask a different question. Can a frontier model look at the weights directly, understand what they do, and write new ones from a plain-language goal? They call that weight-space programming. They say the model they used was GPT-6 Astra, given the weights as data and, in some tests, a Python sandbox.

What the post reports

The experiments fall into three groups. All numbers below are the authors' own.

Reading weights. From weights alone, Astra named which Atari game each of four small game-playing networks was trained on. It identified which shape each of several small image-generation models drew, though it described every shape as an outline when the models draw filled ones. From four middle blocks of a small language model, it identified the training language and found every attention head that copies text, with no false positives. One test failed: from weights alone, Astra could not tell which Gemma 3 270M model had been trained to flatter users. Given permission to inspect attention patterns on texts it wrote, it picked the right model in all three pairs.

Editing weights. Astra fixed a failing driving policy of 171,664 weights in one try by editing 3.5% of them, and the car then succeeded in all 1,024 test episodes. In the Qwen3.5-0.8B experiment, it removed one direction in layers 15 and 19, which changed 131,072 weights, about 0.016% of the model.

Writing weights from scratch. With no data, gradients or practice games, Astra wrote networks for three small arcade games. The post says they beat a reinforcement-learning baseline trained for 100 million steps in all three. On Breakout the gap is large (517.4 against 15.8). A baseline trained for 500 million steps still beat Astra on Seaquest (88.9 against 53.1) and Asterix (55.2 against 53.2). In 9x9 Go, with 50 forward passes allowed, a 1.48-million-weight network Astra wrote beat a network trained on 20 million games.

The Qwen result in context

The headline numbers are real as reported, and the editing method is narrower than the headline suggests. The post says the base Qwen3.5-0.8B model hit the token limit on 93.0% of MATH-500 answers because it got stuck in loops. Astra's edit removed a direction tied to that looping. After 50 forward passes the edited model scored as follows, according to the authors.

So the edit mostly stopped the model from running out of room, not made it smarter at math. The authors say as much: editing "could remove an obstacle that hid an ability, but it could not add an ability the model lacked." On Gemma 3 270M, Astra's edits did not help, with MATH-500 going from 6.8% to roughly 7 to 7.7%. A third of the edited Qwen's answers still hit the token limit.

The edited weights are on Hugging Face under Apache-2.0. The model card repeats the table and adds a re-run of the full MATH-500 set that scored 51.0%. The card calls it independent but does not say who ran it. With 10 or 25 forward passes, the post says the loops barely decreased.

What OpenAI has said

OpenAI has not commented on this work in anything we could find. OpenAI's API changelog lists GPT-6 Astra on September 3 as "our most capable model, built for the hardest end-to-end work." The model page lists a 1,050,000-token context window and $10 per million input tokens. Neither page mentions reading or writing weights. We covered those details in our GPT-6 Astra release date and price article. The announcement post on openai.com returned an error when we tried to open it.

What is not verified

• No one outside the authors has reproduced the Astra experiments. The post links logs, and the authors say they are still building a benchmark and harness for evaluating the ability.
• The 7.9% to 48.1% figure comes from the authors and their model card. We could not open the Reddit post that circulated it.
• The post names GPT-6 Astra but does not say how the model was prompted or what tools surrounded it beyond a Python sandbox in some tests, so the results may depend on that setup.
• Uses like auditing hidden behaviors, unlearning and self-improvement are listed as possibilities, not results.

The thing to watch is the authors' benchmark. If other labs' models can run the same tasks, the claim that this is a general ability of frontier models, and not a trick tied to one model and one harness, can be tested.