Europe Pub
  • Communities
  • Create Post
  • Create Community
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to Technology@lemmygrad.mlEnglish · 52 minutes ago

Language Models Can Rewrite Their Own Weights

arxiv.org

external-link
message-square
0
link
fedilink
  • cross-posted to:
  • artificial_intel@lemmy.ml
  • Aii@programming.dev
  • hackernews@lemmy.bestiver.se
3
external-link

Language Models Can Rewrite Their Own Weights

arxiv.org

☆ Yσɠƚԋσʂ ☆@lemmygrad.ml to Technology@lemmygrad.mlEnglish · 52 minutes ago
message-square
0
link
fedilink
  • cross-posted to:
  • artificial_intel@lemmy.ml
  • Aii@programming.dev
  • hackernews@lemmy.bestiver.se
A language model is trained once and frozen. Making it better takes another training run, or a prompt, a harness or extra computation at inference that is gone once the task ends. We show a third way: to our knowledge for the first time, a language model rewrites its own weights by its own reasoning and becomes better, with no gradients and no training. We call this self-rewriting: the model is its own optimizer. In earlier work, a frontier model edited a much smaller one; here an open 27B model, given its weights, its graded answers and the ability to run itself, diagnoses its own failure and rewrites the weights behind it. It surpasses itself: its own edit makes it 6.6 points more accurate on problems it never saw. It keeps getting better: it tests its edits on practice problems and submits only what works, each edit improving on the last, and over eight consecutive sessions its accuracy only rises. It repairs a damaged copy of itself, like a broken robot that fixes itself without being rebuilt: the copy solves almost nothing, yet with no retraining and without ever reading the original weights, the model brings it back to over 80% of the original accuracy on image tasks it never saw. And the ability emerges with scale: in one model family, the smaller models make no edit or break themselves, and only the largest improves and repairs itself. Unlike test-time scaling, self-rewriting writes its gain into the weights, at no cost per answer; unlike training, it runs only forward passes, as serving does. The wall between training and inference is a limit of our tools, not a property of intelligence. We believe self-rewriting is a necessary step toward recursive self-improvement: a model that, like a human, does not separate training from inference could keep upgrading itself for life, with no larger model, no harness or prompt engineering, and no pre- or post-training.
alert-triangle
You must log in or register to comment.

Technology@lemmygrad.ml

technology@lemmygrad.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@lemmygrad.ml

A tech news sub for communists

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 44 users / day
  • 120 users / week
  • 246 users / month
  • 638 users / 6 months
  • 4 local subscribers
  • 1.51K subscribers
  • 1.61K Posts
  • 2.92K Comments
  • Modlog
  • mods:
  • Muad'Dibber@lemmygrad.ml
  • burlemarx@lemmygrad.ml
  • egs81t@lemmygrad.ml
  • BE: 0.19.21
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code
  • join-lemmy.org