Re-test old failures on every new model
Technique
Keep a set of prompts that earlier models failed at. When a new frontier model comes out, run that set before your usual prompts. It shows what the new model can now do.
Theo's current stance
Theo says failures quietly lower what you dare to ask for, and retesting is how he finds the new model's gains.
Try it
- Save prompts your agent failed on into a list.
- When a new model launches, run that list before anything else.
- Widen your normal prompts wherever the new model now succeeds.
First seen
8:58
why when a new frontier model comes out, I immediately try to reset. Instead of just sending the same prompts I sent before, I always start with a set that I've tried on other things that failed to see if it can succeed. Usually when I
Every mention
8:58
why when a new frontier model comes out, I immediately try to reset. Instead of just sending the same prompts I sent before, I always start with a set that I've tried on other things that failed to see if it can succeed. Usually when I
Theo Daily is unofficial and not affiliated with Theo or t3.gg. Written by Claude Opus 5.5 from each video's transcript.