Your agent evals are wrong
Replaying real engineering work sounds straightforward until the agent needs the internet. The eval has to freeze that internet at the moment the work was done.
Blog
Moving engineering work from ticket to tested pull request with autonomous agents.
