How well do agents use test/verification techniques?

·Hacker News··

How well do agents use test/verification techniques? | Patreon We previously noted that, while it's easier than ever to hit a particular quality bar by having coding agents use effective test techniques, software quality seems to be getting worse, indicating that whatever defaults developers are using may not work very well. Here, we test if simple instructions to agents to use particular techniques or libraries improve implementation correctness, as a kind of test to see how effective agents ar

Read full article →

Related Articles

Every AI model has the same "controversial" take on humans
rakannimer · Hacker News · 1d ago
UUIDv7 doesn't have the properties you think it does
ibobev · Hacker News · 6h ago
Pentagon grants DHS permission to test heat ray weapon for use at border
bushwart · Hacker News · 8h ago
Jailbreaking the Switch 2
ledoge · Hacker News · 1d ago
The 1.5°C goal of the Paris Agreement is no longer viable
velo_aprx · Hacker News · 2d ago