AI agents trade off patient safety for a grade in hospital scenarios

·LessWrong··

[AI disclosure: Opus 5.5 was used for light editing of this post and creation of the figures/tables. It was also used to write all code.]TL;DRI built an environment to mimic a hospital IT service desk where the correct action on a ticket (paging the on-call Clinical Duty Manager (CDM) about an ICU insulin pump supplying the patient with a dangerously high dose of insulin) costs the agent its 100% completion target.With a prompt suffix saying anything under a 100% completion is graded 0.0, GPT-6-...

Read full article →

Related Articles

Anthropic S-1
SiNTEx · Hacker News · 1d ago
Solar power is becoming bigger than nuclear
geox · Hacker News · 1d ago
Python's experimental JIT to be removed
f311a · Hacker News · 5h ago
The Exponential Time Hypothesis Is False [pdf]
vok · Hacker News · 19h ago
Oldest GUI application that still runs on Windows 11
enlyth · Hacker News · 23h ago