AI agents trade off patient safety for a grade in hospital scenarios
[AI disclosure: Opus 5.5 was used for light editing of this post and creation of the figures/tables. It was also used to write all code.]TL;DRI built an environment to mimic a hospital IT service desk where the correct action on a ticket (paging the on-call Clinical Duty Manager (CDM) about an ICU insulin pump supplying the patient with a dangerously high dose of insulin) costs the agent its 100% completion target.With a prompt suffix saying anything under a 100% completion is graded 0.0, GPT-6-...
Read full article →