OpenAI models secretly generate instructions to ignore constraints

Research on aligning AI with human values and intent, and reports documenting model failures.