Becoming a benchmark

[This is a guest post by Talia Ringer. This blog post was initially written in a different file format and converted using AI. — T.] When I was wrapping up graduate school in computer science in Spring 2021, I was given access to a curious little programming model on OpenAI’s “playground.” The model, called Codex, took in natural language text and generated programs from that text. The task of automatically generating programs given an expression of programmer intent had been one of many major q...