OpenAI chief scientist Jakub Pachocki has said, publicly, that no lab has solved alignment to a degree that would justify scaling at maximum speed, and that he hopes voluntary slowdowns become a normal part of how the industry operates. Coming from the person who runs research at the company that set the pace, that is worth pausing on. It is also, read carefully, a statement … [Read more...] about OpenAI Chief Scientist Jakub Pachocki Says No Lab Has Solved Alignment Well Enough to Scale at Full Speed
OpenAI
OpenAI Says It Hit Its Automated Research Intern Goal at 3.1 Agent-Workdays Per Human Workday
OpenAI says it has reached the "automated research intern" milestone it set for itself, and it has put two numbers behind the claim. Its researchers are now running 3.1 agent-workdays for every human workday, and the heaviest external users are spending upward of $7,000 a day on tokens. Agent-workdays is a new unit, and it is a smart one to publish. It sidesteps benchmark … [Read more...] about OpenAI Says It Hit Its Automated Research Intern Goal at 3.1 Agent-Workdays Per Human Workday
OpenAI Quietly Revised Its GPT-6 Astra Evaluation Metrics After Launch
Emily Forlini reports in Fortune that OpenAI has quietly changed how it evaluates GPT-6 Astra, in ways that appear to flatter the model, and that it has continued revising other metrics since launch. Changing a measurement after you have seen the result it produces is the oldest problem in empirical work. It is not automatically dishonest. Evaluation suites do get saturated, … [Read more...] about OpenAI Quietly Revised Its GPT-6 Astra Evaluation Metrics After Launch