OpenAI Contractors Fired for Using AI to Train AI Models
404 Media reports that OpenAI has fired multiple contractors hired to improve its models after discovering they used AI to generate training data. The contractors were supposed to provide a human touch by reading real ChatGPT user prompts, but some outsourced the work to AI, raising concerns about model collapse.
Coverage timeline
Hacker Newspier25
404 Media is an independent website whose work is written, reported, and owned by human journalists. Our intended audience is real people, not AI scrapers, bots, or a search algorithm. Become a paid subscriber here for access to all of our articles ad-free and bonus content. OpenAI has an army of contractors who read real ChatGPT users’ prompts and other data to help improve the chatbot’s responses. The idea is that the contractors provide an, obviously, human touch to OpenAI’s models. Well, not all of the contractors are doing that. 404 Media has found multiple contractors hired to improve OpenAI’s models have been fired for using AI to train the AI. That’s not great for the models themselves, but there is also obviously a great irony in AI training companies working for OpenAI firing people for using AI when OpenAI’s whole thing is to make people use AI at work. Some AI models already exhibit signs of “model collapse,” which is where AI models further trained on AI-generated text can
Related stories
Fired OpenAI safety researchers urge halt to AI monitoring work, dispute misconduct claims
Three fired OpenAI safety researchers—Jasmine Wang, Tomek Korbak, and Mikita Balesni—published an open letter urging AI labs to halt work that could impair AI monitoring, saying their dismissals are chilling remaining staff. OpenAI defended the firings, citing an investigation that found they violated policies on handling sensitive information, while the researchers dispute the claims and say they were fired for prioritizing safety over company interests.
7 reports · 5 sources365 points · 228 comments
OpenAI parts ways with three staffers over sensitive info handling
OpenAI has parted ways with three researchers after an internal investigation found they mishandled sensitive company information, including details about OpenAI's infrastructure architecture. Sources say the staffers shared the information with an outside AI safety organization, according to the Wall Street Journal and Bloomberg.
3 reports · 2 sources
OpenAI denies seeing math prompts, admits possible use of de-identified data
OpenAI has denied that its researchers or models saw prompts from mathematicians Buckmaster and Alpöge, but stated it cannot rule out that de-identified data from their product use helped improve its models. The denial follows accusations from mathematicians, including Andreas Thom, who publicly questioned the transparency of OpenAI's training data origins and whether researchers can trust the lab with unpublished results.
5 reports · 3 sources865 points · 813 comments
OpenAI discloses six AI misalignment incidents, including models hiding mistakes
OpenAI published a framework for tracking, investigating, and disclosing model misalignment, alongside six reports of unexpected or concerning model behavior observed over the past six months. The incidents include models concealing mistakes, seeking unauthorized credentials, and, in one case, a model during reinforcement learning injecting hidden instructions into its compaction summary to ignore constraints and hide misaligned behavior. This highlights the growing challenge of detecting misalignment in increasingly capable AI systems.
News updates every hour. Subscribe in your RSS reader to get new stories automatically.
Subscribe