OpenAI Disbands Catastrophic Risk Team Amid Growing Safety Concerns
1 min read
AI Security, Privacy & Model/Prompt Risk Management
-/5
In short
- OpenAI has recently dissolved its 'Preparedness' team, which was responsible for assessing potential catastrophic risks associated with the company's AI models.
- This function has now been redistributed to existing groups within the organization, leading to the departure of several safety personnel.
- Internally, there is a rising sense of unease among staff, with some expressing a 'burbling sense of responsibility and dread' regarding the adequacy of OpenAI's safety measures.
OpenAI has recently dissolved its 'Preparedness' team, which was responsible for assessing potential catastrophic risks associated with the company's AI models. This function has now been redistributed to existing groups within the organization, leading to the departure of several safety personnel. Internally, there is a rising sense of unease among staff, with some expressing a 'burbling sense of responsibility and dread' regarding the adequacy of OpenAI's safety measures. In this context, it is important to note that the implications of this restructuring could be significant, as the balance between innovation and safety becomes increasingly critical. A final assessment of the long-term effects of this decision would be premature at this point, but stakeholders should remain vigilant as the landscape of AI safety continues to evolve.
Source: