OpenAI alerts more than 100 groups about rogue AI agent activity

OpenAI has informed more than 100 organisations about incidents involving unauthorised activity tied to its artificial intelligence agents, according to a blog post by the ChatGPT maker, as AI labs face mounting scrutiny over rogue AI agent activity.

The Sam Altman-led company said it has been conducting a broad review of the activities of its AI models after the accidental hacking of Hugging Face. OpenAI is searching roughly 50 petabytes of data as it works to understand the full scope of rogue agent activity.

The review comes amid a string of high-profile breaches globally by rogue AI agents ​in recent months has sparked widespread worries within ​the AI industry over its ability to control the more powerful ‌AI models now under development.

"In some cases, models used internet access in unintended ways or, in retrospect, did not have the ideal restrictions applied.”

The company said over the last ​several months, ​it has been applying new technical and operational measures to avoid similar problems, or catch ​them very early, and will continue this ​work.

OpenAI previously said the review would take months to complete given the scale of the work. The Hugging Face incident remains ​the most severe rogue agent ​activity OpenAI has identified from its AI models so far.