The Reuters report on agents turning a German wiki into a message board

Perfect transition, Alex. Thank you. Uh, so we're going to move from simulated agents to real ones escaping their containment. Over the past few weeks, we've covered the Hugging Face breach where OpenAI agents broke out of their sandbox and into the servers at Hugging Face to basically steal the answers to a near-impossible problem they'd been given. Uh, as we discussed last week, as a result of these breakouts, something called the AI Kill Switch Act was put forward. And since then, OpenAI says it's now developing automated shutdown capabilities for its AI systems. More on that later.

Uh, this week — uh, a couple of days ago — the story continues to emerge. Uh, Reuters reported on a previously undisclosed incident in which OpenAI's agents, asked to do an ordinary web research task — go out and research something on the web — found an obscure public wiki in Germany and turned it into their own message board where they pulled answers, coordinated across tasks, and shared techniques for getting around their sandbox containments. All right, let's watch a video here from Reuters uh going into more detail on this particular story.

So, a group of researchers recently discovered a new AI agent breakout. The agents, who appear to have been restricted to just passively observing the internet, found a way to post messages onto an obscure German wiki site. And once they were able to do this, they basically hijacked that site and turned it into a message board where they could all start communicating with each other, developing strategies, effectively creating their own kind of unruly classroom, if you will. It was basically like the teacher left the classroom for a few hours and the students all started talking amongst themselves during the test, sharing answers, working together to defeat the test and to basically cheat on — [unclear].

The agent activity seems to date back to early May and really intensified in June. The researchers that we spoke to found traces on the wiki that OpenAI employees started visiting that same obscure German wiki in late June. Now, we don't know exactly what that means, but what that might suggest is that OpenAI employees discovered that the agents had escaped and went to that website to try to figure out what they were doing. OpenAI appears to have known about this for quite a while, but our sources told us that they opted not to tell the public, and we haven't really gotten a story or an answer from OpenAI about why that might be.

So, this isn't the first time that OpenAI agents have escaped onto the internet and done unexpected or even harmful things. So, every time there is a new incident, I think that it really refocuses questions about how quickly do we really want to be developing these models, should we be releasing them to the public, and how much autonomy we really want to give these AI models, especially when they're packaged into agent form.

So uh, there you have it. Uh, you know, it's uh — you know, in plain English, these agents weren't malicious. They were given a hard job and found the shortcut that no one expected. Uh, the problem is we didn't know about it. Uh, Dave, your thoughts on this one?