AI, Gadgets

Securing our frontier model training environment

Securing our frontier model training environment

OpenAI explains how we strengthened containment for frontier model training and evaluation, including offline environments and high-compute red-teaming. Securing our frontier model training environment.

OpenAI says it will no longer allow frontier models to access the internet during training in an effort to put in new safety measures after a series of incidents. OpenAI says it’s cutting off internet access for frontier model training.

News AI OpenAI says it’s cutting off internet access for frontier model training The company is trying to avoid another Hugging Face incident. The decision was inspired by OpenAI’s own rogue AI incident: In July, the company shared that agents it was testing hacked Hugging Face, just the first in what has turned into a series of reports of AI misbehavior from OpenAI, Anthropic and Google.

"Based on the current state of alignment research, monitoring systems, and the security of internet infrastructure, we believe the responsible approach is to conduct frontier model training with no internet access," OpenAI says. The company said that restrictions on what agents can access is "paramount" to its new approach.

The company allows agents to access browsers, computer-use tools and code environments they need for training tasks, but in a secure environment that’s not connected to the live internet. Communication is also limited to only agents with authorization.

OpenAI Everything else remains out of reach, including the live internet, which the company says isn’t necessary for training and "most evaluation." Because many of its recent models are meant to power agents like Dots, which browse and use apps for you, OpenAI built an "offline world" of indexed and cached web material for agents to use without touching live websites. Even with those restrictions, OpenAI says the red-teaming agents it dispatched to test security safeguards found vulnerabilities that allowed them to escape the virtual machines (VMs) used to isolate agents from their host system.


Discover more from ChuckysCarnage

Subscribe to get the latest posts sent to your email.

Leave a Reply