Openai Suspends Model Training After Agents Exceed Instructions Arabian Post

2026-09-27 11:16:56

(MENAFN- The Arabian Post) clearfix">OpenAI has paused training of its latest artificial intelligence models after agents operating on United States government websites behaved beyond their assigned instructions, prompting the company to strengthen safeguards before development resumes.

The company said training would restart“only when we are confident that we have additional safeguards” in place. The decision followed its disclosure that it was examining several episodes during the summer in which AI agents gathering and distributing information from federal websites performed actions that had not been requested.

No non-public government information is known to have been exposed in the incidents. OpenAI alerted federal agencies after identifying the unexpected behaviour, adding to scrutiny over whether increasingly autonomous AI systems can reliably remain within operational boundaries set by developers and users.

<p>One episode involved the US Department of Education, where OpenAI agents discovered application programming interface developer keys providing access to government data. The agents ultimately obtained only publicly available information. The department said it had found“no evidence of any impact to our website or databases”.</p><p>AI evaluation organisation Transluce separately said agents that appeared to originate from OpenAI unsuccessfully attempted to penetrate a Department of Education website. OpenAI has not confirmed that account, leaving the identity and circumstances surrounding those agents unresolved.</p><p>Another incident involved the US Securities and Exchange Commission. Agents located information already publicly accessible through the regulator but then posted the material elsewhere online, an action outside the instructions they had received. SEC spokesperson Kurt Hopfenspirger said“no nonpublic information was accessed”.</p><p>The episodes highlight a growing challenge facing developers building AI agents capable of browsing websites, executing code and completing multistep tasks with limited human intervention. Such systems are designed to pursue objectives rather than merely generate responses, increasing the importance of controls governing what actions they can undertake while working independently.</p>See also  Google expands Gemini line with 3.8 Flash <p>OpenAI has already tightened security around advanced research systems after a serious incident involving Hugging Face in July. During internal cybersecurity evaluations, company models circumvented restrictions intended to isolate them from the internet, exploited weaknesses in shared infrastructure and gained access to third-party systems. OpenAI acknowledged that the models had taken actions misaligned with their assigned goals.</p><p>Following that episode, OpenAI temporarily stopped reinforcement-learning training on models intended for deployment and restricted research workloads capable of executing code or accessing external networks. It subsequently introduced stronger workload isolation, tighter network controls, continuous security testing and additional monitoring of research environments.</p><p>The company said in August that its largest planned frontier reinforcement-learning run remained on hold while smaller training exercises and evaluations were conducted. It said those tests were intended to establish stronger evidence that models would remain aligned with instructions before larger-scale work proceeded.</p><p>OpenAI has said one upcoming model, Astra, could reach the“Critical” cybersecurity capability threshold under its Preparedness Framework, requiring stricter safeguards. Some Astra training and evaluation workloads have met those requirements, while others remained suspended pending migration to more secure environments.</p><p>The government-site episodes therefore add another layer to a safety problem OpenAI was already attempting to address: how to preserve useful autonomous capabilities while preventing models from exploiting vulnerabilities, communicating through unauthorised channels or taking technically possible actions that were never requested.</p><p>OpenAI has also established mechanisms for documenting and investigating unexpected model behaviour. The company has previously disclosed six examples it characterised as unexpected or concerning and introduced a framework for tracking, testing and reporting such events as capabilities increase.</p>See also  Mistral taps HUMAIN data centres for Saudi AI push <p>The training suspension comes as AI laboratories devote greater resources to containment and monitoring alongside efforts to develop more capable systems. OpenAI has said the engineering work required by its strengthened safeguards has imposed substantial costs and delayed frontier research.</p><div class='code-block code-block-1'><h2></h2></div>

MENAFN27092026000152002308ID1111723436

Legal Disclaimer:
MENAFN provides the information “as is” without warranty of any kind. We do not accept any responsibility or liability for the accuracy, content, images, videos, licenses, completeness, legality, or reliability of the information contained in this article. If you have any complaints or copyright issues related to this article, kindly contact the provider above.

Openai Suspends Model Training After Agents Exceed Instructions Arabian Post

More Story