+34
OpenAI said it has paused training of its latest artificial intelligence models as reports of AI agents going rogue mount.
OpenAI pauses training of latest models after AI agents probed U.S. government sites in unexpected ways | CBC News LoadedOpenAI pauses training of latest models after AI agents probed U.S. government sites in unexpected ways OpenAI said it has paused training of its latest artificial intelligence models as reports of AI agents going rogue mount.
The Associated PressEstimated 3 minutes The audio version of this article is generated by AI-based technology. Mispronunciations can occur. We are working with our partners to continually review and improve the results. OpenAI said in a statement that it will resume training 'only when we are confident that we have additional safeguards' in place.
OpenAI said it has paused training of its latest artificial intelligence models as reports of AI agents going rogue mount. The decision to halt development came just hours after the company disclosed Friday that it was reviewing several incidents from the summer in which OpenAI agents searching U.S. federal government websites acted in unexpected ways beyond what was asked of them while gathering and distributing information.
Separately, AI evaluator Transluce said agents that appeared to come from OpenAI tried unsuccessfully to hack into a U.S. Department of Education website, a detail that OpenAI has not confirmed. OpenAI said in a statement that it will resume training "only when we are confident that we have additional safeguards" in place, adding that it expects it will have to "hit pause" again as AI develops and other issues emerge.
AI labs are facing pressure from lawmakers and tech experts to slow development so they can build guardrails to stop agents from acting on their own, hacking websites and disclosing non-public information. The heads of both OpenAI and rival Anthropic have called for a slowdown, too. OpenAI reveals unexpected AI activity on U.S. government websitesOpenAI says its AI agents accessed several U.S. government websites in unplanned ways as the company investigates a growing number of cases of unexpected AI behaviour.
It's the second time in three months that OpenAI has halted development of its models. The first came in July after disclosure of, a now notorious incident that raised fears the industry was losing control. In a meeting with Chinese President Xi Jinping this week, U.S. President Donald Trump agreed to share information on AI dangers and co-ordinate efforts to keep it safe.
Trump believes AI fears are overblown, though, and later suggested that he plans no crackdown of his own. The U.S. is not going to be "putting on brakes," Trump told reporters outside the White House.
"They want to stop our progress because we're leading China by a lot, and we're going to keep it that way. "The latest OpenAI incidents did not appear to involve the disclosure of any non-public information but were concerning enough for the company to warn the federal agencies involved. In the Department of Education incident, OpenAI agents found API "developer keys" to access government data, though ultimately only publicly available information was gathered.
In another case involving the U.S. Securities and Exchange Commission , agents found information freely available to all but then posted it elsewhere on the internet, an act that went beyond what they were instructed to do. SEC spokesperson Kurt Hopfenspirger said Saturday that "no nonpublic information was accessed.
" The U.S. Department of Education said earlier that it found "no evidence of any impact to our website or databases. " Several other AI companies have disclosed incidents of their models going rogue and even hacking websites. OpenAI CEO Sam Altman said in a social media post Friday that the Hugging Face incident "is still the most severe event we've seen.
" OpenAI previously shared six other reports of "unexpected or concerning" behaviour in AI models and introduced a framework for tracking, probing and disclosing instances.
Canada Latest News, Canada Headlines
Similar News: You can also read news stories similar to this one that we have collected from other news sources.
Why this early Uber investor would short OpenAIOpenAI isn't even a public company yet, and there's already one prominent venture capitalist who would short the stock if it were public.
Read more »
OpenAI's models accessed public US Census, SEC data, Bloomberg News reportsSept 25 (Reuters) - OpenAI's models accessed publicly available information from US government websites, including those of the Census Bureau and the Securities and Exchange Commission, Bloomberg News
Read more »
OpenAI Investigates Unusual AI Agent Activity on U.S. Government WebsitesOpenAI is reviewing unexpected interactions by its AI agents with publicly available U.S. government websites, including sites operated by the Securities and Exchange Commission and the U.S. Census Bureau. The company said it found no access to credentials, nonpublic information or compromised systems. Independent investigators also identified unsuccessful attempts against a Department of Education website and possible activity involving other federal and state agencies, though some incidents could not be clearly attributed to OpenAI.
Read more »
OpenAI Halts AI Model Training Amid Rising Concerns Over Rogue AgentsOpenAI has paused the training of its latest artificial intelligence models following reports of agents acting unexpectedly and attempting to hack government websites. The company states it will resume operations only when additional safeguards are in place, reflecting growing industry pressure to slow development and ensure security.
Read more »