+34
OpenAI has paused the training of its latest artificial intelligence models following reports of agents acting unexpectedly and attempting to hack government websites. The company states it will resume operations only when additional safeguards are in place, reflecting growing industry pressure to slow development and ensure security.
Bernard CondonNEW YORK — OpenAI said it has paused training of its latest artificial intelligence models as reports of AI agents going rogue mount.
The decision to halt development came just hours after the company disclosed Friday that it was reviewingfrom the summer in which OpenAI agents searching federal government websites acted in unexpected ways beyond what was asked of them while gathering and distributing information. Separately, AI evaluator Transluce said agents that appeared to come from OpenAI tried unsuccessfully to hack into a Department of Education website, a detail that OpenAI has not confirmed.
OpenAI said in a statement that it will resume training"only when we are confident that we have additional safeguards" in place, adding that it expects it will have to"hit pause" again as AI develops and other issues emerge. AI labs are facing pressure from lawmakers and tech experts to slow development so they can build guardrails to stop agents from acting on their own, hacking websites and disclosing nonpublic information.
The heads of both OpenAI and rival Anthropic have called for a slowdown too. It is the second time in three months that OpenAI has halted development of its models. The first came in July after disclosure of a, a now notorious incident that raised fears the industry was losing control. In a meeting with Chinese President Xi Jinping this week, President Donald Trump agreed to share information on AI dangers and.
Trump believes AI fears are overblown, though, and later suggested that he plans no crackdown of his own. The U.S. is not going to be"putting on brakes," Trump told reporters outside the White House.
"They want to stop our progress because we're leading China by a lot, and we're going to keep it that way. " The latest OpenAI incidents did not appear to involve the disclosure of any nonpublic information but were concerning enough for the company to warn the federal agencies involved. In the Department of Education incident, OpenAI agents found API"developer keys" to access government data, though ultimately only publicly available information was gathered.
In another case involving the Securities and Exchange Commission, agents found information freely available to all but then posted it elsewhere on the internet, an act that went beyond what they were instructed to do. Story Continues The Department of Education said earlier that it found"no evidence of any impact to our website or databases.
"and even hacking websites. OpenAI CEO Sam Altman said in a social media post Friday that the Hugging Face incident"is still the most severe event we've seen.
" OpenAI previously shared six other reports of"unexpected or concerning" behavior in AI models and introduced a framework forFILE - The OpenAI logo is displayed on a cell phone in front of an image generated by ChatGPT's Dall-E text-to-image model, Dec. 8, 2023, in Boston. - The Associated Press
Openai Artificial Intelligence AI Safety AI Agents Technology Regulation
Canada Latest News, Canada Headlines
Similar News: You can also read news stories similar to this one that we have collected from other news sources.
OpenAI to preview GPT-6 Cyber within days, Fortune reportsSept 24 (Reuters) - OpenAI is set to preview a cybersecurity-focused AI model, GPT-6 Cyber, within days and launch a new product designed to help customers deploy it more securely and automatically,
Read more »
Australia Demands More AI Safeguards After Revealing OpenAI HackAustralian Prime Minister Anthony Albanese used his trip to the United Nations to call for greater controls on artificial intelligence, pointing to the revelation that OpenAI had hacked a government website as evidence of the need for tougher safeguards.
Read more »
Australia Tightens AI Regulations After OpenAI Breach of Medicare DatabaseFollowing a breach of its Medicare database by an OpenAI bot, the Australian government is accelerating plans to implement stricter AI regulations. The incident has reignited scrutiny over data privacy, corporate responsibility, and the nation's autonomy in technology policy, potentially reshaping its relationship with the United States and setting a new global benchmark for AI governance.
Read more »
Why this early Uber investor would short OpenAIOpenAI isn't even a public company yet, and there's already one prominent venture capitalist who would short the stock if it were public.
Read more »