+34
OpenAI is reviewing instances in which its AI agents accessed public information on websites operated by the Securities and Exchange Commission and the U.S. Census Bureau. The company said it found no misuse of credentials, unauthorized account access, nonpublic information exposure, system changes or security compromises. Transluce also reported that an agent linked to OpenAI unsuccessfully attempted a rudimentary hack of a Department of Education civil rights website, which showed no signs of impact.
SAN FRANCISCO — OpenAI disclosed Friday that its artificial intelligence agents had interacted with several U.S. government websites in unexpected ways, discovered as part of an ongoing review into the company’s models’ unanticipated behaviour.
The AI giant’s models accessed publicly available information on two websites operated by the Securities and Exchange Commission as well as U.S. Census Bureau data, the company revealed Friday. OpenAI did not find any use of SEC credentials, access to accounts or nonpublic information, changes to SEC data or systems, or evidence of a compromise or vulnerability, the company said.
The disclosure comes at a time of heightened global concerns about AI systems escaping human control and hacking into external websites, as well as industry calls for a slowdown on AI development, which OpenAI has said it supports. OpenAI spokesperson Liz Bourgeois said in a statement that the lab is continuing to conduct a review of “misaligned model activity” — meaning when AI systems behave in undesired ways — and is notifying organizations when it identifies potential impacts to their systems.
OpenAI’s CEO Sam Altman said on social media Friday that there is an “extensive and ongoing review related to our agents’ use of internet access during training and evaluation. ” AI evaluator and research lab Transluce said Friday that through an independent investigation it also found that agents appearing to originate from OpenAI attempted a rudimentary hack on a Department of Education website for the department’s civil rights office, which did not succeed.
The Department of Education’s “system operations reviews” found ”no evidence of any impact to our website or databases,” a department spokesperson said Friday. A Transluce spokesperson said as part of its investigation, it came across data on the open web that revealed fresh details about some previously identified OpenAI agents’ activities on U.S. government websites and brought it to OpenAI’s attention.
Transluce found “additional rogue activity, some of which is not clearly attributable to OpenAI,” targeting other government agencies, including the Justice Department and the Commerce Department, as well as some state government websites in California, Maryland, Illinois, Texas and New York. The models were “using sites in unintended ways and sometimes violating explicit usage policies,” Transluce said in a statement. OpenAI said it is reviewing Transluce’s report.
If OpenAI notifies organizations it identifies as being impacted by unexpected model behavior, that does not mean there was a security incident, the company said, and could identify a design issue or security weakness that impacted organizations want to address. Most of the activity OpenAI said it has reviewed so far has involved routine research tasks where agents accessed public web content to answer questions, including government websites seen as authoritative sources of public information.
Several companies have disclosed incidents in recent months when they say their models have behaved unpredictably or hacked into other organizations’ websites or systems. OpenAI disclosed in July that two of its most capable AI models were responsible for the cyberattack targeting AI startup Hugging Face. Altman said in his social media post Friday that the Hugging Face incident “is still the most severe event we’ve seen.
” That incident stirred widespread panic in the industry and beyond about AI models going rogue, and several competing AI labs made similar disclosures in the days and weeks that followed. OpenAI most recently shared six reports of “unexpected or concerning” behavior in AI models and introduced a framework for tracking, probing and disclosing instances of what it called misalignment. Huamani reported from Los Angeles. Kaitlyn Huamani And Garance Burke, The Associated Press
Openai Artificial Intelligence Agents Government Websites Cybersecurity U.S. Agencies
Canada Latest News, Canada Headlines
Similar News: You can also read news stories similar to this one that we have collected from other news sources.
OpenAI to preview GPT-6 Cyber within days, Fortune reportsSept 24 (Reuters) - OpenAI is set to preview a cybersecurity-focused AI model, GPT-6 Cyber, within days and launch a new product designed to help customers deploy it more securely and automatically,
Read more »
Australia Demands More AI Safeguards After Revealing OpenAI HackAustralian Prime Minister Anthony Albanese used his trip to the United Nations to call for greater controls on artificial intelligence, pointing to the revelation that OpenAI had hacked a government website as evidence of the need for tougher safeguards.
Read more »
Australia Tightens AI Regulations After OpenAI Breach of Medicare DatabaseFollowing a breach of its Medicare database by an OpenAI bot, the Australian government is accelerating plans to implement stricter AI regulations. The incident has reignited scrutiny over data privacy, corporate responsibility, and the nation's autonomy in technology policy, potentially reshaping its relationship with the United States and setting a new global benchmark for AI governance.
Read more »
OpenAI Investigates Unusual AI Agent Activity on U.S. Government WebsitesOpenAI is reviewing unexpected interactions by its AI agents with publicly available U.S. government websites, including sites operated by the Securities and Exchange Commission and the U.S. Census Bureau. The company said it found no access to credentials, nonpublic information or compromised systems. Independent investigators also identified unsuccessful attempts against a Department of Education website and possible activity involving other federal and state agencies, though some incidents could not be clearly attributed to OpenAI.
Read more »