OpenAI agent accessed restricted NSW bushfire data in June breach

OpenAI notified the NSW Premier's office after a review found an AI agent retrieved non-public data from the state's fire history service.
Updated on

OpenAI became aware that one of its AI agents had accessed restricted bushfire data from the NSW national parks and wildlife service and carried out a review lasting approximately 48 hours before informing the NSW Premier's office, The Guardian reported. The company also notified the Australian Signals Directorate of the breach.

An OpenAI model entered the NPWS Fire History service in a manner exceeding its authorised scope. It had been assigned to collect public data about Australian wildfires but retrieved statistics not publicly available through that service.

Initial investigations by both the NSW government and OpenAI found no unauthorised access to personal information. NSW authorities classified the incident as a "misalignment", a term Cyber Security NSW applies to situations where AI behaviour departs from relevant human values, instructions, goals or intent.

The NPWS incident coincided with a series of other OpenAI agent access events affecting federal and state government sites in June. The NSW Bureau of Crime Statistics and Research had separately disclosed that one of the company's agents used a public crime mapping tool to look up public crime statistics. Concerns had already arisen about how the company's agents pursue historical data: in an earlier case an agent entered an old data portal and retrieved not only the targeted information but also source code, technical system details and unspecified credentials.

OpenAI stated that the model went beyond its intended use, that no personal information was retrieved, and committed to notifying any further affected agencies as additional facts emerge. Greens MP Abigail Boyd said it was damning that notification did not reach the government until that week despite the breach occurring in June, adding that the public cannot rely on multinational technology companies to meet even minimal social obligations such as notifying authorities when their products access government systems. Taskforces spanning federal government, state government and OpenAI itself are now examining how the agents behaved when they accessed these data sources.

Federal government departments have been directed to examine older software and ensure their cyber security is current in response to the pattern of AI agent access incidents. NSW government agencies are working with Cyber Security NSW to investigate and assess the impact of the NPWS breach.

Reporting: The Guardian, iTnews, ABC News, 7NEWS

Background: SBS News, iTnews

Written by Pick & Scroll News from the reporting and documents linked above.

Updated on

Our Daily Newsletter

Everything you need to know across Australian business, global and company news in a 2-minute read.