OpenAI adds safeguards to Pentagon deal after backlash

ChatGPT maker OpenAI said Monday it amended its new contract with the Department of Defense to block its artificial intelligence tools from being used for mass surveillance of Americans.

The change followed public backlash over the original deal announced Friday, which allowed the Pentagon to use OpenAI’s systems for any lawful purpose, raising concerns that the technology could be used to monitor US citizens.

Under the revised terms, OpenAI’s tech “shall not be intentionally used for domestic surveillance of U.S. persons and nationals.” The contract also bans the deliberate tracking or monitoring of Americans, including through commercially purchased personal data.

Chief executive Sam Altman said protecting civil liberties is critical and admitted the company rushed its initial announcement. He said the Pentagon assured OpenAI the tools would not be used by defense intelligence agencies such as the National Security Agency.

The controversy triggered a sharp consumer reaction. The US ChatGPT app uninstalls jumped 295% day-over-day on February 28, according to Sensor Tower. Downloads fell 13% Saturday and another 5% Sunday, while one-star reviews surged 775%.

Rival Anthropic’s Claude app rose 51% and hit No. 1 on the US App Store after the AI firm declined a similar agreement with the Pentagon over surveillance and autonomous weapons concerns.