A Storm of Controversy: OpenAI's Pentagon Deal and the Battle for AI Ethics
The recent events surrounding OpenAI's deal with the US Department of War have sparked a heated debate, raising crucial questions about the role of AI in our society.
OpenAI, the powerhouse behind ChatGPT, has decided to amend its initial agreement with the DoW, acknowledging that the rushed deal appeared "opportunistic and sloppy." This move comes after CEO Sam Altman admitted to the company's haste, which led to concerns about the potential misuse of their AI technology for domestic mass surveillance.
But here's where it gets controversial: Altman assured that OpenAI's technology would be explicitly barred from such surveillance activities and would not be deployed by defense intelligence agencies like the NSA. However, this promise has not quelled the fears of many, especially given the historical context of the Snowden scandal, where the NSA was exposed for mass surveillance practices.
The backlash against OpenAI was swift, with users on various platforms advocating for a "delete ChatGPT" campaign. The controversy even drove Anthropic's chatbot, Claude, to the top of Apple's App Store charts, surpassing ChatGPT in popularity.
And this is the part most people miss: the complex web of ethical concerns and power dynamics at play. Nearly 900 employees from OpenAI and Google, another AI industry leader, have signed an open letter urging their employers to refuse the DoW's demands for surveillance and autonomous killing. They warn of the government's tactics to "divide and conquer," emphasizing the need for unity among tech companies to uphold democratic values.
The letter, signed by 796 Google employees and 98 OpenAI staff, highlights the deep divisions within the industry. OpenAI's blog post announcing the DoW deal claimed to have established "more guardrails" than previous agreements, but critics, including OpenAI's former head of policy research, Miles Brundage, have questioned how OpenAI managed to navigate ethical concerns that Anthropic deemed insurmountable.
Brundage expressed his distrust towards certain individuals within OpenAI, particularly in their dealings with the government and politics. He emphasized the importance of democratic processes and the role of experts in shaping societal decisions, adding that he would "rather go to jail" than follow an unconstitutional order.
As the controversy unfolds, three more US cabinet-level agencies have followed suit, ceasing the use of Anthropic's AI products after the DoW's declaration of Anthropic as a supply chain risk. With Trump's order to phase out Anthropic, the battle for AI ethics rages on, leaving many to wonder: In this high-stakes game, who will ultimately decide the boundaries of AI's role in our society?
