A top robotics executive at OpenAI said Saturday she had resigned over the company’s deal with the US Department of Defence to allow its artificial intelligence to be used for war and potential domestic surveillance.
Ethical Concerns Lead to Resignation
Caitlin Kalinowski, a prominent robotics executive at OpenAI, announced her resignation due to ethical objections over the company's contract with the US Department of Defence. This deal permits the use of OpenAI's artificial intelligence for military purposes and potential domestic surveillance. Kalinowski voiced profound concern that critical issues like surveillance without judicial oversight and lethal autonomy lacking human authorization were not given sufficient deliberation by the company.
OpenAI's Pentagon Deal and Public Backlash
The defence contract was secured last month, shortly after competitor Anthropic publicly refused to allow unconditional military deployment of its AI technology. Following criticism, OpenAI CEO Sam Altman stated the company would modify the contract to prevent its models from being used for domestic surveillance of US persons and nationals, acknowledging concerns about granting unchecked power to military officials. However, Kalinowski emphasized that her issue was rooted in principle rather than personal disagreement.
Governance and Haste in AI Deployment
Kalinowski further elaborated on her concerns, highlighting the rushed nature of OpenAI's Pentagon deal and the absence of clearly defined guardrails for such powerful technology. She stressed that these matters are too significant for agreements or announcements to be hurried without proper safeguards in place, indicating a fundamental governance concern. This incident underscores the growing debate within the tech industry regarding the ethical implications and responsible deployment of advanced AI systems, particularly in sensitive areas like defence and security.
