Near War Over AI Intel
CNN said the report circulated across the US military set off alarm bells and triggered plans to intercept the vessel, with armed members preparing to board and military planes in the air.
CNN reported that officials dug deeper just before the planned operation and found the report had been generated with the help of artificial intelligence, after a chatbot the analyst used inaccurately identified the material the ship was carrying.
One source told CNN that the report was “entirely false,” and another said it also “almost started a war,” adding that any US operation against a Chinese vessel could have risked spiraling into armed conflict between the two nations.
CNN further reported that the analyst queried a chatbot about intelligence reporting on the ship’s manifest originating with US Special Operations Command Pacific, based in Hawaii, and then used AI again to package the findings into a standard intelligence report disseminated to military officials.
AI Targeting Risks and Debate
Reuters reported that US and Chinese security experts proposed nuclear-style safeguards for AI risks, warning that an AI system that interferes with a nuclear command network or launches a military cyber operation could leave Washington or Beijing with minutes to decide whether the other government attacked.
Reuters said the experts urged red lines around nuclear systems, human control over consequential cyberattacks, and a hotline for incidents involving autonomous AI, with the recommendations published last week ahead of planned government-level AI talks and an expected September 24 meeting in Washington between Donald Trump and Xi Jinping.
Reuters quoted Brookings Institution senior fellow Melanie Sisson arguing that humans should retain sole authority to initiate AI-enabled cyberattacks against the other country’s nuclear command, control and communications systems or strategically important infrastructure.
Reuters also reported that Fudan University associate professor Tianjiao Jiang proposed explicit red lines preventing AI from independently deciding to use nuclear weapons or autonomously attacking nuclear command systems, alongside protections around critical infrastructure including energy, finance and healthcare.
In parallel, Al-Jazira Net described how an AI chatbot merged open-source intelligence with classified signals intelligence to reach an incorrect assessment about the ship’s cargo, and a source described the incident as having “almost sparked a war,” noting that any American operation against a Chinese ship would have led to armed conflict between the two countries.
Human Control, Hotlines, Stakes
Reuters said the Brookings-Tsinghua proposals also included a dedicated US-China military hotline for AI incidents, warning that automated cyber exchanges could escalate too quickly for human intervention and be interpreted as an attack before understanding what actually happened.
“a hotline for incidents involving autonomous AI”
Reuters reported that experts including Carla Freeman at Johns Hopkins School of Advanced International Studies questioned the utility of the existing US-China military crisis communication hotline, citing Chinese officials’ refusal to answer US counterparts’ calls about the “spy balloon incident” in February 2023.
Reuters added that the Chinese State Security Minister Chen Yixin wrote that AI “fundamentally transforms the form of military struggle,” moving from playing a supporting role to a key role, citing AI-directed strikes in the US-Israeli war with Iran.
Reuters reported that neither government has publicly endorsed the Brookings-Tsinghua proposals, while China has increasingly placed AI inside its existing arms-control bureaucracy and Washington has no equivalent single arms-control home for AI.
The stakes described across the reporting were immediate and high, with CNN warning that the episode underscored the “profound risks” of using AI for targeting in the middle of a war, while Reuters framed the safeguards as preventing accidents from being mistaken for attacks and limiting machine-made military decisions.
