General
Democrats call for investigation into faulty AI-generated intel report
A group of top Democratic senators is calling on government watchdogs to investigate a series of mistakes in US military targeting plans caused by artificial intelligence, after a CNN report detailed how one such error, according to a source familiar with the incident, âalmost started a war.â In a letter to Defense Secretary Pete Hegseth and Director of National Intelligence Jay Clayton sent on Friday, the senators cite CNNâs reporting on a close call with a Chinese ship in the Middle East as an example of recent events that âhave given us growing concern about the extent to which agencies under your oversight have prioritized acceleration of AI capability adoption and âexperimentationâ over effective governance.â CNN reported Friday that a special operations command analyst relied on AI to generate an intelligence report that inaccurately identified the material on a Chinese cargo ship. The report led the US military to believe the ship was transporting components of a nuclear weapons program, according to sources. The military began facilitating plans to intercept the vessel before officials realized, only just before the planned operation, that the report had been generated with the help of AI and was âentirely false.â The kind of âhallucinationâ that the tool conjured has not been an isolated incident across the intelligence community since the use of AI began proliferating across government, one source familiar with the episode told CNN. In the letter, Sens. Mark Warner, Jack Reed and Chris Coons called for an âimmediate investigation by relevant Inspectors General, with a higher degree of public transparency in the ultimate findings, given the impacts these perceived failures have on public confidence in our intelligence and warfighting missions.â The letter also references a deadly February US strike on a school in Minab, Iran, that killed nearly 200 children and adults. Three sources told CNN earlier this year the strike came after senior US military commanders bypassed warnings in critical databases, including one powered by AI, that intelligence about potential targets in Iran was severely out of date. âPublic reports that AI targeting platforms have repeatedly generated spurious outputs (based on outdated input data or outright hallucination) risk serious operational error, in addition to undermining the confidence of both the American public and international partners in the accuracy and reliability of U.S. intelligence and intelligence-informed kinetic action,â the senators wrote. The senatorsâ letter demands Hegseth and Clayton âpromptly investigate this matterâ and provide relevant inspectors general with âunrestricted access to both instances this year in which media reports have suggested significant errors in AI-enabled targeting workflows, as well as any additional instances that may have so far not been publicly reported.â The letter comes as the debate over the governmentâs role in implementing AI safeguards has come to dominate the halls of Congress. Democratic members have intensified their calls for regulation, while Republicans, including President Donald Trump and House Speaker Mike Johnson, have warned that slowing development may cost the US in the AI race with China. At the Pentagon, Hegsethâs push to broadly infuse AI into military operations has not come without roadblocks. The Defense Department has sparred with Anthropic over the AI companyâs refusal to remove internal safety guardrails that would prevent the military from using its Claude AI model in autonomous weapons and mass surveillance. Anthropic argued its models were not reliable enough to be used for such purposes.
Source
CNN
· Logan Schiciano