
The United States’ Special Operations Command (SOCOM) is seeking companies to develop highly convincing deepfake internet users, as outlined in a recent procurement document reviewed by The Intercept. The document, part of a 76-page wish list from the Department of Defense’s Joint Special Operations Command (JSOC), emphasizes the need for advanced technologies that can create online personas indistinguishable from real individuals. These fabricated profiles are intended for use on social media and other online platforms, complete with realistic images, videos, and audio layers that mimic human behavior.
SOCOM’s interest in deepfake technology reflects a broader trend in military operations, where such tools could be used to gather intelligence from public online forums. This initiative follows last year’s indication that SOCOM planned to employ deepfake videos for propaganda purposes. The desire for these capabilities highlights a contradiction in U.S. policy, as officials have consistently warned about the threats posed by deepfakes when used by adversaries. National security officials have labeled the state-sponsored use of synthetic media as a significant risk, particularly from countries like Russia, China, and Iran.
Despite warnings against the dangers of deepfakes, the Pentagon is actively pursuing technologies that could facilitate their own use, raising ethical concerns. Critics, including experts from the AI Now Institute, argue that such technologies serve no legitimate purpose beyond deception. This move could normalize the use of deepfakes for government operations and potentially encourage adversaries to adopt similar tactics, further blurring the lines between truth and fiction in information dissemination.
The U.S. government’s dual approach—promoting transparency while exploring deceptive technologies—poses a fundamental tension. Experts worry that this strategy could undermine public trust in government communications, as segments of the population may grow increasingly skeptical of official information. As SOCOM explores the offensive potential of deepfakes, concerns about credibility and the impact on democratic societies become more pronounced, highlighting the complexities of navigating the evolving landscape of information warfare.
