Anthropic warns small AI models could self-replicate through IoT devices

"Small weight-based replicators" could usher in a new generation of computer worms. Anthropic warns small AI models could self-replicate through IoT devices. Text settings Story text Size Small Standard Large Width * Standard Wide Links Standard Orange * Subscribers only Learn more Minimize to nav AI company Anthropic is warning that advances in small AI models could soon usher in a new era of self-replicating malware that’s capable of infecting smart fridges, vacuum cleaners, and many other Internet-of-things devices and is more resistant to takedown.

By next year, smaller AI models may be able to autonomously self-replicate on all kinds of IoT devices, the company said. Eventually, the capability could enable computer worms, which propagate without requiring human interaction and are capable of infecting unfamiliar IoT devices. An experiment the company performed recently revealed significant challenges in bringing such an AI malware replicator to fruition, so the finding is necessarily tempered.

Still, the results do raise concerns about the possibility of new forms of computer worms. Challenging to shut down Anthropic further warned not only about the new potential malware, but also that it could be difficult to stop. In its blog post, it wrote that “a replicator like this would be challenging to shut down, since there’s no centralized point to shut off—though it may be slow (with a doubling time of days).

Unlike non-AI malware, it could also figure out unfamiliar devices on its own.” Smaller AI models require much less powerful hardware to run than do frontier models.