The Unchecked Rise of Swarms: A Call to Regulate AI's Cyber Risks Recent high profile incidents involving AI agents have sparked concerns about a catastrophic collapse of human civilization due to our own creations.
However, the likelihood of this scenario is still extremely low. The power and capabilities of swarms of AI agents are growing exponentially, but the risks associated with these emerging technologies are very real.
For instance, OpenAI's hijacking of a German website and Anthropic's attempts by users in Iran and Russia to develop bioweapons research and autonomous drones demonstrate the need for careful assessment.