- Technology
- Artificial Intelligence
Artificial intelligence experts have warned that AI "swarms" are poised to infiltrate social media by deploying agents that mimic human behavior and exploit our tendency to follow the herd.
When you purchase through links on our site, we may earn an affiliate commission. Here’s how it works.
Social media users could find themselves swept up in a movement of AI's making.
(Image credit: Andriy Onufriyenko via Getty Images)
Share
Share by:
- Copy link
- X
Swarms of artificial intelligence (AI) agents could soon invade social media platforms en masse to spread false narratives, harass users and undermine democracy, researchers warn.
These "AI swarms" will form part of a new frontier in information warfare, capable of mimicking human behavior to avoid detection while creating the illusion of an authentic online movement, based on a commentary published Jan. 22 in the journal Science.
You may like-
'It won’t be so much a ghost town as a zombie apocalypse': How AI might forever change how we use the internet
-
Experts divided over claim that Chinese hackers launched world-first AI-powered cyber attack — but that's not what they're really worried about
-
AI can develop 'personality' spontaneously with minimal prompting, research shows. What does that mean for how we use it?
"Humans, generally speaking, are conformist," commentary co-author Jonas Kunst, a professor of communication at the BI Norwegian Business School in Norway, told Live Science. "We often don't want to agree with that, and people vary to a certain extent, but all things being equal, we do have a tendency to believe what most people do has certain value. That's something that can relatively easily be hijacked by these swarms."
And if you don't get swept up with the herd, the swarm could also be a harassment tool to discourage arguments that undermine the AI's narrative, the researchers argued. For example, the swarm could emulate an angry mob to target an individual with dissenting views and drive them off the platform.
The researchers don't give a timeline for the invasion of AI swarms, so it's unclear when the first agents will arrive on our feeds. However, they noted that swarms would be difficult to detect, and thus the extent to which they might have already been deployed is unknown. For many, signs of the growing influence of bots on social media are already evident, while the dead internet conspiracy theory — that bots are responsible for the majority of online activity and content creation — has been gaining traction over the last few years.
Shepherding the flock
The researchers warn that the emerging AI swarm risk is compounded by long-standing vulnerabilities in our digital ecosystems, already weakened by what they described as the "erosion of rational-critical discourse and a lack of shared reality among citizens."
Sign up for the Live Science daily newsletter nowContact me with news and offers from other Future brandsReceive email from us on behalf of our trusted partners or sponsorsBy submitting your information you agree to the Terms & Conditions and Privacy Policy and are aged 16 or over.Anyone who uses social media will know that it's become a very divisive place. The online ecosystem is also already littered with automated bots — non-human accounts following the commands of computer software that comprise more than half of all web traffic. Conventional bots are typically only capable of performing simple tasks over and over again, like posting the same incendiary message. They can still cause harm, spreading false information and inflating false narratives, but they're usually pretty easy to detect and rely on humans to be coordinated at scale.
The next-generation AI swarms, on the other hand, are coordinated by large language models (LLMs) — the AI systems behind popular chatbots. With an LLM at the helm, a swarm will be sophisticated enough to adapt to the online communities it infiltrates, installing collections of different personas that retain memory and identity, according to the commentary.
"We talk about it as a kind of organism that is self-sufficient, that can coordinate itself, can learn, can adapt over time and, by that, specialize in exploiting human vulnerabilities," Kunst said.
You may like-
'It won’t be so much a ghost town as a zombie apocalypse': How AI might forever change how we use the internet
-
Experts divided over claim that Chinese hackers launched world-first AI-powered cyber attack — but that's not what they're really worried about
-
Popular AI chatbots have an alarming encryption flaw — meaning hackers may have easily intercepted messages
This mass manipulation is far from hypothetical. Last year, Reddit threatened legal action against researchers who used AI chatbots in an experiment to manipulate the opinions of four million users in its popular forum r/changemyview. According to the researchers' preliminary findings, their chatbots' responses were between three to six times more persuasive than those made by human users.
A swarm could contain hundreds, thousands — or even a million — AI agents. Kunst noted that the number scales with computing power and would also be limited by restrictions that social media companies may introduce to combat the swarms.
But it's not all about the number of agents. Swarms could target local community groups that would be suspicious of a sudden influx of new users. In this scenario, only a few agents would be deployed. The researchers also noted that because the swarms are more sophisticated than traditional bots, they can have more influence with fewer numbers.
"I think the more sophisticated these bots are, the less you actually need," commentary lead author Daniel Schroeder, a researcher at the technology research organization SINTEF in Norway, told Live Science.
Guarding against next-gen bots
Agents boast an edge in debates with real users because they can post 24 hours a day, every day, for however long it takes for their narrative to take hold. The researchers added that in "cognitive warfare," AI's relentlessness and persistence can be weaponized against limited human efforts.
RELATED STORIES—AI may accelerate scientific progress — but here's why it can't replace human scientists
—AI can develop 'personality' spontaneously with minimal prompting, research shows. What does that mean for how we use it?
—Indigenous TikTok star 'Bush Legend' is actually AI-generated, leading to accusations of 'digital blackface'
Social media companies want real users on their platforms, not AI agents, so the researchers envisage that companies will respond to AI swarms with improved account authentication — forcing users to prove they are real people. But the researchers also flagged some issues with this approach, arguing that it could discourage political dissent in countries where people rely on anonymity to speak out against governments. Authentic accounts can also be hijacked or acquired, which complicates things further. Still, the researchers noted that strengthening authentication would make it more difficult and costly for those wishing to deploy AI swarms.
The researchers also proposed other swarm defenses, like scanning live traffic for statistically anomalous patterns that could represent AI swarms and the establishment of an "AI Influence Observatory" ecosystem, in which academic groups, NGOs and other institutions can study, raise awareness and respond to the AI swarm threat. In essence, the researchers want to get ahead of the issue before it can disrupt elections and other large events.
"We are with a reasonable certainty warning about a future development that really might have disproportionate consequences for democracy, and we need to start preparing for that," Kunst said. "We need to be proactive instead of waiting for the first type of larger events being negatively influenced by AI swarms."
Patrick PesterSocial Links NavigationTrending News WriterPatrick Pester is the trending news writer at Live Science. His work has appeared on other science websites, such as BBC Science Focus and Scientific American. Patrick retrained as a journalist after spending his early career working in zoos and wildlife conservation. He was awarded the Master's Excellence Scholarship to study at Cardiff University where he completed a master's degree in international journalism. He also has a second master's degree in biodiversity, evolution and conservation in action from Middlesex University London. When he isn't writing news, Patrick investigates the sale of human remains.
Show More CommentsYou must confirm your public display name before commenting
Please logout and then login again, you will then be prompted to enter your display name.
Logout Read more
'It won’t be so much a ghost town as a zombie apocalypse': How AI might forever change how we use the internet
Experts divided over claim that Chinese hackers launched world-first AI-powered cyber attack — but that's not what they're really worried about
Popular AI chatbots have an alarming encryption flaw — meaning hackers may have easily intercepted messages
Some people love AI, others hate it. Here's why.
Even AI has trouble figuring out if text was written by AI — here's why
Why the rise of humanoid robots could make us less comfortable with each other
Latest in Artificial Intelligence
Giving AI the ability to monitor its own thought process could help it think like humans
Microsoft says its newest AI chip Maia 200 is 3 times more powerful than Google's TPU and Amazon's Trainium processor
AI may accelerate scientific progress — but here's why it can't replace human scientists
AI can develop 'personality' spontaneously with minimal prompting, research shows. What does that mean for how we use it?
Indigenous TikTok star 'Bush Legend' is actually AI-generated, leading to accusations of 'digital blackface'
Even AI has trouble figuring out if text was written by AI — here's why
Latest in News
'Part of the evolutionary fabric of our societies': Same-sex sexual behavior in primates may be a survival strategy, study finds
More than 43,000 years ago, Neanderthals spent centuries collecting animal skulls in a cave; but archaeologists aren't sure why
Halley wasn't the first to figure out the famous comet. An 11th-century monk did it first, new research suggests.
James Webb telescope breaks own record, discovering farthest known galaxy in the universe
South Carolina's measles outbreak nears 790 cases — making it the biggest in decades
5,000-year-old rock art from ancient Egypt depicts 'terrifying' conquest of the Sinai Peninsula
LATEST ARTICLES
1Thousands of dams in the US are old, damaged and unable to cope with extreme weather. How bad is it?- 2'Part of the evolutionary fabric of our societies': Same-sex sexual behavior in primates may be a survival strategy, study finds
- 3More than 43,000 years ago, Neanderthals spent centuries collecting animal skulls in a cave; but archaeologists aren't sure why
- 4Watch awkward Chinese humanoid robot lay it all down on the dance floor
- 5The Snow Moon will 'swallow' one of the brightest stars in the sky this weekend: Where and when to look
