Saw this meme on our dev marketing channel and it cracked me up.
Looks like the next WW3 would be fought between bots on the web 😂
On a more serious note, a few days ago, Google’s Gary Illyes warned that AI agents might soon create web congestion.
More tools are crawling the web than ever before. Most are scanning pages and extracting content to train models or run internal workflows. The volume is growing fast, and many sites aren’t prepared for the strain.
The issue for your site is how often they return and how much pressure they put on your infrastructure.
Each visit can trigger backend processes like database queries or dynamic page rendering. Over time, this slows down your site, clutters your analytics with noise, and wastes resources on traffic that doesn’t lead to any outcome.
If you haven’t done a check in a while, it’s worth taking a look:
– Review your robots.txt file
– Block crawlers you don’t need
– Reduce costly database queries
– Set up filters that help you spot bot traffic
BTW, may the best bot win! 🤞