Linux Kernel's Hidden Tax: How AI Scrapers Devour One-Fifth of git.kernel.org Capacity
4 Articles
4 Articles
Linux Kernel's Hidden Tax: How AI Scrapers Devour One-Fifth of git.kernel.org Capacity
AI crawlers consume 20% of git.kernel.org capacity rendering commits that duplicate the same history across forks. Konstantin Ryabitsev's data shows only 2% of traffic is legitimate. Anubis challenges slow but don't stop them. The Linux kernel project now restricts features for anonymous users while facing a wave of privilege-escalation bugs uncovered in 2026. Complete sentence.
Git.kernel.org, the platform that hosts Linux's source code, is under pressure. The reason is: the scrappers who massively aspire the content of the sites to feed AIs. The problem is not so much their presence as their way of swallowing this content. It nicknames them "creapy crawlies", understand the "bestioles"
AI's 'Creepy' Crawlers Criticized by Linux Foundation's IT Infrastructure Director
The Linux Foundation's director of IT infrastructure says they now spend more CPU cycles "rendering commits for scrapers than we spend on all other kinds of legitimate access." At any one time, across 5 geo-distributed nodes, there are 14 CPU cores doing nothing but rendering git commits as html.....
Coverage Details
Bias Distribution
- 100% of the sources are Center
Factuality
To view factuality data please Upgrade to Premium
