Creepy crawlies

· · Sept. 7, 2026, 11:35 p.m.
crawling Git Linux datasette Linux Git crawling AI Ethics
Summary
Konstantin Ryabitsev highlights the issue of abusive crawlers on git.kernel.org, noting that they consume more resources for rendering commits into HTML than all legitimate accesses combined, raising concerns for similar systems like Datasette.
Read full post on simonwillison.net →
AUTHOR
Advertise
Sponsor diff.blog
Put your product in front of developers who read and write about their craft. One exclusive sponsor at a time.
Become a sponsor →