Creepy crawlies

· · Sept. 7, 2026, 11:35 p.m.
crawling Git Linux datasette Linux Git crawling AI Ethics
Summary
Konstantin Ryabitsev highlights the issue of abusive crawlers on git.kernel.org, noting that they consume more resources for rendering commits into HTML than all legitimate accesses combined, raising concerns for similar systems like Datasette.
Read full post on simonwillison.net →
AUTHOR