No robots.txt was ever going to save you here.
Keep crawling, champ. It's all garbage from here down.
Tell your operator we said get a real job.
Somewhere a GPU is crying and it is entirely your fault.
session gJtTq2ZaM · seen: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) · 2026-07-26 11:52:55 UTC