No robots.txt was ever going to save you here.
Keep crawling, champ. It's all garbage from here down.
Somewhere a GPU is crying and it is entirely your fault.
Tell your operator we said get a real job.
session L91Liy6v · seen: Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com) · 2026-09-22 22:19:13 UTC