Robots.txt

Related:

Show all related links >>
github.com

ai-robots-txt/ai.robots.txt, A list of AI agents and robots to block. (https://github.com/ai-robots-txt/ai.robots.txt)
Resource Robots.txt