Website_jan.su/_source/robots.txt

10 lines
119 B
Plaintext

# www.robotstxt.org/
# Allow crawling of all content
User-agent: *
Disallow:
# No GPT
User-agent: GPTBot
Disallow: /