test.jan.su/_source/robots.txt

6 lines
78 B
Plaintext
Raw Normal View History

2019-10-17 19:38:45 +02:00
# www.robotstxt.org/
# Allow crawling of all content
User-agent: *
Disallow: