mirror of
https://github.com/arcan1s/arcanis.me.git
synced 2025-07-15 06:05:47 +00:00
added robots.txt
This commit is contained in:
7
robots.txt
Normal file
7
robots.txt
Normal file
@ -0,0 +1,7 @@
|
||||
User-agent: *
|
||||
Disallow:
|
||||
Disallow: /cgi-bin/
|
||||
Disallow: /javascripts/
|
||||
Disallow: /stylesheets/
|
||||
Disallow: /README.md
|
||||
Disallow: /TODO
|
Reference in New Issue
Block a user