Left4Code/robots.txt
1
0
Fork 0
mirror of https://git.qwik.space/left4code/robots.txt.git synced 2025-08-14 21:09:31 +05:30
Code Issues Packages Projects Releases Wiki Activity

Initial commit

Browse Source
This commit is contained in:
left4code
2025-08-10 20:53:26 +02:00
commit a8c8a58f51
2 changed files with 120 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
README.md Normal file
View File

@@ -0,0 +1,3 @@
# robots.txt
A collection of robots.txt files for sites where it's the only option to defend against scraping like Neocities or Nekoweb.