Left4Code/robots.txt
1
0
Fork 0
mirror of https://git.qwik.space/left4code/robots.txt.git synced 2025-08-14 21:09:31 +05:30
Code Issues Packages Projects Releases Wiki Activity
Files
a8c8a58f51aa9b1a7e3c9bcba97afd8eab4cfebc
robots.txt/README.md
left4code a8c8a58f51 Initial commit
2025-08-10 20:53:26 +02:00

137 B
Raw Blame History

robots.txt

A collection of robots.txt files for sites where it's the only option to defend against scraping like Neocities or Nekoweb.

Reference in New Issue View Git Blame Copy Permalink