tedkulp/teddit
1
0
Fork 0
mirror of https://codeberg.org/teddit/teddit.git synced 2026-04-15 21:14:53 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
0eb5ce1b6ea686abbe135f8ebcedb9c2ec9f6d2e
teddit/static/robots.txt
teddit f8e6d326ba disallow Applebot, crawls way too much
2021-11-18 20:29:24 +01:00

4 lines
53 B
Plaintext
Raw Blame History

User-agent: MJ12bot
User-agent: Applebot
Disallow: /
Reference in New Issue View Git Blame Copy Permalink