tedkulp/teddit
1
0
Fork 0
mirror of https://codeberg.org/teddit/teddit.git synced 2026-04-19 21:54:58 -04:00
Code Issues Packages Projects Releases Wiki Activity

disallow Applebot, crawls way too much

Browse Source
This commit is contained in:
teddit
2021-11-18 20:29:24 +01:00
parent 998fa01a39
commit f8e6d326ba
1 changed files with 1 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files
static/robots.txt
+1
View File
@@ -1,2 +1,3 @@
User-agent: MJ12bot User-agent: MJ12bot
User-agent: Applebot
Disallow: / Disallow: /