]> cat aescling's git repositories - mastodon.git/commitdiff
Disallow search engine indexing
authoraescling <aescling+gitlab@cat.family>
Sun, 13 Nov 2022 08:16:06 +0000 (03:16 -0500)
committeraescling <aescling+gitlab@cat.family>
Sun, 13 Nov 2022 08:16:06 +0000 (03:16 -0500)
https://glitch.cat.family/@Lady searched for "glitch cat family"
recently and our instance showed up, which we consider undesirable. This
commit performs the trivial edit to /robots.txt that politely requests
robots to not look at anything on our website. Search engines at least
eventually comply with this request.

public/robots.txt

index 771bf2160b4e3bdc65981d3680ef1ae78925f79d..78a0ccab9c9622fe2d4a48d2e40c7580ed722891 100644 (file)
@@ -1,5 +1,4 @@
 # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
 
 User-agent: *
-Disallow: /media_proxy/
-Disallow: /interact/
+Disallow: /