From: aescling <aescling+gitlab@cat.family>
Date: Sun, 13 Nov 2022 08:16:06 +0000 (-0500)
Subject: Disallow search engine indexing
X-Git-Url: https://git.xn--scling-oua.cat.family/?a=commitdiff_plain;h=07c5037f3d6c4db17cdd510c6fbadb95e881816e;p=mastodon.git

Disallow search engine indexing

https://glitch.cat.family/@Lady searched for "glitch cat family"
recently and our instance showed up, which we consider undesirable. This
commit performs the trivial edit to /robots.txt that politely requests
robots to not look at anything on our website. Search engines at least
eventually comply with this request.
---

diff --git a/public/robots.txt b/public/robots.txt
index 771bf2160..78a0ccab9 100644
--- a/public/robots.txt
+++ b/public/robots.txt
@@ -1,5 +1,4 @@
 # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
 
 User-agent: *
-Disallow: /media_proxy/
-Disallow: /interact/
+Disallow: /