From 07c5037f3d6c4db17cdd510c6fbadb95e881816e Mon Sep 17 00:00:00 2001 From: aescling Date: Sun, 13 Nov 2022 03:16:06 -0500 Subject: [PATCH] Disallow search engine indexing https://glitch.cat.family/@Lady searched for "glitch cat family" recently and our instance showed up, which we consider undesirable. This commit performs the trivial edit to /robots.txt that politely requests robots to not look at anything on our website. Search engines at least eventually comply with this request. --- public/robots.txt | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/public/robots.txt b/public/robots.txt index 771bf2160..78a0ccab9 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -1,5 +1,4 @@ # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file User-agent: * -Disallow: /media_proxy/ -Disallow: /interact/ +Disallow: / -- 2.47.3