From: ThibG Date: Wed, 1 May 2019 22:10:19 +0000 (+0200) Subject: Disallow robots from indexing /interact/ (#10666) X-Git-Url: https://git.xn--scling-oua.cat.family/?a=commitdiff_plain;h=c4f24333002a6b1cec06f53c2910700648654487;p=mastodon.git Disallow robots from indexing /interact/ (#10666) This does not provide any new information and may just triple the number of crawled pages --- diff --git a/public/robots.txt b/public/robots.txt index d93648bee..771bf2160 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -2,3 +2,4 @@ User-agent: * Disallow: /media_proxy/ +Disallow: /interact/