]> cat aescling's git repositories - mastodon.git/commit
Actually prevent search engine indexing
authoraescling <aescling+gitlab@cat.family>
Sun, 1 Jan 2023 03:00:30 +0000 (22:00 -0500)
committercat æscling <11325618-aescling@users.noreply.gitlab.com>
Tue, 4 Jul 2023 18:12:25 +0000 (18:12 +0000)
commitd4b049dc34896b0be3479a8cf1171ea2ae6ec809
treeb2b3a0d5ebc0f8eab30f432147f4f90b4d91c898
parenta4022c2d7584cfcae33045904d05d9e6fc233968
Actually prevent search engine indexing

Disabling visibility via robots.txt prevents purroper indexers, like
googlebot, from detecting X-Robots-Tag or the like is on a page. This
also adds an X-Robots-Tag header to all requests.
config/environments/production.rb
public/robots.txt