]> cat aescling's git repositories - mastodon.git/commit
Change robots.txt to exclude some URLs (#10037)
authorEugen Rochko <eugen@zeonfederated.com>
Wed, 13 Feb 2019 20:28:18 +0000 (21:28 +0100)
committerGitHub <noreply@github.com>
Wed, 13 Feb 2019 20:28:18 +0000 (21:28 +0100)
commit80161f43510ad9316c60c9b50dd5c09c2dae4d54
tree460e50d7b81024e30a7ca42c003690b80b6c0ace
parent7750416597e4d172b1d4751215aac2a50cf528e3
Change robots.txt to exclude some URLs (#10037)

- Exclude static assets
- Exclude uploaded files
- Exclude alternate versions of the profile page
- Exclude media proxy URLs
public/robots.txt