IntenseWebs/discourse
3
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2025-02-25 18:55:32 -06:00
Code Issues Packages Projects Releases Wiki Activity

Disallow auth callbacks in robots.txt

Browse Source
This commit is contained in:
Neil Lalonde
2014-01-14 10:42:22 -05:00
parent 2a89f51d19
commit 88d9f3a786
1 changed files with 9 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

9
app/views/robots_txt/index.erb
View File

@@ -1,2 +1,11 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
User-agent: *
Disallow: /auth/cas
Disallow: /auth/facebook/callback
Disallow: /auth/twitter/callback
Disallow: /auth/google/callback
Disallow: /auth/yahoo/callback
Disallow: /auth/github/callback
Disallow: /auth/persona/callback
Disallow: /auth/cas/callback