IntenseWebs/discourse
3
0
Fork 0
mirror of https://github.com/discourse/discourse.git synced 2025-02-25 18:55:32 -06:00
Code Issues Packages Projects Releases Wiki Activity

added support for disabling indexing by google using SiteSetting.allow_index_in_robots_txt = false

Browse Source
This commit is contained in:
Sam Saffron
2013-02-11 11:02:57 +11:00
parent 8250586306
commit c50a9e4d01
7 changed files with 54 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
public/robots.txt
View File

@@ -1,5 +0,0 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
#
# To ban all spiders from the entire site uncomment the next two lines:
# User-Agent: *
# Disallow: /