From 66af9866f0506eaad48fe4b9ca43e66089da046b Mon Sep 17 00:00:00 2001 From: Robert Went Date: Sun, 9 Sep 2018 17:41:57 +0100 Subject: [PATCH] Adds robots.txt and disallows all --- public/robots.txt | 5 +++++ 1 file changed, 5 insertions(+) create mode 100644 public/robots.txt diff --git a/public/robots.txt b/public/robots.txt new file mode 100644 index 00000000..dfbc662a --- /dev/null +++ b/public/robots.txt @@ -0,0 +1,5 @@ +# For more information about the robots.txt standard, see: +# http://www.robotstxt.org/orig.html + +User-agent: * +Disallow: /