Adding robots.txt

brystmar · Sep 21, 2019 · 5ff60d8 · 5ff60d8
1 parent 2546a6c
commit 5ff60d8
Show file tree

Hide file tree

Showing 2 changed files with 3 additions and 1 deletion.
diff --git a/.gitignore b/.gitignore
@@ -11,7 +11,7 @@ env_variables.yaml
 breadsheet.py
 breadsheet-prod.json
 breadsheet-prod.json.old
-breadvars.zip
+breadvar*
 .aws/*
 .boto
 .boto/*

diff --git a/robots.txt b/robots.txt
@@ -0,0 +1,2 @@
+# https://www.robotstxt.org/robotstxt.html
+User-agent: *
Original file line number	Diff line number	Diff line change
		@@ -0,0 +1,2 @@
		# https://www.robotstxt.org/robotstxt.html
		User-agent: *