Issue #2446657 by rpayanm, er.pushpinderrana: Remove dead link from robots.txt

DavidRothstein · DavidRothstein · commit a577cc98e33a · 2015-03-30T18:49:19.000-04:00
diff --git a/robots.txt b/robots.txt
@@ -12,9 +12,6 @@
 #
 # For more information about the robots.txt standard, see:
 # http://www.robotstxt.org/robotstxt.html
-#
-# For syntax checking, see:
-# http://www.frobee.com/robots-txt-check
 
 User-agent: *
 Crawl-delay: 10

Original file line number	Diff line number	Diff line change
`@@ -12,9 +12,6 @@`
`12`	`12`	`#`
`13`	`13`	`# For more information about the robots.txt standard, see:`
`14`	`14`	`# http://www.robotstxt.org/robotstxt.html`
`15`		`-#`
`16`		`-# For syntax checking, see:`
`17`		`-# http://www.frobee.com/robots-txt-check`
`18`	`15`
`19`	`16`	`User-agent: *`
`20`	`17`	`Crawl-delay: 10`