Skip to content
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.

Commit 9368f26

Browse files
jshasyphar
authored andcommittedJan 9, 2025·
robots: also disallow %5E (urlencoded caret)
1 parent c1be79c commit 9368f26

File tree

1 file changed

+3
-0
lines changed

1 file changed

+3
-0
lines changed
 

‎static/robots.txt

Lines changed: 3 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,4 +4,7 @@ Sitemap: https://docs.rs/sitemap.xml
44
# https://docs.rs/about/redirections
55
User-Agent: *
66
Disallow: */^
7+
# %5E is '^', URL-encoded. Based on the Search Console, Google
8+
# may be encoding '^' before checking against robots.txt.
9+
Disallow: */%5E
710
Disallow: */~

0 commit comments

Comments
 (0)
Please sign in to comment.