diff options
| author | Robin Houston <robin@lenny.robin> | 2011-07-28 11:34:35 +0100 |
|---|---|---|
| committer | Robin Houston <robin@lenny.robin> | 2011-07-28 11:34:35 +0100 |
| commit | 5c6dfebda5d6f6ec2b3f25905b95e3a9e4247fe7 (patch) | |
| tree | 7fba440b9c2896f34287540cf56f579498094d08 | |
| parent | 1e4243ee7507f6e3a3d1e15ec056d55d62e81ea7 (diff) | |
Add /signing to the list of disallowed paths in robots.txt, because Googlebot is requesting hundreds of them
| -rw-r--r-- | public/robots.txt | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/public/robots.txt b/public/robots.txt index f1cf80d7c..80dfd8ef7 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -18,3 +18,5 @@ Disallow: /upload/ Disallow: /user/contact/ Disallow: /feed/ Disallow: /profile/ +Disallow: /signin + |