diff options
| author | Robin Houston <robin@lenny.robin> | 2011-07-28 11:34:35 +0100 |
|---|---|---|
| committer | Robin Houston <robin@lenny.robin> | 2011-07-28 11:38:23 +0100 |
| commit | 642a3f74b7036383dd326584e411f98eb463cc0c (patch) | |
| tree | 8968423933bb4e59dab75404d1e597e4474c20e5 | |
| parent | 44ffca31030651ca9d816cfd7d0784d0652c4ee5 (diff) | |
Add /signing to the list of disallowed paths in robots.txt, because Googlebot is requesting hundreds of them
| -rw-r--r-- | public/robots.txt | 2 |
1 files changed, 2 insertions, 0 deletions
diff --git a/public/robots.txt b/public/robots.txt index f1cf80d7c..80dfd8ef7 100644 --- a/public/robots.txt +++ b/public/robots.txt @@ -18,3 +18,5 @@ Disallow: /upload/ Disallow: /user/contact/ Disallow: /feed/ Disallow: /profile/ +Disallow: /signin + |