diff options
author | Petter Reinholdtsen <pere@hungry.com> | 2016-04-06 14:22:52 +0200 |
---|---|---|
committer | Petter Reinholdtsen <pere@hungry.com> | 2016-04-06 14:22:52 +0200 |
commit | 301e00ea51f69f552c734601979227083c4922b4 (patch) | |
tree | e91f2e588facb83c247ee7848ac584480c72c5bc | |
parent | eb5ba80453f40bba9119f7a3c626fca133535dc9 (diff) |
Slow down refetch of strange entries, to avoid being locked out.
-rw-r--r-- | scrapersources/postliste-oep | 1 |
1 files changed, 1 insertions, 0 deletions
diff --git a/scrapersources/postliste-oep b/scrapersources/postliste-oep index 4de35d4..0c7f03a 100644 --- a/scrapersources/postliste-oep +++ b/scrapersources/postliste-oep @@ -353,6 +353,7 @@ def reparse_strange_entries(datastorage): if 50 <= len(datastorage): save(data=datastorage) datastorage = [] + time.sleep(0.2) if 0 < len(datastorage): save(data=datastorage) datastorage = [] |