aboutsummaryrefslogtreecommitdiffstats
path: root/scrapersources
Commit message (Expand)AuthorAgeLines
* Fix scraper metadata to work with new summary script.Petter Reinholdtsen2016-10-06-45/+47
* Get script working on local files instead of using scraperwiki.Petter Reinholdtsen2016-10-06-26/+22
* Time to run scraper daily.Petter Reinholdtsen2016-10-05-1/+2
* Improve formatting of sender/receiver.Petter Reinholdtsen2016-10-05-1/+1
* First draft scraper for Narvik.Petter Reinholdtsen2016-10-05-104/+198
* Add logic to rescan recent days twice to discover late entries.Petter Reinholdtsen2016-10-03-2/+15
* Use explicit range(start, stop, step) instead of calculations to make date ca...Petter Reinholdtsen2016-10-03-5/+5
* Improve handling of limited CPU resources.Petter Reinholdtsen2016-10-02-6/+10
* Correct day calculations and handle running out of CPU time better.Petter Reinholdtsen2016-10-02-9/+21
* Add CPU limit and report the number of records fetched.Petter Reinholdtsen2016-10-02-3/+27
* Fix typo in date parsing.Petter Reinholdtsen2016-10-02-1/+1
* Quiet down scraper.Petter Reinholdtsen2016-10-02-1/+1
* Use better name for new scraper.Petter Reinholdtsen2016-10-02-0/+0
* First draft scraper for Oslo kommune, Byrådsavdelingene.Petter Reinholdtsen2016-10-02-0/+155
* Remove debug output.Petter Reinholdtsen2016-09-26-1/+0
* Complete scraper for Ås kommune.Petter Reinholdtsen2016-09-26-23/+54
* Fix encoding problem with Ås kommune scraper.Petter Reinholdtsen2016-09-26-1/+1
* First draft scraper for Ås kommune.Petter Reinholdtsen2016-09-26-0/+131
* Make rescanning optional.Petter Reinholdtsen2016-04-08-10/+22
* Enable code reading backwards by default.Petter Reinholdtsen2016-04-08-1/+1
* Make sure saved and sql minimum value is the same most of the time.Petter Reinholdtsen2016-04-08-1/+1
* Make sure to save caseyear and caseseqnr as integers.Petter Reinholdtsen2016-04-08-2/+2
* Handle '-' in exemption field.Petter Reinholdtsen2016-04-07-0/+2
* Document that the Stortinget parser is broken now.Petter Reinholdtsen2016-04-07-2/+7
* Allow OEP scraper to run longer when no CPU limit is set.Petter Reinholdtsen2016-04-07-2/+2
* Correct initial backlog start point calculation for OEP scraper.Petter Reinholdtsen2016-04-07-1/+1
* Fix PDF locator code for Ruter scraper.Petter Reinholdtsen2016-04-07-1/+1
* Move OEP starting point closer to the current one.Petter Reinholdtsen2016-04-07-2/+2
* Get scraper running as standalone program.Petter Reinholdtsen2016-04-07-4/+1
* Make sure reparse_strange_entries() do not fail when all tables are empty.Petter Reinholdtsen2016-04-06-15/+18
* Drop some unused imports of lazycache.Petter Reinholdtsen2016-04-06-3/+0
* Slow down refetch of strange entries, to avoid being locked out.Petter Reinholdtsen2016-04-06-0/+1
* Gah, another typo.Petter Reinholdtsen2016-04-06-1/+1
* Typo.Petter Reinholdtsen2016-04-06-1/+1
* Enable reparsing of another batch of strange entries parsedPetter Reinholdtsen2016-04-06-2/+3
* Use correct UTF-8 marker in header.Petter Reinholdtsen2016-04-06-1/+1
* Handle environment without CPU limitation.Petter Reinholdtsen2016-04-06-1/+6
* Typo.Petter Reinholdtsen2016-03-26-1/+1
* Fix OEP scraper.Petter Reinholdtsen2016-03-26-1/+8
* Start on new scraiper for sio.no.Petter Reinholdtsen2015-11-23-0/+30
* Almost ready to use [DMS2002]Anders Einar Hilden2015-01-22-31/+90
* Add debug info.Petter Reinholdtsen2015-01-20-0/+1
* Rewrite logic to select dates, to parse both forward and back in time.Petter Reinholdtsen2015-01-20-6/+23
* New county scraper.Petter Reinholdtsen2015-01-19-0/+93
* Document missing fields.Petter Reinholdtsen2015-01-18-0/+1
* We can extract all but 3 elementsAnders Einar Hilden2015-01-18-37/+178
* Starting to rewrite datafinder-dodeAnders Einar Hilden2015-01-18-30/+65
* Add meta-info.Petter Reinholdtsen2015-01-18-2/+29
* Cleanup.Petter Reinholdtsen2015-01-17-2/+12
* Get it limping along again.Petter Reinholdtsen2015-01-17-1/+11