diff options
| author | Petter Reinholdtsen <pere@hungry.com> | 2014-02-27 14:43:12 +0100 |
|---|---|---|
| committer | Petter Reinholdtsen <pere@hungry.com> | 2014-02-27 14:51:44 +0100 |
| commit | 07341ea71f0c84565279a46aeb83cec1386afbb8 (patch) | |
| tree | 66f4d49367d7943e09f4e51e025ad9edf38f8410 /fetch-scraper-sqlite | |
| parent | 4799ce2d9a405c4127b1d3fd27ef68c58d37635d (diff) | |
Add script to fetch sqlite files directly.
Diffstat (limited to 'fetch-scraper-sqlite')
| -rwxr-xr-x | fetch-scraper-sqlite | 9 |
1 files changed, 9 insertions, 0 deletions
diff --git a/fetch-scraper-sqlite b/fetch-scraper-sqlite new file mode 100755 index 0000000..23dc24c --- /dev/null +++ b/fetch-scraper-sqlite @@ -0,0 +1,9 @@ +#!/bin/sh + +for scraper in $(ls scrapersources/); do + dbfile=sqlite-dbs/$scraper.sqlite3 + if [ ! -f $dbfile ] ; then + wget -O sqlite-dbs/$scraper.sqlite3 https://classic.scraperwiki.com/scrapers/export_sqlite/$scraper/ + fi +done + |