diff options
| author | Petter Reinholdtsen <pere@scraper.nuug.no> | 2014-11-25 20:23:08 +0100 |
|---|---|---|
| committer | Petter Reinholdtsen <pere@scraper.nuug.no> | 2014-11-25 20:23:08 +0100 |
| commit | 922c8bae5a8fb9dc0434e91c6fcb68af4862a072 (patch) | |
| tree | e69a86d2a05c0b6021ada22fed98fcb8c587b2ab | |
| parent | 913bff5107bda6899382bb94a55e62b9a42d553c (diff) | |
Get script working.
| -rwxr-xr-x | run-scraper | 8 |
1 files changed, 6 insertions, 2 deletions
diff --git a/run-scraper b/run-scraper index 1f9637b..c617064 100755 --- a/run-scraper +++ b/run-scraper @@ -4,6 +4,10 @@ # the scrapers to be tested locally. file=$1 -export PYTHONPATH=`pwd`/testlib -python $file +topdir=`pwd` + +export PYTHONPATH=`pwd`/testlib/scraperwiki-python:`pwd`/testlib/dumptruck + +mkdir -p data/$1 +(cd data/$file ; python $topdir/scrapersources/$file) |