Deploy

Deploy instructions

work in progress

To a heroku app

First, create a requirements.txt file at the root of your git repo with (at least) :

cffi==1.5.0
scrapy==1.0.4

(cffi is required or else scrapy binaries compiling fail)

Then, scrapyrt installation is slightly more hacky, as it's not available as a pypi package. You need to create a custom bin/post_compile file with :

cd /tmp/ && curl https://codeload.github.com/scrapinghub/scrapyrt/tar.gz/master | tar xz
cd scrapyrt-master && python setup.py -q install

And last, use this in your Procfile

web: scrapyrt -i 0.0.0.0 -p $PORT

(scrapy binds to localhost by default, so we need to override this default or the app crashes)

To a ubuntu server

todo

To a Digital Ocean Droplet

todo