Produces content for Chahub.
$ git clone [email protected]:codalab/chahub-producers.git
$ cd chahub-producers
$ pip install -r requirements.txt
You'll need to get an API KEY from a Chahub admin, please post an issue if you'd like to produce content for Chahub!
$ export CHAHUB_API_URL='https://chahub.org/api/v1/'
# You can only get a Chahub API key from a Chahub admin
$ export CHAHUB_API_KEY=123925d-ac20-455c-asdf-bf624asdfbef
$ python scrape.py --adapter_name kaggle
- Get Chahub Producer API keys from a Chahub admin (post an issue on our Github for help with this) for each producer you'd like to make
- In our case we setup one for Kaggle and one for RAMP
- Set your API key environment variables on Heroku, like
CHAHUB_API_KEY_KAGGLE
andCHAHUB_API_KEY_RAMP
- Setup Heroku Scheduler (in Resources tab)
- "Add a new job"
- Put in the command
python scrape.py
- Run it once daily using a free dyno
- Save it