setup_macos.md

Greynir - Setup instructions for macOS

These instructions are for macOS 10.12 or later.

Install dependencies

Using Homebrew:

brew install python3 pypy3 postgresql ossp-uuid

Alternately, you can install these packages manually:

• Python 3
• PyPy 3.5
• PostgreSQL
• uuid-ossp module

Set up Python virtualenv

Make sure pip and virtualenv are up to date:

pip3 install --upgrade pip
pip3 install --upgrade virtualenv

Check out source code using git:

cd ~
git clone https://github.com/vthorsteinsson/Reynir
cd ~/Reynir

Create and activate virtual environment, install required Python packages:

virtualenv -p /usr/local/bin/pypy3 venv
source venv/bin/activate
pip3 install -r requirements.txt

Set up database

Connect to PostgreSQL database:

psql

Create user (replace your_name with your username):

create user reynir with password 'reynir';
create user your_name;
alter role your_name with superuser;

Create database:

create database scraper with encoding 'UTF8' \
LC_COLLATE='is_IS.utf8' LC_CTYPE='is_IS.utf8' \
TEMPLATE=template0;

Enable uuid extension:

\c scraper
create extension if not exists "uuid-ossp";

Verify that the uuid extension is enabled:

select * from pg_extension;

and then \q to quit the postgres client.

Finally, create the database tables used by Greynir:

cd ~/Reynir
python scraper.py --init

Run

Change to the Reynir repo directory and activate the virtual environment:

cd ~/Reynir
venv/bin/activate

Web application

Defaults to running on localhost:5000 but this can be changed in config/Reynir.conf.

python main.py

Scrapers

python scraper.py

NB: Due to issues with Python's fork() in recent versions of macOS, you may need to run the following command first in for scraping to work:

export OBJC_DISABLE_INITIALIZE_FORK_SAFETY=YES

Interactive shell

./shell.sh

Starts an IPython shell with a database session (s), the Reynir parser (r) and all SQLAlchemy database models preloaded. For more info, see Using the Greynir Shell.