We can run these as batch jobs to save time!
ssh [email protected]
git clone https://github.com/TheStanfordDaily/archives.git
cd archives
nvm use 10
npm i
mkdir slurm_logs
YEAR_START=1892 sbatch --array=0-122 slurm-script.sh
ssh [email protected]
sacct -u ashwin99 | grep RUNNING | wc -l # 512
squeue -u ashwin99 | wc -l # 259
tail -f slurm_logs/1479134.log
Once you're done, do the following:
cd output
git init
git add -A
git remote add https://github.com/TheStanfordDaily/archives-text.git
git commit -m "commit"
git checkout -b fixed-text
git push origin fixed-text