Our goal is to scrape all the Google Maps reviews from the stores of the WMF group.
To do so we decided to fork the "Google Maps Scraper" project. We chose it because it is quite fast, lightweight and completely automated. If you want to check out the original project go here.
Also, for more info on the forked project check out the original README file.
1️⃣ Download Node.js 18+. Follow instructions here.
2️⃣ Clone the repo:
git clone https://github.com/newnowgroup/google-maps-scraper.git
cd google-maps-scraper2️⃣ Create Conda environment 🐍:
conda env create --name google-maps-scraper python=3.10 pip
conda activate google-maps-scraper2️⃣ Install Dependencies 📦:
pip install -r requirements.txt3️⃣ Scrape the reviews:
python main.pyOnce the scraping process is complete, you can find your leads inside your OneDrive folder, in the wmf-reviews directory.