Skip to content

joffemd/googleScraper

 
 

Repository files navigation

Scraping Google Starter Script

Simple script to scrape Google using requests and bs4.

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.

Prerequisites

Python3+

https://www.python.org/downloads/

Installing

# clone repo
git clone https://github.com/getlinksc/scrape_google.git
# install requirements after changing directory to scrape_google
pip install -r requirements.txt
# modify query in search.py and run script
python writeToExcel.py
  • Python3 - Python is a programming language that lets you work quickly and integrate systems more effectively.
  • Pip - The Python Package Installer
  • Requests - HTTP for Humans
  • Beautiful Soup - a Python library for pulling data out of HTML and XML files
  • Google Search API - an API for scraping Google search results

Contributing

Versioning

Authors

License

Acknowledgments

About

Scrapes google search results to find government website

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 100.0%