Skip to content

Latest commit

 

History

History
7 lines (6 loc) · 183 Bytes

README.md

File metadata and controls

7 lines (6 loc) · 183 Bytes

Spider

This is a multi-threaded website crawler written in Python 3.

To Run the Crawler:

  1. Change constants PROJECT_NAME and HOMEPAGE in main.py
  2. Run python(3) main.py