A simple webcrawler written in python
To run the crawler, you need to install networkx library for graph data structrure support. Do that by opening up the terminal and typing:
pip install networkx
To run it, type this in the terminal:
python main.py <the_targeted_url>
In the output.txt file you will get a list of all found website uri's found