Skip to content

Files

Latest commit

9ef0431 · Mar 7, 2024

History

History

web-scrapper

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Mar 7, 2024
Mar 7, 2024

Project 5: Web Scraper 🕸️

Overview

This Python program is a basic web scraper that extracts information from a website. It utilizes the BeautifulSoup and requests libraries to retrieve and parse HTML data.

Features

  • Fetches and displays information from a specified website.
  • Utilizes the BeautifulSoup library for HTML parsing.
  • Requires the requests library to make HTTP requests.

How to Run 🚀

  1. Clone the repository:

    git clone https://github.com/shashankatthaluri/10_Basic_python_projects/web-scrapper.git

Navigate to the project directory:

cd web-scrapper

Install the required libraries:

pip install beautifulsoup4 requests

Run the Python script:

python web_scrapper.py

Follow the prompts to specify the website URL and see the extracted information.

Example

$ python web_scrapper.py

Enter the URL of the website to scrape: https://example.com

Fetching data from https://example.com...

Extracted Information:
- Title: Example Domain
- Paragraphs:
  1. This domain is established to be used for illustrative examples in documents.
  2. You may use this domain in examples without prior coordination or asking for permission.