This repository contains code for a project that utilizes Crew AI to search for news articles, fetch their full text, summarize the articles, and extract keywords.
The project consists of the following components:
- Agents: Agents are responsible for specific tasks such as searching for news articles, fetching full text, summarizing articles, and extracting keywords.
- Tasks: Tasks represent the specific actions to be performed by agents.
- Data Processing: The code includes functions to process the fetched news articles, format them, and save the results to a JSON file.
- agents.py: Defines the agents responsible for various tasks.
- tasks.py: Defines the tasks to be performed by the agents.
- news_summary.ipynb: Jupyter Notebook containing the main code for the project.
- .gitignore: Specifies files and directories to be ignored by Git.
- README.md: This file, providing an overview of the project.
To use the project:
- Install the required dependencies using
pip install -r requirements.txt
. - Set up necessary environment variables or secrets.
- Run the
news_summary.ipynb
notebook to execute the code and perform the news summary task.
- crewai: Python library for building AI-powered workflows.
- langchain-groq: Python library for using Groq language model.
- duckduckgo-search: Python library for searching DuckDuckGo.
Contributions are welcome! If you have any suggestions, bug fixes, or enhancements, feel free to open an issue or submit a pull request.