Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The webscraper is not able to scrape next page. #4

Open
vignesh1507 opened this issue Oct 15, 2024 · 0 comments
Open

The webscraper is not able to scrape next page. #4

vignesh1507 opened this issue Oct 15, 2024 · 0 comments
Labels
good first issue Good for newcomers help wanted Extra attention is needed

Comments

@vignesh1507
Copy link
Owner

The scraping code which i have written using python language, in that i have used both selenium and beautifulsoup (bs4) modules/libraries to scrape the content from websites but the problem with application is its not able to scrape the next page in the website.

For example: there are 12 pages in a single website the application is only scraping the first page and its not moving forward to the next page, i have tried using multiple techniques like pagination, using next page's xpath in the code etc.
@vignesh1507 vignesh1507 added help wanted Extra attention is needed good first issue Good for newcomers labels Oct 15, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
good first issue Good for newcomers help wanted Extra attention is needed
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@vignesh1507