Skip to content
#

useragents

Here are 29 public repositories matching this topic...

Processes XML sitemaps and extracts URLs. Includes features such as support for both plain XML and compressed XML files, multiple input sources, protection against anti-bot measures, multi-threading, and automatic processing of nested sitemaps.

  • Updated Sep 9, 2025
  • Python
UserAgentLookup

This is the initial build of script using proxy rotating, user agents and other techniques to stay anonymous. I know this is the not professional script but will be useful for moderate scraping.

  • Updated Feb 15, 2023
  • Python

Improve this page

Add a description, image, and links to the useragents topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the useragents topic, visit your repo's landing page and select "manage topics."

Learn more