Skip to content

Files

Latest commit

author
ym2011
Mar 18, 2020
a60bb66 · Mar 18, 2020

History

History

User Agents

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
Mar 18, 2020
Jun 16, 2019
Jun 16, 2019
Jun 16, 2019
Jun 16, 2019
Jun 16, 2019
Jun 16, 2019
Jun 16, 2019

User-Agent Lists

Sometimes you need change the User-Agent string used when making alot of requests to the same server(s) often.

  • Research Purposes ONLY

That can be a hard thing to do if you only know a handful of user agents.

Not to mention building your own comprehensive list of user agent strings takes time.

In the spirit of the rfc.bib project, this project aims to make a comprehensive set of User-Agent string lists available for all to use.

Usage

Download a list today free of charge

OR

Generate the lists yourself (Requires python 3.5)

  • [sudo] pip install -r requirements.txt
  • python useragents.py --all

For more options execute python useragents.py --help

List Info

Origins

The User-Agent lists made available by this repo come from

Flavors

All list provided by this repo come in two flavors namely csv and json.

Both flavors can be found in a directory of same name and both flavors share the same "keys".

Keys

ua_org_allagents.(csv|json)

  • description: The name of the browser/bot/etc using the User-Agent string
  • ua: The User-Agent string

techpatterns_com_useragentswitcher.(csv|json)

  • kind: Is the userof the User-Agent string a browser, mobile, spider
  • description: Name version (os) for the user of the User-Agent string
  • ua: The User-Agent string

[browser].(csv|json)

  • ua: The User-Agent string
  • version: The version of the browser using the User-Agent string
  • commonality: How common is this User-Agent string

User-Agents Included By Each List

ua_org_allagents.(csv|json) provides 2460 User-Agent strings comprised of

  • Web Crawlers / Robots
  • Browsers (Older)
  • Tools (Curl, etc)
  • Scanners

techpatterns_com_useragentswitcher.(csv|json) provides 830 User-Agent strings comprised of

  • Browsers - Windows
  • Browsers - Mac
  • Browsers - Linux, Browsers - Unix
  • Mobile Devices
  • Spiders
  • Miscellaneous

[browser].(csv|json) provides 1501 User-Agent strings specific to a browser

  • chrome
  • firefox
  • safari
  • opera
  • internet-explorer
  • android

License

MIT