User-Agent Lists

Sometimes you need change the User-Agent string used when making alot of requests to the same server(s) often.

• Research Purposes ONLY

That can be a hard thing to do if you only know a handful of user agents.

Not to mention building your own comprehensive list of user agent strings takes time.

In the spirit of the rfc.bib project, this project aims to make a comprehensive set of User-Agent string lists available for all to use.

Usage

Download a list today free of charge

OR

Generate the lists yourself (Requires python 3.5)

• [sudo] pip install -r requirements.txt
• python useragents.py --all

For more options execute python useragents.py --help

List Info

Origins

The User-Agent lists made available by this repo come from

• user-agents.org: ua_org_allagents.(csv|json)
• techpatterns.com: techpatterns_com_useragentswitcher.(csv|json)
• developers.whatismybrowser.com: [browser].(csv|json)

Flavors

All list provided by this repo come in two flavors namely csv and json.

Both flavors can be found in a directory of same name and both flavors share the same "keys".

Keys

ua_org_allagents.(csv|json)

• description: The name of the browser/bot/etc using the User-Agent string
• ua: The User-Agent string

techpatterns_com_useragentswitcher.(csv|json)

• kind: Is the userof the User-Agent string a browser, mobile, spider
• description: Name version (os) for the user of the User-Agent string
• ua: The User-Agent string

[browser].(csv|json)

• ua: The User-Agent string
• version: The version of the browser using the User-Agent string
• commonality: How common is this User-Agent string

User-Agents Included By Each List

ua_org_allagents.(csv|json) provides 2460 User-Agent strings comprised of

• Web Crawlers / Robots
• Browsers (Older)
• Tools (Curl, etc)
• Scanners

techpatterns_com_useragentswitcher.(csv|json) provides 830 User-Agent strings comprised of

• Browsers - Windows
• Browsers - Mac
• Browsers - Linux, Browsers - Unix
• Mobile Devices
• Spiders
• Miscellaneous

[browser].(csv|json) provides 1501 User-Agent strings specific to a browser

• chrome
• firefox
• safari
• opera
• internet-explorer
• android

User-Agents Included By Each List (patched by pankaj)

>>> from uagents import UserAgents
>>> firefox_ua = UserAgents(profile='firefox')
>>> chrome_ua = UserAgents(profile='chrome')
>>> firefox_ua.return_ua()
'Mozilla/5.0 (Windows NT 5.1; rv:7.0.1) Gecko/20100101 Firefox/7.0.1'
>>> chrome_ua.return_ua()
'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/60.0.3112.113 Safari/537.36'
>>> 

License

MIT