First Set of rules for haproxy-crs

Author: aarvee10

aws-ip-range.lst

@@ -0,0 +1,364 @@
+webmole
+wisenutbot
+prowebwalker
+hanzoweb
+email
+toata dragostea mea pentru diavola
+gameBoy, powered by nintendo
+missigua
+poe-component-client
+emailsiphon
+adsarobot
+under the rainbow 2.
+nessus
+floodgate
+email extractor
+webaltbot
+contactbot/
+butch__2.1.1
+pe 1.4
+indy library
+autoemailspider
+mozilla/3.mozilla/2.01
+fantombrowser
+digout4uagent
+panscient.com
+telesoft
+; widows
+converacrawler
+www.weblogs.com
+murzillo compatible
+isc systems irc search 2.1
+emailmagnet
+microsoft url control
+datacha0s
+emailwolf
+production bot
+sitesnagger
+webbandit
+web by mail
+faxobot
+grub crawler
+jakarta
+eirgrabber
+webemailextrac
+extractorpro
+attache
+educate search vxb
+8484 boston project
+franklin locator
+nokia-waptoolkit
+mailto:[email protected]
+full web bot
+pcbrowser
+psurf
+user-Agent
+pleasecrawl/1.
+kenjin spider
+gecko/25
+no browser
+webster pro
+wep Search 00
+grub-client
+fastlwspider
+this is an exploit
+contentsmartz
+teleport pro
+dts agent
+nikto
+morzilla
+via
+atomic_email_hunter
+program shareware 1.0.
+ecollector
+emailcollect
+china local browse 2.
+backdoor
+stress test
+foobar/
+emailreaper
+xmlrpc exploit
+compatible ; msie
+s.t.a.l.k.e.r.
+compatible-
+webvulnscan
+nameofagent
+copyrightcheck
+advanced email extractor
+surveybot
+compatible ;.
+searchbot admin@google
+wordpress/4.01
+webemailextract
+larbin@unspecified
+turing machine
+zeus
+windows-update-agent
+morfeus fucking scanner
+user-agent:
+voideye
+mosiac 1
+chinaclaw
+newt activeX; win32
+web downloader
+safexplorer tl
+[email protected]
+cheesebot
+hhjhj@yahoo
+fiddler
+psycheclone
+microsoft internet explorer/5.0
+core-project/1
+atspider
+copyguard
+neuralbot/0.2
+wordpress hash grabber
+amiga-aweb/3.4
+packrat
+rsync
+crescent internet toolpak
+security scan
+vadixbot
+concealed defense
+a href=
+bwh3_user_agent
+internet ninja
+microsoft url
+emailharvest
+shai
+wisebot
+internet exploiter sux
+wells search ii
+webroot
+digimarc webreader
+botversion
+black hole
+w3mir
+pmafind
+athens
+hl_ftien_spider
+ injection
+takeout
+eo browse
+cherrypicker
+internet-exprorer
+Baiduspider
+webmole
+wisenutbot
+prowebwalker
+hanzoweb
+email
+toata dragostea mea pentru diavola
+gameBoy, powered by nintendo
+missigua
+poe-component-client
+emailsiphon
+adsarobot
+under the rainbow 2.
+nessus
+floodgate
+email extractor
+webaltbot
+contactbot/
+butch__2.1.1
+pe 1.4
+indy library
+autoemailspider
+mozilla/3.mozilla/2.01
+fantombrowser
+digout4uagent
+panscient.com
+telesoft
+; widows
+converacrawler
+www.weblogs.com
+murzillo compatible
+isc systems irc search 2.1
+emailmagnet
+microsoft url control
+datacha0s
+emailwolf
+production bot
+sitesnagger
+webbandit
+web by mail
+faxobot
+grub crawler
+eirgrabber
+webemailextrac
+extractorpro
+attache
+educate search vxb
+8484 boston project
+franklin locator
+nokia-waptoolkit
+mailto:[email protected]
+full web bot
+pcbrowser
+psurf
+user-Agent
+pleasecrawl/1.
+kenjin spider
+gecko/2525
+no browser
+webster pro
+wep Search 00
+grub-client
+fastlwspider
+this is an exploit
+contentsmartz
+teleport pro
+dts agent
+nikto
+morzilla
+via
+atomic_email_hunter
+program shareware 1.0.
+ecollector
+emailcollect
+china local browse 2.
+backdoor
+stress test
+foobar/
+emailreaper
+xmlrpc exploit
+compatible ; msie
+s.t.a.l.k.e.r.
+compatible-
+webvulnscan
+nameofagent
+copyrightcheck
+advanced email extractor
+surveybot
+compatible ;.
+searchbot admin@google
+wordpress/4.01
+webemailextract
+larbin@unspecified
+turing machine
+zeus
+windows-update-agent
+morfeus fucking scanner
+user-agent:
+voideye
+mosiac 1
+chinaclaw
+newt activeX; win32
+web downloader
+safexplorer tl
+[email protected]
+cheesebot
+hhjhj@yahoo
+fiddler
+psycheclone
+microsoft internet explorer/5.0
+core-project/1
+atspider
+copyguard
+neuralbot/0.2
+wordpress hash grabber
+amiga-aweb/3.4
+packrat
+rsync
+crescent internet toolpak
+security scan
+vadixbot
+concealed defense
+a href=
+bwh3_user_agent
+internet ninja
+microsoft url
+emailharvest
+shai
+wisebot
+internet exploiter sux
+wells search ii
+webroot
+digimarc webreader
+botversion
+black hole
+w3mir
+pmafind
+athens
+hl_ftien_spider
+ injection
+takeout
+eo browse
+cherrypicker
+internet-exprorer
+Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
+Mozilla/5.0 (compatible; YandexBot/3.0; +http://yandex.com/bots)
+Sogou Pic Spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07)
+Sogou head spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07) 
+Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) 
+Sogou Orion spider/3.0( http://www.sogou.com/docs/help/webmasters.htm#07) 
+Sogou-Test-Spider/4.0 (compatible; MSIE 5.5; Windows 98)
+Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbnails)
+Mozilla/5.0 (compatible; Exabot/3.0; +http://www.exabot.com/go/robot)
+#CRAWLER
+Mozilla/5.0 (compatible; TweetmemeBot/2.11; +http://tweetmeme.com/)
+adidxbot/1.1 (+http://search.msn.com/msnbot.htm)
+adidxbot/2.0 (+http://search.msn.com/msnbot.htm)
+Mozilla/5.0 (compatible; Konqueror/3.5; Linux) KHTML/3.5.5 (like Gecko) (Exabot-Thumbn
+Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)
+Mozilla/5.0 (compatible; JikeSpider; +http://www.jike.com/spider.html)
+UnwindFetchor/1.0 (+http://www.gnip.com/)
+Updownerbot (+http://www.updowner.com/bot)
+Mozilla/5.0 (compatible; archive.org_bot +http://www.archive.org/details/archive.org_bot)
+tra.cx.pider (+http://tra.cx/help/tra.cx.pider)
+Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.1)
+Mozilla/5.0 (compatible; Evrinid Iudex 2.0.0; +http://www.evri.com/evrinid)
+Mozilla/5.0 (compatible; NetSeer crawler/2.0; +http://www.netseer.com/crawler.html; [email protected])
+Mozilla/5.0 (compatible; CareerBot/1.1; +http://www.career-x.de/bot.html)
+Mozilla/5.0 (compatible; AhrefsBot/3.1; +http://ahrefs.com/robot/
+Mozilla/5.0 (compatible; GrapeshotCrawler/2.0; +http://www.grapeshot.co.uk/crawler.php)
+Mozilla/5.0 (compatible; grapeFX/0.9; [email protected]
+findlinks/2.0.2 (+http://wortschatz.uni-leipzig.de/findlinks/)
+findlinks/2.6 (+http://wortschatz.uni-leipzig.de/findlinks/)
+Pixray-Seeker/2.0 (Pixray-Seeker; +http://www.pixray.com/pixraybot; [email protected]
+Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1) Gecko/20021204
+Mozilla/5.0 (Java) outbrain
+ExB Language Crawler 2.0 (+http://www.exb.de/)
+ExB Language Crawler 2.0 (+http://www.exb.de/crawler)
+Moreoverbot/5.1 (+http://www.moreover.com; [email protected]) Mozilla/5.0
+Mozilla/5.0 Moreover/5.1 (+http://www.moreover.com; [email protected])
+Mozilla/5.0 (compatible; WBSearchBot/1.1; +http://www.warebay.com/bot.html)
+Mozilla/5.0 (compatible; rogerBot/1.0; UrlCrawler; http://www.seomoz.org/dp/rogerbot)
+techmixx Spider v1 (http://techmixx.com/)
+userAgent=artmixx Spider v1 (http://artmixx.com/)
+#BOT
+Mozilla/5.0 (compatible; Mail.RU/2.0)
+">Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
+Mozilla/5.0 (compatible; discobot-news; +http://discoveryengine.com/discobot.html)
+Mozilla/5.0 (compatible; discobot/2.0; +http://discoveryengine.com/discobot.html)
+SeznamBot/3.0 (+http://fulltext.sblog.cz/)
+Mozilla/5.0 (compatible; Butterfly/1.0; +http://labs.topsy.com/butterfly/) Gecko/2009032608 Firefox/3.0.8
+ia_archiver (+http://www.alexa.com/site/help/webmasters; [email protected])
+Sosospider+(+http://help.soso.com/webspider.htm)
+Mozilla/5.0 (compatible; Sosoimagespider/2.0; +http://help.soso.com/soso-image-spider.htm)
+Mozilla/5.0 (compatible; MJ12bot/v1.4.3; http://www.majestic12.co.uk/bot.php?+)
+Mozilla/5.0 (compatible; YandexAntivirus/2.0; +http://yandex.com/bots)
+Mozilla/5.0 (compatible; YandexDirect/3.0; +http://yandex.com/bots)
+Mozilla/4.0 (compatible; Netcraft Web Server Survey)
+Voyager/1.0
+Mozilla/5.0 (Windows; U; Windows NT 5.1; en; rv:1.9.0.13) Gecko/2009073022 Firefox/3.5.2 (.NET CLR 3.5.30729) SurveyBot/2.3 (DomainTools)
+Mozilla/5.0 (compatible; AcoonBot/4.11.1; +http://www.acoon.de/robot.asp)
+Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search
+Mozilla/5.0 (Linux;u;Android 2.3.7;zh-cn;) AppleWebKit/533.1 (KHTML,like Gecko) Version/4.0 Mobile Safari/533.1 (compatible; +http://www.baidu.com/search/spider.html)
+Mozilla/5.0 (Windows; U; Windows NT 5.1; zh-CN; rv:1.9.2.8;baidu Transcoder) Gecko/20100722 Firefox/3.6.8 ( .NET CLR 3.5.30729)
+Mozilla/4.0 (compatible; MSIE 6.0; Windows NT 5.0; baidu Transcoder;)
+Baiduspider-image+(+http://www.baidu.com/search/spider.htm)
+Baiduspider+(+http://www.baidu.com/search/spider.htm)
+Mozilla/5.0 (compatible; Baiduspider/2.0; +http://www.baidu.com/search/spider.html)
+DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo; +http://search.goo.ne.jp/option/use/sub4/sub4-1/)
+omgilibot/0.3 +http://www.omgili.com/Crawler.html
+psbot/0.1 (+http://www.picsearch.com/bot.html)
+Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
+Mozilla/5.0 (compatible; Blekkobot; ScoutJet; +http://blekko.com/about/blekkobot)
+Mozilla/5.0 (compatible; BountiiBot/1.1; +http://bountii.com/contact.php)
+Mozilla/5.0 (compatible; YRSpider; +http://www.yunyun.com/SiteInfo.php?r=about)
+Mozilla/5.0 (X11; U; Linux i686; en-US; rv:1.2.1) Gecko/20021204
+Mozilla/5.0 (compatible; OpenindexSpider; +http://www.openindex.io/en/webmasters/spider.html
+User-Agent
+FatBot
+linkdexbot