Skip to content

Commit 422432a

Browse files
committed
[Pattern] Pattern updates
1 parent 40e4c7d commit 422432a

File tree

6 files changed

+25
-8
lines changed

6 files changed

+25
-8
lines changed

Diff for: CHANGELOG.md

+4
Original file line numberDiff line numberDiff line change
@@ -1,5 +1,9 @@
11
# Changelog
22

3+
## [5.1.11](https://github.com/omrilotan/isbot/compare/v5.1.10...v5.1.11)
4+
5+
- [Pattern] Pattern updates
6+
37
## [5.1.10](https://github.com/omrilotan/isbot/compare/v5.1.9...v5.1.10)
48

59
- [Pattern] Pattern updates

Diff for: fixtures/downloaded/downloaded

+1-1
Original file line numberDiff line numberDiff line change
@@ -1 +1 @@
1-
Mon, 24 Jun 2024 10:32:10 GMT
1+
Wed, 26 Jun 2024 12:40:55 GMT

Diff for: fixtures/downloaded/matomo-org.json

+7-1
Original file line numberDiff line numberDiff line change
@@ -719,6 +719,7 @@
719719
"Magellan",
720720
"Mozilla/5.0 (compatible; WebwikiBot/2.1; +https://www.webwiki.co.uk)",
721721
"phpMyAdmin",
722+
"phpMyAdmin/reporting-script",
722723
"Trackable/0.1 NNjCeA",
723724
"Matomo/4.15.1",
724725
"CustomUserAgent/1.0",
@@ -956,5 +957,10 @@
956957
"Mozilla/5.0 (compatible; Cloudflare-Smart-Transit/1.0; +https://www.cloudflare.com/",
957958
"Mozilla/5.0 (Linux; Android 11; Moto G Power (2022)) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Mobile Safari/537.36 CloudflareObservatory/1.0",
958959
"Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/109.0.0.0 Safari/537.36 CloudflareObservatory/1.0",
959-
"Mozilla/4.0 (compatible; DepSpid/5.07; +http://about.depspid.net)"
960+
"Mozilla/4.0 (compatible; DepSpid/5.07; +http://about.depspid.net)",
961+
"GlobalWebSearch",
962+
"acme.sectigo.com/v2/DV",
963+
"acme.sectigo.com/v2/OV",
964+
"acme.sectigo.com/v2/EV",
965+
"Mozilla/5.0 (compatible; Website-info.net-Robot; https://website-info.net/robot)"
960966
]

Diff for: fixtures/downloaded/myip.ms.json

+11-5
Original file line numberDiff line numberDiff line change
@@ -498,13 +498,13 @@
498498
"Mozilla/5.0 (Linux; Android 5.1; CUBOT_NOTE_S Build/LMY47I) AppleWebKit/537.36 (KHTML, like Gecko) Version/4.0 Chrome/39.0.0.0 Mobile Safari/537.36",
499499
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/106.0.5249.91 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
500500
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/116.0.5845.140 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
501+
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.6422.175 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
501502
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/27.0.1453 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
502503
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/77.0.3865.99 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
503504
"Mozilla/5.0 (compatible; heritrix/3.1.2-SNAPSHOT-20131029-0036 +http://archive.org/details/archive.orgbot)",
504505
"Mozilla/5.0 (compatible; Yeti/1.1; +https://naver.me/spd)",
505506
"Mozilla/5.0 (iPhone; CPU iPhone OS 83 like Mac OS X) AppleWebKit/537.36 (KHTML like Gecko) Version/8.0 Mobile/12F70 Safari/600.1.4 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
506507
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.88 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
507-
"Mozilla/5.0 (Linux; Android 6.0.1; Nexus 5X Build/MMB29P) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.6422.175 Mobile Safari/537.36 (compatible; Googlebot/2.1; +http://www.google.com/bot.html)",
508508
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/97.0.4692.71 Safari/537.36",
509509
"SocialRankIOBot; http://socialrank.io/about",
510510
"GoogleProducer; (+http://goo.gl/7y4SX)",
@@ -640,6 +640,7 @@
640640
"admantx-euastn/2.5 (+http://www.admantx.com/service-fetcher.html)",
641641
"annotategoogle; http://ponderer.org/download/annotategoogle.user.js",
642642
"Barkrowler/0.5.1 (experimenting / debugging - sorry for your logs ) http://www.exensa.com/crawl - [email protected] -- based on BuBiNG",
643+
"colly - https://github.com/gocolly/colly/v2",
643644
"Mozilla/5.0 (compatible; Baiduspider-cpro; +http://www.baidu.com/search/spider.html)",
644645
"Mozilla/5.0 (compatible; JikeSpider; +http://shoulu.jike.com/spider.html)",
645646
"Mozilla/5.0 (compatible; Yeti/1.1; +http://help.naver.com/support/robots.html)",
@@ -658,7 +659,6 @@
658659
"AdsBot-Google-Mobile (+http://www.google.com/mobile/adsbot.html) Mozilla (iPhone; U; CPU iPhone OS 3 0 like Mac OS X) AppleWebKit (KHTML like Gecko) Mobile Safari",
659660
"Barkrowler/0.9 (+http://www.exensa.com/crawl)",
660661
"CCBot/1.0 (+http://www.commoncrawl.org/bot.html)",
661-
"colly - https://github.com/gocolly/colly/v2",
662662
"CRAZYWEBCRAWLER 0.9.10 http://www.crazywebcrawler.com",
663663
"CRAZYWEBCRAWLER 0.9.6 http://www.crazywebcrawler.com",
664664
"DomainCrawler/3.0 ([email protected]; http://www.domaincrawler.com/whatmyip.co)",
@@ -999,6 +999,7 @@
999999
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/117.0.5938.88 Safari/537.36",
10001000
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/117.0.5938.92 Safari/537.36",
10011001
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/89.0.4389.127 Safari/537.36",
1002+
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)",
10021003
"My Nutch Spider/Nutch-1.6",
10031004
"Re-re Studio (+http://re-re.ru/)",
10041005
"SemrushBot",
@@ -1054,7 +1055,6 @@
10541055
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/81.0.4044.108 Safari/537.36",
10551056
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/89.0.4389.84 Safari/537.36",
10561057
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; Googlebot/2.1; +http://www.google.com/bot.html) Chrome/96.0.4664.93 Safari/537.36",
1057-
"Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; GPTBot/1.2; +https://openai.com/gptbot)",
10581058
"MSNbot",
10591059
"niki-bot",
10601060
"omgili/0.5 +http://omgili.com",
@@ -1359,6 +1359,7 @@
13591359
"Mozilla/5.0 (compatible; PaperLiBot/2.1; https://support.paper.li/entries/20023257-what-is-paper-li)",
13601360
"Mozilla/5.0 (compatible; Pinterestbot/1.0; +http://www.pinterest.com/bot.html)",
13611361
"Mozilla/5.0 (compatible; Scopia Crawler 1.2; +http://www.scopia.co)",
1362+
"Mozilla/5.0 (compatible; SemrushBot-SWA/0.1; +http://www.semrush.com/bot.html)",
13621363
"Mozilla/5.0 (compatible; SemrushBot/0.97bl; +http://www.semrush.com/bot.html)",
13631364
"Mozilla/5.0 (compatible; SemrushBot/0.99bl; +http://www.semrush.com/bot.html)",
13641365
"Mozilla/5.0 (compatible; SEOkicks-Robot +http://www.seokicks.de/robot.html)",
@@ -1535,7 +1536,6 @@
15351536
"Mozilla/5.0 (compatible; Qwantify/vR; +https://www.qwant.com/)",
15361537
"Mozilla/5.0 (compatible; rogerBot/1.0; UrlCrawler; http://www.seomoz.org/dp/rogerbot)",
15371538
"Mozilla/5.0 (compatible; SemrushBot-SA/0.97; +http://www.semrush.com/bot.html)",
1538-
"Mozilla/5.0 (compatible; SemrushBot-SWA/0.1; +http://www.semrush.com/bot.html)",
15391539
"Mozilla/5.0 (compatible; SemrushBot/1.2~bl; http://www.semrush.com/bot.html)",
15401540
"Mozilla/5.0 (compatible; SemrushBot; +http",
15411541
"Mozilla/5.0 (compatible; SeznamBot/3.2-test1; +http://fulltext.sblog.cz/)",
@@ -2201,6 +2201,7 @@
22012201
"IABot: Checking if link from Wikipedia is broken and needs removal - See https://meta.wikimedia.org/wiki/InternetArchiveBot/FAQ_for_sysadmins",
22022202
"IAS crawler (page scorer; http://integralads.com/site-indexing-policy/)",
22032203
"ias-jp/3.1 (+https://www.admantx.com/service-fetcher.html)",
2204+
"ias-or/3.3 (former https://www.admantx.com + https://integralads.com/about-ias/)",
22042205
"ICC-Crawler/2.0 (Mozilla-compatible; ; http://kc.nict.go.jp/project1/crawl.html)",
22052206
"ICC-Crawler/2.0 (Mozilla-compatible; ; http://www.nict.go.jp/en/univ-com/plan/crawl.html)",
22062207
"Iframely/0.8.6 (+http://iframely.com/;)",
@@ -2776,7 +2777,6 @@
27762777
"HTTP_Request2/2.3.0 (http://pear.php.net/package/http_request2) PHP/7.0.32-0ubuntu0.16.04.1",
27772778
"HybridBot (hybrid.ru/about. If our bot caused problems please contact us. Contact email: [email protected])",
27782779
"ias-au/3.1 (+https://www.admantx.com/service-fetcher.html)",
2779-
"ias-or/3.3 (former https://www.admantx.com + https://integralads.com/about-ias/)",
27802780
"ICC-Crawler/2.0 (Mozilla-compatible; ; http://ucri.nict.go.jp/en/icccrawler.html)",
27812781
"Iframely/1.3.1 (+https://iframely.com/docs/about) Notion",
27822782
"Is is up? (+https://isitup.org)",
@@ -2828,6 +2828,7 @@
28282828
"Mozilla/5.0 (compatible; KZ BRAIN Mobile; http://servermobile.net) @124.146.175.4",
28292829
"Mozilla/5.0 (compatible; LinkpadBot/2.3; +http://linkpad.org/robot/)",
28302830
"Mozilla/5.0 (compatible; Linux x86_64; Mail.RU_Bot/Img/2.0; +https://help.mail.ru/webmaster/indexing/robots)",
2831+
"Mozilla/5.0 (compatible; Linux; AGAKIDSBOT/3.1 +agakids.ru/project) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/124.0.0.0 Safari/537.36",
28312832
"Mozilla/5.0 (compatible; MJ12bot/v1.2.1; http://www.majestic12.co.uk/bot.php?+)",
28322833
"Mozilla/5.0 (compatible; MJ12bot/v1.4.0; http://www.majestic12.co.uk/bot.php?+)",
28332834
"Mozilla/5.0 (compatible; MojeekBot/0.11; +https://www.mojeek.com/bot.html)",
@@ -3541,6 +3542,11 @@
35413542
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) cnv.aws-prod---sieve.hlfs-rest_client/1718785656-0",
35423543
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) cnv.aws-prod---sieve.hlfs-rest_client/1718790668-0",
35433544
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) cnv.aws-prod---sieve.hlfs-rest_client/1718834075-0",
3545+
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) cnv.aws-prod---sieve.hlfs-rest_client/1719230533-0",
3546+
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) cnv.aws-prod---sieve.hlfs-rest_client/1719236756-0",
3547+
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) cnv.aws-prod---sieve.hlfs-rest_client/1719240581-0",
3548+
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) cnv.aws-prod---sieve.hlfs-rest_client/1719259503-0",
3549+
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) cnv.aws-prod---sieve.hlfs-rest_client/1719318807-0",
35443550
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) tands-prod-eng.hlfs-prod---sieve.hlfs-desktop/1603028876-0",
35453551
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) tands-prod-eng.hlfs-prod---sieve.hlfs-desktop/1603256091-0",
35463552
"Mozilla/5.0 (compatible; Yahoo Ad monitoring; https://help.yahoo.com/kb/yahoo-ad-monitoring-SLN24857.html) tands-prod-eng.hlfs-prod---sieve.hlfs-desktop/1603374815-0",

Diff for: package.json

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
{
22
"name": "isbot",
3-
"version": "5.1.10",
3+
"version": "5.1.11",
44
"description": "🤖/👨‍🦰 Recognise bots/crawlers/spiders using the user agent string.",
55
"keywords": [
66
"bot",

Diff for: src/patterns.json

+1
Original file line numberDiff line numberDiff line change
@@ -76,6 +76,7 @@
7676
"^zdm/\\d",
7777
"^zoom marketplace/",
7878
"^{{.*}}$",
79+
"admin",
7980
"analyzer",
8081
"archive",
8182
"ask jeeves/teoma",

0 commit comments

Comments
 (0)