Family Genealogy - Site Notes
   

TNG Traffic Analysis - User Agents

 

The User Agent is the browser or bot that accesses a web site. The agent is identified by a text string in the HTTP request, and includes version and operating system details. This analysis is for agents accessing these TNG web sites by PHP requests for the last 5 months (Jan-May 2020).

 

There were 1462 unique agent strings seen (Table 1). When major types are grouped together, there were 105. The Bots were the most frequent individual requesters as expected. The high count for "Linux; Android" suggests a Bot or hacker rather than human access. "

 

The Knowledge AI, MegaIndex, and Seekport Crawler seem the have a monthly schedule. MegaIndex and Seekport have very consistent request quantities. All three do their entire scan in just 2 to 5 days. They all use the same IP address for each scan burst.

 

 Bing Bot" is steady day after day, and month after month, and also Google but much slower. All others are trivial and inconsistent. Bing and Google bots both use a large range of IP addresses.

 

As for regular user access, Windows browsers were highest as expected. And iPad access is higher than I expected. Note that users have much higher request counts, probably because they request all the icons and images.

 

Table 1 - Agents All TNG Jan Feb Mar Apr May
The Knowledge AI 107,559 106,633 2 1,649 35,053 218 69,711
MegaIndex 96,595 95,411 0 31,805 31,802 0 31,804
Seekport Crawler 77,010 75,904 24,705 896 24,703 897 24,703
Bing Bot 93,991 74,509 11,488 17,258 20,061 13,938 11,764
Linux; Android 89.316 72,990 2,913 12,734 17,365 15,479 24,499
Serpstat Bot 10,396 10,151 0 200 0 0 9,995
Windows; Firefox 17,209 8,897          
iPad; All 10,411 5,991          
Windows; Safari 37,832 5,245          
Windows Trident (IE 11?) 60,045 3,919          
Macintosh; Safari 19,646 3,484
Unspecified 3,758 3,380          
Turnit Bot 2,721 2,577 0 0 0 0 2,577
Google Bot 4,172 1,539 829 281 93 82 254
X11; Firefox (Linux?) 3,216 1,465          
Macintosh; Firefox 4,149 1,384          
iPhone; All 9,788 1,096          
X11; Safari 4,397 1,081          
Opera 930 930          
netEstate NE Crawler 1,041 918 0 918 0 0 0
MS IE (Windows 7 and lower) 1,614 974          
CC Bot 775 651 302 145 4 145 55
Search Atlas SEO Crawler 726 438 0 0 438 0 0
Others: All ( 309) TNG  (79) 16,323 2,200          
Total 678,837 482,089

 

.

Page modified: 21 Jun 2020 19:18:20 -0700

Back to Top Send comments or questions to Contact Us. Home Page