 |
|
 |
|
|
|
The materials shown on this page are copyright protected by
their authors and/or respective institutions. |
|
|
|
|
On Bots - Binary Search Tree |
|
Author(s):
(unknown) |
Institution:
Drunk Men Work Here |
Year:
2006 |
URL:
http://drunkmenworkhere.org/219 |
Project Description:
2,147,483,647 web pages ('nodes') were numbered and arranged in a Binary Search Tree. For each page the traffic of the three major search bots (Yahoo! Slurp, Googlebot and msnbot) was monitored over a period of one year (between 2005-4-13 and 2006-4-13).
Each search engine's behavior was visualized as a tree image that represents which nodes were crawled. Each line in the image represents a node, the number of times a search bot visited the node determines the length of the line.
As part of the results, the authors found Yahoo! Slurp to be the most active search bot and the first search engine to discover the Binary Search Tree experiment. In the first hours after discovery it crawled the tree vigorously, at a speed of over 2.3 nodes per second. The image shown represents the resulting tree of Yahoo! Slurp crawling over 1 year.
|
|
|
|
|
|
|
|
|
Comments (0):
|
|
|
|
|
| *Note* Before you submit your comment, bear in mind there's no guarantee it will be seen by this project's author. In case you want to contact the author directly, please follow the provided URL. |
| Leave a Comment: |
|
|
|
* COMMENTS HAVE BEEN TEMPORARILY DISABLED *
(We're looking for the best solution to avoid unwanted SPAM)
|
|
