Browsing by Subject "Crawlers"
Now showing items 1-1 of 1
-
Article
An investigation of web crawler behavior: Characterization and metrics
(2005)In this paper, we present a characterization study of search-engine crawlers. For the purposes of our work, we use Web-server access logs from five academic sites in three different countries. Based on these logs, we analyze ...