Browsing by Subject "Web crawlers"
Now showing items 1-3 of 3
(2004)An important challenge in peer-to-peer (P2P) networks is to efficiently search the contents of other peers. The authors survey existing search techniques for information retrieval in P2P networks, including recent techniques ...
(2005)In this paper, we present a characterization study of search-engine crawlers. For the purposes of our work, we use Web-server access logs from five academic sites in three different countries. Based on these logs, we analyze ...
(2011)In this paper we present a methodology for detecting web crawlers in real time. We use decision trees to classify requests in real time, as originating from a crawler or human, while their session is ongoing. For this ...