Browsing by Subject "Web crawlers"

Now showing items 1-3 of 3

    • Article  

      Information retrieval techniques for peer-to-peer networks 

      Zeinalipour-Yazdi, Constantinos D.; Kalogeraki, Vana; Gunopulos, Dimitrios (2004)
      An important challenge in peer-to-peer (P2P) networks is to efficiently search the contents of other peers. The authors survey existing search techniques for information retrieval in P2P networks, including recent techniques ...
    • Article  

      An investigation of web crawler behavior: Characterization and metrics 

      Dikaiakos, Marios D.; Stassopoulou, Athena; Papageorgiou, Loizos (2005)
      In this paper, we present a characterization study of search-engine crawlers. For the purposes of our work, we use Web-server access logs from five academic sites in three different countries. Based on these logs, we analyze ...
    • Conference Object  

      Real-time web crawler detection 

      Balla, A.; Stassopoulou, Athena; Dikaiakos, Marios D. (2011)
      In this paper we present a methodology for detecting web crawlers in real time. We use decision trees to classify requests in real time, as originating from a crawler or human, while their session is ongoing. For this ...