dc.contributor.author | Dikaiakos, Marios D. | en |
dc.contributor.author | Stassopoulou, Athena | en |
dc.contributor.author | Papageorgiou, Loizos | en |
dc.contributor.editor | Quirchmayr G. | en |
dc.contributor.editor | Bauknecht K. | en |
dc.contributor.editor | Min Tjoa A. | en |
dc.creator | Dikaiakos, Marios D. | en |
dc.creator | Stassopoulou, Athena | en |
dc.creator | Papageorgiou, Loizos | en |
dc.date.accessioned | 2019-11-13T10:39:52Z | |
dc.date.available | 2019-11-13T10:39:52Z | |
dc.date.issued | 2003 | |
dc.identifier.issn | 0302-9743 | |
dc.identifier.uri | http://gnosis.library.ucy.ac.cy/handle/7/53845 | |
dc.description.abstract | In this paper, we present a study of crawler behavior based on Web-server access logs. To this end, we use logs from five different academic sites in three countries. Based on these logs, we analyze the activity of different crawlers that belong to five Search Engines: Google, AltaVista, Inktomi, FastSearch and CiteSeer. We compare crawler behavior to the characteristics of the general World-Wide Web traffic, and to general characterization studies based on Web-server access logs. We analyze crawler requests to derive insights into the behavior and strategy of crawlers. Our results and observations provide useful insights into crawler behavior and serve as basis of our ongoing work on the automatic detection of WWW robots. © Springer-Verlag Berlin Heidelberg 2003. | en |
dc.source | 4th International Conference on E-Commerce and Web Technology, EC-Web 2003 | en |
dc.source.uri | https://www.scopus.com/inward/record.uri?eid=2-s2.0-33947181188&doi=10.1007%2fb11826&partnerID=40&md5=e4dc28cbc988f543ce6d7dfe7b990828 | |
dc.subject | World Wide Web | en |
dc.subject | Search engines | en |
dc.subject | Characterization studies | en |
dc.subject | Web services | en |
dc.subject | Web servers | en |
dc.subject | Access log | en |
dc.subject | Automatic Detection | en |
dc.subject | Behavior-based | en |
dc.subject | CiteSeer | en |
dc.title | Characterizing crawler behavior from web server access logs | en |
dc.type | info:eu-repo/semantics/article | |
dc.identifier.doi | 10.1007/b11826 | |
dc.description.volume | 2738 | |
dc.description.startingpage | 369 | |
dc.description.endingpage | 378 | |
dc.author.faculty | 002 Σχολή Θετικών και Εφαρμοσμένων Επιστημών / Faculty of Pure and Applied Sciences | |
dc.author.department | Τμήμα Πληροφορικής / Department of Computer Science | |
dc.type.uhtype | Article | en |
dc.description.notes | <p>Sponsors: | en |
dc.description.notes | Conference code: 130649 | en |
dc.description.notes | Cited By :12</p> | en |
dc.source.abbreviation | Lect. Notes Comput. Sci. | en |
dc.contributor.orcid | Dikaiakos, Marios D. [0000-0002-4350-6058] | |
dc.gnosis.orcid | 0000-0002-4350-6058 | |