Browsing by Subject "Distributed crawling"
Now showing items 1-2 of 2
-
Conference Object
IPMicra: An IP-address based location aware distributed web crawler
(2004)Distributed crawling is able to overcome Important limitations of the traditional single-sourced web crawling systems. However, the optimal benefit of distributed crawling is usually limited to the sites hosting the crawlers, ...
-
Article
UCYMICRA: Distributed indexing of the web using migrating crawlers
(2003)Due to the tremendous increase rate and the high change frequency of Web documents, maintaining an up-to-date index for searching purposes (search engines) is becoming a challenge. The traditional crawling methods are no ...