Prefetching in content distribution networks via Web communities identification and outsourcing
Date
2008Author
Sidiropoulos, Antonis![ORCID logo](https://orcid.org/sites/default/files/images/orcid_16x16.png)
Katsaros, Dimitrios S.
Stamos, Kostas
![ORCID logo](https://orcid.org/sites/default/files/images/orcid_16x16.png)
Manolopoulos, Yannis
ISSN
1386-145XSource
World Wide WebVolume
11Issue
1Pages
39-70Google Scholar check
Keyword(s):
Metadata
Show full item recordAbstract
Content distribution networks (CDNs) improve scalability and reliability, by replicating content to the "edge" of the Internet. Apart from the pure networking issues of the CDNs relevant to the establishment of the infrastructure, some very crucial data management issues must be resolved to exploit the full potential of CDNs to reduce the "last mile" latencies. A very important issue is the selection of the content to be prefetched to the CDN servers. All the approaches developed so far, assume the existence of adequate content popularity statistics to drive the prefetch decisions. Such information though, is not always available, or it is extremely volatile, turning such methods problematic. To address this issue, we develop self-adaptive techniques to select the outsourced content in a CDN infrastructure, which requires no apriori knowledge of request statistics. We identify clusters of "correlated" Web pages in a site, called Web site communities, and make these communities the basic outsourcing unit. Through a detailed simulation environment, using both real and synthetic data, we show that the proposed techniques are very robust and effective in reducing the user-perceived latency, performing very close to an unfeasible, off-line policy, which has full knowledge of the content popularity. © 2007 Springer Science+Business Media, LLC.