scispace - formally typeset
Proceedings ArticleDOI

A scalable system for consistently caching dynamic Web data

Jim Challenger, +2 more
- Vol. 1, pp 294-303
Reads0
Chats0
TLDR
This paper presents a new approach for consistently caching dynamic Web data in order to improve performance and was a critical component at the official Web site for the 1998 Olympic Winter Games by using data update propagation (DUP), maintains data dependence information between cached objects and the underlying data which affect their values in a graph.
Abstract
This paper presents a new approach for consistently caching dynamic Web data in order to improve performance. Our algorithm, which we call data update propagation (DUP), maintains data dependence information between cached objects and the underlying data which affect their values in a graph. When the system becomes aware of a change to underlying data, graph traversal algorithms are applied to determine which cached objects are affected by the change. Cached objects which are found to be highly obsolete are then either invalidated or updated. The DUP was a critical component at the official Web site for the 1998 Olympic Winter Games. By using DUP, we were able to achieve cache hit rates close to 100% compared with 80% for an earlier version of our system which did not employ DUP. As a result of the high cache hit rates, the Olympic Games Web site was able to serve data quickly even during peak request periods.

read more

Citations
More filters
Journal ArticleDOI

A survey of web caching schemes for the Internet

TL;DR: This paper first describes the elements of a Web caching system and its desirable properties, then the state-of-art techniques which have been used in Web caching systems are surveyed, and the research frontier in Web cache is discussed.
Journal ArticleDOI

The state of the art in locally distributed Web-server systems

TL;DR: This article classifies and describes main mechanisms to split the traffic load among the server nodes, discussing both the alternative architectures and the load sharing policies.
Journal ArticleDOI

In-Memory Big Data Management and Processing: A Survey

TL;DR: This survey aims to provide a thorough review of a wide range of in-memory data management and processing proposals and systems, including both data storage systems and data processing frameworks.
Patent

Dynamic content assembly on edge-of-network servers in a content delivery network

TL;DR: In this article, a content provider leverages an edge side include (ESI) markup language that is used to define Web page fragments for dynamic assembly at the edge of the Internet.
Proceedings ArticleDOI

Middle-tier database caching for e-business

TL;DR: A simple extension to the existing federated features in DB2 UDB is presented, which enables a regular DB2 instance to become a DBCache without any application modification, and an extensive set of experiments with an E-Commerce benchmark is conducted to show the benefits of this approach and illustrate tradeoffs in caching considerations.
References
More filters
Book

The Design and Analysis of Computer Algorithms

TL;DR: This text introduces the basic data structures and programming techniques often used in efficient algorithms, and covers use of lists, push-down stacks, queues, trees, and graphs.
Proceedings Article

Cost-aware WWW proxy caching algorithms

TL;DR: GreedyDual-Size as discussed by the authors incorporates locality with cost and size concerns in a simple and nonparameterized fashion for high performance, which can potentially improve the performance of main-memory caching of Web documents.
Proceedings Article

The Measured Access Characteristics of World-Wide-Web Client Proxy Caches

TL;DR: An analysis of access traces collected from seven proxy servers deployed in various locations throughout the Internet shows that a 2- to 10-GB second-level cache yields hit rates between 24% and 45% with 85% of these hits due to sharing among different clients.
Proceedings Article

Improving web server performance by caching dynamic data

TL;DR: The DynamicWeb cache is analyzed, which resulted in near-optimal performance for many cases and 58% of optimal performance in the worst case on systems which invoke server programs via CGI.
Proceedings ArticleDOI

A Scalable and Highly Available System for Serving Dynamic Data at Frequently Accessed Web Sites

TL;DR: The system and key techniques used for achieving performance and high availability at the official Web site for the 1998 Olympic Winter Games which was one of the most popular Web sites for the duration of the Olympic Games are described.
Related Papers (5)