Operating profiles for consumers of computing resources may be automatically determined based on an analysis of actual resource usage measurements and other operating metrics. Measurements may be taken while a consumer, such as a virtual machine instance, uses computing resources, such as those provided by a host. A profile may be dynamically determined based on those measurements. Profiles may be generalized such that groups of consumers with similar usage profiles are associated with a single profile. Assignment decisions may be made based on the profiles, and computing resources may be reallocated or oversubscribed if the profiles indicate that the consumers are unlikely to fully utilize the resources reserved for them. Oversubscribed resources may be monitored, and consumers may be transferred to different resource providers if contention for resources is too high.

Automated profiling of resource usage

A system and method for monitoring the performance associated with fulfilling resource requests and determining optimizations for improving such performance are provided. A processing device obtains and processes performance metric information associated with processing a request for an original resource and any embedded resource. The processing device uses the processed performance metric information to determine a CDN service provider for alternatively hosting at least a portion of the original resource and/or any embedded resources. In some embodiments, in making such a determination, the processing device assesses performance metric information collected and associated with subsequent resource requests for the original resource and any embedded resources using each of a variety of alternative CDN service providers. Aspects of systems and methods for generating recommendations associated with monitoring the operation and performance of CDN service providers with respect to specific resource requests are also provided.

Optimizing content management

A system, method and computer-readable medium for request routing. A DNS server at a content delivery network service provider obtains a DNS query corresponding to a resource requested from a client computing device and associated with a first resource identifier. The first resource identifier includes a first portion with DNS information and a second portion with path information. The DNS server selects a network computing component for processing the requested resource based on the DNS portion of the resource identifier and transmits information identifying the selected network computing component to the client computing device.

Request routing using network computing components

A system, method, and computer readable medium for managing network storage provider and CDN service providers are provided. A content broker component obtains client computing device requests for content provided by a content provider. The content broker processes the client computing device requests and determines whether a subsequent request for the resource should be directed to a network storage provider or a CDN service provider as a function of the updated or processed by the content broker.

Managing content delivery network service providers by a content broker

A system, method, and computer-readable medium for updating request routing information associated with client location information are provided. A content delivery network service provider receives a DNS query from a client computing device. The DNS query corresponds to a resource identifier for requested content from the client computing device. The content delivery network service provider obtains a query IP address corresponding to the client computing device. Based on routing information associated with the query IP address, the content delivery network service provider routes the DNS query. The process further includes monitoring performance data associated with the transmission of the requested resource and updating routing information associated with the query IP address based on the performance data for use in processing subsequent requests form the client computing device.

Updating routing information based on client location

An arrangement and methods for operation in a cache memory system to facitate re-synchronising non-volatile cache memories (150B, 160B) following interruption in communication. A primary adapter (150) creates a non-volatile record (150C) of each cache update before it is applied to either cache. Each such record is cleared when the primary adapter knows that the cache update has been applied to both adapters' caches. In the event of a reset or other failure, the primary adapter can read the non-volatile list of transfers which were ongoing. For each entry in this list, the primary adapter negotiates with the secondary adapter (160) and transfers only the data which may be different. The amount of data to be transferred between the adapters following reset/failure is generally much lower than under previous solutions, since the data to be transferred represents only the transactions which were in progress at the time of the reset or failure, rather than the entire non-volatile cache contents; also, new transactions need not be suspended while even this reduced resynchronisation takes place: all that is necessary is for the (relatively short) list of in-doubt quanta of data to be searched (if the transaction does not overlap any entries in this list then it need not be suspended; if it does overlap then the transaction may be queued until the resynchronisation completes).

Cache memory arrangement and methods for use in a cache memory system

The invention relates to caching data in a data processing system including a host computer and a storage subsystem including at least one customer disk and a cache disk. Write transactions are received specifying data to be written to at least one customer disk and these are cached in a volatile memory of the storage subsystem and written to the cache disk. The transaction data is written sequentially to the cache disk when available. In the intervening periods (i.e., when no transaction data is available), padding data is instead written sequentially to the cache disk.

Methods, apparatus and system for caching data

A method for maintaining data access during failure of a controller in a multiple controller storage subsystem ( 103 ) is provided. The storage subsystem ( 103 ) has an array of data storage devices ( 109 ) and more than one controller ( 104, 105 ) for managing the data storage. The method comprises a first controller ( 201 ) saving its internal state information ( 212 ) and, optionally, resetting itself ( 213 ). One or more of the other controllers ( 202, 203 ) carry out the steps of pausing operation of the controller ( 221, 231 ), saving internal state information of the controller at the time of pausing ( 222, 232 ), and continuing operation of the controller ( 223, 233 ). The one or more other controllers ( 202, 203 ) may pause operation and save their internal state information when they receive a message broadcast ( 220, 230 ) from the first controller ( 201 ) which has detected an error.

Maintaining data access during failure of a controller

A method for data retention in a data cache and a data storage system are provided. The data storage system ( 100 ) includes a storage controller ( 102 ) with a cache ( 103 ) and a data storage means ( 106 ). The cache ( 103 ) has a first least recently used list ( 104 ) for referencing dirty data which is stored in the cache ( 103 ), and a second least recently used list ( 105 ) for clean data in the cache ( 103 ). Dirty data is destaged from the cache ( 103 ) when it reaches the tail of the first least recently used list ( 104 ) and clean data is purged from the cache ( 103 ) when it reaches the tail of the second least recently used list ( 105 ).

Michael Huw Francis

Papers

Cache memory arrangement and methods for use in a cache memory system

Methods, apparatus and system for caching data

Maintaining data access during failure of a controller

Method for data retention in a data cache and data storage system