A method and system for reducing storage requirements and speeding up storage operations by reducing the storage of redundant data includes receiving a request that identifies one or more data objects to which to apply a storage operation. For each data object, the storage system determines if the data object contains data that matches another data object to which the storage operation was previously applied. If the data objects do not match, then the storage system performs the storage operation in a usual manner. However, if the data objects do match, then the storage system may avoid performing the storage operation.

System and method for storing redundant information

A method and system for reducing storage requirements and speeding up storage operations by reducing the storage of redundant data includes receiving a request that identifies one or more files or data objects to which to apply a storage operation. For each file or data object, the storage system determines if the file or data object contains data that matches another file or data object to which the storage operation was previously applied, based on awareness of the application that created the data object. If the data objects do not match, then the storage system performs the storage operation in a usual manner. However, if the data objects do match, then the storage system may avoid performing the storage operation with respect to the particular file or data object.

Application-aware and remote single instance data management

A system and method of creating archive copies of data sets is described. In some examples, the system creates an archive copy from an original data set. In some examples, the system creates an archive copy when creating a recovery copy for a data set. In some examples, the system creates a copy without redundant data, and then encrypts the data set.

Systems and methods for creating copies of data, such as archive copies

A distributed, deduplicated storage system according to certain embodiments is arranged in a parallel configuration including multiple deduplication nodes. Deduplicated data is distributed across the deduplication nodes. The deduplication nodes can be networked together and communicate with one another according using a light-weight, customized communication scheme (e.g., a scheme based on FTP or HTTP). In some cases, deduplication management information including deduplication signatures and/or other metadata is stored separately from the deduplicated data in deduplication management nodes, improving performance and scalability.

Distributed deduplicated storage system

Described in detail herein are systems and methods for single instancing blocks of data in a data storage system. For example, the data storage system may include multiple computing devices (e.g., client computing devices) that store primary data. The data storage system may also include a secondary storage computing device, a single instance database, and one or more storage devices that store copies of the primary data (e.g., secondary copies, tertiary copies, etc.). The secondary storage computing device receives blocks of data from the computing devices and accesses the single instance database to determine whether the blocks of data are unique (meaning that no instances of the blocks of data are stored on the storage devices). If a block of data is unique, the single instance database stores it on a storage device. If not, the secondary storage computing device can avoid storing the block of data on the storage devices.

Block-level single instancing

According to one or more embodiments of the present invention, a network cache intercepts data requested by a client from a remote server interconnected with the cache through one or more wide area network (WAN) links (e.g., for Wide Area File Services, or “WAFS”). The network cache stores the data and sends the data to the client. The cache may then intercept a first write request for the data from the client to the remote server, and determine one or more portions of the data in the write request that changed from the data stored at the cache (e.g., according to one or more hashes created based on the data). The network cache then sends a second write request for only the changed portions of the data to the remote server.

System and method for bandwidth optimization in a network storage environment

A technique for eliminating duplicate data is provided. Upon receipt of a new data set, one or more anchor points are identified within the data set. A bit-by-bit data comparison is then performed of the region surrounding the anchor point in the received data set with the region surrounding an anchor point stored within a pattern database to identify forward/backward delta values. The duplicate data identified by the anchor point, forward and backward delta values is then replaced in the received data set with a storage indicator.

System and method for sampling based elimination of duplicate data

A method of importing a plurality of data from a physical data storage device into a virtual tape library system that is used with a data protection application. The virtual tape library system is usable with an existing data protection application designed for use with a physical tape library without modifying the existing data protection application. The method includes: triggering a signal representing a command to import the plurality of data from the physical data storage device; providing a controller that receives the signal; providing a data storage medium in communication with the controller, the data storage medium has at least one virtual library defined thereon; and copying at least a portion of the plurality of data from the physical data storage device to a virtual tape.

Method of importing data from a physical data storage device into a virtual tape library

The present invention is a tape library comprising both a small front-end portion and a larger back-end portion. The front-end portion is a visible virtual or physical tape library; and the back-end portion is a large invisible virtual or physical tape vault. The DPA is a typical DPA which only sees the front-end library. If desired, all messages regarding the importing and exporting of tapes are reviewed by an agent. The agent manages the automatic transfer of tapes between the front-end and the back-end, and notifies the user when a manual import or export is needed. This greatly reduces both the amount of hardware required to establish a virtual or physical tape library and also reduces the amount of labor required by a user to physically import and export tapes. If both the front-end library and, the back-end vault are virtual and reside on the same virtual tape library appliance, no data movement is necessary and the tapes can be moved merely by performing small software state changes. In this case, manual operation may be acceptable.

System and method for virtual vaulting

A method and system for copying backup data is disclosed. Backup data may be copied to a first virtual tape library in the same format as it would be copied to a physical tape library. The backup data may also be electronically copied to a second virtual tape library or to a physical tape library.

Don Alvin Trimmer

Papers

System and method for bandwidth optimization in a network storage environment

System and method for sampling based elimination of duplicate data

Method of importing data from a physical data storage device into a virtual tape library

System and method for virtual vaulting

Method and system for copying backup data