A system and method for providing on-line, real-time, transparent data migration from an existing storage device to a replacement storage device. The existing and replacement storage devices are connected as a composite storage device that is coupled to a host, network or other data processing system. The replacement storage device includes a table which identifies data elements that have migrated to the replacement storage device. When a host system makes a data transfer request for one or more data elements, the replacement storage device determines whether the data elements have been migrated. If the data elements have migrated, the replacement storage device responds to the data transfer request independently of any interaction with the existing storage device. If the data elements have not migrated, the replacement storage device migrates the requested data elements and then responds to the data request and updates the data element map or table. When not busy servicing other requests, the replacement storage device operates in a background mode to migrate data elements so the data migration can occur concurrently with and transparently to system operations.

System and method for on-line, real time, data migration

The present disclosure relates to a distributed information storage system which functions as virtual cloud storage overlay on top of physical cloud storage systems. The disclosure discloses transparently solving all the data management related security, virtualization, reliability and enables transparent cloud storage migration, cloud storage virtualization, information dispersal and integration across disparate cloud storage devices operated by different providers or on-premise storage. The cloud storage is owned or hosted by same or different third-party providers who own the information contained in the storage which eliminates cloud dependencies. This present disclosure functions as a distributed cloud storage delivery platform enabling various functionalities like cloud storage virtualization, cloud storage integration, cloud storage management and cloud level RAID.

Distributed virtual storage cloud architecture and a method thereof

A system for providing resources of a cloud infrastructure is provided. In the system, a client terminal may dynamically span its storage to heterogeneous cloud storages as necessary. A client determines, when receiving a file access request from an application, whether to process the file access request as a local file access request for access to a local storage of the client or as a cloud file access request for access to a cloud storage connected through the Internet. A brokerage server receives the file access request and supports the client by brokering a connection to a cloud infrastructure in response to the file access request.

Client, brokerage server and method for providing cloud storage

Techniques are described for managing access of executing programs to non-local block data storage. In some situations, a block data storage service uses multiple server storage systems to reliably store network-accessible block data storage volumes that may be used by programs executing on other physical computing systems. A group of multiple server block data storage systems that store block data volumes may in some situations be co-located at a data center, and programs that use volumes stored there may execute on other physical computing systems at that data center. If a program using a volume becomes unavailable, another program (e.g., another copy of the same program) may in some situations obtain access to and continue to use the same volume, such as in an automatic manner in some such situations.

Managing access of multiple executing programs to non-local block data storage

Methods and apparatus for optimizing resource utilization in distributed storage systems. A data migration technique is described that may operate in the background in a distributed storage data center to migrate data among a fleet of storage units to achieve a substantially even and randomized data storage distribution among all storage units in the fleet. When new storage units are added to the fleet and coupled to the data center network, the new storage units are detected. Instead of processing and storing new data to the newly added storage units, as in conventional distributed storage systems, the new units are blocked from general client I/O to allow the data migration technique to migrate data from other, previously installed storage hardware in the data center onto the new storage hardware. Once the storage load on the new storage units is balanced with the rest of the fleet, the new storage units are released for general client I/O.

Methods and apparatus for optimizing resource utilization in distributed storage systems

Issues concerning the transference of data from existing databases to other applications are discussed. The process of transferring data is called data migration, and it is divided into two processes: extracting data from existing systems in the form of an extracted file, and loading data from the extracted file into the new application. The new application usually requires data in different formats, and so transformation of data is generally needed. Moreover, the new application frequently requires data from more than one source database system, so integration of data is necessary in the migration process. >

https://ieeexplore.ieee.org/iel2/665/6720/00271615.pdf

C.S. Ku

Papers

Data Migration