System and method for bulk data movement between storage tiers
First Claim
Patent Images
1. A computer-implemented method, comprising:
- in response to a request for data migration from a source storage tier to a target storage tier, identifying, by a processor, one or more candidate files to be migrated from the source storage tier to the target storage tier;
generating, by the processor, a candidate index having information stored therein for identifying a plurality of segments associated with each of the candidate files;
after the segments associated with the one or more candidate files have been indicated in the candidate index, retrieving by the processor the segments from one or more storage units of the source storage tier based on the information stored in the candidate index; and
migrating, by the processor, the segments of the one or more candidate files from the source storage tier to the target storage tier, including transmitting segments of the source storage tier that are identified based on the candidate index to the target storage tier over a network, wherein the source storage tier and the target storage tier are separate storage systems coupled to the network, wherein migrating segments of the one or more candidate files comprises;
scanning storage containers containing segments in the source storage tier,identifying candidate segments in the scanned storage containers based on the candidate index,generating a fingerprint for each candidate segment by performing a hash operation on the candidate segment,transmitting the fingerprint to the target storage tier to allow the target storage tier to determine based on the fingerprint whether the candidate segment has been stored in the target storage tier, andtransmitting to the target storage tier the candidate segments that have not been stored in the target storage.
9 Assignments
0 Petitions
Accused Products
Abstract
Techniques for data migration of a storage system are described herein. According to one embodiment, a candidate index is generated to store information identifying a plurality of segments associated with one or more candidate files of a source storage tier to be migrated to a target storage tier of a storage system. Segments of the one or more candidate files are then migrated from the source storage tier to the target storage tier according to a sequential order, and based on the candidate index.
-
Citations
21 Claims
-
1. A computer-implemented method, comprising:
-
in response to a request for data migration from a source storage tier to a target storage tier, identifying, by a processor, one or more candidate files to be migrated from the source storage tier to the target storage tier; generating, by the processor, a candidate index having information stored therein for identifying a plurality of segments associated with each of the candidate files; after the segments associated with the one or more candidate files have been indicated in the candidate index, retrieving by the processor the segments from one or more storage units of the source storage tier based on the information stored in the candidate index; and migrating, by the processor, the segments of the one or more candidate files from the source storage tier to the target storage tier, including transmitting segments of the source storage tier that are identified based on the candidate index to the target storage tier over a network, wherein the source storage tier and the target storage tier are separate storage systems coupled to the network, wherein migrating segments of the one or more candidate files comprises; scanning storage containers containing segments in the source storage tier, identifying candidate segments in the scanned storage containers based on the candidate index, generating a fingerprint for each candidate segment by performing a hash operation on the candidate segment, transmitting the fingerprint to the target storage tier to allow the target storage tier to determine based on the fingerprint whether the candidate segment has been stored in the target storage tier, and transmitting to the target storage tier the candidate segments that have not been stored in the target storage. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. A non-transitory computer-readable storage medium having instructions stored therein, which when executed by a computer, cause the computer to perform operations of data migration of a storage system, the operations comprising:
-
in response to a request for data migration from a source storage tier to a target storage tier, identifying, by a processor, one or more candidate files to be migrated from the source storage tier to the target storage tier; generating a candidate index having information stored therein for identifying a plurality of segments associated with each of the candidate files; after the segments associated with the one or more candidate files have been indicated in the candidate index, retrieving by the processor the segments from one or more storage units of the source storage tier based on the information stored in the candidate index; and migrating the segments of the one or more candidate files from the source storage tier to the target storage tier, including transmitting segments of the source storage tier that are identified based on the candidate index to the target storage tier over a network, wherein the source storage tier and the target storage tier are separate storage systems coupled to the network, wherein migrating segments of the one or more candidate files comprises; scanning storage containers containing segments in the source storage tier, identifying candidate segments in the scanned storage containers based on the candidate index, generating a fingerprint for each candidate segment by performing a hash operation on the candidate segment, transmitting the fingerprint to the target storage tier to allow the target storage tier to determine based on the fingerprint whether the candidate segment has been stored in the target storage tier, and transmitting to the target storage tier the candidate segments that have not been stored in the target storage. - View Dependent Claims (9, 10, 11, 12, 13, 14)
-
-
15. A storage system operating as a source storage tier, the system comprising:
-
a candidate builder executed by a processor, in response to a request for data migration from the source storage tier to a target storage tier, to identify one or more candidate files to be migrated from the source storage tier to the target storage tier and to generate a candidate index having information stored therein for identifying a plurality of segments associated with each of the candidate files; and a migration module executed by the processor and coupled to the candidate builder, after the segments associated with the one or more candidate files have been indicated in the candidate index, to retrieve the segments from one or more storage units of the source storage tier based on the information stored in the candidate index and to migrate the segments of the one or more candidate files from the source storage tier to the target storage tier, including transmitting segments of the source storage tier that are identified based on the candidate index to the target storage tier over a network, wherein the source storage tier and the target storage tier are separate storage systems coupled to the network, wherein migrating segments of the one or more candidate files comprises; scanning storage containers containing segments in the source storage tier, identifying candidate segments in the scanned storage containers based on the candidate index, generating a fingerprint for each candidate segment by performing a hash operation on the candidate segment, transmitting the fingerprint to the target storage tier to allow the target storage tier to determine based on the fingerprint whether the candidate segment has been stored in the target storage tier, and transmitting to the target storage tier the candidate segments that have not been stored in the target storage. - View Dependent Claims (16, 17, 18, 19, 20, 21)
-
Specification