System and method for on-line, real time, data migration

• US 6,598,134 B2
• Filed: 08/30/2001
• Issued: 07/22/2003
• Est. Priority Date: 09/01/1995
• Status: Expired due to Term

• Current Assignee: EMC Corporation (Dell Technologies Inc.)
• Original Assignee: EMC Corporation (Dell Technologies Inc.)
• Inventors: LeCrone, Douglas E., Ofek, Yuval, Yanai, Moshe
• Primary Examiner(s): Kim, Matthew
• Assistant Examiner(s): BATAILLE, PIERRE MICHE
• Application Number:
  US09/943,052
• Publication Number:
  US 20020004890A1
• Time in Patent Office: 691 Days
• Field of Search: 711/112, 711/114, 711/161, 711/162, 711/165, 711/170, 711/111, 711/163, 709/217, 709/219, 709/226, 712/20, 714/6, 714/7, 714/8
• US Class Current: 711/162
• CPC Class Codes: G06F 12/0638 Combination of memories, e.g. ROM and RAM such as to permit replacement or supplementing of words in one module by words in another module address formation of the next microinstruction G06F9/26; masking faults in memories by using spares or by reconfiguring G11C29/70
• CPC Class Codes: G06F 12/08 in hierarchically structured memory systems, e.g. virtual memory systems
• CPC Class Codes: G06F 12/0866 for peripheral storage systems, e.g. disk cache
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0647 Migration mechanisms
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0689 Disk arrays, e.g. RAID, JBOD
• CPC Class Codes: G11B 19/02 Control of operating function, e.g. switching from recording to reproducing
• CPC Class Codes: G11B 5/86 Re-recording, i.e. transcribing information from one magnetisable record carrier on to one or more similar or dissimilar record carriers by varying the order of the information G11B27/029, G11B27/036

Abstract

A system and method for providing on-line, real-time, transparent data migration from an existing storage device to a replacement storage device. The existing and replacement storage devices are connected as a composite storage device that is coupled to a host, network or other data processing system. The replacement storage device includes a table which identifies data elements that have migrated to the replacement storage device. When a host system makes a data transfer request for one or more data elements, the replacement storage device determines whether the data elements have been migrated. If the data elements have migrated, the replacement storage device responds to the data transfer request independently of any interaction with the existing storage device. If the data elements have not migrated, the replacement storage device migrates the requested data elements and then responds to the data request and updates the data element map or table. When not busy servicing other requests, the replacement storage device operates in a background mode to migrate data elements so the data migration can occur concurrently with and transparently to system operations.

Claims

1. A method for migrating data elements from an existing storage device to a replacement storage device in a data processing system with a host system having a plurality of input-output connections available to storage devices wherein data element transfers with the existing storage device occur over a first input-output connection in response to data transfer requests, said method comprising the steps of:

A) establishing a data migration configuration concurrently with the processing of host system data transfer requests by;

i) establishing a first path between the replacement storage device and a second host system input-output connection, and

ii) establishing a second path between the existing and replacement storage devices;

B) rerouting host system data transfer requests to the second host system input-output connection;

C) performing first transfers between the host system and the replacement storage device in response to data transfer requests from the host system over the first path;

D) performing second transfers from the existing storage device to the replacement storage device over the second path; and

E) controlling said performance of first and second transfers until all the data elements have migrated from the existing storage device to the replacement storage device.

2. A method as recited in claim 1 wherein said rerouting includes the steps of:

i) testing the configuration for validity,

ii) responding to a valid configuration by suspending the processing of data transfer requests directed to the existing storage device by the host system,

iii) substituting the second host system input-output connection for the first host system input-output connection, and

iv) terminating the data transfer request processing suspension.

3. A method as recited in claim 2 wherein a data migration command with a predetermined syntax and with addresses that define a configuration of the existing and replacement storage devices and said configuration testing includes the step of verifying the syntax of and the configuration defined in the data migration command.

4. A method as recited in claim 3 wherein said verification includes the step of determining that the existing and replacement storage devices defined in the data migration command are valid.

5. A method as recited in claim 2 wherein the host system includes a stop input-output operations module for performing the suspension of input-output operations.

6. A method as recited in claim 5 wherein the host system includes multiple host computers and an identification of each host computer that processes data transfer requests for the existing storage device, said suspension stopping input-output operations between the existing storage device and each identified host computer.

7. A method as recited in claim 6 wherein said rerouting occurs after the synchronization of each host computer.

8. A method as recited in claim 7 wherein said rerouting occurs only if said synchronization of each of the host computers occurs within a predetermined time interval.

9. A method as recited in claim 2 wherein each of the existing and storage devices has an associated unit control block used by the host system for processing data transfer requests, said substitution of input-output connections including the step of swapping the unit control blocks whereby the unit control block for the existing storage device becomes the unit control block for the replacement storage device.

10. A method as recited in claim 9 wherein swapping of the unit control blocks includes the step of eliminating any duplicate identifications by changing the identification of the existing storage device.

11. A method for migrating data elements from an existing storage device to a replacement storage device in a data processing system with a plurality of host computers, each host computer having a plurality of input-output connections available to storage devices wherein data element transfers with the existing storage device occur over a first host computer input-output connection with each of the plurality of host computers and wherein the replacement storage device has a plurality of input-output connections, said method comprising the steps of:

A) establishing a data migration configuration concurrently with the processing of host system data transfer requests from the host computers by;

i) establishing first paths between plurality of storage device input-output connections for the replacement storage device and a second host computer input-output connection for each of the plurality of host computers, and

ii) establishing a second path between the existing and replacement storage devices;

B) rerouting data transfer requests from each of the plurality of host computers to its corresponding second host system input-output connection;

C) enabling the performance of first transfers between each of the plurality of host computers and the replacement storage device in response to data transfer requests from the host computers over the first paths after said rerouting;

D) enabling the performance of second transfers from the existing storage device to the replacement storage device over the second path after the rerouting; and

E) controlling said performance of first and second transfers until all the data elements have migrated from the existing storage device to the replacement storage device.

12. A method as recited in claim 11 wherein said rerouting includes the steps of:

i) testing the configuration for validity,

ii) responding to a valid configuration by suspending the processing of data transfer requests directed to the existing storage device by each of the plurality of host computers,

iii) substituting the second host system input-output connection for the first host system input-output connection in each of the plurality of host computers, and

iv) terminating the data transfer request processing suspension.

13. A method as recited in claim 12 wherein a data migration command with a predetermined syntax and with addresses that define a configuration of the existing and replacement storage devices and said configuration testing includes the step of verifying the syntax of and the configuration defined in the data migration command.

14. A method as recited in claim 13 wherein said verification includes the step of determining that the existing and replacement storage devices defined in the data migration command are valid.

15. A method as recited in claim 14 wherein said suspension stops input-output operations between the existing storage device and each identified host computer.

16. A method as recited in claim 15 wherein said rerouting occurs after the suspension of input-output operations of each host computer.

17. A method as recited in claim 16 wherein said rerouting occurs only if said suspension of input-output operations of each of the host computers occurs within a predetermined time interval.

18. A method as recited in claim 12 wherein each of the existing and replacement storage devices has an associated unit control block used by each of the plurality of host computers for processing data transfer requests, said substitution of input-output connections including the step of swapping the unit control blocks whereby each unit control block for the existing storage device becomes a unit control block for the replacement storage device.

19. A method as recited in claim 18 wherein swapping of the unit control blocks includes the step of eliminating any duplicate identifications by changing the identification of the existing storage device.