Use of virtual targets for preparing and servicing requests for server-free data transfer operations

• US 7,660,866 B2
• Filed: 07/30/2008
• Issued: 02/09/2010
• Est. Priority Date: 03/07/2003
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lay, Jeou-Rong, Chambliss, David D.
• Primary Examiner(s): Eng; David Y
• Application Number:
  US12/182,173
• Publication Number:
  US 20080288670A1
• Time in Patent Office: 559 Days
• Field of Search: 709/213, 710/22
• US Class Current: 709/213
• CPC Class Codes: H04L 67/1097 for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
• CPC Class Codes: H04L 69/329 in the application layer [OSI layer 7]
• CPC Class Codes: H04L 9/40 Network security protocols

Abstract

A system, a storage manager server and a computer program product for utilizing virtual targets and abstract copy orders in preparing and servicing requests for server-free data transfer operations in a data storage network. The abstract copy orders represent data transfers between virtual targets and real devices. They allow source target copy orders to be prepared separately from destination target copy orders. The abstract copy orders may then be converted into concrete copy orders involving only real device targets for execution by a data mover that implements the server-free data transfer operations.

Claims

1. A system for supporting server-free data transfers between data storage devices in a data storage network in cooperation with a data mover in the network, comprising:

a programmable computer platform configured with one or more computer readable storage media storing instructions that are executable by said computer platform to perform operations, comprising;

generating abstract copy orders representing data transfers involving virtual targets;

said virtual targets being associated with queues that queue said abstract copy orders;

each abstract copy order that is queued by one of said virtual targets representing a virtual supplier or a virtual consumer of data to or from said virtual target;

converting said abstract copy orders into concrete copy orders involving only real device targets for execution by said data mover; and

said converting comprising said abstract copy orders involving real source targets being prepared separately from abstract copy orders involving real destination targets and thereafter merged into said concrete copy orders.

2. A system in accordance with claim 1 wherein said virtual targets are virtual FIFOs.

3. A system in accordance with claim 1 wherein said abstract copy orders are data transfer requests that specify (a) a source target and a destination target with at least one of said targets being virtual, (b) data locating information as necessary to locate said data on said source or destination target if either is real, and (c) data size information.

4. A system in accordance with claim 3 wherein said concrete copy orders are SCSI-3 extended copy command segment descriptors.

5. A system in accordance with claim 1 wherein said abstract copy orders are converted into concrete copy orders by merging pairs of abstract copy orders that reference a common virtual target along with respective real source and destination targets so that for each abstract copy order pair said real source target is combined with said real destination target to form a concrete copy order.

6. A system in accordance with claim 1 wherein said abstract copy orders are converted to concrete copy orders by grouping abstract copy orders involving a common virtual target into supplier and consumer lists, and merging pairs of abstract copy orders at the head of each list so that a real source target associated with one abstract copy order of a pair is linked to a real destination target associated with another abstract copy order of said pair.

7. A system in accordance with claim 1 wherein said operations further include generating inter-virtual target abstract copy orders involving data transfers between virtual source and destination targets.

8. A system in accordance with claim 7 wherein said inter-virtual target abstract copy orders are used to accommodate data reordering or inline data insertion when implementing server-free data transfers.

9. A system in accordance with claim 7 wherein said operations further include collapsing each of said inter-virtual target abstract copy orders into an abstract copy order supplying data from a real source target to said source virtual target with an abstract copy order providing data from said destination virtual target to a real destination target.

10. A system in accordance with claim 1 wherein said operations further include dividing said abstract copy orders into separate abstract copy orders involving data transfers of smaller size in order to accommodate data deadlock conditions.

11. A system in accordance with claim 1 wherein said operations further include generating data buffer commands for said data mover to buffer data until a data transfer to a real destination target can be performed that will allow an abstract copy order specifying said real destination target to be eliminated.

12. A storage manager server for supporting server-free data transfers between data storage devices in a data storage network in cooperation with a data mover in the network, comprising:

a programmable computer platform configured with one or more computer readable storage media storing instructions that are executable by said computer platform to perform operations, comprising;

generating abstract copy orders representing data transfers involving virtual targets;

said virtual targets being associated with queues that queue said abstract copy orders;

each abstract copy order that is queued by one of said virtual targets representing a virtual supplier or a virtual consumer of data to or from said virtual target;

converting said abstract copy orders into concrete copy orders involving only real device targets for execution by said data mover; and

said converting comprising said abstract copy orders involving real source targets being prepared separately from abstract copy orders involving real destination targets and thereafter merged into said concrete copy orders.

13. A storage manager server in accordance with claim 12 wherein said virtual targets are virtual FIFOs.

14. A storage manager server in accordance with claim 12 wherein said abstract copy orders are data transfer requests that specify (a) a source target and a destination target with at least one of said targets being virtual, (b) data locating information as necessary to locate said data on said source or destination target if either is real, and (c) data size information.

15. A storage manager server in accordance with claim 14 wherein said concrete copy orders are SCSI-3 extended copy command segment descriptors.

16. A storage manager server in accordance with claim 12 wherein said abstract copy orders are converted into concrete copy orders by merging pairs of abstract copy orders that reference a common virtual target along with respective real source and destination targets so that for each abstract copy order pair said real source target is combined with said real destination target to form a concrete copy order.

17. A storage manager server in accordance with claim 12 wherein said abstract copy orders are converted to concrete copy orders by grouping abstract copy orders involving a common virtual target into supplier and consumer lists, and merging pairs of abstract copy orders at the head of each list so that a real source target associated with one abstract copy order of a pair is linked to a real destination target associated with another abstract copy order of said pair.

18. A storage manager server in accordance with claim 12 wherein said operations further include generating inter-virtual target abstract copy orders involving data transfers between virtual source and destination targets.

19. A storage manager server in accordance with claim 18 wherein said inter-virtual target abstract copy orders are used to accommodate data reordering or inline data insertion when implementing server-free data transfers.

20. A storage manager server in accordance with claim 18 wherein said operations further include collapsing each of said inter-virtual target abstract copy orders into an abstract copy order supplying data from a real source target to said source virtual target with an abstract copy order providing data from said destination virtual target to a real destination target.

21. A storage manager server in accordance with claim 12 wherein said operations further include dividing said abstract copy orders into separate abstract copy orders involving data transfers of smaller size in order to accommodate data deadlock conditions.

22. A storage manager server in accordance with claim 12 wherein said operations further include generating data buffer commands for said data mover to buffer data until a data transfer to a real destination target can be performed that will allow an abstract copy order specifying said real destination target to be eliminated.

23. A computer readable storage medium storing instructions which, when executed on a data processing apparatus, will perform operations for supporting server-free data transfers between data storage devices in a data storage network in cooperation with a data mover in the network, comprising:

generating abstract copy orders representing data transfers involving virtual targets;

said virtual targets being associated with queues that queue said abstract copy orders;

each abstract copy order that is queued by one of said virtual targets representing a virtual supplier or a virtual consumer of data to or from said virtual target;

converting said abstract copy orders into concrete copy orders involving only real device targets for execution by said data mover; and

said converting comprising said abstract copy orders involving real source targets being prepared separately from abstract copy orders involving real destination targets and thereafter merged into said concrete copy orders.

24. A computer program product in accordance with claim 23 wherein said virtual targets are virtual FIFOs.

25. A computer program product in accordance with claim 23 wherein said abstract copy orders are data transfer requests that specify (a) a source target and a destination target with at least one of said targets being virtual, (b) data locating information as necessary to locate said data on said source or destination target if either is real, (c) and data size information.

26. A computer program product in accordance with claim 25 wherein said concrete copy orders are SCSI-3 extended copy command segment descriptors.

27. A computer program product in accordance with claim 23 wherein said abstract copy orders are converted into concrete copy orders by merging pairs of abstract copy orders that reference a common virtual target along with respective real source and destination targets so that for each abstract copy order pair said real source target is combined with said real destination target to form a concrete copy order.

28. A computer program product in accordance with claim 23 wherein said abstract copy orders are converted to concrete copy orders by grouping abstract copy orders involving a common virtual target into supplier and consumer lists, and merging pairs of abstract copy orders at the head of each list so that a real source target associated with one abstract copy order of a pair is linked to a real destination target associated with another abstract copy order of said pair.

29. A computer program product in accordance with claim 23 wherein said operations further include generating inter-virtual target abstract copy orders involving data transfers between virtual source and destination targets.

30. A computer program product in accordance with claim 29 wherein said inter-virtual target abstract copy orders are used to accommodate data reordering or inline data insertion when implementing server-free data transfers.

31. A computer program product in accordance with claim 29 wherein said operations further include collapsing each of said inter-virtual target abstract copy orders into an abstract copy order supplying data from a real source target to said source virtual target with an abstract copy order providing data from said destination virtual target to a real destination target.

32. A computer program product in accordance with claim 23 wherein said operations further include dividing said abstract copy orders into separate abstract copy orders involving data transfers of smaller size in order to accommodate data deadlock conditions.

33. A computer program product in accordance with claim 23 wherein said operations further include generating data buffer commands for said data mover to buffer data until a data transfer to a real destination target can be performed that will allow an abstract copy order specifying said real destination target to be eliminated.