Communicating chunks between devices

• US 9,665,434 B2
• Filed: 02/07/2012
• Issued: 05/30/2017
• Est. Priority Date: 10/25/2007
• Status: Active Grant

• Current Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Original Assignee: Hewlett Packard Enterprise Development LP (Hewlett-Packard Enterprise Company)
• Inventors: Pelly, Simon, Slater, Alastair, Camble, Peter Thomas
• Primary Examiner(s): Alsip, Michael
• Application Number:
  US13/367,567
• Publication Number:
  US 20120137097A1
• Time in Patent Office: 1,939 Days
• Field of Search: 711154
• CPC Class Codes: G06F 11/1451 by selection of backup contents
• CPC Class Codes: G06F 11/1461 Backup scheduling policy
• CPC Class Codes: G06F 11/1464 for networked environments

Abstract

An apparatus, for connection to a storage device, comprising: a module for communication with a software application and operable to receive instructions to copy data to the storage device; a chunking and identifier generation module operable to receive the data, to process the data into one or more chunks, to generate a first chunk identifier, representative of the identity of a first of the or each chunk of data and, upon processing of the data, to initiate the issuance of a confirmation signal to the software application indicating that the data has been copied to the storage device; and an interface for communication with the storage device, wherein the interface is operable to send the first chunk identifier to the storage device, and to send the first chunk of data to the storage device upon receipt of a transfer instruction from the storage device.

Claims

1. A method of transferring data from a primary data storage medium of a first device to a remote secondary data storage device which is remote from the primary data storage medium, the method comprising:

processing, by the first device, the data into chunks;

issuing, from the first device, a confirmation signal that the data has been copied to the remote secondary data storage device in response to receiving the data and even though at least some of the chunks have not yet been sent to the remote secondary data storage device;

sending a first chunk identifier from the first device to the remote secondary data storage device, the first chunk identifier being representative of an identity of a first chunk of the data;

receiving, at the first device, a transfer instruction from the remote secondary data storage device, the transfer instruction responsive to the remote secondary storage device determining that the first chunk identifier does not at least partially match a stored identifier; and

transferring the first chunk from the primary data storage medium to the remote secondary data storage device in response to the transfer instruction.

2. A method executed by a communication apparatus having a processor, comprising:

processing, by a chunking and identifier module in the communication apparatus, data into chunks;

generating, by the chunking and identifier module, a first chunk identifier representative of an identity of a first of the chunks of data;

sending, through a first interface in the communication apparatus, the first chunk identifier to a remote storage device;

sending, through the first interface, the first chunk of data to the remote storage device upon receipt of a transfer instruction from the remote storage device; and

sending and receiving, through a second interface in the communication apparatus, data to and from the remote storage device independently of the chunking and identifier generation module.

3. The method of claim 2, further comprising receiving the transfer instruction in response to a determination of the remote storage device that the first chunk of data is unknown at the remote storage device.

4. The method of claim 2, wherein the chunking and identifier module generates chunk identifiers for corresponding ones of the chunks, the method further comprising:

sending, through the first interface, the chunk identifiers without associated chunks to the remote storage device,

sending, through the first interface, selected ones of the chunks to the remote storage device in response to receiving indications from the remote storage device identifying which of the chunks are unknown at the remote storage device, the indications responsive to the chunk identifiers, and

declining, by the first interface, to send to the remote storage device remaining ones of the chunks that are known at the remote storage device.

5. The method of claim 2, further comprising:

selectively using one of a plurality of techniques to communicate with the remote storage device, based on at least one factor,

wherein a first of the plurality of techniques includes sending particular data to the remote storage device through the second interface without performing chunking on the particular data being sent, and

wherein a second of the plurality of techniques includes the chunking and identifier generation module processing the particular data into chunks and generating respective chunk identifiers, and sending the chunk identifiers and at least some of the chunks to the remote storage device rather than the particular data.

6. The method of claim 5, wherein the at least one factor is selected from among:

capacities of first and second networks connected respectively to the first and second interfaces, levels of usage of the first and second networks, time period since last backup operation, and amount of data or chunks stored on the remote storage device.

7. The method of claim 2, further comprising:

receiving, from the remote storage device, a plurality of chunk identifiers,

determining whether a chunk corresponding to each of the plurality of chunk identifiers is known to the communication apparatus;

in response to determining that a particular chunk corresponding to a particular one of the plurality of chunk identifiers is known to the communication apparatus, sending a first indication to the remote storage device to cause the remote storage device not to send the particular chunk to the communication apparatus; and

in response to determining that the particular chunk corresponding to the particular chunk identifier is unknown to the communication apparatus, sending a second indication to the remote storage device to cause the remote storage device to send the particular chunk to the communication apparatus.

8. The method of claim 7, wherein the particular chunk is determined to be known if a copy of the particular chunk is already in the communication apparatus.

9. The method of claim 7, wherein the receiving of the chunk identifiers and the determining are part of a data restore operation to restore data from the remote storage device.

10. A method of a communication apparatus, comprising:

receiving, by a module of the communication apparatus, instructions to copy data to a remote storage device;

a chunking and identifier generation module in the communication apparatus;

processing the data into chunks,

generating a first chunk identifier representative of an identity of a first of the chunks of data, and

upon processing of the data, issuing a confirmation signal to a software application indicating that the data has been copied to the remote storage device even though at least some of the chunks have not yet been sent to the remote storage device;

sending, by an interface of the communication apparatus, the first chunk identifier to the remote storage device; and

sending, by the interface, the first chunk of data to the remote storage device upon receipt of a transfer instruction from the remote storage device.

11. The method of claim 10, further comprising sending, by a second interface of the communication apparatus, data to the remote storage device independently of the chunking and identifier generation module.

12. The method of claim 10, further comprising:

receiving, from the remote storage device, a plurality of chunk identifiers,

determining whether a chunk corresponding to each of the plurality of chunk identifiers is known to the communication apparatus;

in response to determining that a particular chunk corresponding to a particular one of the plurality of chunk identifiers is known to the communication apparatus, sending a first indication to the remote storage device to cause the remote storage device not to send the particular chunk to the communication apparatus; and

in response to determining that the particular chunk corresponding to the particular chunk identifier is unknown to the communication apparatus, sending a second indication to the remote storage device to cause the remote storage device to send the particular chunk to the communication apparatus.

13. The method of claim 12, wherein the particular chunk is determined to be known if a copy of the particular chunk is already in the communication apparatus.

14. The method of claim 10, wherein the transfer instruction is responsive to the remote storage device determining that the first chunk identifier does not match a stored identifier at the remote storage device.