Identifying redundant data for disk image streaming

• US 9,229,641 B2
• Filed: 09/11/2013
• Issued: 01/05/2016
• Est. Priority Date: 11/28/2012
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Gschwind, Thomas
• Primary Examiner(s): Bradley, Matthew
• Assistant Examiner(s): Perez-Velez, Rocio Del Mar
• Application Number:
  US14/023,994
• Publication Number:
  US 20140149660A1
• Time in Patent Office: 846 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 12/0246 in block erasable memory, e.g. flash memory
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/7205 Cleaning, compaction, garbage collection, erase control
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0614 Improving the reliability of storage systems
• CPC Class Codes: G06F 3/064 Management of blocks
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0677 Optical disk device, e.g. CD-ROM, DVD

Abstract

Redundant data in a streaming disk image is identified using commands to indicate unused disk blocks, such as TRIM/UNMAP commands. A TRIM/UNMAP layer is added between an operating system and a disk driver to support the use of TRIM/UNMAP commands. Using the TRIM/UNMAP layer, blocks of a streamed disk image that are unallocated by the operating system are identified. The identified unallocated blocks are streamed to a server for analysis and storage.

Claims

1. A system, comprising:

a first processing device comprising a first memory and a second processing device comprising a second memory, the first processing device being configured to;

add a TRIM/UNMAP layer between an operating system and a disk driver to support TRIM/UNMAP commands,

utilize the TRIM/UNMAP layer to identify blocks of a disk image that are unallocated by the operating system as identified unallocated blocks,

send a list of the identified unallocated blocks to the second processing device,

receive a request for only allocated blocks of the disk image from the second processing device, the allocated blocks being from sections of the disk image not included in the list of the identified unallocated blocks,

transfer to the second processing device the allocated blocks in response to the request for the only allocated blocks, and

mark blocks of the disk image based on a second list of identified unallocated blocks to maintain information for subsequent client use; and

the second processing device being configured to;

in response to receiving the list of the identified unallocated blocks, identify allocated blocks from the list of the identified unallocated blocks;

send the request for only the allocated blocks to the first processing device;

simulate the operating system to introduce the TRIM/UNMAP layer on the second processing device and send the second list of identified unallocated blocks to the first processing device.

2. The system of claim 1, wherein the TRIM/UNMAP layer is presented to the operating system as a simulated solid-state drive.

3. The system of claim 1, wherein the sending of the list of the identified unallocated blocks causes the second processing device to identify and to transmit the allocated blocks to the first processing device.

4. The system of claim 1, wherein the identified unallocated blocks are recorded in a log or metadata file associated with the disk image.

5. The system of claim 1, wherein the TRIM/UNMAP layer is utilized to stream image data unidirectionally or bidirectionally between the first processing device and the second processing device.

6. The system of claim 1, wherein the TRIM/UNMAP commands are integrated into the operating system independently of the disk driver.

7. The system of claim 1, wherein the program instructions are further executable by the first processing device to cause the first processing device to:

receive a request for the disk image from the second processing device; and

in response to the request for the disk image, sending the list of the identified unallocated blocks to the second processing device by the first processing device.

8. The system of claim 1, wherein the processor is further configured to:

receive from the second processing device blocks that are identified as unallocated via the TRIM/UNMAP layer due to deletion by the second processing device from a simulated solid-state drive.

9. The system of claim 1, wherein the processor is further configured to:

identify portions of the disk image for streaming in accordance with the allocated blocks; and

stream the portions of the disk image to the second processing device.

10. The system of claim 1, wherein the processor is further configured to:

receive a second list of identified unallocated blocks from the second processing device, the second list of identified unallocated blocks being derived by a second TRIM/UNMAP layer of the second processing device.

11. The system of claim 1, wherein the second list of identified unallocated blocks include blocks that are identified and recorded as unused or unallocated.