SYSTEMS AND METHODS FOR TRANSFORMATION OF LOGICAL DATA OBJECTS FOR STORAGE

• US 20120191739A1
• Filed: 03/28/2012
• Published: 07/26/2012
• Est. Priority Date: 05/31/2006
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: KOIFMAN, Chaim, KEDEM, Nadav, ZOHAR, Avi
• Granted Patent: US 8,954,403 B2
• Time in Patent Office: Days
• US Class Current: 707/756
• CPC Class Codes: G06F 12/023 Free address space management
• CPC Class Codes: G06F 12/1408 by using cryptography for digital transmission H04L9/00
• CPC Class Codes: G06F 16/13 File access structures, e.g. distributed indices arrangements of input from, or output to, record carriers G06F3/06
• CPC Class Codes: G06F 16/1727 Details of free space management performed by the file system saving storage space on storage systems G06F3/0608; management of blocks in storage devices G06F3/064
• CPC Class Codes: G06F 16/1744 using compression, e.g. sparse files
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 21/62 Protecting access to data via a platform, e.g. using keys or access control rules
• CPC Class Codes: G06F 21/6209 to a single file or object, e.g. in a secure envelope, encrypted and accessed using a key, or with access control rules appended to the object itself
• CPC Class Codes: G06F 21/78 to assure secure storage of data address-based protection against unauthorised use of memory G06F12/14; record carriers for use with machines and with at least a part designed to carry digital markings G06K19/00
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/152 Virtualized environment, e.g. logically partitioned system
• CPC Class Codes: G06F 2212/401 Compressed data
• CPC Class Codes: G06F 2212/402 Encrypted data
• CPC Class Codes: G06F 3/0604 Improving or facilitating administration, e.g. storage management
• CPC Class Codes: G06F 3/0605 by facilitating the interaction with a user or administrator
• CPC Class Codes: G06F 3/0608 Saving storage space on storage systems
• CPC Class Codes: G06F 3/0623 in relation to content
• CPC Class Codes: G06F 3/0631 by allocating resources to storage systems
• CPC Class Codes: G06F 3/0638 Organizing or formatting or addressing of data
• CPC Class Codes: G06F 3/0659 Command handling arrangements, e.g. command buffers, queues, command scheduling
• CPC Class Codes: G06F 3/0661 : Format or protocol conversion arrangements
• CPC Class Codes: G06F 3/0665 : at area level, e.g. provisioning of virtual or logical volumes
• CPC Class Codes: G06F 3/067 : Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0673 : Single storage device
• CPC Class Codes: H03M 7/30 : Compression speech analysis-synthesis for redundancy reduction G10L19/00; for image communication H04N; Expansion; Suppression of unnecessary data, e.g. redundancy reduction

Abstract

Systems and methods for transforming a logical data object for storage in a storage device operable with at least one storage protocol, creating, reading, writing, optimization and restoring thereof. Transforming the logical data object comprises creating in the storage device a transformed logical data object comprising one or more allocated storage sections with a predefined size; transforming one or more sequentially obtained chunks of obtained data corresponding to the transforming logical data object; and sequentially storing the processed data chunks into said storage sections in accordance with a receive order of said chunks, wherein said storage sections serve as atomic elements of transformation/de-transformation operations during input/output transactions on the logical data object. The processing may comprise two or more data transformation techniques coordinated in time, concurrently executing autonomous sets of instructions, and provided in a manner preserving the sequence of processing and storing the processed data chunks.

Claims

1. A method for reading data from a transformed logical object comprising a plurality of transformed storage sections, said method comprising:

receiving, by a processor, a request to read a range of data stored in the transformed logical object;

identifying one of all created and last-updated entries related to the data within the range in a transformed storage section;

de-transforming the identified one of the all created and the last-updated entries related to the data within the range in the transformed storage section; and

transmitting the de-transformed data within the range to a requestor.

2. The method of claim 1, further comprising arranging the de-transformed data in an order in which the data was transformed prior to transmission to the requestor.

3. The method of claim 2, wherein transmitting the de-transformed data comprises transmitting the de-transformed data in an order in which the data was stored.

4. The method of claim 1, further comprising identifying one of all created and last-updated entries related to the data within the range in each remaining de-transformed storage section.

5. The method of claim 4, further comprising:

de-transforming the identified one of the all created and the last-updated entries related to the data within the range in each remaining de-transformed storage section; and

transmitting the de-transformed data within the range in each remaining de-transformed storage section to the requestor.

6. The method of claim 5, further comprising arranging the de-transformed data in the de-transformed storage section and the data in each remaining transformed storage section in an order in which the data was stored in the transformed storage section and each remaining transformed storage section prior to transmission to the requestor.

7. The method of claim 6, wherein transmitting the de-transformed data in the transformed storage section and the data in each remaining transformed storage section comprises transmitting the de-transformed data in the order in which the data was stored in the transformed storage section and in each remaining transformed storage section.

8. A system for reading data from a transformed logical object, said system comprising:

a processor; and

a storage device coupled to said processor, wherein the storage device is configured to store computer code that, when executed by the processor, causes the processor to;

receive a request to read a range of data stored in the transformed logical object,

identify one of all created and last-updated entries related to the data within the range in a storage section,

de-transform the identified one of the all created and last-updated entries related to the data within the range in the storage section, and

transmit the de-transformed data within the range to a requestor.

9. The system of claim 8, wherein the processor is further configured to arrange the de-transformed data in an order in which the data was stored.

10. The system of claim 8, wherein, when transmitting the de-transformed data, the processor is configured to transmit the de-transformed data in the order in which the data was de-transformed.

11. The system of claim 8, wherein the processor is further configured to identify one of all created and last-updated entries related to the data within the range in each remaining transformed storage section.

12. The system of claim 11, wherein the processor is further configured to:

de-transform the identified one of the all created and the last-updated entries related to the data within the range in each remaining transformed storage section; and

transmit the de-transformed data within the range in each remaining transformed storage section to the requestor.

13. The system of claim 12, wherein the processor is further configured to arrange the de-transformed data in the transformed storage section and the data in each remaining transformed storage section in an order in which the data was stored in the transformed storage section and each remaining transformed storage section prior to transmission to the requestor.

14. The system of claim 13, wherein, when transmitting the de-transformed data in the transformed storage section and the data in each remaining transformed storage section, the processor is configured to transmit the de-transformed data in the order in which the data was stored in the transformed storage section and in each remaining transformed storage section.

15. A computer program product comprising a computer useable medium including a computer readable program code embodied therein for reading data from a transformed logical object comprising a plurality of transformed storage sections, said computer program product comprising:

computer code for receiving, by a processor, a request to read a range of data stored in the transformed logical object;

computer code for identifying one of all created and last-updated entries related to the data within the range in a transformed storage section;

computer code for de-transforming the identified one of the all created and the last-updated entries related to the data within the range in the transformed storage section; and

computer code for transmitting the de-transformed data within the range to a requestor.

16. The computer program product of claim 15, further comprising computer code for arranging the de-transformed data in an order in which the data was de-transformed prior to transmission to the requestor.

17. The computer program product of claim 16, wherein the computer code for transmitting the de-transformed data comprises computer code for transmitting the de-transformed data in the order in which the data was stored.

18. The computer program product of claim 15, further comprising computer code for identifying one of all created and last-updated entries related to the data within the range in each remaining transformed storage section.

19. The computer program product of claim 18, further comprising:

computer code for de-transforming the identified one of the all created and last-updated entries related to the data within the range in each remaining transformed storage section; and

computer code for transmitting the de-transformed data within the range in each remaining transformed storage section to the requestor.

20. The computer program product of claim 19, further comprising computer code for arranging the de-transformed data in the transformed storage section and the data in each remaining transformed storage section in an order in which the data was de-transformed in the transformed storage section and each remaining transformed storage section prior to transmission to the requestor.

21. The computer program product of claim 20, wherein the computer code for transmitting the de-transformed data in the transformed storage section and the data in each remaining transformed storage section comprises computer code for transmitting the de-transformed data in the order in which the data was stored in the transformed storage section and in each remaining transformed storage section.