Retrieving and converting offline data

• US 10,229,067 B2
• Filed: 02/08/2016
• Issued: 03/12/2019
• Est. Priority Date: 02/08/2016
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Wilcock, Glenn R.
• Primary Examiner(s): Patel, Ashokkumar B
• Assistant Examiner(s): Farooqui, Quazi
• Application Number:
  US15/018,700
• Publication Number:
  US 20170228325A1
• Time in Patent Office: 1,128 Days
• Field of Search: 713193
• CPC Class Codes: G06F 12/08 in hierarchically structured memory systems, e.g. virtual memory systems
• CPC Class Codes: G06F 12/1408 by using cryptography for digital transmission H04L9/00
• CPC Class Codes: G06F 16/258 Data format conversion from or to a database
• CPC Class Codes: G06F 21/80 in storage media based on magnetic or optical technology, e.g. disks with sectors preventing unauthorised reproduction or copying of disc-type recordable media G11B20/00
• CPC Class Codes: G06F 2212/1044 Space efficiency improvement
• CPC Class Codes: G06F 2212/402 Encrypted data
• CPC Class Codes: G06F 3/0607 by facilitating the process of upgrading existing storage systems, e.g. for improving compatibility between host and storage device
• CPC Class Codes: G06F 3/0661 Format or protocol conversion arrangements
• CPC Class Codes: G06F 3/067 Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]
• CPC Class Codes: G06F 3/0685 Hybrid storage combining heterogeneous device types, e.g. hierarchical storage, hybrid arrays

Abstract

A computer-implemented method according to one embodiment includes receiving a request for data, where the data is stored in a first format in a first storage area of a system, retrieving the data stored in the first format from the first storage area of the system, converting the data from the first format to a second format, and returning the data in the second format.

Claims

1. A computer-implemented method, comprising:

receiving a read-only request from a requestor to access a file, where a data portion of the file is encrypted, compressed, and stored in an offline storage area of a system;

determining that the file is a nearline file, based on a metadata portion of the file stored in an online storage area of the system, where the metadata portion of the file includes an identifier of the file, a description of the data portion of the file, and a location of the data portion of the file within the offline storage area of the system;

determining the location of the data portion of the file within the offline storage area of the system, based on the metadata portion of the file;

retrieving the data portion of the file from the offline storage area of the system;

converting the data portion of the file, including decompressing and decrypting the data portion of the file to create a decompressed and decrypted data portion of the file; and

returning the decompressed and decrypted data portion of the file directly to the requestor without writing the decompressed and decrypted data portion of the file to the online storage area of the system.

2. The computer-implemented method of claim 1, wherein the read-only request includes a retrieve request that includes a read-only indicator that indicates that the data portion of the file should only be returned to an original count key data (CKD) format and then presented to the requestor as a standard read from a CKD device.

3. The computer-implemented method of claim 1, wherein retrieving the data portion of the file includes issuing a software retrieve request using a volser as a container name, a data set name concatenated with a cylinder head location as an object name, and an indicator that the data portion of the file should be presented directly in CKD format as a normal read as opposed to storing the data portion of the file back to the online storage area of the system.

4. The computer-implemented method of claim 1, wherein the requested file includes one or more physical extents.

5. The computer-implemented method of claim 1, wherein the requested file includes read only data.

6. The computer-implemented method of claim 1, wherein the requested file includes physical sequential data.

7. The computer-implemented method of claim 1, wherein the metadata portion of the file further includes an identifier of one or more users associated with the file.

8. The computer-implemented method of claim 1, wherein after the data portion of the file is retrieved, the data portion of the file is converted to a count key data (CKD) format.

9. The computer-implemented method of claim 1, wherein storage management software receives the read-only request to access the file from the requestor, retrieves the data portion of the file from the offline storage area of the system, converts the data portion of the file to create the decompressed and decrypted data portion of the file, and returns the decompressed and decrypted data portion of the file directly to the requestor.

10. The computer-implemented method of claim 9, wherein the storage management software resides within the online storage area within the system.

11. A computer program product for dynamically managing a table of contents, the computer program product comprising a computer readable storage medium having program instructions embodied therewith, wherein the computer readable storage medium is not a transitory signal per se, the program instructions executable by a processor to cause the processor to perform a method comprising:

receiving, by the processor, a read-only request from a requestor to access a file, where a data portion of the file is encrypted, compressed, and stored in an offline storage area of a system;

determining, by the processor, that the file is a nearline file, based on a metadata portion of the file stored in an online storage area of the system, where the metadata portion of the file includes an identifier of the file, a description of the data portion of the file, and a location of the data portion of the file within the offline storage area of the system;

determining, by the processor, the location of the data portion of the file within the offline storage area of the system, based on the metadata portion of the file;

retrieving, by the processor, the data portion of the file from the offline storage area of the system;

converting, by the processor, the data portion of the file, including decompressing and decrypting the data portion of the file to create a decompressed and decrypted data portion of the file; and

returning, by the processor, the decompressed and decrypted data portion of the file directly to the requestor without writing the decompressed and decrypted data portion of the file to the online storage area of the system.

12. The computer program product of claim 11, wherein the read-only request includes a retrieve request that includes a read-only indicator that indicates that the data portion of the file should only be returned to an original count key data (CKD) format and then presented to the requestor as a standard read from a CKD device.

13. The computer program product of claim 11, wherein retrieving the data portion of the file includes issuing a software retrieve request using a volser as a container name, a data set name concatenated with a cylinder head location as an object name, and an indicator that the data portion of the file should be presented directly in CKD format as a normal read as opposed to storing the data portion of the file back to the online storage area of the system.

14. The computer program product of claim 11, wherein the requested file includes one or more physical extents.

15. The computer program product of claim 11, wherein the requested file includes read only data.

16. The computer program product of claim 11, wherein the requested file includes physical sequential data.

17. The computer program product of claim 11, wherein the metadata portion of the file further includes an identifier of one or more users associated with the file.

18. The computer program product of claim 11, wherein after the data portion of the file is retrieved, the data portion of the file is converted to a count key data (CKD) format.

19. The computer program product of claim 11, wherein storage management software receives the read-only request to access the file from the requestor, retrieves the data portion of the file from the offline storage area of the system, converts the data portion of the file to create the decompressed and decrypted data portion of the file, and returns the decompressed and decrypted data portion of the file directly to the requestor.

20. A system, comprising:

a hardware processor and logic integrated with the processor, executable by the processor, or integrated with and executable by the processor, the logic being configured to;

receive a read-only request from a requestor to access a file, where a data portion of the file is encrypted, compressed, and stored in an offline storage area of the system;

determine that the file is a nearline file, based on a metadata portion of the file stored in an online storage area of the system, where the metadata portion of the file includes an identifier of the file, a description of the data portion of the file, and a location of the data portion of the file within the offline storage area of the system;

determine the location of the data portion of the file within the offline storage area of the system, based on the metadata portion of the file;

retrieve the data portion of the file from the offline storage area of the system;

convert the data portion of the file, including decompressing and decrypting the data portion of the file to create a decompressed and decrypted data portion of the file; and

return the decompressed and decrypted data portion of the file directly to the requestor without writing the decompressed and decrypted data portion of the file to the online storage area of the system.