Data set connection manager having a plurality of data sets to represent one data set

• US 10,127,262 B2
• Filed: 02/11/2014
• Issued: 11/13/2018
• Est. Priority Date: 07/01/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Reed, David C., Reed, Thomas C., Smith, Max D.
• Primary Examiner(s): Almani, Mohsen
• Application Number:
  US14/178,269
• Publication Number:
  US 20140164337A1
• Time in Patent Office: 1,736 Days
• Field of Search: 707616
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0652 Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
• CPC Class Codes: G06F 3/0673 Single storage device

Abstract

Provided are a computer program product, system, and method for a data set connection manager having a plurality of data sets to represent one data set. A request is processed to open a connection to a data set having members, wherein the connection is used to perform read and write requests to the members in the data set. In response to establishing the connection, establishing for the connection a primary data set having all the members; a secondary data set to which updated members in the primary data set are written; and a pending delete data set to pending delete members comprising members that are updated.

Claims

1. A computer program product for maintaining a connection to a data set in a memory device, the computer program product comprising a non-transitory computer readable storage medium having computer readable program code embodied therein that executes to perform operations, the operations comprising:

processing a request to open a connection to a data set having members to represent the data set in a data set connection manager in the memory device, wherein the connection is used to perform read and write requests to the members in the data set;

initiating the open the connection to make the data set open for read/write access by establishing the data set connection manager in the memory device for the connection to have;

a primary data set comprising the data set having all the members;

a secondary data set to which updated members in the primary data set are written; and

a pending delete data set to store pending delete members comprising an old version of the members prior to being updated;

copying a member from the primary data set to the pending delete data set prior to updating the member in the primary data set, wherein the member is subject to a pending read operation;

copying a member from the secondary data set to the pending delete data set prior to updating the member in the secondary data set, wherein the member is subject to a pending read operation; and

using the data set connection manager to manage connections to the members of the data set for read and write operations to direct read and write connections to a requested member of the data set represented in the data set connection manager.

2. The computer program product of claim 1, wherein the operations further comprise:

removing a member from the primary data set when the member is updated;

migrating unchanged members not subject to a read or write operation from the primary data set to the secondary data set; and

in response to all members in the primary data set being represented in the secondary data set, indicating the secondary data set as the primary data set and creating a new secondary data set.

3. The computer program product of claim 1, wherein the operations further comprise:

receiving an update to a member in the primary data set subject to a read operation;

forming an updated member from the member in the primary data set and the update;

including the updated member in the secondary data set; and

wherein the copying the member from the primary data set to the pending delete data set comprises moving the old version of the member in the primary data set prior to the update from the primary data set to the pending delete data set, wherein the old version of the member in the pending delete data set comprises a pending delete member.

4. The computer program product of claim 3, wherein the operations further comprise:

redirecting the read operation being performed on the member in the primary data set to the pending delete member in the pending delete data set.

5. The computer program product of claim 3, wherein the operations further comprise:

receiving an update to a member in the secondary data set subject to a read operation;

forming an updated member from the member in the secondary data set and the update;

including the updated member in the secondary data set; and

wherein the copying the member from the secondary data set to the pending delete data set comprises moving the old version of the member in the secondary data set prior to the update from the secondary data set to the pending delete data set.

6. The computer program product of claim 1, wherein the operations further comprise:

creating an additional pending delete data set in response to the pending delete data set becoming full.

7. The computer program product of claim 6, wherein the operations further comprise:

determining that a full pending delete data set has no pending delete members having an open read operation; and

deleting the full pending delete data set in response to determining that the full pending delete data set has no pending delete members having an open read operation.

8. The computer program product of claim 1, wherein the operations further comprise:

maintaining a catalog indicating locations of members in the primary data set or the secondary data set and old versions of the members being read in the pending delete data set; and

using the catalog to provide access to the members in the primary data set, secondary data set and pending delete data set.

9. The computer program product of claim 1, wherein the operations further comprise:

receiving a command to close the connection to the data set;

moving any members in the primary data set to the secondary data set;

deleting the primary data set in response to moving all the members in the primary data set to the secondary data set;

indicating the secondary data set as the primary data set; and

deleting all pending delete data sets.

10. The computer program product of claim 1, wherein the primary data set, the secondary data set, and the pending delete data set each include an index and members.

11. A system for maintaining a connection to a data set, comprising:

a processor;

a memory device; and

a computer readable storage medium having computer readable program code embodied therein that executes to perform operations, the operations comprising;

processing a request to open a connection to a data set having members to represent the data set in a data set connection manager in the memory device, wherein the connection is used to perform read and write requests to the members in the data set;

initiating the open the connection to make the data set open for read/write access by establishing the data set connection manager in the memory device for the connection to have;

a primary data set comprising the data set having all the members;

a secondary data set to which updated members in the primary data set are written; and

a pending delete data set to store pending delete members comprising an old version of the members prior to being updated;

copying a member from the primary data set to the pending delete data set prior to updating the member in the primary data set, wherein the member is subject to a pending read operation;

copying a member from the secondary data set to the pending delete data set prior to updating the member in the secondary data set, wherein the member is subject to a pending read operation; and

using the data set connection manager to manage connections to the members of the data set for read and write operations to direct read and write connections to a requested member of the data set represented in the data set connection manager.

12. The system of claim 11, wherein the operations further comprise:

removing a member from the primary data set when the member is updated;

migrating unchanged members not subject to a read or write operation from the primary data set to the secondary data set; and

in response to all members in the primary data set being represented in the secondary data set, indicating the secondary data set as the primary data set and creating a new secondary data set.

13. The system of claim 12, wherein the operations further comprise:

receiving a command to close the connection to the data set;

moving any members in the primary data set to the secondary data set;

deleting the primary data set in response to moving all the members in the primary data set to the secondary data set;

indicating the secondary data set as the primary data set; and

deleting all pending delete data sets.

14. The system of claim 11, wherein the operations further comprise:

receiving an update to a member in the primary data set subject to a read operation;

forming an updated member from the member in the primary data set and the update;

including the updated member in the secondary data set; and

wherein the copying the member from the primary data set to the pending delete data set comprises moving the old version of the member in the primary data set prior to the update from the primary data set to the pending delete data set, wherein the old version of the member in the pending delete data set comprises a pending delete member.

15. The system of claim 14, wherein the operations further comprise:

redirecting the read operation being performed on the member in the primary data set to the pending delete member in the pending delete data set.

16. The system of claim 14, wherein the operations further comprise:

receiving an update to a member in the secondary data set subject to a read operation;

forming an updated member from the member in the secondary data set and the update;

including the updated member in the secondary data set; and

wherein the copying the member from the secondary data set to the pending delete data set comprises moving the old version of the member in the secondary data set prior to the update from the secondary data set to the pending delete data set.

17. The system of claim 11, wherein the primary data set, the secondary data set, and the pending delete data set each include an index and members.

18. A method for maintaining a connection to a data set, comprising

processing a request to open a connection to a data set having members to represent the data set in a data set connection manager in a memory device, wherein the connection is used to perform read and write requests to the members in the data set;

initiating the open the connection to make the data set open for read/write access by establishing the data set connection manager in the memory device for the connection to have;

a primary data set comprising the data set having all the members;

a secondary data set to which updated members in the primary data set are written; and

a pending delete data set to store pending delete members comprising an old version of the members prior to being updated;

copying a member from the primary data set to the pending delete data set prior to updating the member in the primary data set, wherein the member is subject to a pending read operation;

copying a member from the secondary data set to the pending delete data set prior to updating the member in the secondary data set, wherein the member is subject to a pending read operation; and

using the data set connection manager to manage connections to the members of the data set for read and write operations to direct read and write connections to a requested member of the data set represented in the data set connection manager.

19. The method of claim 18, further comprising:

removing a member from the primary data set when the member is updated;

migrating unchanged members not subject to a read or write operation from the primary data set to the secondary data set; and

in response to all members in the primary data set being represented in the secondary data set, indicating the secondary data set as the primary data set and creating a new secondary data set.

20. The method of claim 18, further comprising:

receiving an update to a member in the primary data set subject to a read operation;

forming an updated member from the member in the primary data set and the update;

including the updated member in the secondary data set; and

wherein the copying the member from the primary data set to the pending delete data set comprises moving the old version of the member in the primary data set prior to the update from the primary data set to the pending delete data set, wherein the old version of the member in the pending delete data set comprises a pending delete member.

21. The method of claim 20, further comprising:

redirecting the read operation being performed on the member in the primary data set to the pending delete member in the pending delete data set.

22. The method of claim 20, further comprising:

receiving an update to a member in the secondary data set subject to a read operation;

forming an updated member from the member in the secondary data set and the update;

including the updated member in the secondary data set; and

wherein the copying the member from the secondary data set to the pending delete data set comprises moving the old version of the member in the secondary data set prior to the update from the secondary data set to the pending delete data set.

23. The method of claim 18, wherein the primary data set, the secondary data set, and the pending delete data set each include an index and members.