Data set connection manager having a plurality of data sets to represent one data set

• US 8,688,635 B2
• Filed: 07/01/2011
• Issued: 04/01/2014
• Est. Priority Date: 07/01/2011
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Reed, David C., Reed, Thomas C., Smith, Max D.
• Primary Examiner(s): Trujillo, James
• Assistant Examiner(s): Almani, Mohsen
• Application Number:
  US13/174,789
• Publication Number:
  US 20130007292A1
• Time in Patent Office: 1,005 Days
• Field of Search: 707/616
• US Class Current: 707/616
• CPC Class Codes: G06F 16/2365 Ensuring data consistency and integrity
• CPC Class Codes: G06F 3/0617 in relation to availability
• CPC Class Codes: G06F 3/0652 Erasing, e.g. deleting, data cleaning, moving of data to a wastebasket
• CPC Class Codes: G06F 3/0673 Single storage device

Abstract

Provided are a computer program product, system, and method for a data set connection manager having a plurality of data sets to represent one data set. A request is processed to open a connection to a data set having members, wherein the connection is used to perform read and write requests to the members in the data set. In response to establishing the connection, establishing for the connection a primary data set having all the members; a secondary data set to which updated members in the primary data set are written; and a pending delete data set to pending delete members comprising members that are updated.

Claims

1. A computer program product for maintaining a connection to a data set, the computer program product comprising a non-transitory computer readable storage medium having computer readable program code embodied therein that executes to perform operations, the operations comprising:

processing a request to open a connection to a data set having members, wherein the connection is used to perform read and write requests to the members in the data set;

in response to establishing the connection, establishing for the connection;

a primary data set having all the members;

a secondary data set to which updated members in the primary data set are written; and

a pending delete data set to store pending delete members comprising members that are updated;

migrating unmodified members not subject to a read or write operation from the primary data set to the secondary data set;

determining a ratio of updated members to unmodified members; and

increasing a rate at which the unmodified members not subject to a read or write operation are migrated from the primary data set to the secondary data set in response to determining an increase in the ratio of updated members to unmodified members.

2. The computer program product of claim 1, wherein the operations further comprise:

removing a member from the primary data set when the member is updated;

migrating unchanged members not subject to a read or write operation from the primary data set to the secondary data set;

in response to all members in the primary data set being represented in the secondary data set, indicating the secondary data set as the primary data set and creating a new secondary data set.

3. The computer program product of claim 1, wherein the operations further comprise:

receiving an update to a member in the primary data set subject to a read operation;

forming an updated member from the member in the primary data set and the update;

including the updated member in the secondary data set; and

moving the member in the primary data set prior to the update from the primary data set to the pending delete data set, wherein the member in the pending delete data set comprises a pending delete member.

4. The computer program product of claim 3, wherein the operations further comprise:

redirecting the read operation being performed on the member in the primary data set to the pending delete member in the pending delete data set.

5. The computer program product of claim 3, wherein the operations further comprise:

receiving an update to a member in the secondary data set;

forming an updated member from the member in the secondary data set and the update;

including the updated member in the secondary data set; and

moving the member in the secondary data set prior to the update from the secondary data set to the pending delete data set.

6. The computer program product of claim 1, wherein the operations further comprise:

creating an additional pending delete data set in response to the pending delete data set becoming full.

7. The computer program product of claim 6, wherein the operations further comprise:

determining that a full pending delete data set has no pending delete members having an open read operation; and

deleting the full pending delete data set in response to determining that the full pending delete data set has no pending delete members having an open read operation.

8. The computer program product of claim 1, wherein the operations further comprise:

maintaining a catalog indicating locations of members in the primary data set or the secondary data set and old versions of the members being read in the pending delete data set; and

using the catalog to provide access to the members in the primary data set, secondary data set and pending delete data set.

9. The computer program product of claim 1, wherein the operations further comprise:

receiving a command to close the connection to the data set;

moving any members in the primary data set to the secondary data set;

deleting the primary data set in response to moving all the members in the primary data set to the secondary data set;

indicating the secondary data set as the primary data set; and

deleting all pending delete data sets.

10. A system for maintaining a connection to a data set, comprising:

a processor;

a computer readable storage medium having computer readable program code embodied therein that executes to perform operations, the operations comprising;

processing a request to open a connection to a data set having members, wherein the connection is used to perform read and write requests to the members in the data set;

in response to establishing the connection, establishing for the connection;

a primary data set having all the members;

a secondary data set to which updated members in the primary data set are written; and

a pending delete data set to store pending delete members comprising members that are updated;

migrating unmodified members not subject to a read or write operation from the primary data set to the secondary data set;

determining a ratio of updated members to unmodified members; and

increasing a rate at which the unmodified members not subject to a read or write operation are migrated from the primary data set to the secondary data set in response to determining an increase in the ratio of updated members to unmodified members.

11. The system of claim 10, wherein the operations further comprise:

removing a member from the primary data set when the member is updated;

migrating unchanged members not subject to a read or write operation from the primary data set to the secondary data set;

in response to all members in the primary data set being represented in the secondary data set, indicating the secondary data set as the primary data set and creating a new secondary data set.

12. The system of claim 10, wherein the operations further comprise:

receiving an update to a member in the primary data set subject to a read operation;

forming an updated member from the member in the primary data set and the update;

including the updated member in the secondary data set; and

moving the member in the primary data set prior to the update from the primary data set to the pending delete data set, wherein the member in the pending delete data set comprises a pending delete member.

13. The system of claim 12, wherein the operations further comprise:

redirecting the read operation being performed on the member in the primary data set to the pending delete member in the pending delete data set.

14. The system of claim 12, wherein the operations further comprise:

receiving an update to a member in the secondary data set;

forming an updated member from the member in the secondary data set and the update;

including the updated member in the secondary data set; and

moving the member in the secondary data set prior to the update from the secondary data set to the pending delete data set.

15. The system of claim 10, wherein the operations further comprise:

receiving a command to close the connection to the data set;

moving any members in the primary data set to the secondary data set;

deleting the primary data set in response to moving all the members in the primary data set to the secondary data set;

indicating the secondary data set as the primary data set; and

deleting all pending delete data sets.

16. A method for maintaining a connection to a data set, comprising

processing a request to open a connection to a data set having members, wherein the connection is used to perform read and write requests to the members in the data set;

in response to establishing the connection, establishing for the connection;

a primary data set having all the members;

a secondary data set to which updated members in the primary data set are written; and

a pending delete data set to store pending delete members comprising members that are updated;

migrating unmodified members not subject to a read or write operation from the primary data set to the secondary data set;

determining a ratio of updated members to unmodified members; and

increasing a rate at which the unmodified members not subject to a read or write operation are migrated from the primary data set to the secondary data set in response to determining an increase in the ratio of updated members to unmodified members.

17. The method of claim 16, further comprising:

removing a member from the primary data set when the member is updated;

migrating unchanged members not subject to a read or write operation from the primary data set to the secondary data set;

in response to all members in the primary data set being represented in the secondary data set, indicating the secondary data set as the primary data set and creating a new secondary data set.

18. The method of claim 16, further comprising:

receiving an update to a member in the primary data set subject to a read operation;

forming an updated member from the member in the primary data set and the update;

including the updated member in the secondary data set; and

moving the member in the primary data set prior to the update from the primary data set to the pending delete data set, wherein the member in the pending delete data set comprises a pending delete member.

19. The method of claim 18, further comprising:

redirecting the read operation being performed on the member in the primary data set to the pending delete member in the pending delete data set.

20. The method of claim 18, further comprising:

receiving an update to a member in the secondary data set;

forming an updated member from the member in the secondary data set and the update;

including the updated member in the secondary data set; and

moving the member in the secondary data set prior to the update from the secondary data set to the pending delete data set.

21. The method of claim 16, further comprising:

receiving a command to close the connection to the data set;

moving any members in the primary data set to the secondary data set;

deleting the primary data set in response to moving all the members in the primary data set to the secondary data set;

indicating the secondary data set as the primary data set; and

deleting all pending delete data sets.