Analysis of data utilization

• US 10,698,962 B2
• Filed: 11/20/2018
• Issued: 06/30/2020
• Est. Priority Date: 01/30/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: McDuff, Steve
• Primary Examiner(s): Vu, Viet D
• Application Number:
  US16/196,171
• Publication Number:
  US 20190087494A1
• Time in Patent Office: 588 Days
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9538 Presentation of query results
• CPC Class Codes: H04L 43/065 related to network devices
• CPC Class Codes: H04L 67/1014 based on the content of a request

Abstract

One or more processors determine a first amount of data that was provided to a program by a data source. One or more processors analyze a degree of usage of the first amount of data by the program. One or more processors determine a second amount of data that was used by the program based, at least in part, on the degree of usage. The second amount of data is a portion of the first amount of data.

Claims

1. A method for determining efficiency of data exchange comprising:

determining, by one or more processors, a first amount of data that was provided to a program by a data source;

analyzing, by one or more processors, a degree of usage of the first amount of data by the program;

determining, by one or more processors, a second amount of data that was used by the program based, at least in part, on the degree of usage, wherein the second amount of data is a portion of the first amount of data;

initializing, by one or more processors, a data registry in response to a start of an operation;

instrumenting, by one or more processors, a first data into the data registry;

determining, by one or more processors, whether the first data was read by the program;

responsive to a determination that the first data was read by the program, flagging, by one or more processors, the first data;

determining, by one or more processors, a degree of efficiency of data usage by the program; and

generating, by one or more processors, a report indicating the degree of efficiency of data usage by the program.

2. The method of claim 1 further comprising:

determining, by one or more processors, one or more types of data within the first amount of data that were used by the program.

3. The method of claim 1, wherein the step of determining, by one or more processors, the first amount of data that was provided to the program by the data source further comprises:

determining, by one or more processors, the first amount of data that was provided to the program by the data source using one or both of an application programming interface call and a Structured Query Language query.

4. The method of claim 1 further comprising:

generating, by one or more processors, an analysis that includes one or more outputs, wherein the outputs include one or more of;

an operation name, an operation identification number, the first amount of data, the second amount of data, a percent data amount used by the program, a set of parameters used by the operation, and a list of the first amount of data, wherein the list of the first amount of data includes a set of data flagged as read and a set of data flagged as unread.

5. The method of claim 1 further comprising:

initializing, by one or more processors, a data registry in response to a start of an operation;

instrumenting, by one or more processors, a first data into the data registry;

determining, by one or more processors, whether the first data was read by the program; and

responsive to a determination that the first data was read by the program, flagging, by one or more processors, the first data.

6. The method of claim 1 further comprising:

determining, by one or more processors, a degree of efficiency of data usage by the program; and

generating, by one or more processors, a report indicating the degree of efficiency of data usage by the program.

7. A computer program product for capturing event information comprising:

one or more computer-readable storage media and program instructions stored on the one or more computer-readable storage media, the program instructions comprising;

program instructions to determine a first amount of data that was provided to a program by a data source;

program instructions to analyze a degree of usage of the first amount of data by the program;

program instructions to determine a second amount of data that was used by the program based, at least in part, on the degree of usage, wherein the second amount of data is a portion of the first amount of data;

program instructions to initialize a data registry in response to a start of an operation;

program instructions to instrument a first data into the data registry;

program instructions to determine whether the first data was read by the program;

program instructions to respond to a determination that the first data was read by the program by flagging the first data;

program instructions to determine a degree of efficiency of data usage by the program; and

program instructions to generate a report indicating the degree of efficiency of data usage by the program.

8. The computer program product of claim 7 further comprising:

program instructions to determine one or more types of data within the first amount of data that were used by the program.

9. The computer program product of claim 7, wherein program instructions to determine the first amount of data that was provided to the program by the data source further comprises:

program instructions to determine the first amount of data that was provided to the program by the data source using one or both of an application programming interface call and a Structured Query Language query.

10. The computer program product of claim 7 further comprising:

program instructions to generate an analysis that includes one or more outputs, wherein the outputs include one or more of;

an operation name, an operation identification number, the first amount of data, the second amount of data, a percent data amount used by the program, a set of parameters used by the operation, and a list of the first amount of data, wherein the list of the first amount of data includes a set of data flagged as read and a set of data flagged as unread.

11. The computer program product of claim 7 further comprising:

program instructions to initialize a data registry in response to a start of an operation;

program instructions to instrument a first data into the data registry;

program instructions to determine whether the first data was read by the program; and

program instructions to respond to a determination that the first data was read by the program by flagging the first data.

12. The computer program product of claim 7 further comprising:

program instructions to determine a degree of efficiency of data usage by the program; and

program instructions to generate a report indicating the degree of efficiency of data usage by the program.

13. A computer system for determining efficiency of data exchange comprising:

one or more computer processors;

one or more computer readable storage medium;

program instructions to determine a first amount of data that was provided to a program by a data source;

program instructions to analyze a degree of usage of the first amount of data by the program;

program instructions to determine a second amount of data that was used by the program based, at least in part, on the degree of usage, wherein the second amount of data is a portion of the first amount of data;

program instructions to initialize a data registry in response to a start of an operation;

program instructions to instrument a first data into the data registry;

program instructions to determine whether the first data was read by the program;

program instructions to respond to a determination that the first data was read by the program by flagging the first data;

program instructions to determine a degree of efficiency of data usage by the program; and

program instructions to generate a report indicating the degree of efficiency of data usage by the program.

14. The computer system of claim 13 further comprising:

program instructions to determine one or more types of data within the first amount of data that were used by the program.

15. The computer system of claim 13, wherein the program instructions to determine the first amount of data that was provided to the program by the data source further comprise:

program instructions to determine the first amount of data that was provided to the program by the data source using one or both of an application programming interface call and a Structured Query Language query.

16. The computer system of claim 13 further comprising:

program instructions to generate an analysis that includes one or more outputs, wherein the outputs include one or more of;

an operation name, an operation identification number, the first amount of data, the second amount of data, a percent data amount used by the program, a set of parameters used by the operation, and a list of the first amount of data, wherein the list of the first amount of data includes a set of data flagged as read and a set of data flagged as unread.

17. The computer system of claim 13 further comprising:

program instructions to initialize a data registry in response to a start of an operation;

program instructions to instrument a first data into the data registry;

program instructions to determine whether the first data was read by the program; and

program instructions to respond to a determination that the first data was read by the program by flagging the first data.

18. The computer system of claim 13 further comprising:

program instructions to determine a degree of efficiency of data usage by the program; and

program instructions to generate a report indicating the degree of efficiency of data usage by the program.