QUALITY ANALYSIS ON OBJECT NOTATION DATA SOURCES

• US 20170102923A1
• Filed: 10/13/2015
• Published: 04/13/2017
• Est. Priority Date: 10/13/2015
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Ayyagari, Phani Kumar V. U., Bhide, Manish A., Eshwar, Bhavani K., Jasti, Purnachandra R.
• Granted Patent: US 10,324,981 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 16/80 of semi-structured data, e.g. markup language structured data such as SGML, XML or HTML content-based retrieval of web data G06F16/95
• CPC Class Codes: G06F 9/45504 Abstract machines for programme code execution, e.g. Java virtual machine [JVM], interpreters, emulators

Abstract

Determination of a degree of similarity among and between a set of text notation schema instances. One type of text notation schema instance is the JSON type. In some embodiments, the degree of similarity is expressed as a schema variance value which is determined by individually comparing the schema instances of the set of text notation schema instances to a representative majority schema. Also, determining a quality of a data source associated with the plurality of text notation schema instances based, at least in part, upon the similarity value.

Claims

1. A computer-implemented method comprising:

receiving a plurality of text notation schema instances;

determining a degree of similarity of structure and content between at least some of the text notation schema instances of the plurality of text notation schema instances; and

outputting a similarity value based, at least in part, upon the determined degree of similarity.

2. The computer-implemented method of claim 1 wherein the plurality of text notation schema instances are instances of an object-oriented notation scripting language schema.

3. The computer-implemented method of claim 2 wherein the plurality of text notation schema instances are instances of JSON (JAVA scripting language object notation schema.

4. The computer-implemented method of claim 1 wherein the determination of the degree of similarity includes the following:

matching nodes between schema instances during a pass using level order traversal; and

matching nodes between schema instances, where the nodes are at different levels of the schema instances under comparison.

5. The computer-implemented method of claim 1 wherein the determination of the degree of similarity includes the following:

determining a majority schema instance that is representative of the plurality of schemas instances considered as a whole;

for each schema instance of the plurality of schema instances, determining a degree of similarity respectively between each schema instance and the majority schema instance; and

determining an aggregate degree of similarity for the plurality of schema instances by aggregating the degree of similarity determined for each schema instance relative to the majority schema instance.

6. The computer-implemented method of claim 5 wherein the determination of the degree of similarity respectively between each schema instance and the majority schema instance includes the following:

matching nodes between the schema instance and the majority schema instance during a pass using level order traversal; and

matching nodes between the schema instance and the majority schema instance, where the nodes are at different levels of the schema instances under comparison.

7. The computer-implemented method of claim 1 further comprising:

determining a quality of a data source associated with the plurality of text notation schema instances based, at least in part, upon the similarity value.

8. A computer program product comprising a computer readable storage medium having stored thereon:

first program instructions programmed to receive a plurality of text notation schema instances;

second program instructions programmed to determine a degree of similarity of structure and content between at least some of the text notation schema instances of the plurality of text notation schema instances; and

third program instructions programmed to output a similarity value based, at least in part, upon the determined degree of similarity.

9. The computer program product of claim 8 wherein the plurality of text notation schema instances are instances of an object-oriented notation scripting language schema.

10. The computer program product of claim 9 wherein the plurality of text notation schema instances are instances of JSON (JAVA scripting language object notation schema.

11. The computer program product of claim 8 wherein the second program instructions include:

fourth program instructions programmed to match nodes between schema instances during a pass using level order traversal; and

fifth program instructions programmed to match nodes between schema instances, where the nodes are at different levels of the schema instances under comparison.

12. The computer program product of claim 8 wherein the second program instructions include:

fourth program instructions programmed to determine a majority schema instance that is representative of the plurality of schemas instances considered as a whole;

fifth program instructions programmed to, for each schema instance of the plurality of schema instances, determine a degree of similarity respectively between each schema instance and the majority schema instance; and

sixth program instructions programmed to determine an aggregate degree of similarity for the plurality of schema instances by aggregating the degree of similarity determined for each schema instance relative to the majority schema instance.

13. The computer program product of claim 12 wherein the fifth program instructions include:

seventh program instructions programmed to match nodes between the schema instance and the majority schema instance during a pass using level order traversal; and

eighth program instructions programmed to match nodes between the schema instance and the majority schema instance, where the nodes are at different levels of the schema instances under comparison.

14. The computer program product of claim 8 further comprising:

fourth program instructions programmed to determine a quality of a data source associated with the plurality of text notation schema instances based, at least in part, upon the similarity value.

15. A computer system for, the computer system comprising:

a processor(s) set; and

a computer readable storage medium;

wherein;

the processor set is structured, located, connected and/or programmed to run program instructions stored on the computer readable storage medium; and

the program instructions include;

first program instructions programmed to receiving a plurality of text notation schema instances;

second program instructions programmed to determining a degree of similarity of structure and content between at least some of the text notation schema instances of the plurality of text notation schema instances; and

third program instructions programmed to outputting a similarity value based, at least in part, upon the determined degree of similarity.

16. The computer system of claim 15 wherein the plurality of text notation schema instances are instances of an object-oriented notation scripting language schema.

17. The computer system of claim 16 wherein the plurality of text notation schema instances are instances of JSON (JAVA scripting language object notation schema.

18. The computer system of claim 15 wherein the determination of the degree of similarity includes the following:

fourth program instructions programmed to matching nodes between schema instances during a pass using level order traversal; and

fifth program instructions programmed to matching nodes between schema instances, where the nodes are at different levels of the schema instances under comparison.

19. The computer system of claim 15 wherein the determination of the degree of similarity includes the following:

fourth program instructions programmed to determining a majority schema instance that is representative of the plurality of schemas instances considered as a whole;

fifth program instructions programmed to, for each schema instance of the plurality of schema instances, determining a degree of similarity respectively between each schema instance and the majority schema instance; and

sixth program instructions programmed to determining an aggregate degree of similarity for the plurality of schema instances by aggregating the degree of similarity determined for each schema instance relative to the majority schema instance.

20. The computer system of claim 18 wherein the determination of the degree of similarity respectively between each schema instance and the majority schema instance includes the following:

seventh program instructions programmed to matching nodes between the schema instance and the majority schema instance during a pass using level order traversal; and

eighth program instructions programmed to matching nodes between the schema instance and the majority schema instance, where the nodes are at different levels of the schema instances under comparison.