SIMILARITY AND RANKING OF DATABASES BASED ON DATABASE METADATA

• US 20150269161A1
• Filed: 11/12/2014
• Published: 09/24/2015
• Est. Priority Date: 03/19/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Kiernan, Gerald G., Bhagavan, Srini
• Granted Patent: US 10,303,793 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/152 using file content signatures, e.g. hash values
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 16/9535 Search customisation based on user profiles and personalisation
• CPC Class Codes: G06F 16/9538 Presentation of query results

Abstract

A processor selects a first database and a second database from a plurality of databases. The processor determines one or more terms found in the first and second database, wherein each term of the one or more terms includes metadata of a database of the plurality of databases. The processor identifies one or more common terms between the first database and the second database and determines the one or more common terms found in each of a plurality of groups of databases of the plurality of databases, wherein each group of databases corresponds to a number of databases which constitute the group of databases. The processor determines a similarity score between the first database and the second database of the plurality of databases based on the one or more common terms found in each group of databases of the plurality of databases.

Claims

1. A method for determining similarity of databases, the method comprising:

(a) selecting a first database and a second database from a plurality of databases;

(b) determining if one or more terms found in the first database are also found in the second database, wherein each term of the one or more terms includes metadata of a database of the plurality of databases, and wherein the one or more terms found in both the first database and the second database are one or more common terms;

(c) determining a quantity of the one or more common terms found in each of a plurality of groups of databases of the plurality of databases, wherein each group of databases corresponds to a number of databases which constitute the group of databases; and

(d) determining a similarity score between the first database and the second database of the plurality of databases based on the one or more common terms found in each group of databases of the plurality of databases.

2. The method of claim 1, further comprising:

performing steps (a) through (d) for each pairing of the first database with each database of the plurality of databases other than the second database.

3. The method of claim 2, further comprising:

ranking the similarity scores for each pairing of the first database with each database of the plurality of databases.

4. The method of claim 1, further comprising:

performing steps (a) through (d) on all pairings of databases of the plurality of databases, other than pairings with the first database; and

ranking the similarity scores of all the pairings of the plurality of databases, other than pairings with the first database.

5. The method of claim 1, further comprising:

creating a graph based on the quantity of the one or more common terms found in each group of databases of the plurality of groups of databases, wherein the graph is associated with a similarity of the second database to the first database.

6. The method of claim 1, wherein the metadata of each of the one or more common terms includes at least one of a database table name, a database table column name, and a database table column type.

7. The method of claim 1, wherein at least one term of the one or more terms is a hash derived from the metadata of the database of the plurality of databases.

8. The method of claim 1, wherein determining the one or more common terms includes determining a partial match of the one or more common terms between the first database and the second database.

9. A method for determining a similarity of databases to search criteria, the method comprising:

(a) receiving search criteria, wherein the search criteria includes one or more terms;

(b) determining the one or more terms found in both the search criteria and a first database of a plurality of databases, wherein the one or more terms found in both the search criteria and a first database are one or more common terms;

(c) determining a quantity of the one or more common terms found in each of a plurality of groups of databases of the plurality of databases, wherein a group of databases of the plurality of groups of databases corresponds to a number of databases which constitutes the group of databases; and

(d) determining a similarity score of the first database of the plurality of databases based on the quantity of the one or more common terms found in each group of databases of the plurality of databases, wherein the similarity of the first database to the search criteria is based on the similarity score.

10. The method of claim 9, wherein determining a similarity score of the first database, further comprises:

performing steps (a) through (d) for each pairing of the search criteria and each database of the plurality of databases other than the first database.

11. The method of claim 10, further comprising:

ranking the similarity of each database of the plurality of databases to the search criteria, based on the similarity score of each database of the plurality of databases.

12. The method of claim 9, wherein the one or more terms of the search criteria include metadata of one or more databases, the metadata having at least one of a database table name, a database table column name, and a database table column type.

13. The method of claim 9, wherein the search criteria is a hash derived from the one or more terms of the search criteria.

14. The method of claim 9, wherein determining the one or more common terms includes determining a partial match of the one or more common terms between the search criteria and the first database.