External linking based on hierarchical level weightings

• US 9,411,859 B2
• Filed: 03/26/2015
• Issued: 08/09/2016
• Est. Priority Date: 12/14/2009
• Status: Active Grant

• Current Assignee: LexisNexis Risk Solutions, Inc. (RELX PLC)
• Original Assignee: LexisNexis Risk Solutions, Inc. (RELX PLC)
• Inventors: Morton, Charles Edwards, Bayliss, David Alan
• Primary Examiner(s): LEROUX, ETIENNE PIERRE
• Application Number:
  US14/669,325
• Publication Number:
  US 20150199363A1
• Time in Patent Office: 502 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/24 Querying
• CPC Class Codes: G06F 16/245 Query processing
• CPC Class Codes: G06F 16/2455 Query execution
• CPC Class Codes: G06F 16/24578 using ranking
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/282 Hierarchical databases, e.g. IMS, LDAP data stores or Lotus Notes
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/35 Clustering; Classification

Abstract

Certain implementations of the disclosed technology include systems and methods for external linking based on hierarchal level weightings. The method may include associating external query data having one or more query field values with a record in a linked hierarchical database. The linked hierarchical database may include a plurality of records, each record having a record identifier and representing an entity in a hierarchy, each record associated with a hierarchy level, each record including one or more fields, each field configured to contain a field value. The associating may include receiving the external query data, wherein the external query data includes one or more search values; and identifying, from the plurality of records in the linked hierarchical database, one or more matched fields having field values that at least partially match the one or more search values.

Claims

1. A computer-implemented method comprising:

associating external query data having one or more query field values with a record in a linked hierarchical database, the linked hierarchical database comprising a plurality of records, each record having a record identifier and representing an entity in a hierarchy, each record associated with a hierarchy level, each record comprising one or more fields, each field configured to contain a field value, the associating comprising;

receiving the external query data, wherein the external query data comprises one or more search values; and

identifying, from the plurality of records in the linked hierarchical database, one or more matched fields having field values that at least partially match the one or more search values;

scoring, with zero or more match weights, each of the one or more matched fields;

determining an aggregate weight for each matched field based at least in part on the scoring with the zero or more match weights;

merging, based at least in part on determining the aggregate weights, the one or more matched fields to form a merged table having records with matched fields;

scoring the merged table based at least in part on the aggregate weights;

identifying, based at least in part on the scoring, a grouping comprising one or more of the plurality of entities within a same branch of the hierarchy and corresponding to different hierarchy levels; and

outputting, based at least in part on the scoring and identifying, a record identifier corresponding to a matching entity in the hierarchy.

2. The method of claim 1, wherein scoring, with the zero or more match weights, comprises scoring each of the one or more matched fields with a uniqueness weight, the uniqueness weight representing a specificity of the field value in relation to all field values in a corresponding field of the plurality of records in the linked hierarchical database.

3. The method of claim 1, further comprising:

sorting the one or more matched fields according to the determined aggregate weights;

at least partially forming one or more search tables corresponding to the one or more search values; and

at least partially forming one or more base tables corresponding to the one or more fields of the plurality of records of the linked hierarchical database; and

wherein the merging, based at least in part on determining the aggregate weights, comprises combining at least a portion of the one or more search tables and the one or more base tables to form the merged table.

4. The method of claim 3, wherein at least partially forming the one or more base tables comprises at least partially forming tables having multiple fields and wherein the base tables comprise record identifiers for each entity in the hierarchy and wherein the method further comprises sorting each entity in the hierarchy by an associated hierarchy level, wherein the sorting each entity in the hierarchy by the associated hierarchy level comprises progressively sorting each entity in the hierarchy by each hierarchy level from a highest level to a lowest level in the hierarchy.

5. The method of claim 3, wherein the one or more search tables comprise zero or more common fields, and wherein the one or more base tables comprise zero or more common fields, and wherein the one or more base tables comprise record identifiers for each entity in the hierarchy.

6. The method of claim 1, further comprising:

determining, from the merged table, and based at least in part from the aggregate weights, a first leading scorer of the matched fields and a second leading scorer of the matched fields, the first leading scorer associated with a record having a highest aggregate weight and the second leading scorer associated with a record having a second highest aggregate weight;

determining a first condition comprising whether a first weight associated with the first leading scorer meets or exceeds a first predetermined value;

determining a second condition comprising whether a difference between the first weight and a second weight associated with the second leading scorer meets or exceeds a second predetermined value; and

wherein the matching entity corresponds to the first leading scorer and is based at least in part on the determining of the first condition and on the determining of the second condition.

7. The method of claim 6, wherein the matching entity further corresponds to an entity associated with a lowest hierarchy level associated with the grouping.

8. The method of claim 6, further comprising;

merging aggregate weights of one or more entities associated with intermediate hierarchy levels in the grouping in response to determining that the first condition or the second condition is not met;

re-determining the first condition and the second condition; and

outputting a record identifier corresponding to an entity associated with a lowest hierarchy level of the grouping in response to re-determining the first condition and the second condition.

9. The method of claim 1, wherein the aggregate weight for each field is based, at least in part, on field values scored from each of the plurality of records in the linked hierarchical database.

10. A system comprising:

a memory for storing data and computer-executable instructions; and

at least one processor configured to access the memory, wherein the at least one processor is further configured to execute the computer-executable instructions to cause the system to perform a method comprising;

associating external query data having one or more query field values with a record in a linked hierarchical database, the linked hierarchical database comprising a plurality of records, each record having a record identifier and representing an entity in a hierarchy, each record associated with a hierarchy level, each record comprising one or more fields, each field configured to contain a field value, the associating comprising;

receiving the external query data, wherein the external query data comprises one or more search values; and

identifying, from the plurality of records in the linked hierarchical database, one or more matched fields having field values that at least partially match the one or more search values;

scoring, with zero or more match weights, each of the one or more matched fields;

determining an aggregate weight for each matched field based at least in part on the scoring with the zero or more match weights;

merging, based at least in part on determining the aggregate weights, the one or more matched fields to form a merged table having records with matched fields;

scoring the merged table based at least in part on the aggregate weights;

identifying, based at least in part on the scoring, a grouping comprising one or more of the plurality of entities within a same branch of the hierarchy and corresponding to different hierarchy levels; and

outputting, based at least in part on the scoring and identifying, a record identifier corresponding to a matching entity in the hierarchy.

11. The system of claim 10, wherein scoring, with the zero or more match weights, comprises scoring each of the one or more matched fields with a uniqueness weight, the uniqueness weight representing a specificity of the field value in relation to all field values in a corresponding field of the plurality of records in the linked hierarchical database.

12. The system of claim 10, wherein the at least one processor is further configured to execute the computer-executable instructions to cause the system to perform the method further comprising:

sorting the one or more matched fields according to the determined aggregate weights;

at least partially forming one or more search tables corresponding to the one or more search values; and

at least partially forming one or more base tables corresponding to the one or more fields of the plurality of records of the linked hierarchical database; and

wherein the merging, based at least in part on determining the aggregate weights, comprises combining at least a portion of the one or more search tables and the one or more base tables to form the merged table; and

wherein the one or more search tables comprise zero or more common fields, and wherein the one or more base tables comprise zero or more common fields, and wherein the one or more base tables comprise record identifiers for each entity in the hierarchy.

13. The system of claim 12, wherein at least partially forming the one or more base tables comprises at least partially forming tables having multiple fields and wherein the base tables comprise record identifiers for each entity in the hierarchy and wherein the method further comprises sorting each entity in the hierarchy by an associated hierarchy level, wherein the sorting each entity in the hierarchy by the associated hierarchy level comprises progressively sorting each entity in the hierarchy by each hierarchy level from a highest level to a lowest level in the hierarchy.

14. The system of claim 10, wherein the at least one processor is further configured to execute the computer-executable instructions to cause the system to perform the method further comprising:

determining, from the merged table, and based at least in part from the aggregate weights, a first leading scorer of the matched fields and a second leading scorer of the matched fields, the first leading scorer associated with a record having a highest aggregate weight and the second leading scorer associated with a record having a second highest aggregate weight;

determining a first condition comprising whether a first weight associated with the first leading scorer meets or exceeds a first predetermined value;

determining a second condition comprising whether a difference between the first weight and a second weight associated with the second leading scorer meets or exceeds a second predetermined value; and

wherein the matching entity corresponds to the first leading scorer and is based at least in part on the determining of the first condition and on the determining of the second condition.

15. The system of claim 14, wherein the matching entity further corresponds to an entity associated with a lowest hierarchy level associated with the grouping.

16. The system of claim 14, wherein the at least one processor is further configured to execute the computer-executable instructions to cause the system to perform the method further comprising:

merging aggregate weights of one or more entities associated with intermediate hierarchy levels in the grouping in response to determining that the first condition or the second condition is not met;

re-determining the first condition and the second condition; and

outputting a record identifier corresponding to an entity associated with a lowest hierarchy level of the grouping in response to re-determining the first condition and the second condition.

17. The system of claim 10, wherein the aggregate weight for each field is based, at least in part, on field values scored from each of the plurality of records in the linked hierarchical database.

18. A non-transient computer-readable medium that stores instructions, that when executed by a computer device having one or more processors, cause the computer device to perform a method comprising:

associating external query data having one or more query field values with a record in a linked hierarchical database, the linked hierarchical database comprising a plurality of records, each record having a record identifier and representing an entity in a hierarchy, each record associated with a hierarchy level, each record comprising one or more fields, each field configured to contain a field value, the associating comprising;

receiving the external query data, wherein the external query data comprises one or more search values; and

identifying, from the plurality of records in the linked hierarchical database, one or more matched fields having field values that at least partially match the one or more search values;

scoring, with zero or more match weights, each of the one or more matched fields;

determining an aggregate weight for each matched field based at least in part on the scoring with the zero or more match weights;

merging, based at least in part on determining the aggregate weights, the one or more matched fields to form a merged table having records with matched fields;

scoring the merged table based at least in part on the aggregate weights;

identifying, based at least in part on the scoring, a grouping comprising one or more of the plurality of entities within a same branch of the hierarchy and corresponding to different hierarchy levels; and

outputting, based at least in part on the scoring and identifying, a record identifier corresponding to a matching entity in the hierarchy.

19. The non-transient computer-readable medium of claim 18, wherein the method further comprises:

at least partially forming one or more search tables corresponding to the one or more search values; and

at least partially forming one or more base tables corresponding to the one or more fields of the plurality of records of the linked hierarchical database; and

wherein the merging, based at least in part on determining the aggregate weights, comprises combining at least a portion of the one or more search tables and the one or more base tables to form the merged table, and wherein at least partially forming the one or more base tables comprises at least partially forming tables having multiple fields and wherein the base tables comprise record identifiers for each entity in the hierarchy and wherein the method further comprises;

sorting each entity in the hierarchy by an associated hierarchy level, wherein the sorting each entity in the hierarchy by the associated hierarchy level comprises progressively sorting each entity in the hierarchy by each hierarchy level from a highest level to a lowest level in the hierarchy.

20. The non-transient computer-readable medium of claim 19, wherein the method further comprises:

determining, from the merged table, and based at least in part from the aggregate weights, a first leading scorer of the matched fields and a second leading scorer of the matched fields, the first leading scorer associated with a record having a highest aggregate weight and the second leading scorer associated with a record having a second highest aggregate weight;

determining a first condition comprising whether a first weight associated with the first leading scorer meets or exceeds a first predetermined value;

determining a second condition comprising whether a difference between the first weight and a second weight associated with the second leading scorer meets or exceeds a second predetermined value;

merging aggregate weights of one or more entities associated with intermediate hierarchy levels in the grouping in response to determining that the first condition or the second condition is not met;

re-determining the first condition and the second condition; and

outputting a record identifier corresponding to an entity associated with a lowest hierarchy level of the grouping in response to re-determining the first condition and the second condition;

wherein the matching entity corresponds to the first leading scorer and is based at least in part on the determining of the first condition and on the determining of the second condition, and wherein the matching entity further corresponds to an entity associated with a lowest hierarchy level associated with the grouping.