STATISTICAL RECORD LINKAGE CALIBRATION FOR GEOGRAPHIC PROXIMITY MATCHING

• US 20110191353A1
• Filed: 01/31/2011
• Published: 08/04/2011
• Est. Priority Date: 01/29/2010
• Status: Active Grant

• Current Assignee: LexisNexis Risk Data Management, Inc. (RELX PLC)
• Original Assignee: LexisNexis Risk Data Management, Inc. (RELX PLC)
• Inventors: L'HEUREUX, George Conrad, Bayliss, David Alan
• Granted Patent: US 8,489,618 B2
• Time in Patent Office: Days
• US Class Current: 707/749
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/29 Geographical information databases

Abstract

Disclosed is a system for, and method of, calculating parameters used to determine whether records and entity representations should be linked. The system and method use a symmetric and reflexive function to allow for linking records and entity representations whose field values differ. The system and method apply iterative techniques such that parameters from each linking iteration are used in the next linking iteration. The system and method need no human interaction in order to calibrate and utilize record matching formulas used for the linking decisions. These techniques may be used for geographic location proximity matching.

Claims

1. A method for generating entity representations in a computer implemented database using a record matching formula and for generating parameters for the record matching formula, the database comprising a plurality of records, each record comprising a plurality of fields, each field capable of containing a field value, wherein at least a portion of parameters for the record matching formula are generated using a symmetric and reflexive function and configured for a particular field value appearing in a selected field of at least one record, and wherein the process provides for linking records or entity representations with non-identical field values, the method comprising the steps of:

forming a notional grid over a geographic area of interest that contains a plurality of points, wherein the geographic area of interest comprises a plurality of squares and wherein each of the plurality of points is associated with one of the plurality of records in the database that contains absolute geographic location information;

calculating a plurality of match probabilities, wherein each match probability reflects a likelihood that an arbitrary point in the geographic area of interest lies within a distance of a square within which the arbitrary point lies as determined by the symmetric and reflexive function;

calculating a plurality of match weights based on the plurality of match probabilities;

linking at least two entity representations in the database based on one or more of the plurality of match weights using the record matching formula; and

retrieving information from at least one record in the database.

2. The method of claim 1, wherein the absolute geographic location information comprises at least one of latitude coordinate data and longitude coordinate data.

3. The method of claim 1, wherein the geographic area of interest comprises at least one of a portion of a city a portion of a county, a portion of a state, a portion of a country, a portion of a continent, and a portion of the world.

4. The method of claim 1, wherein each of the plurality of points represents a location represented by the absolute geographic location information contained in a corresponding record.

5. The method of claim 1, further comprising generating, for each of the plurality of squares, a point tally that indicates an amount of the plurality of points that lie within a corresponding square.

6. The method of claim 1, further comprising calculating a distance between each pair of squares of the plurality of squares.

7. The method of claim 6, wherein the distance between a pair of squares is calculated as the distance between centers of the pair of squares.

8. The method of claim 1, wherein the distance comprises a radius.

9. The method of claim 1, wherein the record matching formula comprises a weighted sum of probabilities that two records match.

10. A system for generating entity representations in a computer implemented database using a record matching formula and for generating parameters for the record matching formula, the database comprising a plurality of records, each record comprising a plurality of fields, each field capable of containing a field value, wherein at least a portion of parameters for the record matching formula are generated using a symmetric and reflexive function and configured for a particular field value appearing in a selected field of at least one record, and wherein the process provides for linking records or entity representations with non-identical field values, the system comprising:

a processor programmed to form a notional grid over a geographic area of interest that contains a plurality of points, wherein the geographic area of interest comprises a plurality of squares and wherein each of the plurality of points is associated with one of the plurality of records in the database that contains absolute geographic location information;

a processor programmed to calculate a plurality of match probabilities, wherein each match probability reflects a likelihood that an arbitrary point in the geographic area of interest lies within a distance of a square within which the arbitrary point lies as determined by the symmetric and reflexive function;

a processor programmed to calculate a plurality of match weights based on the plurality of match probabilities;

a processor programmed to link at least two entity representations in the database based on one or more of the plurality of match weights using the record matching formula; and

a processor programmed to retrieve information from at least one record in the database.

11. The system of claim 10, wherein the absolute geographic location information comprises at least one of latitude coordinate data and longitude coordinate data.

12. The system of claim 10, wherein the geographic area of interest comprises at least one of a portion of a city a portion of a county, a portion of a state, a portion of a country, a portion of a continent, and a portion of the world.

13. The system of claim 10, wherein each of the plurality of points represents a location represented by the absolute geographic location information contained in a corresponding record.

14. The system of claim 10, further comprising a processor programmed to generate, for each of the plurality of squares, a point tally that indicates an amount of the plurality of points that lie within a corresponding square.

15. The system of claim 10, further comprising a processor programmed to calculate a distance between each pair of squares of the plurality of squares.

16. The system of claim 15, wherein the distance between a pair of squares is calculated as the distance between centers of the pair of squares.

17. The system of claim 10, wherein the distance comprises a radius.

18. The system of claim 10, wherein the record matching formula comprises a weighted sum of probabilities that two records match.