System and method for associating related records to common entities across multiple lists

• US 9,483,546 B2
• Filed: 12/15/2014
• Issued: 11/01/2016
• Est. Priority Date: 12/15/2014
• Status: Active Grant

• Current Assignee: Palantir Technologies Incorporated
• Original Assignee: Palantir Technologies Incorporated
• Inventors: Tessier-Lavigne, Christian, Erenrich, Daniel
• Primary Examiner(s): VU, BAI DUC
• Application Number:
  US14/571,098
• Publication Number:
  US 20160171075A1
• Time in Patent Office: 687 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/215 Improving data quality; Data cleansing, e.g. de-duplication, removing invalid entries or correcting typographical errors
• CPC Class Codes: G06F 16/24558 Binary matching operations
• CPC Class Codes: G06F 16/24575 using context
• CPC Class Codes: G06F 16/2462 Approximate or statistical queries
• CPC Class Codes: G06F 16/2465 Query processing support for facilitating data mining operations in structured databases
• CPC Class Codes: G06F 16/285 Clustering or classification

Abstract

Computer implemented systems and methods are disclosed for associating records across lists, wherein the lists include a plurality of records and the plurality of records is associated with a respective entity. In accordance with some embodiments, the systems and methods further comprise grouping one or more records from a first list into a first group based on fields of the records in the first list, grouping one or more records from a second list into a second group based on fields of the records in the second list, pairing a record from the first group with a record from the second group, assessing each pair of records based on an evaluation of the respective pair according to fields of the pair, and associating records from the first group and records of the second group with an entity based on the assessment.

Claims

1. A system for associating records across a first list and a second list to a common entity, the system comprising:

one or more memory devices that store;

a set of instructions; and

a first list and a second list, wherein the first list and the second list both include a plurality of records, and wherein each of the plurality of records is associated with a respective entity and includes one or more fields;

one or more processors configured to execute the set of instructions that cause the one or more processors to;

group, into a first group, one or more records of the first list based on one or more fields of the records of the first list;

group, into a second group, one or more records of the second list based on one or more fields of the records of the second list;

pair a record of the one or more records of the first group with a record of the one or more records of the second group;

assess each pair of the one or more pairs based on an evaluation of the respective pair according to one or more fields of the pair; and

associate one or more records of the first group and one or more of the records of the second group with an entity based on the assessment.

2. The system of claim 1, wherein the group of records of the first group and the group of records of the second group are based on similar one or more fields.

3. The system of claim 1, wherein the assessment is based on one or more evaluations.

4. The system of claim 1, where the assessment is trained based on the one or more evaluations.

5. The system of claim 1, wherein the assessment of a first record and a second record of the pair is at least partially based on information that is external to the first record and the second record of the pair.

6. The system of claim 1, further comprising one or more processors configured to execute a set of instructions that cause the one or more processors to associate one or more records of the first group with one or more other records of the first group based on the one or more assessments of a pair.

7. The system of claim 1, wherein at least one of the first list and the second list is cleaned before the at least one of the first list and the second list is grouped.

8. A method for associating records across a first list and a second list to a common entity, the method comprising:

obtaining a first list and a second list, wherein the first list and the second list both include a plurality of records, and wherein each of the plurality of records is associated with a respective entity and includes one or more fields;

grouping a record of the plurality of records of the first list into one or more first groups based on one or more fields of the record;

grouping a record of the plurality of records of the second list into one or more second groups based on one or more fields of the record;

pairing a record of the first group with a record of the second group, wherein the record of the first group and the record of the second group were grouped respectively based on similar one or more fields;

evaluating, one or more times, a pair;

associating, with an entity, the records of a pair, wherein the association is based on assessing the one or more evaluations of the pair.

9. The method of claim 8, wherein the grouping of records of the first group and the grouping of records of the second group are based on similar one or more fields.

10. The method of claim 8, where associating is trained based on the one or more evaluations.

11. The method of claim 8, wherein assessing a first record and a second record of the pair is at least partially based on information that is external to the first record and the second record of the pair.

12. The method of claim 8, further comprising of associating one or more records of the first group with one or more other records of the first group based on evaluating the pair.

13. A non-transitory computer-readable medium storing a set of instructions that are executable by one or more processors to cause the one or more processors to perform a method to associate related records across a first list and a second list to a common entity, the method comprising:

obtaining a first list and a second list, wherein the first list and the second list both include a plurality of records, and wherein each of the plurality of records is associated with a respective entity and includes one or more fields;

grouping a record of the plurality of records of the first list into one or more first groups based on one or more fields of the record;

grouping a record of the plurality of records of the second list into one or more second groups based on one or more fields of the record;

pairing a record of the first group with a record of the second group, wherein the record of the first group and the record of the second group were grouped respectively based on similar one or more fields;

evaluating, one or more times, a pair;

associating, with an entity, the records of a pair, wherein the association is based on assessing the one or more evaluations of the pair.

14. The non-transitory computer-readable medium of claim 13, wherein the grouping of records of the first group and the grouping of records of the second group are based on similar one or more fields.

15. The non-transitory computer-readable medium of claim 13, where associating is trained based on the one or more evaluations.

16. The non-transitory computer-readable medium of claim 13, wherein evaluating a first record and a second record of the pair is at least partially based on information that is external to the first record and the second record of the pair.

17. The non-transitory computer-readable medium of claim 13, further comprising a set of instructions that are executable by one or more processors to cause the one or more processors to perform associating one or more records of the first group with one or more other records of the first group based on evaluating the pairs.