Data File Correlation System And Method

• US 20100023511A1
• Filed: 10/02/2009
• Published: 01/28/2010
• Est. Priority Date: 09/22/2005
• Status: Abandoned Application

• Current Assignee: Robert B. Davis, Wincenty J. Borodziewicz
• Original Assignee: Robert B. Davis, Wincenty J. Borodziewicz
• Inventors: Davis, Robert E., Borodziewicz, Wincenty J.
• Application Number:
  US12/572,757
• Publication Number:
  US 20100023511A1
• Time in Patent Office: Days
• US Class Current: N/A
• CPC Class Codes: G06F 16/334 Query execution G06F16/335 takes precedence

Abstract

A method for correlating data from a data source representing a single data file to a data target containing a plurality of data files is provided. The method includes normalizing the data from the data source, such as by removing white space and replacing data strings. One or more data strings are selected for use as preliminary selection criteria. The preliminary selection criteria are then used to search for one or more matches in the normalized data from the data source. If no match is found, one or more data strings are selected for use as secondary selection criteria. A correlation score is calculated if at least one match is found using the preliminary selection criteria.

Claims

1. A processor-implemented method for correlating data from a data source representing a single data file to a data target containing a plurality of data files, comprising:

normalizing the data from the data source;

determining one or more data strings to use as preliminary selection criteria;

using the preliminary selection criteria to search for one or more matches in the normalized data from the data source using a data processor;

determining one or more data strings to use as secondary selection criteria if no match is found using the preliminary selection criteria; and

calculating a correlation score if at least one match is found using the preliminary selection criteria using the data processor; and

storing the correlation score in a computer-readable memory.

2. The method of claim 1 further comprising determining one or more data strings to use as secondary selection criteria if the correlation score is less than a threshold score.

3. The method of claim 1 further comprising associating data from the data source to one of the data files of the plurality of data files of the data target if the correlation score equals a matching score.

4. The method of claim 2 wherein the threshold score 1S selected based on the data source.

5. The method of claim 2 wherein the threshold score is selected based on the data target.

6. The method of claim 3 wherein the matching score 1S selected based on the data source.

7. The method of claim 3 wherein the matching score 1S selected based on the data target.

8. The method of claim 1 wherein calculating the correlation score if at least one match is found using the preliminary selection criteria comprises determining:

Score=BL−

(dist1*m)

where;

BL=a predetermined baseline value

dist1=Levenshtein(source_str, result_str)

m=multiplier based on whether preliminary selection criteria is a key criteria

source_str=data string extracted from source

dataresult str=data string located in target data;

wherein the determining is performed using the data processor.

9. The method of claim 8 further comprising:

determining whether the correlation score is greater than or equal to a predetermined threshold; and

adjusting the correlation score if the correlation score is not greater than or equal to the predetermined threshold.

10. The method of claim 9 wherein adjusting the correlation score if the correlation score is not greater than or equal to the predetermined threshold comprises adding a constant to the score if the matched data string is a key criteria.

11. The method of claim 9 wherein adjusting the correlation score if the correlation score is not greater than or equal to the predetermined threshold comprises determining:

Score=Score+[(edt−

dist2)*m]

Where;

edt=predetermined edit distance threshold

dist2=(source_str,result_str)

m=multiplier based on whether secondary selection criteria is a key criteria

source_str=data string extracted from source

dataresult_str=data string located in target data;

wherein the determining is performed using the data processor.

12. A computer-implemented method for correlating data from a data source representing an electronically-stored single data file to a data target containing a plurality of electronically-stored data files, comprising:

normalizing the data from the data source using data processing equipment;

determining one or more data strings that are a first subset of a plurality of data strings to use as preliminary selection criteria using data processing equipment;

using the preliminary selection criteria to search for one or more matches in the normalized data from the data source using data processing equipment;

determining one or more data strings that are a second subset of the plurality of data strings to use as secondary selection criteria using data processing equipment if no match is found using the preliminary selection criteria; and

calculating a correlation score using data processing equipment if at least one match is found using the preliminary selection criteria.

13. The method of claim 12 further comprising determining one or more data strings to use as secondary selection criteria using data processing equipment if the correlation score is less than a threshold score.

14. The method of claim 12 further comprising associating data from the data source to one of the data files of the plurality of data files of the data target using data processing equipment if the correlation score equals a matching score.

15. The method of claim 13 wherein the threshold score is selected based on the data source.

16. The method of claim 13 wherein the threshold score is selected based on the data target.

17. The method of claim 14 wherein the threshold score is selected based on the data source.

18. The method of claim 14 wherein the threshold score is selected based on the data target.

19. The method of claim 12 wherein calculating the correlation score using data processing equipment if at least one match is found using the preliminary selection criteria comprises using data processing equipment to determine a variable score based on the equation:

Score=BL−

(dist1*m)

where;

BL=a predetermined baseline value

dist1=Levenshtein(source_str, result_str)

m=multiplier based on whether preliminary selection criteria is a key criteria

source_str=data string extracted from source

dataresult_tr=data string located in target data.

20. A computer-implemented system for correlating data from a data source representing an electronically-stored single data file to a data target containing a plurality of electronically-stored data files, comprising:

means for normalizing the data from the data source;

means for determining one or more data strings to use as preliminary selection criteria;

means for using the preliminary selection criteria to search for one or more matches in the normalized data from the data source;

means for determining one or more data strings to use as secondary selection criteria if no match is found using the preliminary selection criteria; and

means for calculating a correlation score if at least one match is found using the preliminary selection criteria.