System and methods for data indexing and processing

• US 20070013968A1
• Filed: 07/14/2006
• Published: 01/18/2007
• Est. Priority Date: 07/15/2005
• Status: Active Grant

• Current Assignee: Indxit Systems Incorporated
• Original Assignee: Indxit Systems Incorporated
• Inventors: Morvant, Matthew, Ebaugh, Michael
• Granted Patent: US 7,860,844 B2
• Time in Patent Office: Days
• US Class Current: 358/448
• CPC Class Codes: G06F 16/2228 Indexing structures
• CPC Class Codes: G06F 16/31 Indexing; Data structures therefor; Storage structures
• CPC Class Codes: G06F 16/313 Selection or weighting of terms for indexing
• CPC Class Codes: G06F 16/3331 Query processing
• CPC Class Codes: G06Q 10/10 Office automation; Time management
• CPC Class Codes: G06Q 30/04 Billing or invoicing
• CPC Class Codes: G06V 30/414 Extracting the geometrical structure, e.g. layout tree; Block segmentation, e.g. bounding boxes for graphics or text
• CPC Class Codes: G06V 30/418 Document matching, e.g. of document images
• CPC Class Codes: Y02A 90/10 Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation

Abstract

Systems and methods are disclosed that allow for indexing, processing, or both of information from physical media or electronic media, which may be received from a plurality of sources. In embodiments, a document file may be matched using pattern matching methods and may include comparisons with a comparison reference database to improve or accelerate the indexing process. In embodiments, information may be presented to a user as potential matches thereby improving manual indexing processes. In embodiments, one or more additional actions may occur as part of the processing, including without limitation, association additional data with a document file, making observations from the document file, notifying individuals, creating composite messages, and billing events. In an embodiment, data from a document file may be associated with a key word, key phrase, or word frequency value that enables adaptive learning so that unindexed data may be automatically indexed based on user interaction history.

Claims

1. A method for indexing a document file comprising a plurality of characters arranged into an array of strings, the method comprising:

filtering the array of strings to obtain a set of strings;

for each string in the set of strings, creating a first sequence list comprising a substring starting at a first character position in the string and a second sequence list comprising a substring starting at a second character position in the string;

generating a comparison reference database by querying the first and second sequence lists against a reference database, the reference database comprise a plurality of records and each record comprises a plurality of data fields;

for each record in the comparison reference database,

generating a first set of substrings based upon a first set of data fields from the plurality of data fields in the record;

comparing the first set of substrings against the set of strings to identify a longest substring match, if any, for each of the first set of data fields from the record;

filtering the comparison reference database to create a second comparison reference database by selecting each record that has a longest substring match for one or more data fields from the first set of data fields.

assigning a point value for each match found in a record and summing the point value for the record; and

responsive to a record having a total point value exceeding a threshold match value, associating the document file with that record.

2. The method of claim 1 further comprises the step of:

filtering the second comparison reference database based upon proximity within the set of strings of at least two of the longest substring matches of a record from the comparison reference database.

3. The method claim 2 further comprising the step of:

for each record in the second comparison reference database,

generating a second set of substrings based upon a second set of data fields from the plurality of data fields in the record;

comparing the second set of substrings against the set of strings to identify a longest substring match, if any, for each of the second set of data fields from the record;

filtering the second comparison reference database to generate a third comparison reference database by selecting each record that has a longest substring match for one or more data fields from the second set of data fields.

4. The method claim 3 further comprising the step of:

filtering the comparison reference database based upon proximity within the set of strings of at least two of the longest substring matches of a record from the comparison reference database.

5. The method claim 1 wherein the step of filtering the array of strings to obtain a set of strings comprises:

filtering the array of strings to select strings from the array of strings that contains at least one capital letter.

6. The method claim 5 wherein the step of filtering the array of strings to obtain a set of strings further comprises performing at least one of the following:

filtering the set of strings to remove strings identified in a list; and

filtering the set of strings to select strings exceeding a pre-selected number of characters.

7. The method of claim 1 further comprising the step of:

responsive to no records having a total point value exceeding a total point value exceeding the threshold match value, providing at least a portion of the plurality of records to a user for selection.

8. The method of claim 7 further comprising the step of:

providing match information with the at least a portion of the plurality of records.

9. The method of claim 1 further comprising the step of:

associating a billing event based upon identifying a set of characters within the plurality of characters.

10. A computer-readable medium comprising one or more sequences of instructions which, when executed by one or more processors, cause the one or more processors to perform at least the steps of claim 1.

11. A method for indexing a document file comprising a plurality of characters arranged into an array of strings, the method comprising:

identifying date strings within the array of strings that correspond to a date and selecting a date string that corresponds to the earliest date;

comparing the date string that corresponds to the earliest date against a reference database, the reference database comprise a plurality of records and each record comprises at least one data field, to generate a comparison reference database comprising records from the reference database that possess at least one data field that matches the date string;

responsive to the comparison reference database comprising a plurality of records, performing a matching operation to reduce the number of records that comprise the comparison reference database; and

responsive to the comparison reference database comprising one record, associating the document file with that record.

12. The method of claim 11 wherein the matching operation comprises performing one or more matching algorithms.

13. The method of claim 12 wherein a matching algorithm from the one or more matching algorithm may filter the array of strings or the comparison reference database.

14. The method of claims 13 further comprising:

filtering the array of strings to obtain a set of strings wherein the set of strings comprise all strings within a specified position in the array from the date string corresponding to the earliest date; and

comparing the set of strings to one or more data fields from each record in the comparison reference database.

15. The method of claim 14 further comprising:

responsive to no record exceeding a threshold match, filtering the array of strings to obtain a second set of strings wherein the second set of strings comprise all strings within a second specified position in the array from the string corresponding to the earliest date; and

comparing the second set of strings to one or more data fields from each record in the comparison reference database.

16. The method of claim 12 further comprising the step of:

responsive to the comparison reference database comprising a second plurality of records following performance of the matching operation, providing at least a portion of the second plurality of records to a user for selection.

17. The method of claim 16 further comprising the step of:

providing match information with the at least a portion of the second plurality of records.

18. A computer-readable medium comprising one or more sequences of instructions which, when executed by one or more processors, cause the one or more processors to perform at least the steps of claim 11.

19. A system for indexing a document file comprising:

a communications services module coupled to receive from a client a document file and a reference database comprising a plurality of records wherein each record comprises at least one data field element;

an extraction services module, communicatively coupled to the communications services module, that obtains from the document file a plurality of characters arranged into an array of strings; and

indexing services module, communicatively coupled to the extraction services module, that compares a first set of strings from the array of strings against a comparison reference database obtained by filtering the reference database, and;

responsive to at least a portion of the first set of strings exceeding a threshold match with at least a portion of a record in the comparison reference database, associates the document file with the record; and

responsive to the first set of strings matching a plurality of records in the comparison reference database, providing match information to a user for selection.

20. The system of claim 19 wherein the communication services modules receives matching information from a user related to the document file and wherein the indexing services module uses the matching information with a subsequent matching operation.

21. The system of claim 19 wherein the document file is associated with the record by a structured file for indexing the document file and wherein the communications services module transmits the structured file to a user.

22. The system of claim 19 further comprising

an observation services module, communicatively coupled to the indexing services module, that takes an action based upon an observation made within a document file.