Method and system for approximate string matching

• US 9,251,294 B2
• Filed: 07/04/2010
• Issued: 02/02/2016
• Est. Priority Date: 06/19/2004
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Nevidomski, Alexei, Volkov, Pavel
• Primary Examiner(s): PENG, HUAWEN A
• Application Number:
  US12/830,345
• Publication Number:
  US 20100268724A1
• Time in Patent Office: 2,039 Days
• Field of Search: 707/759, 707/796, 707/797
• US Class Current: 1/1
• CPC Class Codes: G06F 16/90344 by using string matching techniques

Abstract

Approximate string matching of a target string to a trie data structure in which the trie data structure has a root node and generations of child nodes, each node representing at least one character in an alphabet to provide a lexicon of words and word fragments. Traversing the trie data structure includes starting from the root node by comparing each node of a branch of the trie data structure to characters in the target string and adding characters traversed in a branch of the trie data structure to a gathered string to provide suggestions of approximate matches. If a node is reached that is flagged as a node for a word or a word fragment and, and if the target string is longer than the gathered string, the method loops back to the root node, and continues the traverse from the root node. At each node, the system determines if there is a correction rule for one or more characters in the remainder of the target string from the current node, and if so, applies the correction rule to the target string to obtain a modified target string.

Claims

1. A method of approximate string matching of a target string to a trie data structure, the trie data structure having a root node and generations of child nodes, each node representing at least one character in an alphabet, the method comprising:

traversing the trie data structure starting from the root node by comparing each node of a branch of the trie data structure to at least one character in the target string;

determining, at each node, if there is a correction rule for one or more characters in the remainder of the target string from the current node, and, if so, applying the correction rule to the target string to modify the target string to obtain a modified target string, wherein applying the correction rule includes performing a sequence to sequence character substitution on the target string to obtain the modified target string, and continuing to traverse the trie data structure from the current node using the modified target string, wherein no additional modifications of the modified target string are allowed within its modified parts; and

providing, responsive to the traversing, at least one suggestion from the trie data structure.

2. A method as in claim 1, further comprising:

adding characters traversed in a branch of the trie data structure to a gathered string; and

reaching a node flagged as a node for a word or a word fragment, comparing the length of the target string to the length of the gathered string, and, if the target string is longer than the gathered string, looping back to the root node, and continuing the traverse from the root node.

3. A method as in claim 1, further comprising:

also continuing to traverse the trie data structure from the current node with the original target string following applying the correction rule by performing a sequence to sequence character substitution on the target string to obtain the modified target string.

4. A method as claimed in claim 2, wherein at the step of reaching a node flagged as a node for a word or a word fragment, if the node is flagged as a word and if the target string is longer than the gathered string, the method includes adding a word break to the gathered string before looping back to the root node.

5. A method as claimed in claim 2, wherein at the step of reaching a node flagged as a node for a word or a word fragment, if the node is flagged as a word fragment and if the target string is longer than the gathered string, the method includes looping back to the root node and continuing to add characters to the gathered string.

6. A method as claimed in claim 1, wherein the method includes at each node:

accepting a match for a character by appending the character to a gathered string and incrementing the current character in the target string;

or

applying an edit operation to a gathered string and incrementing a count of an error value for the approximation.

7. A method as claimed in claim 6, wherein the method includes predefining edit operations to be skipped depending on the edit operations carried out in previous steps of the traverse.

8. A method as claimed in claim 1, wherein the traverse is a single, non-deterministic pass which gathers entries which conform to an error tolerance.

9. A method as claimed in claim 1, wherein the correction rule is stored in the trie data structure.

10. A method as claimed in claim 1, wherein the correction rule is stored in a separate data structure.

11. A system including at least one processor and a memory storing program code for execution on the processor for approximate string matching of a target string to a trie data structure, comprising:

a trie data structure stored in said memory and having a root node and generations of child nodes each node representing at least one character in an alphabet;

program code for traversing the trie data structure starting from the root node by comparing each node of a branch of the trie data structure to at least one character in the target string;

program code for determining, at each node, if there is a correction rule for one or more characters in the remainder of the target string from the current node, and, if so, applying the correction rule to the target string to modify the target string to obtain a modified target string, wherein applying the correction rule includes performing a sequence to sequence character substitution on the target string to obtain the modified target string, and for continuing to traverse the trie data structure from the current node using the modified target string, wherein no additional modifications of the modified target string are allowed within its modified parts; and

program code for providing, responsive to the traversing, at least one suggestion from the trie data structure.

12. A system as claimed in claim 11, the program code further comprising:

program code for adding characters traversed in a branch of the trie data structure to a gathered string; and

program code for reaching a node flagged as a node for a word or a word fragment, comparing the length of the target string to the length of the gathered string, and, if the target string is longer than the gathered string, looping back to the root node, and continuing the traverse from the root node.

13. A system as claimed in claim 11, the program code further comprising:

program code for also continuing to traverse the trie data structure from the current node with the original target string following applying the correction rule by performing a sequence to sequence character substitution on the target string to obtain the modified target string.

14. A system as claimed in claim 12, the program code further comprising:

program code for, responsive to reaching a node flagged as a node for a word or a word fragment, if the node is flagged as a word and if the target string is longer than the gathered string, adding a word break to the gathered string before looping back to the root node.

15. A system as claimed in claim 12, the program code further comprising:

program code for, responsive to reaching a node flagged as a node for a word or a word fragment, if the node is flagged as a word fragment and if the target string is longer than the gathered string, looping back to the root node and continuing to add characters to the gathered string.

16. A system as claimed in claim 11, the program code further comprising program code for, at each node:

accepting a match for a character by appending the character to a gathered string and incrementing the current character in the target string;

or

applying an edit operation to a gathered string and incrementing a count of an error value for the approximation.

17. A system as in claim 16, the program code further comprising:

program code for predefining edit operations to be skipped depending on the edit operations carried out in previous steps of the traverse.

18. A system as claimed in claim 11, wherein the traverse is a single, non-deterministic pass which gathers entries which conform to an error tolerance.

19. A system as claimed in claim 11, wherein the correction rule is stored in the trie data structure.

20. A computer program product stored on a non-signal computer readable storage medium, comprising program code for performing the steps of:

traversing the trie data structure starting from the root node by comparing each node of a branch of the trie data structure to at least one character in the target string;

determining, at each node, if there is a correction rule for one or more characters in the remainder of the target string from the current node, and, if so, applying the correction rule to the target string to modify the target string to obtain a modified target string, wherein applying the correction rule includes performing a sequence to sequence character substitution on the target string to obtain the modified target string, and continuing to traverse the trie data structure from the current node using the modified target string, wherein no additional modifications of the modified target string are allowed within its modified parts; and

providing, responsive to the traversing, at least one suggestion from the trie data structure.