Natural language parsers to normalize addresses for geocoding
First Claim
Patent Images
1. A method for normalizing an input address comprising the steps of:
- under control of a computer system comprising computer hardware;
receiving an input address indicative of a physical address;
parsing the input address into components;
classifying each component with a preliminary address field classification according to;
one or more predetermined regular expressions and a lexicon of known tokens, thereby generating classified components, wherein said classifying each component is performed by matching each component to the one or more predetermined regular expressions only when there is no match between that component and the lexicon of known tokens;
determining which of at least one of a plurality of countries and jurisdictions corresponds to the address input;
selecting a predictive model corresponding to the address input from a plurality of predictive models, each of the plurality of predictive models being an automated country-specific natural language parser uniquely defined for a corresponding one of the plurality of countries and jurisdictions, the selected predictive model comprising a graph having address field nodes and edges connecting the address field nodes, each address field node comprising an address field and a corresponding set of one or more address field classifications each assigned a first probability value, and each edge assigned a second probability value; and
executing the selected predictive model to update the preliminary address field classification of at least some of the classified components with one of the address fields in the graph based at least partly on the first and second probability values of the address field nodes and the edges that correspond to the preliminary address field classification of each component.
9 Assignments
0 Petitions
Accused Products
Abstract
The present invention provides a technique for building natural language parsers by implementing a country and/or jurisdiction specific set of training data that is automatically converted during a build phase to a respective predictive model, i.e., an automated country specific natural language parser. The predictive model can be used without the training data to quantify any input address. This model may be included as part of a larger Geographic Information System (GIS) data-set or as a stand alone quantifier. The build phase may also be run on demand and the resultant predictive model kept in temporary storage for immediate use.
53 Citations
16 Claims
-
1. A method for normalizing an input address comprising the steps of:
under control of a computer system comprising computer hardware; receiving an input address indicative of a physical address; parsing the input address into components; classifying each component with a preliminary address field classification according to;
one or more predetermined regular expressions and a lexicon of known tokens, thereby generating classified components, wherein said classifying each component is performed by matching each component to the one or more predetermined regular expressions only when there is no match between that component and the lexicon of known tokens;determining which of at least one of a plurality of countries and jurisdictions corresponds to the address input; selecting a predictive model corresponding to the address input from a plurality of predictive models, each of the plurality of predictive models being an automated country-specific natural language parser uniquely defined for a corresponding one of the plurality of countries and jurisdictions, the selected predictive model comprising a graph having address field nodes and edges connecting the address field nodes, each address field node comprising an address field and a corresponding set of one or more address field classifications each assigned a first probability value, and each edge assigned a second probability value; and executing the selected predictive model to update the preliminary address field classification of at least some of the classified components with one of the address fields in the graph based at least partly on the first and second probability values of the address field nodes and the edges that correspond to the preliminary address field classification of each component. - View Dependent Claims (2, 3, 4, 5)
-
6. A method of constructing a natural language parser comprising the steps of:
-
loading a training file defining an acceptable format for one or more regular expressions and comprising selected address field and token pairs; parsing the training file into a number of tokens; classifying the tokens with preliminary address field classifications according to a lexicon of known tokens and the regular expressions, wherein said classifying the tokens is performed by matching each of the tokens to one of the regular expressions only when there is no match between the token and the lexicon of known tokens; and generating a plurality of predictive models so as to be uniquely defined for a corresponding unique country or jurisdiction and so as to define a probability for each of one or more address fields that may be associated with a given token, each of the predictive models being an automated country-specific natural language parser comprising a graph having address field nodes and edges connecting the address field nodes, each address field node comprising an address field and a corresponding set of one or more address field classifications each assigned a first probability value, and each edge assigned a second probability value, wherein the predictive models are each configured to associate components of an input address with unique address fields by assigning each of the components one of the address fields in the graph based at least partly on the first and second probability values of the address field nodes and the edges that correspond to the preliminary address field classifications of the tokens; wherein at least said generating is implemented by a computer system comprising computer hardware. - View Dependent Claims (7, 8, 9, 10)
-
-
11. A non-transitory computer readable medium encoded with computer readable program code, the program code comprising the instructions of:
-
parsing an input address into components; classifying each component with a preliminary classification according to;
one or more predetermined regular expressions and a lexicon of known tokens, thereby generating classified components, wherein said classifying each component is performed by matching a component to the one or more predetermined regular expressions only when there is no match between that component and the lexicon of known tokens; andexecuting a selected one of a plurality of different predictive models to associate each classified component with a unique address field, wherein the predictive models are respectively associated with particular countries or jurisdictions, the selected predictive model being an automated country-specific natural language parser comprising a graph having address field nodes and edges connecting the address field nodes, each address field node comprising an address field and a corresponding set of one or more address field classifications each assigned a first probability value, and each edge assigned a second probability value; said executing the selected predictive model to associate each classified component with a unique address field by updating the preliminary address field classification of each of the classified components with one of the address fields in the graph based at least partly on the first and second probability values of the nodes and the edges that correspond to the preliminary address field classification of each component. - View Dependent Claims (12, 13, 14, 15, 16)
-
Specification