Apparatus and method for recognizing the state of origin of a vehicle license plate

• US 8,218,822 B2
• Filed: 05/14/2008
• Issued: 07/10/2012
• Est. Priority Date: 05/14/2007
• Status: Expired due to Fees

• Current Assignee: 3M Innovative Properties Company (3M Company)
• Original Assignee: PIPS Technology Incorporated (3M Company)
• Inventors: Sefton, Alan K.
• Primary Examiner(s): Wu, Jingge
• Assistant Examiner(s): GORADIA, SHEFALI DINESH
• Application Number:
  US12/120,375
• Publication Number:
  US 20080285804A1
• Time in Patent Office: 1,518 Days
• Field of Search: 382/104, 382/162, 382/165, 382/105
• US Class Current: 382/105
• CPC Class Codes: G06V 20/52 Surveillance or monitoring of activities, e.g. for recognising suspicious objects recognising microscopic objects G06V20/69
• CPC Class Codes: G06V 20/625 License plates

Abstract

A system analyzes various design characteristics of a vehicle license plate, including character size, placement and color, to identify the state of issuance of the plate. In some embodiments, the system uses spectral properties of light reflected from a vehicle license plate to determine spectral frequency bands having the best contrast between characters on the plate and the background of the plate. For example, red characters against a white background exhibit high contrast levels at wavelengths of about 420 nm to about 595 nm. Green characters against a white background exhibit high contrast levels at wavelengths of about 600 nm to about 750 nm. Blue characters against a white background exhibit high contrast levels at wavelengths of about 550 nm to about 750 nm. Thus, spectral characteristics in combination with other design-related characteristics of a license plate may be used to identify the state of origin of the plate. Once the state of origin is identified, origin-specific syntax matching may be used to enhance optical character recognition routines.

Claims

1. An apparatus for extracting information from a vehicle license plate, comprising:

one or more imaging devices for acquiring one or more images that include the vehicle license plate, where the one or more images include color information;

a license plate detection module for detecting a vehicle license plate image portion within the one or more images;

a license plate characteristic database for storing license plate characteristics of license plates issued by a plurality of state governments;

an origin determination module for determining a plurality of license plate characteristics found in the vehicle license plate image portion, for comparing the license plate characteristics found in the vehicle license plate image portion to license plate characteristics stored in the license plate characteristic database, for determining based on the comparison multiple candidate state governments from which the vehicle license plate may have issued, for each of the multiple candidate state governments, applying a color test that is specific to the candidate state government, wherein each color test detects whether a particular color is present in a particular location in the vehicle license plate image portion, for selecting, based at least in part on the particular color detected in the particular location in the vehicle license plate image portion, at least one of the candidate state governments as the state government that issued the license plate, and for generating state issue information based on the selection;

an optical character recognition engine for determining alphanumeric characters from the license plate image portion; and

an output device for outputting the alphanumeric characters and the state issue information.

2. The apparatus of claim 1 further comprising:

a spectral band selection module for selecting one or more spectral bands of the license plate image portion; and

the optical character recognition engine uses the one or more spectral bands in determining alphanumeric characters.

3. The apparatus of claim 2 wherein the spectral band selection module uses information generated by the origin determination module in selecting the one or more spectral bands of the license plate image portion for use by the optical character recognition engine.

4. The apparatus of claim 2 wherein the spectral band selection module selects the one or more spectral bands of the license plate image portion that provide an optimal character-to-background contrast.

5. The apparatus of claim 1 further comprising a syntax adjustment module for adjusting syntax of the alphanumeric characters based at least in part on the state issue information.

6. The apparatus of claim 1 wherein the origin determination module generates state issue information that includes the state of origin of the license plate and information indicating an issue series of the license plate.

7. The apparatus of claim 1 wherein the one or more imaging devices acquire multiple images of the vehicle license plate, wherein each image is acquired in a different region of the spectrum.

8. The apparatus of claim 1 wherein the optical character recognition engine determines the alphanumeric characters before the origin determination module determines the license plate characteristics found in the vehicle license plate image portion, and wherein the origin determination module determines the license plate characteristics based at least in part on the alphanumeric characters determined by the optical character recognition engine.

9. The apparatus of claim 1 wherein the optical character recognition engine determines the alphanumeric characters after the origin determination module determines the license plate characteristics found in the vehicle license plate image portion, and wherein the optical character recognition engine determines the alphanumeric characters based at least in part on the license plate characteristics determined by origin determination module.

10. A method for determining vehicle license plate information, comprising:

(a) acquiring one or more images that include a vehicle license plate, where the one or more images include color information;

(b) detecting a vehicle license plate image portion within the one or more images;

(c) determining alphanumeric characters in the license plate image portion;

(d) determining a plurality of license plate characteristics found in the vehicle license plate image portion;

(e) comparing the license plate characteristics found in the vehicle license plate image portion to license plate characteristics stored in a license plate characteristic database, where the license plate characteristic database relates license plate characteristics to states of origin;

(f) based on the comparison of step (e), determining multiple candidate state governments from which the vehicle license plate may have issued;

(g) for each of the multiple candidate state governments determined in step (f), applying a color test that is specific to the candidate state government, wherein each color test detects whether a particular color is present in a particular location in the vehicle license plate image portion;

(h) selecting at least one of the candidate state governments as the state government that issued the license plate, wherein the selecting is based at least in part on the particular color detected in the particular location in the vehicle license plate image portion;

(i) determining state issue information based at least in part on the selection of step (h); and

(j) outputting the alphanumeric characters and the state issue information.

11. The method of claim 10 further comprising adjusting syntax of the alphanumeric characters based at least in part on the state issue information.

12. The method of claim 10 wherein step (i) includes determining state issue information that includes a state of origin of the license plate and information indicating an issue series of the license plate.

13. The method of claim 10 wherein step (a) includes acquiring multiple images of the vehicle license plate, wherein each image is acquired in a different region of the spectrum.

14. A method for determining vehicle license plate information, comprising:

(a) acquiring one or more images that include a vehicle license plate, where the one or more images include color information;

(b) detecting a vehicle license plate image portion within the one or more images;

(c) determining a plurality of license plate characteristics found in the vehicle license plate image portion;

(d) comparing the license plate characteristics found in the vehicle license plate image portion to license plate characteristics stored in a license plate characteristic database, where the license plate characteristic database relates license plate characteristics to states of origin;

(e) based on the comparison of step (d), determining one or more candidate state governments from which the vehicle license plate may have issued;

(f) selecting at least one of the candidate state governments as the state government that issued the license plate, wherein the selecting is based at least in part on the color information in the one or more images;

(g) determining state issue information based on the selection of step (f);

(h) selecting one or more spectral bands to use in determining alphanumeric characters in the license plate image portion, wherein the selecting is based at least in part on the state issue information;

(i) determining alphanumeric characters in the license plate image portion; and

(j) outputting the alphanumeric characters and the state issue information.

15. The method of claim 14 wherein step (h) comprises selecting the one or more spectral bands that provide an optimal character-to-background contrast for determining alphanumeric characters in the license plate image portion.

16. The method of claim 14 wherein step (i) includes performing character syntax matching based at least in part on the state issue information.

17. The method of claim 14 wherein step (g) includes determining state issue information that includes a state of origin of the license plate and information indicating an issue series of the license plate.

18. The method of claim 14 wherein step (a) includes acquiring multiple images of the vehicle license plate, wherein each image is acquired in a different region of the spectrum.