Apparatus and method for reading a license plate

• US 5,081,685 A
• Filed: 11/29/1988
• Issued: 01/14/1992
• Est. Priority Date: 11/29/1988
• Status: Expired due to Term

• Current Assignee: Perceptics LLC
• Original Assignee: Westinghouse Electric Company LLC (Brookfield Asset Management Incorporated)
• Inventors: Jones, Creed F. III, Patek, David R., Goldston, Michael A.
• Primary Examiner(s): Boudreau, Leo H.
• Application Number:
  US07/277,682
• Time in Patent Office: 1,141 Days
• Field of Search: 382/1, 382/30, 382/34, 382/46, 382/44, 382/22, 382/48
• US Class Current: 382/105
• CPC Class Codes: G06V 30/10 Character recognition
• CPC Class Codes: G06V 30/1444 Selective acquisition, locating or processing of specific regions, e.g. highlighted text, fiducial marks or predetermined fields

Abstract

A license plate reader and method for reading the characters of a license plate and for identifying the state which issued the plate utilizes image intensity transition information gathered while scanning the plate. With the gathered intensity transition information, the plate image is identified and the license plate characters are extracted from the plate background with a relatively high degree of accuracy. A chopper isolates the region of the plate containing the character set for character-reading purposes and compensates for rivets in the plate and character appendages. A contour tracer is adapted to trace the exterior edges of each license plate character, and a tilt compensator compensates for the tilted condition of the characters when the plate is tilted relative to the horizontal. Furthermore, intensity transition patterns relating to decorative and non-decorative characteristics of the plate aid in the identification of the state which issued the plate, and an adjuster conforms, when necessary, the identity of an identified character so that the alphanumeric pattern conforms to an acceptable alphanumeric pattern of a plate of the identified plate-issuing state.

Claims

1. In an apparatus for finding and identifying the characters of a license plate having a set of characters including means for producing an image that includes the license plate, and means for recognizing and identifying the characters of the license plate, the improvement comprising:

plate finding means associated with said recognizing and identifying means including;

a) a database containing criteria relating to the expected height of license plate characters contained within the produced image;

b) means for scanning one-line-at-a-time for a predetermined distance across a portion of the license plate character set from a location situated between the top and bottom boundaries of the character set and moving one-line-at-a-time across said character set portion toward the top boundary thereof and moving one-line-at-a-time across said character set portion toward the bottom boundary thereof so that the license plate character set is scanned generally upwardly and downwardly along one vertically-oriented column having a width which is equal to said predetermined distance, each of said scanned lines having an associated average gray level intensity and a gray level variance;

c) means for measuring the average gray level intensity and the gray level variance along the scanned lines;

d) means for sensing at a location adjacent the top boundary of the character set a significant decrease in the gray level variance and the average gray level intensity between one scanned line and another scanned line as said one and another lines are scanned in sequence and identifying said one scanned line as the tip edge of the character set;

e) means for sensing at a location adjacent the bottom boundary of the character set a significant decrease in the average gray level intensity and gray level variance between two successively-scanned lines and identifying the first of said two successively-scanned lines as the bottom edge of the character set; and

f) means for measuring the distance between the identified tip and bottom edges of the character set portion and for comparing the measured distance to height criteria contained within said database to determine whether the measured distance corresponds to an expected height of the character set.

2. The improvement of claim 1 wherein said database contains criteria relating to the expected width of license plate characters and to the expected width of the license plate character set contained within the produced image and the scanning means is adapted to scan across said portion of said license plate character set a distance corresponding to said width criteria so that the width of the column scanned by said scanning means is at least as great as the expected width of a license plate character contained within the produced image and less than the expected width of the character set contained within the produced image.

3. The improvement as defined in claim 1 wherein said measured distance between the identified top and bottom edge is a first measured distance and said improvement further comprises verification means associated with the plate finding means for confirming that the image of the license plate is contained within an identified image block, wherein:

said means for scanning scans one-line-at-a-time for a second predetermined distance across another portion of the license plate character set from a location situated between the top and bottom boundaries of the license plate character set and moving one-line-at-a-time across said another character set portion toward the top boundary thereof and moving one-line-at-a-time across said another character set portion toward the bottom boundary thereof so that the license plate character set is scanned generally upwardly and downwardly along another vertically-oriented column, said another column and said one column being disposed in overlapping relationship to one another, each of said scanned lines within said another column having an associated average gray level intensity and a gray level variance;

said means for measuring the average gray level intensity and the gray level variance measures the average gray level intensity and gray level variance along the lines scanned in said another column;

said means for sensing at a location adjacent the top boundary of the character set senses a significant decrease in the average gray level intensity and gray level variance between one scanned line and another scanned lines in said another column as said one and another line in said another column are scanned in sequence and identifying said one line of said another column as the top edge of the character set;

said means for sensing at a location adjacent the bottom boundary of the character set senses a significant decrease in the average gray level intensity and the gray level variance between two successively-scanned lines in said another column and identifying the first of said two successively-scanned lines in said another column as the bottom edge of the character set;

said means for measuring measures the distance between the identified tip and bottom edges of the character set in said another column to obtain a second measured distance, said verification means further comprising means for comparing the second measured distance to the first measured distance to determine whether the said measured distance corresponds to the first measured distance.

4. The improvement of claim 3 wherein said database contains criteria relating to the expected width of a license plate character set and said verification means includes means for identifying the left and right side edges of the character set, means for measuring the distance between the identified left and right side edges and means for comparing the measured distance between the identified left and right side edges of the characters set with the character set width criteria contained with the database to determine whether the measured distance between the identified side edges corresponds to an expected width of the character set.

5. The improvement as defined in claim 4 wherein said identifying means of said verification means is adapted to scan the character set in a columnar fashion toward the left and right of the one column so that the character set is scanned in a series of overlapping columns and includes measuring means for measuring the height of the character set in each sequentially-scanned column, comparing means for comparing the measured character set height in each column scanned to the height measured in a previously-scanned column to thereby find two consecutive columns adjacent the right and left side edges of the plate reflecting a character set height which does not match the measured height of a previously-scanned column and means for identifying the locations adjacent the sides of the plate at which the consecutive non-matching columns are found as the left and right edges of the plate.

6. In an apparatus for reading the characters of a license plate including means for scanning the license plate and for locating the characters of the license plate as a function of sensed image intensity changes as the license plate is scanned, character alignment means for defining a straight baseline and a straight top line based on the bulk of the lowermost and uppermost points of the characters, and identifying the license plate characters, the improvement comprising:

detecting means associated with the character alignment means for detecting the presence and location of intensity transitions along each of the baseline and top line that are nearest the left edge of the license plate and for detecting the presence and location of the intensity transitions along each of the baseline and top line that are nearest the right edge of the license plate and for joining each of the intensity transition locations detected adjacent the left edge of the license plate with an imaginary first line and for joining each of the intensity transition locations detected adjacent the right edge of the license plate with an imaginary second line, and

said contour tracing means is adapted to disregard license plate information sensed to the left of the first imaginary line and to disregard license plate information sensed to the right of the second imaginary line.

7. The improvement of claim 6 further a database associated with said detecting means containing preprogrammed criteria relating to an expected width of a license plate as a function of the height of the character set, means for measuring the spacing between the imaginary first and second lines and the height of the character set and means for comparing the measured spacing between the imaginary first and second lines to the preprogrammed criteria for verifying that the spacing between the first and second imaginary lines corresponds with an expected width of a character set.

8. In an apparatus for reading the characters of a license plate including means for scanning the license plate and for locating the characters of the license plate as a function of sensed image intensity changes as the license plate is scanned, character alignment means for defining a straight baseline and a top line based on the bulk of the lowermost and uppermost points of the characters, and means for recognizing and identifying the characters of the license plate, the improvement characterized in that:

said character alignment means includes means for detecting the presence and location of an intensity transition along a low path extending parallel to and positioned adjacent and below the defined straight baseline and the existence and location of an intensity transition along a high path extending parallel to and positioned adjacent and above the defined top line; and

means for comparing the location of the detected intensity transition along the low path with the location of the detected intensity transition along the high path and determining whether the compared locations are positioned in a vertical relationship with respect to one another;

said recognizing and identifying means is adapted to disregard license plate information below said baseline and above said top line when each of compared locations is determined to be in a vertical relationship with respect to another one of the compared locations and to disregard license plate information below said low path and above said high path when any of the compared locations is determined not to be in a vertical relationship with another one of the compared locations so that when one compared location is determined not to be in a vertical relationship with any other compared location, at least a portion of the license plate region responsible for the intensity transition sensed along one of the high and low paths and at said one compared location is utilized in the identification of the license plate characters.

9. In an apparatus for reading of a license plate having a set of characters including means for scanning the license plate and means for locating the of the license plate characters as a function of sensed image intensity changes as the license plate is scanned, and means for recognizing and identifying the characters of the license plate, the improvement comprising:

a database containing criteria relating to expected heights of license plates as a function of the length of the license plate character set;

a scanner for vertically scanning the plate first row of license plate characters;

means for measuring the height and length of the first row of license plate characters scanned by said scanner;

means for comparing the height of the first row of characters with the plate-height criteria contained on the database to determine whether the height of the first row of characters corresponds with the expected height of a license plate having a character set length equal to about the measured length of the first row of license plate characters;

said scanner is adapted to continue scanning vertically from the first row of license plate characters for sensing the presence of intensity associated with a second row of license plate characters when the comparing means determines that the height of the first row of characters does not correspond with an expected height of a license plate having a character set length equal to about the sensed length of the first row of license plate characters;

said locating means is adapted to locate the characters in each row of characters scanned in the license plate as a function of the intensity transitions sensed in connection with each row; and

said recognizing and identifying means is adapted to recognize and identify the characters in each row of license plate characters.

10. In a method for finding and identifying the characters of a license plate having a set of characters including the steps of producing an image that includes the license plate, scanning the image and identifying a block of the image which is the image of the license plate, locating the license plate characters as a function of sensed image intensity changes as the license plate is scanned, and recognizing and identifying the characters of the license plate as a function of the traced contours, the improvement comprising:

providing criteria relating to the expected height of license plate characters contained within the produced image;

scanning one-line-at-a-time for a predetermined distance across a portion of the character set from a location situated between the top and bottom boundaries of the character set and moving one-line-at-a-time across the character set portion toward the top boundary thereof and moving one-line-at-a-time across the character set so that the license plate character set is scanned generally upwardly and downwardly along one vertically-oriented column having a width which is equal to the predetermined distance;

measuring the average gray level intensity and the gray level variance along the scanned lines;

sensing at a location adjacent the top boundary of the character set a significant decrease in the measured average gray level intensity and gray level variance between one scanned line and another scanned line as the one and another lines are scanned in sequence and identifying the one scanned line as the top edge of the character set;

sensing at a location adjacent the bottom boundary of the character set a significant decrease in the measured average gray level intensity and gray level variance between two successively-scanned lines and identifying the first of the two successively-scanned lines as the bottom edge of the character set;

measuring the distance between the identified top and bottom edges of the character set; and

comparing the measured distance to the provided height criteria to determine whether the measured distance corresponds to an expected height of the character set.

11. The improvement as defined in claim 10 wherein the measured distance between the identified top and bottom edges is a first measured distance and said improvement further comprises the steps of:

scanning one-line-at-a-time for a predetermined distance across another portion of the license plate character set from a location situated between the top and bottom boundaries of the license plate character set and moving one-line-at-a-time across the another character set portion toward the top boundary of the character set and moving one-line-at-a-time across another character set portion toward the bottom boundary of the character set so that the license plate character set is scanned generally upwardly and downwardly along a second column overlapping the one column;

measuring the average gray level intensity and the gray level variance along the lines scanned in the second column;

sensing at a location adjacent the top boundary of the character set a significant decrease in the measured one of the average gray level intensity and gray level variance between one line and another scanned line as the one and another lines in the second column are scanned in sequence and identifying the one line of the second column as the top edge of the character set;

sensing at a location adjacent the bottom boundary of the character set a significant decrease in the measured the average gray level intensity and the gray level variance between two successively-scanned lines in the second column and identifying the first of the two successively-scanned lines in the second column as the bottom edge of the character set;

means for measuring the distance between the identified top and bottom edges of the character set in the second column; and

comparing the second measured distance to the first measured distance to determine whether the second measured distance corresponds to the first measured distance.

12. The improvement of claim 11 further comprising the steps of:

providing criteria relating to the expected width of a license plate character set;

identifying the left and right side edges of the character set;

measuring the distance between the identified left and right side edges; and

comparing the measured distance between the left and right side edges of the character set with the provided width criteria to determine whether the measured distance between the identified side edges corresponds to an expected width of the character set.

13. In a method for reading the characters of a license plate having a set of characters including the steps of scanning the license plate and locating the characters of the plate as a function of sensed image intensity changes as the license plate is scanned, defining a straight baseline and a straight top line based on the bulk of lowermost and uppermost points of the characters, and recognizing and identifying the license plate characters, the improvement comprising:

detecting the presence and location of intensity transitions along each of the baseline and top line that are nearest the left edge of the license plate and detecting the presence and location of the intensity transitions along each of the baseline and top line that are nearest the right edge of the license plate;

joining each of the intensity transition locations detected adjacent the left edge of the license plate with an imaginary first line and joining each of the intensity transition locations detected adjacent the right edge of the license plate with an imaginary second line; and

disregarding license plate information sensed to the left of the first imaginary line and disregarding license plate information sensed to the right of the second imaginary line.

14. The improvement of claim 13 further the steps of:

providing criteria relating to an expected width of a license plate as a function of the height of the character set; and

measuring the spacing between the imaginary first and second lines and the height of the character set and comparing the measured spacing to the provided criteria for verifying that the spacing as measured between the first and second lines corresponds with an expected width of a license plate.

15. In a method for reading the characters of a license plate including the steps of scanning the license plate and locating the characters of the license plate as a function of sensed image intensity changes as the license plate is scanned, defining a straight baseline and a straight top line based on the bulk of the lowermost and uppermost points of the characters, and recognizing and the characters of the license plate, the improvement comprising:

detecting the presence and location of an intensity transition along a low path extending parallel to and positioned adjacent and below the defined straight baseline and the existence and location of an intensity transition along a high path extending parallel to and positioned adjacent and above the defined top line;

comparing the location of the detected intensity transition along the low path with the location of the detected intensity transition along the high path and determining whether the compared locations are positioned in a vertical relationship with respect to one another; and

disregarding license plate information below the baseline and above the to line when each of the compared locations is determined to be in a vertical relationship with respect to another of the compared locations and disregarding license plate information below the low path and above the high path when any of the compared locations are not determined to be in a vertical relationship with another one of the compared locations so that when one compared location is determined not to be in a vertical relationship with any other compared location, the steps of recognizing and identifying utilize at least a portion of the license plate region responsible for the intensity transition sensed along one of the low and high paths and at the one compared location in the identification of the license plate characters.

16. In a method for reading a license plate having a set of characters including the steps of scanning the license plate and locating the edges of the characters of the license plate as a function of sensed image intensity changes as the license plate is scanned, defining a straight baseline and a straight top line based on the bulk of the lowermost and uppermost points of the characters, tracing the contours of the edges of the license plate and recognizing and identifying the characters of the plate as a function of the traced contours, the improvement comprising:

identifying two left corners of the character set of the license plate wherein one of the left corners is contained along the defined baseline and the other of the left corners is contained along the defined top line;

identifying two right corners of the character set wherein one of the right corners is contained along the defined baseline and the other of the riqht corners is contained along the defined top line;

joining the identified two left corners with an imaginary first line and joining the identified two right corners with an imaginary second line; and

following during the tracing step what would otherwise be considered as a vertical edge of a character along a path which is generally parallel to one of the imaginary first and second lines.

17. The improvement of claim 16, wherein the steps of identifying the two left and two right corners of the plate include the steps of:

a) scanning the license plate one-line-at-a-time along lines extending generally vertically across the license plate character set beginning at a predetermined location between the right and left boundaries of the license plate character set and moving one-line-at-a-time toward each of the right and left boundaries of the character set;

b) measuring the gray level variance along the generally vertically-scanned lines;

c) sensing a significant decrease in gray level variance on the right side of the license plate character set from one generally vertically-scanned line to another generally vertically-scanned line and sensing a significant decrease in gray level variance on the left side of the license plate character set from a first generally vertically-scanned line to a second generally vertically-scanned line; and

d) identifying as the two left corners of the character set the locations along the baseline and the top line which correspond to the site along the left side of the character set at which the significant decrease in gray level variance is sensed and identifying as the two right corners of the character set the locations along the baseline and top line which correspond to the site along the right side of the character set at which the significant decrease in gray level variance is sensed.

18. The improvement of claim 16 further comprising the steps of:

providing criteria relating to an expected width of a license plate character set as a function of the height of the license plate character set;

measuring the height of the character set and spacing between the imaginary first and second lines; and

comparing the measured spacing between the first and second lines to the provided criteria for verifying that the measured spacing corresponds with an expected width of a license plate character set.

19. In a method for reading a license plate having a set of characters including the steps of scanning the license plate and locating the characters of the license plate as a function of sensed image intensity changes as the license plate is scanned, and recognizing and identifying the characters of the license plate the improvement comprising:

providing criteria relating to the expected heights of license plates as a function of the length of the license plate character set;

scanning the license plate from one of the bottom and top of the plate toward the other of the bottom and top of the plate and through a first row of license plate characters;

measuring the height and length of the first row of license plate characters;

comparing the measured height and length of the first row of characters with the provided plate-height criteria to determine whether the height of the first row of characters corresponds with the expected height of a license plate having a character set length equal to about the measured length of the first row of characters;

scanning from the first row of characters toward the other of the bottom and top of the plate;

sensing the presence of and intensity transitions associated with a second row of license plate characters when it is determined that the height of the first row of characters does not correspond with an expected height of a license plate having a character set length equal to about the sensed length of the first row of license plate characters;

locating the characters in the second row of characters as a function of the intensity transitions sensed in connection therewith; and

recognizing and identifying the characters in the second row.