METHOD FOR RECOGNIZING LICENSE PLATE IMAGE, AND RELATED COMPUTER PROGRAM PRODUCT, COMPUTER-READABLE RECORDING MEDIUM, AND IMAGE RECOGNIZING APPARATUS USING THE SAME

• US 20120275653A1
• Filed: 04/28/2011
• Published: 11/01/2012
• Est. Priority Date: 04/28/2011
• Status: Abandoned Application

• Current Assignee: Industrial Technology Research Institute
• Original Assignee: Industrial Technology Research Institute
• Inventors: Kang, Chung-Chia, Lee, Ho-Hsin, Chen, Jian-Ren, Luo, Yi-Fei, Hsieh, Pei-Lun, Liao, Hong-Yuan Mark, Chen, Chih-Wei
• Application Number:
  US13/095,925
• Publication Number:
  US 20120275653A1
• Time in Patent Office: Days
• US Class Current: 382/105
• CPC Class Codes: G06V 20/62 Text, e.g. of license plates, overlay texts or captions on TV images
• CPC Class Codes: G06V 20/625 License plates

Abstract

A computer implemented method for recognizing license plate image, and related computer product, computer-readable recording medium, and image recognizing apparatus using the same is provided. The method includes collecting a plurality of character template images and respectively homogenizing the character template images to generate a plurality of simulated character template images based on the license plate image. The method also includes respectively generating a plurality of similarity degrees corresponding to the simulated character template images by comparing the simulated character template images with the license plate image. The method further includes estimating at least one candidate character corresponding to the license plate image and at least one candidate character position corresponding to the at least one candidate character according to the similarity degrees corresponding to the simulated character template images. Accordingly, the method can effectively recognize license plate numbers in a license plate image.

Claims

1. A computer implemented method of recognizing a license plate image, comprising:

collecting a plurality of character template images;

respectively homogenizing the character template images to generate a plurality of simulated character template images based on the license plate image;

respectively generating a plurality of similarity degrees corresponding to the simulated character template images by comparing the simulated character template images with the license plate image;

estimating at least one candidate character corresponding to the license plate image and at least one candidate character position corresponding to the at least one candidate character according to the similarity degrees corresponding to the simulated character template images.

2. The computer implemented method as claimed in claim 1, further comprising:

combining the character template images to generate a plurality of multiple-character template images based on the at least one candidate character and the at least one candidate character position corresponding to the at least one candidate character;

respectively homogenizing the multiple-character template images to generate a plurality of simulated multiple-character template images based on the license plate image;

respectively generating a plurality of similarity degrees corresponding to the simulated multiple-character template images by comparing the simulated multiple-character template images with the license plate image;

estimating a plurality of possible characters and a plurality of possible character positions corresponding to the possible characters according to the similarity degrees corresponding to the simulated multiple-character template images; and

outputting at least one possible license plate number corresponding to the license plate image based on the possible characters and the possible character positions corresponding to the possible characters.

3. The computer implemented method as claimed in claim 1, further comprising:

generating an inverse coordinate transformation matrix corresponding to the license plate image; and

identifying an image quality of the license plate image,

wherein the step of respectively homogenizing the character template images to generate the simulated character template images based on the license plate image comprising;

respectively normalizing the character template images based on the inverse coordinate transformation matrix and the image quality of the license plate image to generate the simulated character template images.

4. The computer implemented method as claimed in claim 3, wherein the step of identifying the image quality corresponding to the license plate image comprises:

identifying a mean and a standard deviation of a gray level of the license plate image,

wherein the step of respectively normalizing the character template images based on the inverse coordinate transformation matrix and the image quality to generate the simulated character template images comprises;

normalizing a size of each of the character template images based on the inverse coordinate transformation matrix and normalizing a gray level of each of the character template images based on the mean and the standard deviation of the gray level of the license plate image to generate each of the simulated character template images.

5. The computer implemented method as claimed in claim 2, further comprising:

generating an inverse coordinate transformation matrix corresponding to the license plate image; and

identifying an image quality of the license plate image,

wherein the step of respectively homogenizing the multiple-character template images to generate a plurality of simulated multiple-character template images based on the license plate image comprising;

respectively normalizing the multiple-character template images based on the inverse coordinate transformation matrix and the image quality of the license plate image to generate the simulated multiple-character template images.

6. The computer implemented method as claimed in claim 3, further comprising:

extracting the license plate image from an image by selecting four corners of the license plate image in the image or selecting two diagonal corners of the license plate image in the image.

7. The computer implemented method as claimed in claim 5, wherein the step of generating the inverse coordinate transformation matrix corresponding to the license plate image comprises:

identifying a plurality of symmetrical parts on a vehicle image in the image;

rectifying the image to generate a rectified image;

calculating a coordinate transformation matrix between the image and the rectified image by using original positions of the symmetrical parts in the image and new positions of the symmetrical parts in the rectified image; and

calculating the inverse coordinate transformation matrix according to the coordinate transformation matrix.

8. The method as claimed in claim 1, wherein the step of respectively generating the similarity degrees corresponding to the simulated character template images by comparing the simulated character template images with the license plate image comprises:

calculating a distance between each of the simulated character template images and a corresponding position of the license plate image; and

respectively generating the similarity degrees corresponding to the simulated character template images based on the distances.

9. The method as claimed in claim 2, wherein the step of respectively generating similarity degrees corresponding to the simulated multiple-character template images by comparing the simulated multiple-character template images with the license plate image comprises:

sliding each of the simulated multiple-character template images on the license plate image and respectively calculating the similarity degrees corresponding to the simulated multiple-character template images.

10. The method as claimed in claim 1, further comprises:

identifying a specific symbol on the license plate image and a position of the specific symbol.

22. A computer program product, comprising a plurality of program instructions, which when executed by a computer system, cause the computer system to execute the method according to claim 1.

23. A computer-readable recording medium having a program, which when executed by a computer system, cause the computer system to execute the method according to claim 1.

11. An image recognizing apparatus for recognizing a license plate image, comprising:

a database, configured for storing a plurality of character template images;

an image extracting unit, configured for extracting the license plate image;

a template simulating unit, configured for respectively homogenizing the character template images to generate a plurality of simulated character template images based on the license plate image; and

an operation processing unit, configured for comparing the simulated character template images with the license plate image to respectively generate a plurality of similarity degrees corresponding to the simulated character template images,

wherein the operation processing unit estimates at least one candidate character corresponding to the license plate image and at least one candidate character position corresponding to the at least one candidate character according to the similarity degrees corresponding to the simulated character template images.

12. The image recognizing apparatus as claimed in claim 11, further comprising an output unit,

wherein the operation processing unit combines the character template images to generate a plurality of multiple-character template images based on the at least one candidate character and the at least one candidate character position corresponding to the at least one candidate character,

wherein the template simulating unit respectively homogenizes the multiple-character template images to generate a plurality of simulated multiple-character template images based on the license plate image,

wherein the operation processing unit respectively generates a plurality of similarity degrees corresponding to the simulated multiple-character template images by comparing the simulated multiple-character template images with the license plate image,

wherein the operation processing unit estimates a plurality of possible characters and a plurality of possible character positions corresponding to the possible characters according to the similarity degrees corresponding to the simulated multiple-character template images, and

wherein the output unit is configured for outputting at least one possible license plate number corresponding to the license plate image based on the possible characters and the possible character positions corresponding to the possible characters.

13. The image recognizing apparatus as claimed in claim 11,

wherein the template simulating unit generates an inverse coordinate transformation matrix corresponding to the license plate image and identifies an image quality of the license plate image,

wherein the template simulating unit respectively normalizes the character template images based on the inverse coordinate transformation matrix and the image quality of the license plate image to generate the simulated character template images.

14. The image recognizing apparatus as claimed in claim 13, wherein the template simulating unit identifies a mean and a standard deviation of a gray level of the license plate image,

wherein the template simulating unit normalizes a size of each of the character template images based on the inverse coordinate transformation matrix and normalizes a gray level of each of the character template images based on the mean and the standard deviation of the gray level of the license plate image to generate each of the simulated character template images.

15. The image recognizing apparatus as claimed in claim 12, wherein the template simulating unit generates an inverse coordinate transformation matrix corresponding to the license plate image and identifies an image quality of the license plate image,

wherein the template simulating unit respectively normalizes the multiple-character template images based on the inverse coordinate transformation matrix and the image quality of the license plate image to generate the simulated multiple-character template images.

16. The image recognizing apparatus as claimed in claim 13, wherein the image extracting unit extracts the license plate image from an image according to four corners of the license plate image in the image or two diagonal corners of the license plate image in the image.

17. The image recognizing apparatus as claimed in claim 15, wherein the template simulating unit identifies a plurality of symmetrical parts on a vehicle image in the image and rectifies the image to generate a rectified image,

wherein the template simulating unit uses original positions of the symmetrical parts in the image and new positions of the symmetrical parts in the rectified image to calculate a coordinate transformation matrix between the image and the rectified image,

wherein the template simulating unit calculates the inverse coordinate transformation matrix according to the coordinate transformation matrix.

18. The image recognizing apparatus as claimed in claim 11, wherein the operation processing unit slides each of the simulated character template images on the license plate image, and respectively calculates the similarity degrees corresponding to each of the simulated character template images.

19. The image recognizing apparatus as claimed in claim 12, wherein the operation processing unit calculates a distance between each of the simulated character template images and a corresponding position of the license plate image, and respectively generating the similarity degrees corresponding to the simulated character template images based on the distances.

20. The image recognizing apparatus as claimed in claim 11, wherein the template simulating unit identifies a specific symbol on the license plate image and a position of the specific symbol.

21. The image recognizing apparatus as claimed in claim 11, wherein the license plate image is rectified by a camera calibration unit or a 3D scene model reconstruction unit.