Vehicle and road sign recognition device

• US 8,050,456 B2
• Filed: 05/18/2006
• Issued: 11/01/2011
• Est. Priority Date: 06/03/2005
• Status: Expired due to Fees

• Current Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Original Assignee: Honda Motor Co., Ltd. (Honda Motor Company)
• Inventors: Mori, Naoki, Kobayashi, Sachio, Aoki, Tomoyoshi, Nakamori, Takuma
• Primary Examiner(s): Bhatnagar; Anand
• Application Number:
  US11/919,554
• Publication Number:
  US 20100014707A1
• Time in Patent Office: 1,993 Days
• Field of Search: 382/100, 382/103, 382/106, 382/107, 701/23, 701/27, 701/28, 701/200
• US Class Current: 382/103
• CPC Class Codes: G06V 10/56 relating to colour
• CPC Class Codes: G06V 20/588 Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road

Abstract

A vehicle and road sign recognition device each includes: image capturing means (2) which captures a color image of a road via imaging means (6); feature value calculation means (4) which calculates a feature value of each pixel corresponding to the color of a road sign on the road from the color components of each pixel in the color image so as to reduce the effect of brightness on the color components; and road sign detection means (5) which detects the road sign on the road from the feature image in which the feature value of each pixel in the color image is arranged so as to match with the position of each pixel in the color image. Thus, it is possible to accurately detect a road sign such as a lane mark from the color image of the road captured via the imaging means such as a camera even if the road illumination state is partially different.

Claims

1. A vehicle comprising:

an imaging means;

an image capturing means which captures a color image of a road via the imaging means;

a feature value calculation means which calculates a feature value of each pixel corresponding to the color of a road sign on the road from the color components of each pixel in the color image so as to reduce the effect of brightness on the color components; and

a road sign detection means which detects the road sign on the road from the feature image in which the feature value of each pixel in the color image is arranged so as to match with the position of each pixel in the color image.

2. A vehicle according to claim 1, wherein:

the color components of each pixel in the color image are R, G, and B values or C, M, and Y values; and

the feature value calculation means uses a ratio between two given values corresponding to the color of the road sign among the color components of each pixel as the feature value of each pixel in the color image.

6. A vehicle according to one of claims 1 to 5, wherein the road sign detection means detects the road sign on the road by performing a filtering process using a tophat filter or an edge filter for the feature image.

3. A vehicle comprising:

an imaging means;

an image capturing means which captures a color image of a road via the imaging means;

a luminance value calculation means which calculates a luminance value of each pixel from the color components of each pixel in the color image;

a feature value calculation means which calculates a feature value of each pixel corresponding to the color of a road sign on the road from the color components of each pixel in the color image and the luminance value so as to reduce the effect of brightness on the color components; and

a road sign detection means which detects the road sign on the road from the feature image in which the feature value of each pixel in the color image is arranged so as to match with the position of each pixel in the color image.

4. A vehicle according to claim 3, wherein:

the color components of each pixel in the color image are R, G, and B values or C, M, and Y values; and

the feature value calculation means uses, as the feature value of each pixel in the color image, a value obtained by dividing a difference between or sum of two given values corresponding to the color of the road sign among the color components of each pixel by a given correction factor which is determined to be higher as the luminance value increases according to the luminance value of each pixel.

5. A vehicle according to claim 3, wherein:

the color components of each pixel in the color image are R, G, and B values or C, M, and Y values; and

the feature value calculation means uses, according to the luminance value of each pixel and as the feature value of each pixel in the color image, a value obtained by dividing a difference between or sum of two given values corresponding to the color of the road sign among the color components of each pixel by a given correction factor, which is determined to be higher as the luminance value increases, if the luminance value is equal to or higher than a given luminance value and uses a value obtained by dividing the difference or sum by the given correction factor, which is set for the given luminance value, if the luminance value is lower than the given luminance value.

7. A road sign recognition device comprising:

an image capturing means which captures a color image of a road via an imaging means;

a feature value calculation means which calculates a feature value of each pixel corresponding to the color of a road sign on the road from the color components of each pixel in the color image so as to reduce the effect of brightness on the color components; and

a road sign detection means which detects the road sign on the road from the feature image in which the feature value of each pixel in the color image is arranged so as to match with the position of each pixel in the color image.

8. A road sign recognition device according to claim 7, wherein:

the color components of each pixel in the color image are R, G, and B values or C, M, and Y values; and

the feature value calculation means uses a ratio between two given values corresponding to the color of the road sign among the color components of each pixel as the feature value of each pixel in the color image.

9. A road sign recognition device comprising:

an image capturing means which captures a color image of a road via an imaging means;

a luminance value calculation means which calculates a luminance value of each pixel from the color components of each pixel in the color image;

a feature value calculation means which calculates a feature value of each pixel corresponding to the color of a road sign on the road from the color components of each pixel in the color image and the luminance value so as to reduce the effect of brightness on the color components; and

a road sign detection means which detects the road sign on the road from the feature image in which the feature value of each pixel in the color image is arranged so as to match with the position of each pixel in the color image.

10. A road sign recognition device according to claim 9, wherein:

the color components of each pixel in the color image are R, G, and B values or C, M, and Y values; and

the feature value calculation means uses, as the feature value of each pixel in the color image, a value obtained by dividing a difference between or sum of two given values corresponding to the color of the road sign among the color components of each pixel by a given correction factor which is determined to be higher as the luminance value increases according to the luminance value of each pixel.

11. A road sign recognition device according to claim 9, wherein:

the color components of each pixel in the color image are R, G, and B values or C, M, and Y values; and

the feature value calculation means uses, according to the luminance value of each pixel and as the feature value of each pixel in the color image, a value obtained by dividing a difference between or sum of two given values corresponding to the color of the road sign among the color components of each pixel by a given correction factor, which is determined to be higher as the luminance value increases, if the luminance value is equal to or higher than a given luminance value and uses a value obtained by dividing the difference or sum by the given correction factor, which is set for the given luminance value, if the luminance value is lower than the given luminance value.

12. A road sign recognition device according to one of claims 7 to 11, wherein the road sign detection means detects the road sign on the road by performing a filtering process using a tophat filter or an edge filter for the feature image.