VEHICLE VISION SYSTEM WITH TRAFFIC SIGN COMPREHENSION

• US 20140327772A1
• Filed: 05/02/2014
• Published: 11/06/2014
• Est. Priority Date: 05/03/2013
• Status: Abandoned Application

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Sahba, Reza
• Application Number:
  US14/268,169
• Publication Number:
  US 20140327772A1
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/307 virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: G06V 20/582 of traffic signs

Abstract

A vision system of a vehicle includes a camera disposed at a vehicle and having a field of view forward of the vehicle. The camera includes a two dimensional imaging array of a plurality of photosensing pixels and is operable to capture image data. A control includes an image processor that is operable to process image data captured by the camera. The image processor, responsive at least in part to processing of captured image data, is operable to determine road signs ahead of the vehicle, and the image processor uses a matrix algorithm for determining road signs along the road and for determining road sign information for displaying to the driver of the vehicle. The road signs may include speed limit signs and the control may, responsive at least in part to a determination of weather conditions, determine the appropriate speed limit to display to the driver.

Claims

1. A vision system of a vehicle, said vision system comprising:

a camera disposed at a vehicle and having a field of view forward of the vehicle;

wherein said camera comprises a two dimensional imaging array of a plurality of photosensing pixels;

wherein said camera is operable to capture image data;

a control comprising an image processor operable to process image data captured by said camera; and

wherein said control, responsive at least in part to processing by said image processor of captured image data, is operable to determine road signs ahead of the vehicle, and wherein said control uses a matrix algorithm for determining road signs for display of sign information to the driver of the vehicle.

2. The vision system of claim 1, wherein the determined road signs comprise speed limit signs and wherein, responsive at least in part to image processing of captured image data, said control determines different speed limit signs and determines an appropriate speed limit for the vehicle at the vehicle'"'"'s current location.

3. The vision system of claim 2, wherein, responsive at least in part to driving conditions at the vehicle, said control determines an appropriate speed limit for the vehicle.

4. The vision system of claim 3, wherein, responsive at least in part to a determination of weather conditions at the vehicle'"'"'s current location, said control determines the appropriate speed limit.

5. The vision system of claim 4, wherein the determined weather conditions comprise one of rain and snow.

6. The vision system of claim 1, wherein, responsive at least in part to image processing of captured image data, said control generates an output for displaying appropriate sign information to the driver of the vehicle.

7. The vision system of claim 6, comprising a display screen viewable by a driver of the vehicle and operable to display the appropriate sign information responsive to said output.

8. The vision system of claim 1, wherein said control is operable to utilize newly determined road signs and previously determined road signs in determining whether new sign information of a newly determined road sign supplants previous sign information of previously determined road signs.

9. The vision system of claim 8, wherein, responsive to a determination that new sign information supplants previous sign information, said vision system outputs to a display screen to display the new sign information for viewing by the driver of the vehicle.

10. The vision system of claim 1, wherein, responsive at least in part to image processing of captured image data, said control determines the presence of multiple speed limit signs at or along a road region on which the vehicle is traveling, and wherein said control stores data indicative of the determined speed limit signs.

11. The vision system of claim 10, wherein said control determines at least one speed limit sign to display to the driver of the vehicle.

12. The vision system of claim 11, wherein, responsive at least in part to image processing of captured image data, said image processor is operable to determine the current speed limit for the current location of the vehicle and for a determined current road condition, and wherein said vision system displays the current speed limit for viewing by the driver of the vehicle.

13. The vision system of claim 10, wherein, responsive at least in part to image processing of captured image data, said control determines the presence of a first speed limit sign and a second speed limit sign, wherein said first speed limit sign indicates a first speed limit that is applicable during dry road conditions and wherein said second speed limit sign indicates a second speed limit that is applicable during wet road conditions, and wherein, responsive at least in part to the determined current road condition, said control is operable to determine which of the first and second speed limits is applicable to the current road conditions and is operable to display the determined appropriate speed limit for viewing by the driver of the vehicle.

14. The vision system of claim 13, wherein said vision system is operable to store sign data as a matrix and said matrix algorithm is operable to process said matrix to determine appropriate sign information for display to the driver.

15. The vision system of claim 14, wherein said vision system is operable to store location data as part of said matrix.

16. A vision system of a vehicle, said vision system comprising:

a camera disposed at a vehicle and having a field of view forward of the vehicle;

wherein said camera comprises a two dimensional imaging array of a plurality of photosensing pixels;

wherein said camera is operable to capture image data;

a control comprising an image processor operable to process image data captured by said camera;

wherein said control, responsive at least in part to processing by said image processor of captured image data, is operable to determine road signs ahead of the vehicle, and wherein said control uses a matrix algorithm for determining road signs for display of sign information to the driver of the vehicle; and

wherein, responsive at least in part to image processing of captured image data, said control determines the presence of a first road sign and a second road sign, wherein said first road sign indicates first information that is applicable during dry road conditions and wherein said second road sign indicates second information that is applicable during wet road conditions, and wherein said control is operable to determine which of the first and second road signs is applicable to a determined current road condition and is operable to display the determined appropriate information for viewing by the driver of the vehicle.

17. The vision system of claim 16, wherein said vision system is operable to store sign information and location data as a matrix and said matrix algorithm is operable to process said matrix to determine appropriate information for display to the driver.

18. The vision system of claim 17, wherein said first road sign comprises a first speed limit sign indicating a first speed limit and said second road sign comprises a second speed limit sign indicating a second speed limit, and wherein said second speed limit comprises a lower speed limit than said first speed limit.

19. A vision system of a vehicle, said vision system comprising:

a camera disposed at a vehicle and having a field of view forward of the vehicle;

wherein said camera comprises a two dimensional imaging array of a plurality of photosensing pixels;

wherein said camera is operable to capture image data;

a control comprising an image processor operable to process image data captured by said camera;

wherein said control, responsive at least in part to processing by said image processor of captured image data, is operable to determine speed limit signs ahead of the vehicle, and wherein said control uses a matrix algorithm for determining speed limit signs for display of an appropriate speed limit to the driver of the vehicle;

wherein, responsive at least in part to image processing of captured image data and responsive at least in part to a determination of a weather condition at the vehicle'"'"'s current location, said control determines the appropriate speed limit for the vehicle at the vehicle'"'"'s current location; and

wherein said control generates an output for displaying the appropriate speed limit at a display screen that is viewable by the driver of the vehicle.

20. The vision system of claim 19, wherein said control is operable to utilize newly determined speed limit signs and determined speed limit signs in determining whether new speed limit information of a newly determined speed limit sign supplants previous speed limit information of previously determined speed limit signs, and wherein, responsive to a determination that new speed limit information supplants previous speed limit information, said vision system outputs to a display screen to display the new speed limit information for viewing by the driver of the vehicle.