Imaging and display system for vehicle

• US 9,789,821 B2
• Filed: 05/22/2015
• Issued: 10/17/2017
• Est. Priority Date: 09/01/2009
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Baur, Michael J., Blank, Rodney K., Larson, Mark L., Lynam, Niall R.
• Primary Examiner(s): Owens, Tsion B
• Application Number:
  US14/719,446
• Publication Number:
  US 20150251602A1
• Time in Patent Office: 879 Days
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/08 involving special optical features, e.g. avoiding blind spots , e.g. convex mirrors; Side-by-side associations of rear-view and other mirrors B60R1/025, B60R1/10 take precedence
• CPC Class Codes: B60R 1/23 with a predetermined field of view
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2001/1215 with information displays
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/70 characterised by an event-triggered choice to display a specific image among a selection of captured images
• CPC Class Codes: B60R 2300/802 for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: G08G 1/09623 Systems involving the acquisition of information from passive traffic signs by means mounted on the vehicle G08G1/0967 takes precedence
• CPC Class Codes: G08G 1/09626 where the origin of the information is within the own vehicle, e.g. a local storage device, digital map
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 7/181 for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 for receiving images from a single remote source

Abstract

A vehicular vision system includes first, second, third and fourth cameras having respective forward, rearward, sideward and sideward fields of view. A video processor is operable to process second image data captured by the second or rearward viewing camera. A video display screen displays video images derived, at least in part, from captured second image data. The video processor includes an image processor operable for machine vision analysis of first image data captured by the first or forward viewing camera. During a reversing maneuver of the vehicle, the video display screen displays video images derived, at least in part, from captured second image data. During forward travel of the vehicle and responsive to the image processor processing captured first image data to detect a road sign ahead of the vehicle, an image or iconistic representation of the detected road sign is displayed by the video display screen.

Claims

1. A vehicular vision system comprising:

a first camera having a field of view forward of a vehicle equipped with said vehicular vision system and operable to capture first image data;

a second camera having a field of view rearward of the equipped vehicle and operable to capture second image data;

a third camera disposed at a side portion of the equipped vehicle and having a field of view sideward of the equipped vehicle and operable to capture third image data;

a fourth camera disposed at a side portion of the equipped vehicle that is opposed to the side portion at which said third camera is disposed and having a field of view sideward of the equipped vehicle and operable to capture fourth image data;

a video processor operable at least to process second image data captured by said second camera, wherein said second image data comprises at least a left zone second image data set, a middle zone second image data set and a right zone second image data set;

wherein said left zone second image data set corresponds to a left zone that encompasses where another vehicle may at least one of (i) approach from the rear of the equipped vehicle in a left side lane adjacent to the equipped vehicle and (ii) overtake the equipped vehicle in a left side lane adjacent to the equipped vehicle;

wherein said right zone second image data set corresponds to a right zone that encompasses where another vehicle may at least one of (i) approach from the rear of the equipped vehicle in a right side lane adjacent to the equipped vehicle and (ii) overtake the equipped vehicle in a right side lane adjacent to the equipped vehicle;

wherein said middle zone second image data set corresponds to a middle zone that encompasses where another vehicle may approach from the rear of the equipped vehicle in a lane being traveled by the equipped vehicle;

a video display screen for displaying video images, said video images derived, at least in part, from second image data captured by said second camera;

wherein said video display screen comprises a left display region at a left portion of said video display screen and a right display region at a right portion of said video display screen and a middle display region disposed between said left display region and said right display region;

wherein said video processor comprises an image processor operable for machine vision analysis of first image data captured by said first camera;

wherein said video processor receives image data captured at least by said second camera, said third camera and said fourth camera and merges the received image data to generate, for display by said video display screen, a surround view that comprises a panoramic birds-eye view of an area at and around the equipped vehicle, and wherein said video processor generates at least one of graphic overlays, indicia and visual aids to assist the driver'"'"'s interpretation and use of the surround view when displayed by said video display screen;

wherein, during a reversing maneuver of the equipped vehicle, said video display screen uses said left display region, said middle display region and said right display region to display video images derived, at least in part, from second image data captured by said second camera; and

wherein, during forward travel of the equipped vehicle and responsive to said image processor processing first image data captured by said first camera to detect a road sign ahead of the equipped vehicle, an image or iconistic representation of the detected road sign is displayed by said video display screen in order to enhance cognitive awareness by a driver of the equipped vehicle of the presence of the detected road sign so as to enhance the driver'"'"'s awareness of the driving situation or road condition or situation that the equipped vehicle is approaching.

2. The vehicular vision system of claim 1, wherein said video display screen is part of a center stack or center console display used for a navigation or infotainment system of the equipped vehicle and wherein said video display screen comprises a reconfigurable thin film transistor liquid crystal display screen that is backlit by a plurality of white light-emitting light emitting diodes.

3. The vehicular vision system of claim 2, wherein said liquid crystal display screen comprises at least about 85,000 individually addressable pixels and wherein, when said video display screen is operating to display video images, said video display screen provides a contrast ratio of greater than about 250:

1.

4. The vehicular vision system of claim 1, wherein said video display screen comprises a reconfigurable thin film transistor liquid crystal display screen that is backlit by a plurality of white light-emitting light emitting diodes, and wherein said video display screen is disposed behind a transflector, and wherein said video display screen, when backlit and displaying video images, is viewable by a driver of the equipped vehicle, and wherein said video display screen is substantially not viewable by the driver of the equipped vehicle when not backlit and not displaying video images.

5. The vehicular vision system of claim 4, wherein, during forward travel of the equipped vehicle and responsive to detection of a road sign by said image processor processing first image data captured by said first camera, an image of the detected road sign is displayed by said video display screen at an upper part of said left display region at said left portion of said video display screen to alert the driver as to the presence of the detected road sign, and wherein, after the equipped vehicle has passed the road sign, said video display screen ceases displaying the detected road sign.

6. The vehicular vision system of claim 1, wherein said video display screen comprises a reconfigurable thin film transistor liquid crystal display screen that is backlit by a plurality of white light-emitting light emitting diodes and wherein dynamic contrast control is provided to increase the contrast within individual video image frames when backlighting of said video display screen is locally dimmed.

7. The vehicular vision system of claim 1, wherein said second camera comprises a rear backup video camera at a rear portion of the equipped vehicle and wherein, responsive at least in part to machine vision analysis by said image processor of second image data captured by said second camera detecting another vehicle in the left side lane or right side lane adjacent to the equipped vehicle, said video display screen displays a visual warning.

8. The vehicular vision system of claim 1, wherein said video processor is operable to provide on-screen display capability and is operable to at least partially control the intensity of said video display screen responsive to detection of an ambient light intensity at or in the equipped vehicle.

9. The vehicular vision system of claim 1, wherein said road sign comprises a stop sign.

10. The vehicular vision system of claim 1, wherein said second camera comprises a rear backup video camera at a rear portion of the equipped vehicle and wherein said second camera has a rearward field of view of at least about 180 degrees.

11. The vehicular vision system of claim 1, wherein image data is carried to said video processor as digital signals via an Ethernet communication link.

12. The vehicular vision system of claim 1, wherein said image processor of said video processor is a separate image processor chip.

13. The vehicular vision system of claim 1, wherein, during forward travel of the equipped vehicle and responsive to detection of a road sign by said image processor processing first image data captured by said first camera, a stored image of the detected road sign is displayed by said video display screen to alert the driver as to the presence of the detected road sign, and wherein, after the equipped vehicle has passed the road sign, said video display screen ceases displaying the detected road sign.

14. A vehicular vision system comprising:

a first camera having a field of view forward of a vehicle equipped with said vehicular vision system and operable to capture first image data;

a second camera having a field of view rearward of the equipped vehicle and operable to capture second image data;

a third camera disposed at a side portion of the equipped vehicle and having a field of view sideward of the equipped vehicle and operable to capture third image data;

a fourth camera disposed at a side portion of the equipped vehicle that is opposed to the side portion at which said third camera is disposed and having a field of view sideward of the equipped vehicle and operable to capture fourth image data;

a video processor operable at least to process second image data captured by said second camera, wherein said second image data comprises at least a left zone second image data set, a middle zone second image data set and a right zone second image data set;

wherein said left zone second image data set corresponds to a left zone that encompasses where another vehicle may at least one of (i) approach from the rear of the equipped vehicle in a left side lane adjacent to the equipped vehicle and (ii) overtake the equipped vehicle in a left side lane adjacent to the equipped vehicle;

wherein said right zone second image data set corresponds to a right zone that encompasses where another vehicle may at least one of (i) approach from the rear of the equipped vehicle in a right side lane adjacent to the equipped vehicle and (ii) overtake the equipped vehicle in a right side lane adjacent to the equipped vehicle;

wherein said middle zone second image data set corresponds to a middle zone that encompasses where another vehicle may approach from the rear of the equipped vehicle in a lane being traveled by the equipped vehicle;

a video display screen for displaying video images, said video images derived, at least in part, from second image data captured by said second camera;

wherein said video display screen comprises a left display region at a left portion of said video display screen and a right display region at a right portion of said video display screen and a middle display region disposed between said left display region and said right display region;

wherein said video processor comprises an image processor operable for machine vision analysis of first image data captured by said first camera;

wherein said video processor receives image data captured at least by said second camera, said third camera and said fourth camera and merges the received image data to generate, for display by said video display screen, a surround view that comprises a panoramic birds-eye view of an area at and around the equipped vehicle, and wherein said video processor generates at least one of graphic overlays, indicia and visual aids to assist the driver'"'"'s interpretation and use of the surround view when displayed by said video display screen;

wherein said second camera comprises a rear backup video camera at a rear portion of the equipped vehicle and wherein, responsive at least in part to machine vision analysis by said image processor of second image data captured by said second camera detecting another vehicle in the left side lane or right side lane adjacent to the equipped vehicle, said video display screen displays a visual warning;

wherein, during a reversing maneuver of the equipped vehicle, said video display screen uses said left display region, said middle display region and said right display region to display video images derived, at least in part, from second image data captured by said second camera;

wherein said video display screen is part of a center stack or center console display used for a navigation or infotainment system of the equipped vehicle; and

wherein said image processor of said video processor is a separate image processor chip.

15. The vehicular vision system of claim 14, wherein said video processor is operable to provide on-screen display capability and is operable to at least partially control the intensity of said video display screen responsive to detection of an ambient light intensity at or in the equipped vehicle.

16. The vehicular vision system of claim 15, wherein image data is carried to said video processor as digital signals via an Ethernet communication link.

17. The vehicular vision system of claim 15, wherein, during forward travel of the equipped vehicle and responsive to said image processor processing first image data captured by said first camera, an object ahead of the equipped vehicle is detected.

18. The vehicular vision system of claim 17, wherein said object comprises a road sign and wherein an image or iconistic representation of the detected road sign is displayed by said video display screen in order to enhance cognitive awareness by a driver of the equipped vehicle of the presence of the detected road sign so as to enhance the driver'"'"'s awareness of the driving situation or road condition or situation that the equipped vehicle is approaching.

19. A vehicular vision system comprising:

a first camera having a field of view forward of a vehicle equipped with said vehicular vision system and operable to capture first image data;

a second camera having a field of view rearward of the equipped vehicle and operable to capture second image data;

a third camera disposed at a side portion of the equipped vehicle and having a field of view sideward of the equipped vehicle and operable to capture third image data;

a fourth camera disposed at a side portion of the equipped vehicle that is opposed to the side portion at which said third camera is disposed and having a field of view sideward of the equipped vehicle and operable to capture fourth image data;

a video processor operable at least to process second image data captured by said second camera, wherein said second image data comprises at least a left zone second image data set, a middle zone second image data set and a right zone second image data set;

wherein said left zone second image data set corresponds to a left zone that encompasses where another vehicle may at least one of (i) approach from the rear of the equipped vehicle in a left side lane adjacent to the equipped vehicle and (ii) overtake the equipped vehicle in a left side lane adjacent to the equipped vehicle;

wherein said right zone second image data set corresponds to a right zone that encompasses where another vehicle may at least one of (i) approach from the rear of the equipped vehicle in a right side lane adjacent to the equipped vehicle and (ii) overtake the equipped vehicle in a right side lane adjacent to the equipped vehicle;

wherein said middle zone second image data set corresponds to a middle zone that encompasses where another vehicle may approach from the rear of the equipped vehicle in a lane being traveled by the equipped vehicle;

a video display screen for displaying video images, said video images derived, at least in part, from second image data captured by said second camera;

wherein said video display screen comprises a left display region at a left portion of said video display screen and a right display region at a right portion of said video display screen and a middle display region disposed between said left display region and said right display region;

wherein said video processor comprises an image processor operable for machine vision analysis of first image data captured by said first camera;

wherein said video processor receives image data captured at least by said second camera, said third camera and said fourth camera and merges the received image data to generate, for display by said video display screen, a surround view that comprises a panoramic birds-eye view of an area at and around the equipped vehicle, and wherein said video processor generates at least one of graphic overlays, indicia and visual aids to assist the driver'"'"'s interpretation and use of the surround view when displayed by said video display screen;

wherein said second camera comprises a rear backup video camera at a rear portion of the equipped vehicle and wherein, responsive at least in part to machine vision analysis by said image processor of second image data captured by said second camera detecting another vehicle in the left side lane or right side lane adjacent to the equipped vehicle, said video display screen displays a visual warning;

wherein, during a reversing maneuver of the equipped vehicle, said video display screen uses said left display region, said middle display region and said right display region to display video images derived, at least in part, from second image data captured by said second camera;

wherein said video display screen is part of a center stack or center console display used for a navigation or infotainment system of the equipped vehicle;

wherein said video processor is operable to provide on-screen display capability; and

wherein said second camera has a rearward field of view of at least about 180 degrees.

20. The vehicular vision system of claim 19, wherein said image processor of said video processor is a separate image processor chip and wherein, during forward travel of the equipped vehicle and responsive to said image processor processing first image data captured by said first camera, an object ahead of the equipped vehicle is detected.

21. The vehicular vision system of claim 20, wherein said object comprises a road sign and wherein an image or iconistic representation of the detected road sign is displayed by said video display screen in order to enhance cognitive awareness by a driver of the equipped vehicle of the presence of the detected road sign so as to enhance the driver'"'"'s awareness of the driving situation or road condition or situation that the equipped vehicle is approaching.

22. The vehicular vision system of claim 21, wherein said video display screen comprises a reconfigurable thin film transistor liquid crystal display screen that is backlit by a plurality of white light-emitting light emitting diodes, and wherein said liquid crystal display screen comprises at least about 85,000 individually addressable pixels, and wherein, when said video display screen is operating to display video images, said video display screen provides a contrast ratio of greater than about 250:

1.

23. The vehicular vision system of claim 22, wherein the intensity of said video display screen is controlled responsive to detection of an ambient light intensity at or in the equipped vehicle.