Display enhancements for vehicle vision system

• US 5,949,331 A
• Filed: 09/22/1997
• Issued: 09/07/1999
• Est. Priority Date: 02/26/1993
• Status: Expired due to Term

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Schofield, Kenneth, Vadas, Keith J., Larson, Mark L.
• Primary Examiner(s): Hofsass, Jeffery A.
• Assistant Examiner(s): MANNAVA, ASHOK K
• Application Number:
  US08/935,336
• Time in Patent Office: 715 Days
• Field of Search: 340/435, 340/436, 340/901, 340/903, 340/461, 340/438, 340/439, 340/462, 348/118, 348/148, 701/116, 701/117, 701/301
• US Class Current: 340/461
• CPC Class Codes: B60N 2/002 Seats provided with an occupancy detection means mounted therein or thereon detection means responsive to presence or absence of children B60N2/266
• CPC Class Codes: B60Q 1/14 having dimming means
• CPC Class Codes: B60Q 1/1423 Automatic dimming circuits, i.e. switching between high beam and low beam due to change of ambient light or light level in road traffic
• CPC Class Codes: B60Q 2300/054 Variable non-standard intensity, i.e. emission of various beam intensities different from standard intensities, e.g. continuous or stepped transitions of intensity
• CPC Class Codes: B60Q 2300/056 Special anti-blinding beams, e.g. a standard beam is chopped or moved in order not to blind
• CPC Class Codes: B60Q 2300/21 Manual control
• CPC Class Codes: B60Q 2300/314 Ambient light
• CPC Class Codes: B60Q 2300/3321 Detection of streetlights
• CPC Class Codes: B60Q 2300/41 preceding vehicle
• CPC Class Codes: B60Q 2300/42 oncoming vehicle
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/088 using a cell of electrically changeable optical characteristic, e.g. liquid-crystal or electrochromic mirrors
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1223 with sensors or transducers
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 21/01538 for image processing, e.g. cameras or sensor arrays
• CPC Class Codes: B60R 2300/101 : using cameras with adjustable capturing direction
• CPC Class Codes: B60R 2300/103 : using camera systems provided with artificial illumination device, e.g. IR light source
• CPC Class Codes: B60R 2300/105 : using multiple cameras
• CPC Class Codes: B60R 2300/106 : using night vision cameras
• CPC Class Codes: B60R 2300/107 : using stereoscopic cameras
• CPC Class Codes: B60R 2300/205 : using a head-up display
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/30 : characterised by the type of image processing
• CPC Class Codes: B60R 2300/302 : combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/304 : using merged images, e.g. merging camera image with stored images
• CPC Class Codes: B60R 2300/305 : merging camera image with lines or icons
• CPC Class Codes: B60R 2300/307 : virtually distinguishing relevant parts of a scene from the background of the scene
• CPC Class Codes: B60R 2300/404 : triggering from stand-by mode to operation mode
• CPC Class Codes: B60R 2300/50 : characterised by the display information being shared, e.g. external display, data transfer to other traffic participants or centralised traffic controller
• CPC Class Codes: B60R 2300/802 : for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/8026 : in addition to a rear-view mirror system
• CPC Class Codes: B60R 2300/804 : for lane monitoring
• CPC Class Codes: B60R 2300/8053 : for bad weather conditions or night vision
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/8066 : for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8086 : for vehicle path indication
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: B60S 1/0822 : characterized by the arrangement or type of detection means
• CPC Class Codes: B60S 1/0844 : including a camera
• CPC Class Codes: B60S 1/0885 : the sensor being integrated in a rear-view mirror module
• CPC Class Codes: G01J 1/4204 : with determination of ambient light solar light G01J2001/4266
• CPC Class Codes: G01J 1/4228 : arrangements with two or more detectors, e.g. for sensitivity compensation
• CPC Class Codes: G08G 1/167 : Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: H04N 13/239 : using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 2013/0081 : Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 7/18 : Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources

Abstract

A vision system for a vehicle includes at least one image capture device which may be directed rearwardly with respect to the direction of travel of the vehicle. A display system displays an image synthesized from an output of the image capture device. The display system enhances the displayed image by visually informing the driver of what is occurring in the area surrounding the vehicle. For example, hazards, such as objects too close to the vehicle for safe lane-change maneuver, can be highlighted such as by flashing the image of the hazard or displaying the hazard in a particular color.

Claims

1. A vehicular rearview vision system, comprising:

at least one image capture device positioned on the vehicle and adapted to capturing images of objects; and

a display system which displays an image which comprises a rearward facing view of objects captured by said at least one image capture device;

wherein said display system enhances the displayed image by including an image enhancement comprising a visual prompt perspectively related to objects in the image displayed and which visually informs the driver of what is occurring in the area surrounding the vehicle including relative position of objects behind vehicle.

2. The rearview vision system for a vehicle in claim 1 wherein said image enhancement comprises a graphic overlay superimposed on the displayed image indicating distances of objects from the vehicle.

3. The rearview vision system of claim 2 wherein said graphic overlay comprises at least one horizontal mark superimposed on the displayed image.

4. The rearview vision system for a vehicle in claim 3 wherein said at least one horizontal mark is adjusted in response to vehicle speed.

5. The rearview vision system for a vehicle in claim 3 wherein said at least one horizontal mark comprises a plurality of short horizontal lines superimposed on the image at regular rearward intervals.

6. The rearview vision system for a vehicle in claim 5 wherein said lines are positioned to correspond to boundaries of the lane in which the vehicle is travelling.

7. The rearview vision system for a vehicle in claim 6 wherein said lines are moved laterally to correspond to positions of curved lane boundaries when the vehicle is turning.

8. The rearview vision system in claim 7 including a monitoring device for monitoring vehicles turning.

9. The rearview vision system in claim 8 wherein said monitoring device comprises one of a monitor of movement of the vehicle'"'"'s steering system, a monitor of an output of an electronic compass, and a monitor of the vehicle'"'"'s differential drive system.

10. The rearview vision system in claim 1 wherein said image is enhanced by a graphic overlay superimposed on the displayed image including indicia of the anticipated travel of the vehicle.

11. The rearview vision system in claim 10 wherein said graphic overlay is disabled when the vehicle'"'"'s gear actuator is not in reverse gear.

12. The rearview vision system in claim 1 wherein said at least one image capture device comprises at least two image capture devices positioned on opposite lateral sides of said vehicle and wherein said display system displays an image synthesized from outputs of said image capture devices which approximates a rearward-facing substantially seamless panoramic view.

13. The rearview vision system in claim 12 wherein said display system includes a display surface for displaying said outputs of both said image capture devices.

14. The rearview vision system in claim 12 wherein each of said image capture devices is a CMOS imaging array.

15. The rearview vision system in claim 1 wherein said at least one image capture device comprises at least three image capture devices including at least two side image capture devices positioned on opposite lateral sides of said vehicle and at least one center image capture device laterally between said side image capture devices and wherein said display system displays an image synthesized from outputs of said image capture devices which approximates a rearward-facing substantially seamless panoramic view.

16. The rearview vision system in claim 15 wherein said at least three image capture devices are at substantially the same height.

17. The rearview vision system in claim 15 wherein said display system includes a display surface for displaying said outputs of both said image capture devices.

18. The rearview vision system in claim 15 wherein each of said image capture devices comprises a CMOS imaging array.

19. The rearview vision system in claim 1 wherein said at least one image capture device comprises a CMOS imaging array.

20. A vehicular rearview vision system, comprising:

at least one image capture device positioned on the vehicle and directed rearwardly with respect to the direction of travel of the vehicle; and

a display system which displays an image from said at least one image capture device;

wherein said display system enhances the displayed image by visually highlighting hazards in the area surrounding the vehicle, wherein said visually highlighting hazards comprises modifying the displayed images which include said hazards.

22. The rearview vision system in claim 20 wherein said hazards include objects too close to said vehicle for safe lane-change maneuver.

24. The rearview vision system in claim 20 including a speed transducer which provides an input to said display system such that a determination that objects are too close to said vehicle is a function of vehicle speed.

25. The rearview vision system in claim 20 wherein said display system responds to activation of the vehicle turn signal to visually highlight objects too close to said vehicle.

26. The rearview vision system in claim 20 including a sensing system for sensing distance of objects from the vehicle.

27. The rearview vision system in claim 26 wherein said sensing system comprises one of radar, ultrasonic sensing and infrared detection.

28. The rearview vision system in claim 20 wherein said at least one image capture device comprises at least two image capture devices positioned on opposite lateral sides of said vehicle and wherein said display system displays an image synthesized from outputs of said image capture devices which approximates a rearward-facing substantially seamless panoramic view.

29. The rearview vision system in claim 28 wherein said at least two image capture devices include stereoscopic distance-sensing capabilities.

30. The rearview vision system in claim 28 wherein said display system includes a display surface for displaying said outputs of both said image capture devices.

31. The rearview vision system in claim 28 wherein each of said image capture devices is a CMOS imaging array.

32. The rearview vision system in claim 20 wherein said at least one image capture device comprises at least three image capture devices including at least two side image capture devices positioned on opposite lateral sides of said vehicle and at least one center image capture device laterally between said side image capture devices and wherein said display system displays an image synthesized from outputs of said image capture devices which approximates a rearward-facing substantially seamless panoramic view.

33. The rearview vision system in claim 32 wherein said at least three image capture devices are at substantially the same height.

34. The rearview vision system in claim 32 wherein said display system includes a display surface for displaying said outputs of both said image capture devices.

35. The rearview vision system in claim 32 wherein each of said image capture devices is a CMOS imaging array.

21. A rearview vision system for a vehicle, comprising:

at least one image capture device positioned on the vehicle and directed rearwardly with respect to the direction of travel of the vehicle; and

a display system which displays an image from said at least one image capture device;

wherein said display system enhances the displayed image by visually highlighting hazards in the area surrounding the vehicle, wherein said highlighting hazards includes at least one of displaying the hazard in a particular color and flashing the image of the hazard.

23. A rearview vision system in claim 21 wherein said highlighting hazards includes at least one of displaying the object too close to said vehicle in a particular color and flashing the image of the object too close to said vehicle.

36. A vehicular rearview vision system, comprising:

at least one image capture device positioned on the vehicle and directed rearwardly with respect to the direction of travel of the vehicle; and

a display system which displays an image from said at least one image capture device;

wherein said display system includes a graphic overlay superimposed on the displayed image indicating distances of objects from the vehicle and visually highlighting of images of objects too close to the vehicle for safe lane-change maneuver, wherein said visually highlighting comprises modifying the displayed images which include said objects too close to the vehicle.

38. The rearview vision system in claim 36 wherein said graphic overlay comprises at least one horizontal mark superimposed on the displayed image.

39. The rearview vision system in claim 36 including a monitoring device for monitoring vehicles turning.

40. The rearview vision system in claim 39 wherein said monitoring device comprises one of a monitor of movement of the vehicle'"'"'s steering system, a monitor of an output of an electronic compass and a monitor of the vehicle'"'"'s differential drive system.

41. The rearview vision system in claim 36 including a speed transducer wherein said graphic overlay is adjusted in response to vehicle speed and highlighting of objects too close to said vehicle is a function of vehicle speed.

42. The rearview vision system in claim 36 wherein said display system responds to activation of the vehicle turn signal to visually highlight objects too close to said vehicle.

43. The rearview vision system in claim 36 wherein said at least one image capture device comprises at least two image capture devices positioned on opposite lateral sides of said vehicle and wherein said display system displays an image synthesized from outputs of said image capture devices which approximates a rearward-facing substantially seamless panoramic view.

44. The rearview vision system in claim 43 wherein said display system includes a display surface for displaying said outputs of both said image capture devices.

45. The rearview vision system in claim 43 wherein each of said image capture devices is a CMOS imaging array.

46. The rearview vision system in claim 43 wherein said at least two image capture devices include stereoscopic distance-sensing capabilities.

47. The rearview vision system in claim 36 wherein said at least one image capture device comprises at least three image capture devices including at least two side image capture devices positioned on opposite lateral sides of said vehicle and at least one center image capture device laterally between said side image capture devices and wherein said display system displays an image synthesized from outputs of said image capture devices which approximates a rearward-facing substantially seamless panoramic view.

48. The rearview vision system in claim 47 wherein said at least three image capture devices are at substantially the same height.

49. The rearview vision system in claim 47 wherein said display system includes a display surface for displaying said outputs of both said image capture devices.

50. The rearview vision system in claim 47 wherein each of said image capture devices is a CMOS imaging array.

37. A rearview vision system for a vehicle comprising:

at least one image capture device positioned on the vehicle and directed rearwardly with respect to the direction of travel of the vehicle; and

a display system which displays an image from said at least one image capture device;

wherein said display system includes a graphic overlay superimposed on the displayed image indicating distances of objects from the vehicle and visually highlighting of images of objects too close to the vehicle for safe lane-change maneuver, wherein said visually highlighting includes at least one of displaying the object too close to said vehicle in a particular color and flashing the image of the object too close to said vehicle.

51. The rearview vision system in claim 37 including a sensing system for sensing distance of objects from the vehicle.

52. The rearview vision system in claim 51 wherein said sensing system comprises one of radar, ultrasonic sensing and infrared detection.

53. A vehicular vision system, comprising:

at least two image capture devices positioned on opposite lateral sides of said vehicle and adapted to capturing images of objects; and

a display system which displays an image of objects captured by said at least two image capture devices, wherein said display system displays an image synthesized from outputs of said image capture devices which approximates a substantially seamless panoramic view;

wherein said display system enhances the displayed image by including an image enhancement comprising a visual prompt perspectively related to objects in the image displayed and which visually informs the driver of what is occurring in the area surrounding the vehicle.

54. The vision system for a vehicle in claim 53 wherein said image enhancement comprises a graphic overlay superimposed on the displayed image indicating distances of objects from the vehicle.

55. The vision system of claim 54 wherein said graphic overlay comprises at least one horizontal mark superimposed on the displayed image.

56. The vision system for a vehicle in claim 55 wherein said at least one horizontal mark is adjusted in response to vehicle speed.

57. The vision system for a vehicle in claim 55 wherein said at least one horizontal mark comprises a plurality of short horizontal lines superimposed on the image at regular spacial intervals.

58. The vision system for a vehicle in claim 57 wherein said lines are positioned to correspond to boundaries of the lane in which the vehicle is travelling.

59. The vision system for a vehicle in claim 58 wherein said lines are moved laterally to correspond to positions of curved lane boundaries when the vehicle is turning.

60. The vision system in claim 59 including a monitoring device for monitoring vehicles turning.

61. The vision system in claim 60 wherein said monitoring device comprises one of a monitor of movement of the vehicle'"'"'s steering system, a monitor of an output of an electronic compass, and a monitor of the vehicle'"'"'s differential drive system.

62. The rearview vision system in claim 53 wherein said display system includes a display surface for displaying said outputs of both said image capture devices.

63. The rearview vision system in claim 53 wherein each of said image capture devices is a CMOS imaging array.

64. The rearview vision system in claim 53 wherein said at least two image capture devices is a CMOS imaging array.