DRIVER ASSIST SYSTEM FOR VEHICLE

• US 20140015977A1
• Filed: 09/23/2013
• Published: 01/16/2014
• Est. Priority Date: 03/02/2000
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Taylor, David W., McCarthy, Kevin C., Lynam, Niall R., Schofield, Kenneth
• Granted Patent: US 8,676,491 B2
• Time in Patent Office: Days
• US Class Current: 348/148
• CPC Class Codes: B60C 23/0408 transmitting the signals by non-mechanical means from the wheel or tyre to a vehicle body mounted receiver
• CPC Class Codes: B60N 2/976 massaging systems
• CPC Class Codes: B60Q 1/2665 on rear-view mirrors lighting devices for vehicle interior on or for rear-view mirrors B60Q3/258
• CPC Class Codes: B60Q 5/006 indicating risk of collision between vehicles or with pedestrians
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/088 using a cell of electrically changeable optical characteristic, e.g. liquid-crystal or electrochromic mirrors
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1215 with information displays
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/207 using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/301 combining image information with other obstacle sensor information, e.g. using RADAR/LIDAR/SONAR sensors for estimating risk of collision
• CPC Class Codes: B60R 2300/406 using wireless transmission
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G01C 21/26 : specially adapted for navigation in a road network
• CPC Class Codes: G01C 21/36 : Input/output arrangements for on-board computers
• CPC Class Codes: G01C 21/365 : Guidance using head up displays or projectors, e.g. virtual vehicles or arrows projected on the windscreen or on the road itself
• CPC Class Codes: G01S 13/862 : Combination of radar systems with sonar systems
• CPC Class Codes: G01S 13/865 : Combination of radar systems with lidar systems
• CPC Class Codes: G01S 13/867 : Combination of radar systems with cameras
• CPC Class Codes: G06T 2207/30252 : Vehicle exterior; Vicinity of vehicle
• CPC Class Codes: G06T 5/80 : Geometric correction
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/265 : Mixing
• CPC Class Codes: H04N 7/181 : for receiving images from a plurality of remote sources
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A driver assist system for a vehicle includes a camera and a video display screen viewable by a driver of the vehicle. The video display screen is operable to display images derived, at least in part, from image data captured by the camera. A visual cue is displayed by the video display screen in conjunction with display of the captured image data. During a reversing maneuver of the vehicle, image data captured by the camera is displayed by the video display screen as video images so as to assist the driver in reversing the vehicle. When a reversing maneuver of the vehicle is not being executed, the display screen may be operable to display information associated with at least one of (i) a navigational system, (ii) a telematics system and (iii) a vehicle information system.

Claims

1. A driver assist system for a vehicle, said driver assist system comprising:

a CMOS camera disposed at a vehicle equipped with said driver assist system and having a field of view exterior of the equipped vehicle;

wherein said CMOS camera is mounted at the rear of the equipped vehicle;

a video display screen viewable by a driver of the equipped vehicle when the driver is normally operating the equipped vehicle, wherein said video display screen is operable to display images derived, at least in part, from image data captured by said CMOS camera with a display intensity of at least about 200 candelas/sq. meter for viewing by the driver of the equipped vehicle;

wherein a visual cue is displayed by said video display screen in conjunction with display of said captured image data, said visual cue comprising an electronically-generated overlay;

wherein said video display screen comprises a TFT liquid crystal display screen backlit by a plurality of white light emitting light emitting diodes;

a human machine interface, said human machine interface comprising a user input;

wherein said user input comprises at least one of a (i) a vocal input, (ii) a non-vocal input, (iii) a key input and (iv) a touch input;

wherein, during a reversing maneuver of the equipped vehicle, image data captured by said CMOS camera is displayed by said video display screen as video images so as to assist the driver in reversing the equipped vehicle; and

wherein, when a reversing maneuver of the equipped vehicle is not being executed, said display screen is operable to display information associated with at least one of (i) a navigational system, (ii) a telematics system and (iii) a vehicle information system.

2. The driver assist system of claim 1, wherein said visual cue is generated responsive to detection of an object exterior of the equipped vehicle by at least one of (i) object detection by a non-visual detector, (ii) object detection by an ultrasonic detector and (iii) object detection by image processing of captured image data.

3. The driver assist system of claim 1, wherein said visual cue at least one of (i) indicates distance to an object exterior of the equipped vehicle, (ii) indicates an intended path of travel of the equipped vehicle, (iii) indicates proximity to an object exterior of the equipped vehicle and (iv) highlights an object exterior of the equipped vehicle.

4. The driver assist system of claim 1, wherein said visual cue at least one of (i) highlights an object exterior of the equipped vehicle and (ii) highlights an object that the equipped vehicle is in jeopardy of colliding with.

5. The driver assist system of claim 1, wherein said visual cue is accompanied by an audible alert, said audible alert alerting the driver that the equipped vehicle is approaching an object proximate to the equipped vehicle.

6. The driver assist system of claim 1, wherein, responsive to detection of an object exterior of the equipped vehicle by at least one of (i) object detection by a non-visual detector, (ii) object detection by an ultrasonic detector and (iii) object detection by image processing of captured image data, at least one of (a) the driver'"'"'s attention is drawn to an object displayed by said video display screen and (b) said visual cue highlights an object displayed by said video display screen to draw the driver'"'"'s attention to the displayed object.

7. The driver assist system of claim 1, wherein, when a reversing maneuver of the equipped vehicle is not being executed, said display screen is operable to display information associated with a vehicle information system, and wherein said information comprises at least one of (i) vehicle speed information, (ii) vehicle fuel level information, (iii) tire pressure status, (iv) direction information, (v) instrument information and (vi) vehicle function information.

8. The driver assist system of claim 1, wherein at least one of (i) said video display screen is operable to display images derived, at least in part, from image data captured by said CMOS camera with a display intensity of at least about 300 candelas/sq. meter for viewing by the driver of the equipped vehicle and (ii) at least some of said plurality of white light emitting light emitting diodes are operable to each individually pass up to about 100 milliamps forward current.

9. The driver assist system of claim 1, wherein at least one of (i) said user input comprises at least one input for a telematics system of the equipped vehicle, (ii) said user input comprises at least one input for a navigational system of the equipped vehicle, (iii) said user input comprises at least one input for a navigation function of said driver assist system, (iv) said user input comprises at least one input for a biometric system of the equipped vehicle and (v) said driver assist system controls operation of said video display screen responsive, at least in part, to said user input.

10. The driver assist system of claim 1, wherein said video display screen is disposed at one of (i) a windshield electronics module of the equipped vehicle, (ii) an instrument panel of the equipped vehicle and (iii) a console of the equipped vehicle.

11. The driver assist system of claim 1, comprising a control operable to control at least one accessory of the equipped vehicle in accordance with a characteristic of an occupant of the equipped vehicle, and wherein said at least one accessory comprises a seat adjustment system operable to adjust a seat of the equipped vehicle in accordance with a biometric characteristic of an occupant of the equipped vehicle and wherein said seat adjustment system is operable to adjust a seat of the equipped vehicle in response to biometric data, said biometric data pertaining to the occupant of the seat of the equipped vehicle.

12. The driver assist system of claim 1, comprising a control operable to communicate with an external service provider via a wireless communication link between the equipped vehicle and the external service provider, wherein said control receives an input from the driver of the equipped vehicle and responsive thereto establishes said wireless communication link between the equipped vehicle and the external service provider, and wherein said control controls at least one accessory of the equipped vehicle responsive to a geographic location of the equipped vehicle as determined by a global positioning system of the equipped vehicle, and wherein data from the external service provider is downloaded to said control via said wireless communication link, and wherein said control comprises memory for storing downloaded data at least after said wireless communication link established between said control and the external service provider is disconnected, and wherein said downloaded data comprises downloaded driving instruction data useful for instructing the driver of the equipped vehicle how to drive from an initial location to a destination location, and wherein driving instructions derived at least in part from said downloaded driving instruction data are displayed, when the equipped vehicle is not executing a reversing maneuver, by said video display screen for viewing by the driver of the equipped vehicle, and wherein said driving instructions are displayed by said video display screen in a step-by-step manner, with at least some driving instruction steps being displayed by said video display screen after said wireless communication link between said control and the external service provider is disconnected.

13. A driver assist system for a vehicle, said driver assist system comprising:

a CMOS camera disposed at a vehicle equipped with said driver assist system and having a field of view exterior of the equipped vehicle;

wherein said CMOS camera is mounted at the rear of the equipped vehicle;

a video display screen viewable by a driver of the equipped vehicle when the driver is normally operating the equipped vehicle, wherein said video display screen is operable to display images derived, at least in part, from image data captured by said CMOS camera with a display intensity of at least about 200 candelas/sq. meter for viewing by the driver of the equipped vehicle;

wherein a visual cue is displayed by said video display screen in conjunction with display of said captured image data, said visual cue comprising an electronically-generated overlay;

wherein said visual cue at least one of (i) indicates distance to an object exterior of the equipped vehicle, (ii) indicates an intended path of travel of the equipped vehicle, (iii) indicates proximity to an object exterior of the equipped vehicle and (iv) highlights an object exterior of the equipped vehicle;

wherein, during a reversing maneuver of the equipped vehicle, image data captured by said CMOS camera is displayed by said video display screen as video images so as to assist the driver in reversing the equipped vehicle;

wherein, when a reversing maneuver of the equipped vehicle is not being executed, said display screen is operable to display information associated with at least one of (i) a navigational system, (ii) a telematics system and (iii) a vehicle information system; and

wherein said video display screen is disposed at one of (i) a windshield electronics module of the equipped vehicle, (ii) an instrument panel of the equipped vehicle and (iii) a console of the equipped vehicle.

14. The driver assist system of claim 13, wherein at last one of (a) said visual cue indicates at least one of (i) distance to an object exterior of the equipped vehicle and (ii) an intended path of travel of the equipped vehicle, and (b) said visual cue at least one of (i) highlights an object exterior of the equipped vehicle and (ii) highlights an object that the equipped vehicle is in jeopardy of colliding with.

15. The driver assist system of claim 13, wherein, responsive to detection of an object exterior of the equipped vehicle by at least one of (i) non-visual object detection, (ii) ultrasonic object detection and (iii) image processing object detection, at least one of (a) the driver'"'"'s attention is drawn to an object displayed by said video display screen and (b) said visual cue highlights an object displayed by said video display screen to draw the driver'"'"'s attention to the displayed object.

16. The driver assist system of claim 13, wherein, when a reversing maneuver of the equipped vehicle is not being executed, said display screen is operable to display information associated with a vehicle information system, and wherein said information comprises at least one of (i) vehicle speed information, (ii) vehicle fuel level information, (iii) tire pressure status, (iv) direction information, (v) instrument information and (vi) vehicle function information.

17. The driver assist system of claim 13, wherein said video display screen comprises a TFT liquid crystal display screen backlit by a plurality of white light emitting light emitting diodes, and wherein said video display screen is operable to display images derived, at least in part, from image data captured by said CMOS camera with a display intensity of at least about 300 candelas/sq. meter for viewing by the driver of the equipped vehicle.

18. A driver assist system for a vehicle, said driver assist system comprising:

a CMOS camera disposed at a vehicle equipped with said driver assist system and having a field of view exterior of the equipped vehicle;

wherein said CMOS camera is mounted at the rear of the equipped vehicle;

a video display screen viewable by a driver of the equipped vehicle when the driver is normally operating the equipped vehicle, wherein said video display screen is operable to display images derived, at least in part, from image data captured by said CMOS camera with a display intensity of at least about 200 candelas/sq. meter for viewing by the driver of the equipped vehicle;

wherein a visual cue is displayed by said video display screen in conjunction with display of said captured image data, said visual cue comprising an electronically-generated overlay;

wherein said visual cue at least one of (i) indicates distance to an object exterior of the equipped vehicle, (ii) indicates an intended path of travel of the equipped vehicle, (iii) indicates proximity to an object exterior of the equipped vehicle and (iv) highlights an object exterior of the equipped vehicle;

wherein, during a reversing maneuver of the equipped vehicle, image data captured by said CMOS camera is displayed by said video display screen as video images so as to assist the driver in reversing the equipped vehicle;

wherein, when a reversing maneuver of the equipped vehicle is not being executed, said display screen is operable to display information associated with a vehicle information system, and wherein said information comprises at least one of (i) vehicle speed information, (ii) vehicle fuel level information, (iii) tire pressure status, (iv) direction information, (v) instrument information and (vi) vehicle function information; and

wherein said video display screen comprises a TFT liquid crystal display screen backlit by a plurality of white light emitting light emitting diodes.

19. The driver assist system of claim 18, wherein, responsive to detection of an object exterior of the equipped vehicle by at least one of (i) object detection by a non-visual detector, (ii) object detection by an ultrasonic detector and (iii) object detection by image processing of captured image data, at least one of (a) the driver'"'"'s attention is drawn to an object displayed by said video display screen and (b) said visual cue highlights an object displayed by said video display screen to draw the driver'"'"'s attention to the displayed object.

20. The driver assist system of claim 19, wherein at least one of (a) said visual cue is accompanied by an audible alert, said audible alert alerting the driver that the equipped vehicle is approaching an object proximate to the equipped vehicle, (b) said video display screen is operable to display images derived, at least in part, from image data captured by said CMOS camera with a display intensity of at least about 300 candelas/sq. meter for viewing by the driver of the equipped vehicle, (c) said video display screen is operable to display images derived, at least in part, from image data captured by said CMOS camera with a display intensity of at least about 400 candelas/sq. meter for viewing by the driver of the equipped vehicle, (d) at least some of said plurality of white light emitting light emitting diodes are operable to each individually pass up to about 100 milliamps forward current, and (e) said driver assist system comprises a user input and wherein said user input comprises at least one of a (i) a vocal input, (ii) a non-vocal input, (iii) a key input and (iv) a touch input.