Vehicle night vision support system and control method for the same

• US 9,061,632 B2
• Filed: 10/07/2010
• Issued: 06/23/2015
• Est. Priority Date: 10/21/2009
• Status: Expired due to Fees

• Current Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Original Assignee: Toyota Jidosha Kabushiki Kaisha (Toyota Motor Corporation)
• Inventors: Toyofuku, Kunihiko
• Primary Examiner(s): Czekaj, Dave
• Assistant Examiner(s): Rahman, Mohammad J
• Application Number:
  US13/391,157
• Publication Number:
  US 20120320207A1
• Time in Patent Office: 1,720 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: B60R 1/24 in front of the vehicle
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 2300/106 using night vision cameras
• CPC Class Codes: B60R 2300/20 characterised by the type of display used
• CPC Class Codes: B60R 2300/302 combining image information with GPS information or vehicle data, e.g. vehicle speed, gyro, steering angle data
• CPC Class Codes: B60R 2300/308 by overlaying the real scene, e.g. through a head-up display on the windscreen
• CPC Class Codes: B60R 2300/8093 for obstacle warning
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/166 for active traffic, e.g. moving vehicles, pedestrians, bikes

Abstract

A vehicle night vision support system includes an infrared camera that captures an image ahead of a vehicle; a main display that displays the image captured by the infrared camera; a sub-display; and a control unit that controls the sub-display so as to display warning information when it is determined that there is an object in the image displayed on the main display, and controls the sub-display so as to display the warning information when it is estimated or detected that an object that has disappeared from the displayed image is present in the field of view of a driver.

Claims

1. A vehicle night vision support system comprising:

an infrared camera that captures an image ahead of a vehicle;

a main display that displays the image captured by the infrared camera;

a sub-display; and

a control unit that (1) determines whether there is an object in the displayed image on the main display and, when the control unit determines that the object is in the displayed image, controls the sub-display so as to display warning information on the object, (2) calculates a relative position of the object with respect to the vehicle on the basis of a position of the object in the displayed image, (3) estimates or detects whether the object has disappeared from the displayed image but is present in the field of view of the driver, and (4) estimates a time from a time that the object has disappeared in the image displayed on the main display to a time that the object has reached the outside of the field of view of the driver, based on the relative position, wherein

when the control unit estimates or detects that the object that has disappeared from the displayed image but is present in the field of view of the driver, the control unit controls the sub-display so as to display the warning information for the estimated time from the time that the object has disappeared in the image displayed on the main display.

2. The vehicle night vision support system according to claim 1, wherein the sub-display is a head up display.

3. The vehicle night vision support system according to claim 1, further comprising:

a vehicle speed detector that detects a vehicle speed; and

a steering angle detector that detects a steering angle, wherein

the control unit estimates whether the object has disappeared from the displayed image but is present in the field of view of the driver on the basis of the relative position and a driving state of the vehicle, calculated on the basis of the vehicle speed detected by the vehicle speed detector and the steering angle detected by the steering angle detector.

4. The vehicle night vision support system according to claim 3, wherein

the control unit calculates a future position of the vehicle on the basis of the driving state of the vehicle, and

the control unit estimates whether the object has disappeared from the displayed image but is present in the field of view of the driver on the basis of a position of the vehicle which is calculated on the basis of the future position of the vehicle at which the object falls outside the field of view of the driver for the first time.

5. The vehicle night vision support system according to claim 4, wherein

until the vehicle reaches the position of the vehicle at which the object falls outside the field of view of the driver for the first time, the control unit estimates that the object has disappeared from the displayed image but is present in the field of view of the driver.

6. The vehicle night vision support system according to claim 1, wherein

the main display displays a center portion of the image captured by the infrared camera with respect to a horizontal direction of the captured image.

7. The vehicle night vision support system according to claim 6, wherein

the control unit determines whether there is an object in the captured image other than the center portion and, when the control unit determines that the object is in the captured image other than the center portion, controls the sub-display so as to display the warning information.

8. The vehicle night vision support system according to claim 1, wherein

when the control unit determines that the object is in the displayed image, the control unit controls the main display so as to emphasize the object on the displayed image.

9. The vehicle night vision support system according to claim 1, wherein

the object is a pedestrian.

10. A control method for a vehicle night vision support system that includes an infrared camera that captures an image ahead of a vehicle, a main display that displays the image captured by the infrared camera and a sub-display, the control method comprising:

determining whether there is an object in the displayed image on the main display;

when it is determined that the object is in the displayed image, controlling the sub-display so as to display warning information on the object;

calculating a relative position of the object with respect to the vehicle on the basis of a position of the object in the displayed image;

estimating or detecting whether the object has disappeared from the displayed image but is present in the field of view of the driver; and

estimating a time from a time that the object has disappeared in the image displayed on the main display to a time that the object has reached the outside of the field of view of the driver, based on the relative position, wherein

when it is estimated or detected that the object has disappeared from the displayed image but is present in the field of view of the driver, controlling the sub-display so as to display the warning information for the estimated time from the time that the object has disappeared in the image displayed on the main display.