Field of view matching video display system

• US 9,102,269 B2
• Filed: 08/09/2011
• Issued: 08/11/2015
• Est. Priority Date: 08/09/2011
• Status: Active Grant

• Current Assignee: Continental Automotive Systems, Inc. (Continental AG)
• Original Assignee: Continental Automotive Systems, Inc. (Continental AG)
• Inventors: Waite, Sheldon, Klimecki, Marcin
• Primary Examiner(s): Vo, Tung
• Assistant Examiner(s): Cattungal, Rowina
• Application Number:
  US13/205,799
• Publication Number:
  US 20130038732A1
• Time in Patent Office: 1,463 Days
• Field of Search: 345/7, 345/1.2, 348/148
• US Class Current: 1/1
• CPC Class Codes: B60R 1/00 Optical viewing arrangements; Real-time viewing arrangements for drivers or passengers using optical image capturing systems, e.g. cameras or video systems specially adapted for use in or on vehicles
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 1/30 providing vision in the non-visible spectrum, e.g. night or infrared vision
• CPC Class Codes: B60R 2300/202 displaying a blind spot scene on the vehicle part responsible for the blind spot
• CPC Class Codes: B60R 2300/605 the adjustment being automatic
• CPC Class Codes: B60R 2300/8026 in addition to a rear-view mirror system

Abstract

A field of view matching video display system may comprise a tracking device, a rear-facing camera, a processing device, and a display. The tracking device is configured to capture a first video image in a predefined area in the vehicle and provide a first video image signal. The rear-facing camera is configured to capture a second video image and provide a second video image signal. The processing device is configured to analyze the first video image obtained via the first video image signal to determine a head position of the driver, determine a first field of view for the driver based on the head position of the driver, generate a third video image that substantially corresponds with at least a portion of the first field of view of the driver, and provide a third video image signal. The display is configured to show the third video image.

Claims

1. A field of view matching video display system for a vehicle having a driver, the system comprising:

a tracking device comprising a plurality of cameras directed toward the driver'"'"'s head at a corresponding plurality of different angles, each camera providing image data that represents images of the driver'"'"'s head from the different angles;

a movable rear-facing camera, having a field of view which changes responsive to lateral movement of the rear-facing camera along an axis that is substantially parallel to an axle of the vehicle, wherein the rear-facing camera is configured to translate along said axis laterally responsive to a determined angle of the driver'"'"'s head, the rear-facing camera being additionally configured to capture a second video image obtained from said rear-facing camera'"'"'s field of view at different lateral positions along said axis and provide a second video image signal representing the rear-facing camera'"'"'s field of view at different lateral positions;

a processing device, wherein the processing device is configured to;

analyze image data obtained from the first plurality of cameras and determine therefrom a head position of the driver in three dimensions;

determine a first field of view for the driver based on the head position of the driver, the first field of view for the driver being smaller than the rear-facing camera'"'"'s field of view;

determine an obstructed portion of the driver'"'"'s first field of view, the obstructed portion being caused by a field of view obstruction that is located between the rear-facing camera and the driver;

obtain from the second video image, a third video image for presentation on a forward-facing display device located behind the driver and in front of the field of view obstruction, the third video image being obtained by selectively cropping the second video image responsive to the processing device determining a portion of the second video image needed to fill the obstructed portion of the first field of view with an image of the first field of view without the field of view obstruction; and

a forward-facing display device, configured to show the third video image.

2. The system according to claim 1, wherein the processing device is further configured to expand a cropped second video image responsive to a head position and eye positions of the driver.

3. The system according to claim 1, further comprising a rearview mirror, wherein the forward-facing display device is located behind the driver, and configured to be viewable from a reflection in the rearview mirror.

4. The system according to claim 3, wherein the forward-facing display device has a front side and a back side and is configured to be positioned on a display of a rear-facing display for an entertainment system, the rear-facing display having a second front side and a second back side, such that the first back side of the forward-facing display device is facing the second back side of the rear-facing display of the entertainment system.

5. The system according to claim 4, wherein the forward-facing display device completely covers the second back side of the rear-facing display of the entertainment system from the driver when viewing a reflection in the rearview mirror.

6. The system according to claim 4, wherein the rear-facing camera is located proximate to the rear-facing display of the entertainment system.

7. The system according to claim 1, wherein the vehicle has a front and an opposing rear and wherein the rear-facing camera is located proximate to the rear of the vehicle.

8. The system according to claim 1, further comprising a rearview mirror, wherein the forward-facing display device is located in a direction forward of the driver and is configured to be integrated with the rearview mirror.

9. The system according to claim 1, wherein the rear-facing camera is configured to capture the second video image by both translational and rotational positioning of the rear-facing camera, and wherein the processing device is configured to determine the translational and rotational positioning of the rear-facing camera.

10. The system according to claim 1, wherein the rear-facing camera has a corresponding field of view wider than the field of view of the driver.

11. The system according to claim 1, wherein the rear-facing camera has a corresponding first field of view, wherein the first field of view of the driver is completely within the first field of view of the rear-facing camera.

12. The system according to claim 1, wherein at least one camera of the tracking device cameras is integrated with a rearview mirror.

13. The system according to claim 1, wherein the display is configured to also display a textual message.

14. The system according to claim 13, wherein the textual message is displayed by scrolling across the screen.

15. A field of view matching video display method for a vehicle having a driver, the method comprising:

directing a plurality of cameras toward the driver'"'"'s head at a corresponding plurality of different angles, each camera providing image data that represents images of the driver'"'"'s head from the different angles;

using a movable rear-facing camera, having a field of view which changes responsive to lateral movement of the rear-facing camera along an axis that is substantially parallel to an axle of the vehicle, wherein the rear-facing camera is configured to translate along said axis laterally responsive to a determined angle of the driver'"'"'s head, to;

capture a second video image obtained from said rear-facing camera'"'"'s field of view at different lateral positions along said axis and provide a second video image signal representing the rear-facing camera'"'"'s field of view at different lateral positions;

analyzing image data obtained from the first plurality of cameras and determining therefrom a head position of the driver in three dimensions;

determining a first field of view for the driver based on the head position of the driver, the first field of view for the driver being smaller than the rear-facing camera'"'"'s field of view;

determining an obstructed portion of the driver'"'"'s first field of view, the obstructed portion being caused by a field of view obstruction that is located between the rear-facing camera and the driver;

obtaining from the second video image, a third video image for presentation on a forward-facing display device located behind the driver and in front of the field of view obstruction, the third video image being obtained by selectively cropping the second video image responsive to determining a portion of the second video image needed to fill the obstructed portion of the first field of view with an image of the first field of view without the field of view obstruction; and

showing the third video image on a forward-facing display device.