Reactive smart rear view display mirror

• US 10,239,455 B2
• Filed: 08/17/2017
• Issued: 03/26/2019
• Est. Priority Date: 08/19/2016
• Status: Active Grant

• Current Assignee: Panasonic Automotive Systems Company of America (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Automotive Systems Company of America (Panasonic Holdings Corporation)
• Inventors: Eberhard, Jason D., Avery, John
• Primary Examiner(s): Tweel, Jr., John A
• Application Number:
  US15/679,453
• Publication Number:
  US 20180050639A1
• Time in Patent Office: 586 Days
• Field of Search: 340462
• CPC Class Codes: B60R 1/06 mounted on vehicle exterior B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/26 to the rear of the vehicle
• CPC Class Codes: B60R 1/28 with an adjustable field of view
• CPC Class Codes: B60R 2300/306 using a re-scaling of images
• CPC Class Codes: B60R 2300/8046 for replacing a rear-view mirror system
• CPC Class Codes: B60W 2050/146 Display means
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 20/597 Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/19 Sensors therefor

Abstract

A motor vehicle includes a driver sensor detecting a position of a human driver of the motor vehicle. A rear view camera captures images of an environment behind the motor vehicle. A display screen is disposed within a passenger compartment of the motor vehicle. An electronic processor is communicatively coupled to each of the driver sensor, the rear view camera, and the display screen. The electronic processor receives images captured by the rear view camera, receives outputs of the driver sensor, determines a position of the driver'"'"'s head or eyes dependent upon the outputs of the driver sensor, and transmits video signals to the display screen. The video signals are dependent upon the determined position of the driver'"'"'s head or eyes and dependent upon images captured by the rear view camera.

Claims

1. A motor vehicle, comprising:

a driver sensor configured to detect a position of a human driver of the motor vehicle;

a rear view camera configured to capture images of an environment behind the motor vehicle;

a display screen disposed within a passenger compartment of the motor vehicle; and

an electronic processor communicatively coupled to each of the driver sensor, the rear view camera, and the display screen, the electronic processor being configured to;

receive images captured by the rear view camera;

receive outputs of the driver sensor;

determine a position of the driver'"'"'s head or eyes dependent upon the outputs of the driver sensor;

transmit video signals to the display screen, the video signals being dependent upon the determined position of the driver'"'"'s head or eyes and dependent upon images captured by the rear view camera;

select a portion of a field of view of the rear view camera, the selecting being dependent upon the determined position of the driver'"'"'s head or eyes;

shift the selected portion of a field of view of the rear view camera toward a left-hand side of the motor vehicle in response to the driver moving his head toward a right-hand side of the motor vehicle, and

shift the selected portion of a field of view of the rear view camera toward a right-hand side of the motor vehicle in response to the driver moving his head toward a left-hand side of the motor vehicle.

2. A motor vehicle, comprising:

a driver sensor configured to detect a position of a human driver of the motor vehicle;

a rear view camera configured to capture images of an environment behind the motor vehicle;

a display screen disposed within a passenger compartment of the motor vehicle; and

an electronic processor communicatively coupled to each of the driver sensor, the rear view camera, and the display screen, the electronic processor being configured to;

receive images captured by the rear view camera;

receive outputs of the driver sensor;

determine a position of the driver'"'"'s head or eyes dependent upon the outputs of the driver sensor;

transmit video signals to the display screen, the video signals being dependent upon the determined position of the driver'"'"'s head or eyes and dependent upon images captured by the rear view camera; and

select a portion of a field of view of the rear view camera, the selecting being dependent upon the determined position of the driver'"'"'s head or eyes, wherein there is a positive correlation between a broadness of the selected portion of the field of view of the rear view camera and a distance from the driver'"'"'s head or eyes to the display screen.

3. The motor vehicle of claim 2 wherein the electronic processor is configured to produce and transmit video signals including images within the selected portion of a field of view of the rear view camera.

4. The motor vehicle of claim 2 wherein the electronic processor is configured to select a portion of a field of view of the rear view camera to match a field of view that would be presented to the driver if the display screen were a mirror, given the determined position of the driver'"'"'s head or eyes.

5. The motor vehicle of claim 2 wherein the rear view camera comprises a fish-eye camera with a hemispherical field of view.

6. A method of operating a motor vehicle, the method comprising:

capturing images of an environment behind the motor vehicle;

sensing a position of the driver'"'"'s head or eyes;

providing a display screen within a passenger compartment of the motor vehicle;

presenting images on the display screen dependent upon the sensed position of the driver'"'"'s head or eyes, and dependent upon the images captured of the environment behind the motor vehicle;

selecting a portion of a field of view of a rear view camera that captures the images of the environment behind the motor vehicle, the selecting being dependent upon the sensed position of the driver'"'"'s head or eyes;

shifting the selected portion of a field of view of the rear view camera toward a left-hand side of the motor vehicle in response to the driver moving his head toward a right-hand side of the motor vehicle, and

shifting the selected portion of a field of view of the rear view camera toward a right-hand side of the motor vehicle in response to the driver moving his head toward a left-hand side of the motor vehicle.

8. The method of claim 6 further comprising producing and transmitting video signals including images within the selected portion of a field of view of the rear view camera.

9. The method of claim 6 wherein the selecting step includes selecting a portion of a field of view of the rear view camera to match a field of view that would be presented to the driver if the display screen were a mirror, given the sensed position of the driver'"'"'s head or eyes.

10. The method of claim 6 wherein the rear view camera comprises a fish-eye camera with a hemispherical field of view.

7. A method of operating a motor vehicle, the method comprising:

capturing images of an environment behind the motor vehicle;

sensing a position of the driver'"'"'s head or eyes;

providing a display screen within a passenger compartment of the motor vehicle;

presenting images on the display screen dependent upon the sensed position of the driver'"'"'s head or eyes, and dependent upon the images captured of the environment behind the motor vehicle; and

selecting a portion of a field of view of a rear view camera that captures the images of the environment behind the motor vehicle, the selecting being dependent upon the sensed position of the driver'"'"'s head or eyes, wherein there is a positive correlation between a broadness of the selected portion of the field of view of the rear view camera and a distance from the driver'"'"'s head or eyes to the display screen.

11. A motor vehicle, comprising:

a driver sensor configured to detect a position of a human driver of the motor vehicle;

a rear view camera configured to capture images of an environment behind the motor vehicle, the rear view camera having a wide angle field of view;

a display screen disposed within a passenger compartment of the motor vehicle; and

an electronic processor communicatively coupled to each of the driver sensor, the rear view camera, and the display screen, the electronic processor being configured to;

receive images captured by the rear view camera;

receive outputs of the driver sensor;

determine a position of the driver'"'"'s head or eyes dependent upon the outputs of the driver sensor;

select a portion of the wide angle field of view of the rear view camera based upon the determined position of the driver'"'"'s head or eyes;

transmit video signals to the display screen, the video signals being dependent upon images captured by the rear view camera within the selected portion of the wide angle field of view of the rear view camera;

shift the selected portion of the wide angle field of view of the rear view camera toward a left-hand side of the motor vehicle in response to the driver moving his head toward a right-hand side of the motor vehicle, and

shift the selected portion of the wide angle field of view of the rear view camera toward a right-hand side of the motor vehicle in response to the driver moving his head toward a left-hand side of the motor vehicle.

12. A motor vehicle, comprising:

a driver sensor configured to detect a position of a human driver of the motor vehicle;

a rear view camera configured to capture images of an environment behind the motor vehicle, the rear view camera having a wide angle field of view;

a display screen disposed within a passenger compartment of the motor vehicle; and

an electronic processor communicatively coupled to each of the driver sensor, the rear view camera, and the display screen, the electronic processor being configured to;

receive images captured by the rear view camera;

receive outputs of the driver sensor;

determine a position of the driver'"'"'s head or eyes dependent upon the outputs of the driver sensor;

select a portion of the wide angle field of view of the rear view camera based upon the determined position of the driver'"'"'s head or eyes; and

transmit video signals to the display screen, the video signals being dependent upon images captured by the rear view camera within the selected portion of the wide angle field of view of the rear view camera, wherein there is a positive correlation between a broadness of the selected portion of the wide angle field of view of the rear view camera and a distance from the driver'"'"'s head or eyes to the display screen.

13. The motor vehicle of claim 12 wherein the electronic processor is configured to produce the video signals.

14. The motor vehicle of claim 12 wherein the electronic processor is configured to select a portion of the wide angle field of view of the rear view camera to match a field of view that would be presented to the driver if the display screen were a mirror, given the determined position of the driver'"'"'s head or eyes.

15. The motor vehicle of claim 12 wherein the rear view camera comprises a fish-eye camera with a hemispherical field of view.