Intelligent rear-view mirror system

• US 10,703,278 B2
• Filed: 02/07/2017
• Issued: 07/07/2020
• Est. Priority Date: 10/27/2015
• Status: Active Grant

• Current Assignee: Thunder Power New Energy Vehicle Development Company Limited
• Original Assignee: Thunder Power New Energy Vehicle Development Company Limited
• Inventors: Ding, Jia-Wei
• Primary Examiner(s): Kalapodas, Dramos
• Application Number:
  US15/426,476
• Publication Number:
  US 20170158135A1
• Time in Patent Office: 1,246 Days
• CPC Class Codes: B60R 1/025 comprising special mechanical means for correcting the field of view in relation to particular driving conditions, e.g. change of lane; scanning mirrors
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/08 involving special optical features, e.g. avoiding blind spots , e.g. convex mirrors; Side-by-side associations of rear-view and other mirrors B60R1/025, B60R1/10 take precedence
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 11/04 Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2011/0033 Rear-view mirrors
• CPC Class Codes: B60R 2300/108 using 'non-standard' camera systems, e.g. camera sensor used for additional purposes i.a. rain sensor, camera sensor split in multiple image areas
• CPC Class Codes: B60R 2300/30 characterised by the type of image processing
• CPC Class Codes: B60R 2300/80 characterised by the intended use of the viewing arrangement
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06V 40/19 Sensors therefor
• CPC Class Codes: G06V 40/193 Preprocessing; Feature extraction
• CPC Class Codes: H04N 23/51 Housings
• CPC Class Codes: H04N 23/54 Mounting of pick-up tubes, electronic image sensors, deviation or focusing coils

Abstract

Described herein is a rear view mirror system that is configured to adjust to a user'"'"'s position without direct user interaction. In some embodiments, a camera may be included in the rear view mirror system so that its line of sight is perpendicular to a reflective surface. The camera may capture a digital image of the user. Eye patterns may be identified from the image information to determine an appropriate position for the mirror. In some embodiments, the mirror may be repositioned so that the camera'"'"'s line of sight is directed halfway between the identified eye information and the center of a rear window. In some embodiments, the mirror may be re-adjusted periodically.

Claims

1. A rear view mirror apparatus, comprising:

a mirror housing;

a first planar reflective surface, and a second planar reflective surface that is semi-transparent and angled with respect to the first planar reflective surface;

first and second actuation devices configured to rotate the first and second planar reflective surfaces within the mirror housing along vertical and horizontal axes;

a camera device configured to capture imagery in a night mode using a first camera oriented to capture the imagery primarily along a first direction substantially perpendicular to the first planar reflective surface, and to capture the imagery in a day mode using a second camera oriented to capture the imagery primarily along a second direction substantially perpendicular to the second planar reflective surface; and

a processor device configured to;

detect that the planar reflective surface, previously positioned automatically into a particular position, is knocked away from the particular position; and

automatically responsive to the detecting;

determine whether the camera device is in the night mode or the day mode;

capture image information including at least a portion of an image of a vehicle driver when the planar reflective surface is in the default position, where in the capturing is according to the first direction responsive to determining that the camera device is in the night mode, and the capturing is according to the second direction responsive to determining that the camera device is in the day mode;

map the image information to a set of coordinates;

identify, within the image information, a viewer position of the set of coordinates;

identify a vertical position and a horizontal position within the image information, each halfway between the viewer position and an origin point of the set of coordinates; and

generate instructions to the first and second actuation devices to rotate the planar reflective surface within the mirror housing so that the first direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the night mode, and so that the second direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the day mode.

2. The rear view mirror apparatus of claim 1, wherein the camera device is located within the mirror housing, behind the reflective surface.

3. The rear view mirror apparatus of claim 1, wherein the viewer position of the set of coordinates is determined using one or more machine vision techniques.

4. The rear view mirror apparatus of claim 1, wherein the captured image information includes an image of at least one eye.

5. The rear view mirror apparatus of claim 4, wherein the viewer position is determined based at least in part on a position of the image of at least one eye.

6. The rear view mirror apparatus of claim 5, wherein the image at least one eye comprises an image of two eyes and the viewer position is determined to be halfway between the two eyes.

7. The rear view mirror apparatus of claim 1, wherein the processor device is further configured to:

continue to receive captured image information from the camera device;

determine that the viewer position has changed; and

generate new instructions to cause at least one of the first actuation device or the second actuation device to rotate the first and second planar reflective surfaces so that the camera device maintains alignment with a new position located halfway between the viewer position and the origin point.

21. The rear view mirror apparatus of claim 1, further comprising:

a memory having a default position of the first and second planar reflective surfaces stored thereon,

wherein the processor device is further configured, automatically responsive to the detecting, to;

generate instructions to the first and second actuation devices to rotate the first and second planar reflective surfaces within the mirror housing to the default position prior to capturing the image information.

8. A method comprising:

detecting that a planar reflective surface of a vehicle mirror previously positioned automatically into a particular position, is knocked away from the particular position, the planar reflective surface being one of a first planar reflective surface or a second planar reflective surface that is semi-transparent and angled with respect to the first planar reflective surface; and

responsive to the detecting;

determining whether a camera device is in a night mode or a day mode, the camera device configured to capture imagery using a first camera oriented to capture the imagery primarily along a first direction substantially perpendicular to the first planar reflective surface in the night mode, and to capture the imagery using a second camera oriented to capture the imagery primarily along a second direction substantially perpendicular to the second planar reflective surface in the day mode;

capturing image information using the camera device, the image information comprising at least a portion of an image of a vehicle driver;

identifying, within the image information, a viewer position mapped to a set of coordinates;

identifying a vertical position and a horizontal position within the image information, each halfway between the viewer position and an origin point of the set of coordinates; and

rotating, via a first actuation device and a second actuation device, the first and second planar reflective surfaces within a mirror housing so that the first direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the night mode, and so that the second direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the day mode.

9. The method of claim 8, further comprising:

receiving an updated image information;

determining that the viewer position has changed in the updated image information; and

rotating, using at least one of the first actuation device or the second actuation device, the first and second planar reflective surfaces so that the camera device is aligned with an updated position halfway between an updated viewer position and the origin point within the updated image information.

10. The method of claim 9, wherein the updated image information is received on a periodic basis.

11. The method of claim 8, wherein each respective planar reflective surface of the first planar reflective surface and the second planar reflective surface is positioned such that an axis perpendicular to the respective planar reflective surface bisects the viewer position and the origin point within the captured image information.

12. The method of claim 8, wherein the viewer position is identified by matching patterns in the image information with at least one stored eye pattern.

13. The method of claim 8, wherein the origin point corresponds to the center of a rear window of the vehicle.

14. A vehicle mirror system, comprising:

a processor device; and

a memory having a default position of a planar reflective surface stored thereon, and including instructions that, when executed with the processor device, cause the processor device to, at least;

detect that the planar reflective surface previously positioned automatically into a particular position, is knocked away from the particular position, the planar reflective surface being one of a first planar reflective surface or a second planar reflective surface that is semi-transparent and angled with respect to the first planar reflective surface; and

automatically responsive to the detecting;

determine whether a camera device is in a night mode or a day mode, the camera device configured to capture imagery using a first camera oriented to capture the imagery primarily along a first direction substantially perpendicular to the first planar reflective surface in the night mode, and to capture the imagery using a second camera oriented to capture the imagery primarily along a second direction substantially perpendicular to the second planar reflective surface in the day mode;

capture image information, by the camera device, including at least a portion of an image of a vehicle driver;

identify, within the image information, a viewer position mapped to a set of coordinates;

identify a vertical position and a horizontal position within the image information, each halfway between the viewer position and an origin point of the set of coordinates; and

generate instructions to the first and second actuation devices to rotate the first and second planar reflective surfaces within the mirror housing so that the first direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the night mode, and so that the second direction is aligned with the identified vertical position and with the identified horizontal position responsive to determining that the camera device is in the day mode.

15. The vehicle rear-view mirror system of claim 14, wherein at least one of the first actuation device or the second actuation device is a servomotor.

16. The vehicle rear-view mirror system of claim 14, wherein generating instructions to an actuation device includes calculating a degree of rotation corresponding to an identified position.

17. The vehicle rear-view mirror system of claim 16, wherein the actuation device is caused to rotate by the calculated degree of rotation.

18. The vehicle rear-view mirror system of claim 14, wherein the instructions are executed upon detecting a repositioning event.

19. The vehicle rear-view mirror system of claim 14, wherein the repositioning event comprises detecting that a viewer position has changed.

20. The vehicle rear-view mirror system of claim 14, wherein the repositioning event comprises detecting that a vehicle in which the vehicle rear-view mirror system is installed has been turned on.