Multi-sensor interior mirror device with image adjustment

• US 10,300,859 B2
• Filed: 06/08/2017
• Issued: 05/28/2019
• Est. Priority Date: 06/10/2016
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: May, Benjamin, Ihlenburg, Joern, Shulkin, Boris
• Primary Examiner(s): Tran, Trang U
• Application Number:
  US15/617,216
• Publication Number:
  US 20170355314A1
• Time in Patent Office: 719 Days
• Field of Search: 348148, 348118
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/29 Holographic features
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/213 Virtual instruments
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 1/04 mounted inside vehicle B60R1/025, B60R1/08 take precedence
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2300/105 using multiple cameras
• CPC Class Codes: B60R 2300/303 using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/8033 for pedestrian protection
• CPC Class Codes: B60R 2300/804 for lane monitoring
• CPC Class Codes: B60R 2300/806 for aiding parking
• CPC Class Codes: B60R 2300/8066 for monitoring rearward traffic
• CPC Class Codes: B60R 2300/8086 : for vehicle path indication
• CPC Class Codes: G06V 10/25 : Determination of region of interest [ROI] or a volume of interest [VOI]
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: H04N 23/635 : Region indicators; Field of view indicators
• CPC Class Codes: H04N 23/69 : Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/90 : Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums

Abstract

A vision system for a vehicle includes a forward viewing camera disposed at a mirror head of an interior rearview mirror assembly of the vehicle and having a forward field of view through the windshield of the vehicle. A sensor is disposed at the mirror head and determines a change in position of the mirror head relative to a mirror mount of the mirror assembly when the vehicle driver adjusts the mirror head. A control includes a processor operable to process image data captured by the forward viewing camera. Responsive to determination by the sensor of a change of position of the forward viewing camera relative to the mirror mount, the control selects an active sub-array of photosensors to provide an effective field of view of the forward viewing camera. The processor processes image data captured by the active sub-array of photosensors for a driver assistance system of the vehicle.

Claims

1. A vision system for a vehicle, said vision system comprising:

an interior rearview mirror assembly comprising a mirror head and a mirror mount, wherein said mirror mount is fixedly attached at an interior portion of the vehicle, and wherein said mirror head is pivotally mounted at said mirror mount and is adjustable relative to said mirror mount to adjust a rearward field of view of a driver of the vehicle when viewing a mirror reflective element of said mirror head;

a forward viewing camera disposed at said mirror head of said interior rearview mirror assembly and having a forward field of view through the windshield of the vehicle, wherein said forward viewing camera comprises a photosensor array having multiple columns and rows of photosensor elements;

wherein the forward field of view of said forward viewing camera adjusts in tandem with adjustment of said mirror head;

a sensor disposed at said mirror head and operable to determine a change in position of said mirror head relative to said mirror mount;

a control comprising a processor operable to process image data captured by said forward viewing camera;

wherein, responsive to determination by said sensor of a change of position of said mirror head relative to said mirror mount, said control selects an active sub-array of photosensors to provide an effective field of view of said forward viewing camera;

wherein said processor processes image data captured by the active sub-array of photosensors for a driver assistance system of the vehicle; and

wherein the active sub-array of photosensors comprises a subset of photosensors of said photosensor array that is less than the entirety of the rows and columns of photosensor elements of said photosensor array.

2. The vision system of claim 1, wherein said processor does not process image data captured by photosensors that are not part of the active sub-array of photosensors.

3. The vision system of claim 1, wherein said control adjusts the active sub-array of photosensors to accommodate for movement of said forward viewing camera relative to said mirror mount based on the determined change of position of said mirror head when the driver adjusts the rearward field of view provided by said interior rearview mirror assembly.

4. The vision system of claim 1, wherein said control adjusts the active sub-array of photosensors on a frame by frame basis.

5. The vision system of claim 1, wherein said control adjusts the active sub-array of photosensors responsive to determination of a change in the camera'"'"'s field of view relative to the vehicle.

6. The vision system of claim 1, wherein said sensor comprises a motion sensor.

7. The vision system of claim 1, wherein said sensor comprises a gyrosensor.

8. The vision system of claim 1, comprising a rearward viewing camera configured to be disposed at a vehicle and having a rearward field of view exterior of the vehicle.

9. The vision system of claim 8, wherein said rearward viewing camera is part of a multi-camera surround view vision system of the vehicle.

10. The vision system of claim 9, wherein said control receives image data captured by said rearward viewing camera and other cameras disposed at the vehicle and having respective exterior fields of view.

11. The vision system of claim 9, wherein said other cameras comprise (i) a forward viewing camera disposed at a front portion of the vehicle, (ii) a driver-side sideward viewing camera disposed at a driver side of the vehicle and (iii) a passenger-side sideward viewing camera disposed at a passenger side of the vehicle.

12. The vision system of claim 8, comprising a display disposed operable to display video images derived from image data captured by said rearward viewing camera.

13. The vision system of claim 12, wherein said display is disposed at said mirror head and viewable through said mirror reflective element of said interior rearview mirror assembly.

14. A vision system for a vehicle, said vision system comprising:

an interior rearview mirror assembly comprising a mirror head and a mirror mount, wherein said mirror mount is fixedly attached at an interior portion of the vehicle, and wherein said mirror head is pivotally mounted at said mirror mount and is adjustable relative to said mirror mount to adjust a rearward field of view of a driver of the vehicle when viewing a mirror reflective element of said mirror head;

a forward viewing camera disposed at said mirror head of said interior rearview mirror assembly and having a forward field of view through the windshield of the vehicle, wherein said forward viewing camera comprises a photosensor array having multiple columns and rows of photosensor elements;

wherein the forward field of view of said forward viewing camera adjusts in tandem with adjustment of said mirror head;

a sensor disposed at said mirror head and operable to determine a change in position of said mirror head relative to said mirror mount;

a control comprising a processor operable to process image data captured by said forward viewing camera;

wherein, responsive to determination by said sensor of a change of position of said mirror head relative to said mirror mount, said control selects an active sub-array of photosensors to provide an effective field of view of said forward viewing camera;

wherein said control adjusts the active sub-array of photosensors to accommodate for movement of said forward viewing camera relative to said mirror mount based on the determined change of position of said mirror head when the driver adjusts the rearward field of view provided by said interior rearview mirror assembly;

wherein said processor processes image data captured by the active sub-array of photosensors for a driver assistance system of the vehicle;

wherein the active sub-array of photosensors comprises a subset of photosensors of said photosensor array that is less than the entirety of the rows and columns of photosensor elements of said photosensor array; and

wherein said processor does not process image data captured by photosensors that are not part of the active sub-array of photosensors.

15. The vision system of claim 14, wherein said sensor comprises a motion sensor.

16. The vision system of claim 14, comprising a display disposed operable to display video images derived from image data captured by a rearward viewing camera disposed at a rear portion of the vehicle and viewing rearward of the vehicle.

17. A vision system for a vehicle, said vision system comprising:

an interior rearview mirror assembly comprising a mirror head and a mirror mount, wherein said mirror mount is fixedly attached at an interior portion of the vehicle, and wherein said mirror head is pivotally mounted at said mirror mount and is adjustable relative to said mirror mount to adjust a rearward field of view of a driver of the vehicle when viewing a mirror reflective element of said mirror head;

a rearward viewing camera configured to be disposed at a vehicle and having a rearward field of view exterior of the vehicle;

a forward viewing camera disposed at said mirror head of said interior rearview mirror assembly and having a forward field of view through the windshield of the vehicle, wherein said forward viewing camera comprises a photosensor array having multiple columns and rows of photosensor elements;

wherein the forward field of view of said forward viewing camera adjusts in tandem with adjustment of said mirror head;

a sensor disposed at said mirror head and operable to determine a change in position of said mirror head relative to said mirror mount;

a control comprising a processor operable to process image data captured by said rearward viewing camera and said forward viewing camera;

wherein, responsive to determination by said sensor of a change of position of said mirror head relative to said mirror mount, said control selects an active sub-array of photosensors to provide an effective field of view of said forward viewing camera;

wherein said processor processes image data captured by the active sub-array of photosensors for a driver assistance system of the vehicle;

wherein the active sub-array of photosensors comprises a subset of photosensors of said photosensor array that is less than the entirety of the rows and columns of photosensor elements of said photosensor array;

wherein said processor does not process image data captured by photosensors that are not part of the active sub-array of photosensors; and

a display disposed operable to display video images derived from image data captured by said rearward viewing camera.

18. The vision system of claim 17, wherein said sensor comprises a motion sensor.

19. The vision system of claim 17, wherein said rearward viewing camera is part of a multi-camera surround view vision system of the vehicle, and wherein said other cameras comprise (i) a forward viewing camera disposed at a front portion of the vehicle, (ii) a driver-side sideward viewing camera disposed at a driver side of the vehicle and (iii) a passenger-side sideward viewing camera disposed at a passenger side of the vehicle.

20. The vision system of claim 17, wherein said display is disposed at said mirror head and viewable through said mirror reflective element of said interior rearview mirror assembly.