Rearview mirror system for vehicle

• US 9,317,742 B2
• Filed: 12/01/2014
• Issued: 04/19/2016
• Est. Priority Date: 09/27/2006
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Inventors: Kramer, Mark E., Lynam, Niall R., O'Connell, David P., Nise, Vernon R.
• Primary Examiner(s): Nguyen, Kevin
• Application Number:
  US14/556,340
• Publication Number:
  US 20150085127A1
• Time in Patent Office: 505 Days
• Field of Search: 715/781, 715/744, 715/780, 715/810, 715/746, 715/855, 715851-853
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/126 Rotatable input devices for instruments
• CPC Class Codes: B60K 2360/135 Joysticks
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/1526 Dual-view displays
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 11/02 for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
• CPC Class Codes: B60R 11/0235 of flat type, e.g. LCD
• CPC Class Codes: B60R 11/0241 for telephones
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2001/1284 : with communication systems other than radio-receivers, e.g. keyless entry systems, navigation systems; with anti-collision systems
• CPC Class Codes: B60R 2011/0026 : Windows, e.g. windscreen
• CPC Class Codes: B60R 2011/0033 : Rear-view mirrors
• CPC Class Codes: B60R 2011/0063 : using adhesive means, e.g. hook and loop fasteners
• CPC Class Codes: B60R 2011/0075 : using a containment or docking space
• CPC Class Codes: B60R 2011/0085 : with adjustment by rotation in their operational position
• CPC Class Codes: B60R 2300/105 : using multiple cameras
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/802 : for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: G01C 21/265 : constructional aspects of navigation devices, e.g. housings, mountings, displays G01C21/3688 takes precedence
• CPC Class Codes: G01C 21/3611 : using character input or menus, e.g. menus of POIs character input methods in general G06F3/0233
• CPC Class Codes: G01C 21/3614 : through interaction with a road map, e.g. selecting a POI icon on a road map
• CPC Class Codes: G01C 21/362 : received from an external device or application, e.g. PDA, mobile phone or calendar application
• CPC Class Codes: G01C 21/3629 : Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G01C 21/3632 : Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/3644 : Landmark guidance, e.g. using POIs or conspicuous other objects
• CPC Class Codes: G01C 21/3664 : Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/367 : Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
• CPC Class Codes: G01C 21/3682 : output of POI information on a road map G01C21/3614, G01C21/3685 take precedence
• CPC Class Codes: G01C 21/3688 : Systems comprising multiple parts or multiple output devices (not client-server), e.g. detachable faceplates, key fobs or multiple output screens
• CPC Class Codes: G06F 3/01 : Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/16 : Sound input; Sound output speech processing G10L
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/597 : Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/28 : Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04M 1/6091 : including a wireless interface
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A rearview mirror system for a vehicle includes an interior rearview mirror assembly mounted at the interior surface of a windshield of the vehicle. A camera is incorporated into the interior rearview mirror assembly and has a field of view toward a front seat of the vehicle so as to capture images of an occupant of the vehicle. The camera captures image data. An image processor is provided with image data captured by the camera. The image processor image processes image data captured by the camera. The image processor, responsive at least in part to image processing of image data captured by the camera, recognizes movement. The movement comprises a hand gesture made by the occupant of the vehicle.

Claims

1. A rearview mirror system for a vehicle, said rearview mirror system comprising:

an interior rearview mirror assembly;

said interior rearview mirror assembly mounted at the interior surface of a windshield of a vehicle equipped with said rearview mirror system;

a camera incorporated into said interior rearview mirror assembly;

said camera incorporated into said interior rearview mirror assembly having a field of view toward a front seat of the equipped vehicle so as to capture images of an occupant of the equipped vehicle;

said camera capturing image data;

an image processor;

said image processor provided with image data captured by said camera;

said image processor image processing image data captured by said camera;

said image processor, responsive at least in part to image processing of image data captured by said camera, recognizing movement; and

wherein said movement comprises a hand gesture made by said occupant of the equipped vehicle.

2. The rearview mirror system of claim 1, wherein said image processor comprises a system-on-a-chip image processor.

3. The rearview mirror system of claim 2, wherein said system-on-a-chip image processor comprises an EyeQ™

system-on-a-chip image processor.

4. The rearview mirror system of claim 1, wherein said interior rearview mirror assembly comprises an electrochromic mirror reflective element.

5. The rearview mirror system of claim 1, wherein said interior rearview mirror assembly comprises a prismatic mirror reflective element.

6. The rearview mirror system of claim 1, wherein said interior rearview mirror assembly comprises a video display device.

7. The rearview mirror system of claim 6, wherein said video display device is operable to display images representative of a scene occurring exterior of the vehicle.

8. The rearview mirror system of claim 7, wherein said video display device comprises a non-electronic graphic overlay means that is viewable when said video display device is activated.

9. The rearview mirror system of claim 1, comprising a navigation device support structure for supporting a portable navigation device, wherein said navigation device support structure comprises an articulatable receiving structure that is articulatable to adjust an orientation of the portable navigation device supported thereon independent of adjustment of an orientation of a reflective element of said interior rearview mirror assembly, and wherein said navigation device support structure is articulatable between a stowed position, where said receiving structure is articulated such that said receiving structure and the portable navigation device supported thereon are generally along the windshield at a mounting base of said mirror assembly, and a use position, where said receiving structure is articulated such that said receiving structure and the portable navigation device supported thereon are generally below said reflective element and readily viewable by the driver of the vehicle.

10. The rearview mirror system of claim 1, comprising a portable hand-held device capable of being carried into and out of the vehicle, wherein said portable hand-held device is operable to communicate with a vehicle-based receiver, and wherein said interior rearview mirror assembly comprises a display device viewable by the driver of the vehicle, and wherein said display device is operable to display a listing of choices in response to said communication, and wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of messages, (b) a listing of phone numbers, (c) a listing of emails and (d) a listing of titles or tracks.

11. The rearview mirror system of claim 10, wherein said portable hand-held device comprises a portable phone.

12. The rearview mirror system of claim 11, wherein said listing of choices displayed by said display device comprises a listing of emails and wherein said listing of emails comprises at least one of a received email and a transmitted email.

13. The rearview mirror system of claim 12, wherein said listing of choices displayed by said display device is derived, at least in part, from data stored by said portable hand-held device.

14. The rearview mirror system of claim 1, wherein a user input of said mirror assembly is actuatable to navigate a menu.

15. The rearview mirror system of claim 14, wherein a user can navigate said menu to select an item from said listing of choices.

16. A rearview mirror system for a vehicle, said rearview mirror system comprising:

an interior rearview mirror assembly;

said interior rearview mirror assembly mounted at the interior surface of a windshield of a vehicle equipped with said rearview mirror system;

a camera incorporated into said interior rearview mirror assembly;

said camera incorporated into said interior rearview mirror assembly having a field of view toward a front seat of the equipped vehicle so as to capture images of an occupant of the equipped vehicle;

said camera capturing image data;

an image processor;

said image processor provided with image data captured by said camera;

said image processor image processing image data captured by said camera;

said image processor, responsive at least in part to image processing of image data captured by said camera, recognizing movement;

wherein said movement comprises a hand gesture made by said occupant of the equipped vehicle;

wherein said image processor comprises a system-on-a-chip image processor; and

wherein said interior rearview mirror assembly comprises an electrochromic mirror reflective element.

17. The rearview mirror system of claim 16, wherein said image processor is operable to recognize American Sign Language gestures.

18. A rearview mirror system for a vehicle, said rearview mirror system comprising:

an interior rearview mirror assembly;

said interior rearview mirror assembly mounted at the interior surface of a windshield of a vehicle equipped with said rearview mirror system;

a camera incorporated into said interior rearview mirror assembly;

said camera incorporated into said interior rearview mirror assembly having a field of view toward a front seat of the equipped vehicle so as to capture images of an occupant of the equipped vehicle;

said camera capturing image data;

an image processor;

said image processor provided with image data captured by said camera;

said image processor image processing image data captured by said camera;

said image processor, responsive at least in part to image processing of image data captured by said camera, recognizing movement;

wherein said movement comprises a hand gesture made by said occupant of the equipped vehicle; and

wherein said image processor is operable to recognize American Sign Language gestures.

19. The rearview mirror system of claim 18, wherein said interior rearview mirror assembly comprises an electrochromic mirror reflective element.

20. The rearview mirror system of claim 18, wherein said interior rearview mirror assembly comprises a prismatic mirror reflective element.