Multimedia mirror assembly for vehicle

• US 7,937,667 B2
• Filed: 09/26/2007
• Issued: 05/03/2011
• Est. Priority Date: 09/27/2006
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: O'Connell, David P., Nise, Vernon R., Lynam, Niall R., Kramer, Mark E.
• Primary Examiner(s): NGUYEN, CAO H
• Application Number:
  US11/861,904
• Publication Number:
  US 20080077882A1
• Time in Patent Office: 1,315 Days
• Field of Search: 715/700, 715/780, 715851-853, 715863-864, 715/855, 715/744, 715/746, 715/748, 715/810
• US Class Current: 715/781
• CPC Class Codes: B60K 2360/126 Rotatable input devices for instruments
• CPC Class Codes: B60K 2360/135 Joysticks
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/1526 Dual-view displays
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 2370/126 Rotatable input devices
• CPC Class Codes: B60K 2370/135 Joysticks
• CPC Class Codes: B60K 2370/143 Touch sensitive input devices
• CPC Class Codes: B60K 2370/1438 Touch screens
• CPC Class Codes: B60K 2370/146 Input by gesture
• CPC Class Codes: B60K 2370/152 Displays
• CPC Class Codes: B60K 2370/1526 Dual-view displays
• CPC Class Codes: B60K 2370/173 Reversing assist
• CPC Class Codes: B60K 2370/21 using cameras
• CPC Class Codes: B60K 2370/52 Control of displays
• CPC Class Codes: B60K 2370/777 on or in sun visors
• CPC Class Codes: B60K 35/00 : Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 : Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 : Display screens
• CPC Class Codes: B60K 35/28 : characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 : Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 : for controlling displays
• CPC Class Codes: B60R 1/12 : Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 11/02 : for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
• CPC Class Codes: B60R 11/0235 : of flat type, e.g. LCD
• CPC Class Codes: B60R 11/0241 : for telephones
• CPC Class Codes: B60R 2001/1253 : with cameras, video cameras or video screens
• CPC Class Codes: B60R 2001/1284 : with communication systems other than radio-receivers, e.g. keyless entry systems, navigation systems; with anti-collision systems
• CPC Class Codes: B60R 2011/0026 : Windows, e.g. windscreen
• CPC Class Codes: B60R 2011/0033 : Rear-view mirrors
• CPC Class Codes: B60R 2011/0063 : using adhesive means, e.g. hook and loop fasteners
• CPC Class Codes: B60R 2011/0075 : using a containment or docking space
• CPC Class Codes: B60R 2011/0085 : with adjustment by rotation in their operational position
• CPC Class Codes: B60R 2300/105 : using multiple cameras
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/802 : for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: G01C 21/265 : constructional aspects of navigation devices, e.g. housings, mountings, displays G01C21/3688 takes precedence
• CPC Class Codes: G01C 21/3611 : using character input or menus, e.g. menus of POIs character input methods in general G06F3/0233
• CPC Class Codes: G01C 21/3614 : through interaction with a road map, e.g. selecting a POI icon on a road map
• CPC Class Codes: G01C 21/362 : received from an external device or application, e.g. PDA, mobile phone or calendar application
• CPC Class Codes: G01C 21/3629 : Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G01C 21/3632 : Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/3644 : Landmark guidance, e.g. using POIs or conspicuous other objects
• CPC Class Codes: G01C 21/3664 : Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/367 : Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
• CPC Class Codes: G01C 21/3682 : output of POI information on a road map G01C21/3614, G01C21/3685 take precedence
• CPC Class Codes: G01C 21/3688 : Systems comprising multiple parts or multiple output devices (not client-server), e.g. detachable faceplates, key fobs or multiple output screens
• CPC Class Codes: G06F 3/01 : Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/16 : Sound input; Sound output speech processing G10L
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/597 : Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/28 : Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04M 1/6091 : including a wireless interface
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A user-interactive display system for a vehicle includes an interior rearview mirror assembly, a portable hand-held device, and a display device. The portable hand-held device is operable to communicate a first signal to a vehicle-based receiver. A user input is actuatable so that a user can select an item from a listing of choices displayed by the display device, whereby the user-interactive display system (a) displays at the display device data associated with the selected item in response to the user-selection of the selected item from the listing of choices, and/or (b) audibly plays at an audio device of the vehicle data associated with the selected item in response to the user-selection of the selected item from the listing of choices.

Claims

1. A user-interactive display system for a vehicle, said user-interactive display system comprising:

an interior rearview mirror assembly comprising a mounting structure and a reflective element;

a portable hand-held device capable of being carried into and out of the vehicle;

wherein said portable hand-held device, when carried into the vehicle, is operable to communicate a first signal to a vehicle-based receiver;

a display device at or adjacent said interior rearview mirror assembly, said display device being operable to display a listing of choices in response to said communication of said first signal;

wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of voice mail messages of a portable phone, (b) a listing of phone numbers of a portable phone, (c) a listing of received or transmitted emails, and (d) a listing of titles or tracks stored in the memory of a portable playback device or downloadable from an external provider;

said interior rearview mirror assembly further comprising a user input, said user input comprising a touch screen, said user input being actuatable by a user touching appropriate locations on said touch screen to select an item from said listing of choices displayed by said display device, wherein said user input of said mirror assembly is actuatable to navigate menus of said portable hand-held device to select an item from said listing of choices; and

wherein said user-interactive display system is operable to at least one of (a) display at said display device data associated with the selected item in response to said user-selection of the selected item from said listing of choices, and (b) audibly play at an audio device of the vehicle data associated with the selected item in response to said user-selection of the selected item from said listing of choices.

2. The user-interactive display system of claim 1, wherein said user-interactive display system comprises a text to voice converter operable to convert textual data associated with the selected item into a converted voice message.

3. The user-interactive display system of claim 1 further comprising a docking device for said portable hand-held device, said docking device being located in the interior cabin of the vehicle and communicating said first signal to said vehicle-based receiver.

4. The user-interactive display system of claim 3, wherein said docking device communicates a first signal indicative of audio data to a first vehicle-based receiver and communicates a second signal indicative of textual data to a second vehicle-based receiver, said second signal being indicative of display information being displayed at said portable hand-held device, said second signal being communicated to said second vehicle-based receiver via a wireless communication protocol.

5. The user-interactive display system of claim 1, wherein said display is at or near a driver side portion of said reflective element of said interior rearview mirror assembly.

6. The user-interactive display system of claim 1 further comprising a text to voice converter operable to convert textual data associated with the selected item into a converted voice message, and wherein said user input is actuatable by a user so that a user can select at least one of (a) displaying data associated with a selected textual item at said display device and (b) audibly playing data associated with a converted voice message of a selected textual item.

7. The user-interactive display system of claim 1, wherein said interior rearview mirror assembly includes a video display device operable to display images representative of a scene occurring rearward of the vehicle, said video display device displaying said images on a display screen, said video display device comprising a non-electronic graphic overlay means that is viewable when said video display device is activated, wherein said graphic overlay means comprise indicia established in front of an illumination source of said video display device and viewable at said display screen when said video display device is activated and substantially not viewable at said display screen when said video display device is deactivated.

8. The user-interactive display system of claim 1 comprising a navigation device support structure for supporting a portable navigation device, wherein said navigation device support structure comprises an articulatable receiving structure that is articulatable to adjust an orientation of the portable navigation device supported thereon independent of adjustment of an orientation of said reflective element of said interior rearview mirror assembly, wherein said navigation device support structure is articulatable between a stowed position, where said receiving structure is articulated such that said receiving structure and a portable navigation device supported thereon are generally along the windshield at a mounting base of said mirror assembly, and a use position, where said receiving structure is articulated such that said receiving structure and a portable navigation device supported thereon are generally below said reflective element and readily viewable by the driver of the vehicle.

9. The user-interactive display system of claim 8, wherein said user-interactive display system is operable to display information at said portable navigation device in a Consumer Hand-held Display Format when said portable navigation device is not supported on said navigation device support structure and to display information at said portable navigation device in an In-vehicle Display Format when said portable navigation device is supported on said navigation device support structure.

10. A user-interactive display system for a vehicle, said user-interactive display system comprising:

an interior rearview mirror assembly comprising a mounting structure and a reflective element;

a portable hand-held device capable of being carried into and out of the vehicle;

wherein said portable hand-held device, when carried into the vehicle, is operable to communicate a first signal to a vehicle-based receiver;

a docking device for said portable hand-held device, said docking device being located in the interior cabin of the vehicle, said portable hand-held device being dockable at said docking device when carried into the vehicle;

a display device at or adjacent said interior rearview mirror assembly, said display device being operable to display a listing of choices in response to said communication of said first signal, said display device displaying said listing of choices at or near a driver side portion of said reflective element of said interior rearview mirror assembly;

said interior rearview mirror assembly further comprising a user input, said user input comprising a touch screen, said user input being actuatable by a user touching appropriate locations on said touch screen to select an item from said listing of choices displayed by said display device, wherein said user input of said mirror assembly is actuatable to navigate menus of said portable hand-held device to select an item from said listing of choices; and

wherein said user-interactive display system is operable to at least one of (a) display at said display device data associated with the selected item in response to said user-selection of the selected item from said listing of choices, and (b) audibly play at an audio device of the vehicle data associated with the selected item in response to said user-selection of the selected item from said listing of choices.

11. The user-interactive display system of claim 10, wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of voice mail messages of a portable phone, (b) a listing of phone numbers of a portable phone, (c) a listing of received or transmitted emails, and (d) a listing of titles or tracks stored in the memory of a portable playback device or downloadable from an external provider.

12. The user-interactive display system of claim 10, wherein said interior rearview mirror assembly includes a video display device operable to display images representative of a scene occurring rearward of the vehicle, said video display device displaying said images on a display screen, said video display device comprising a non-electronic graphic overlay means that is viewable when said video display device is activated.

13. The user-interactive display system of claim 12, wherein said graphic overlay means comprise indicia established in front of an illumination source of said video display device and viewable at said display screen when said video display device is activated and substantially not viewable at said display screen when said video display device is deactivated.

14. The user-interactive display system of claim 10 comprising a navigation device support structure for supporting a portable navigation device.

15. The user-interactive display system of claim 14, wherein said navigation device support structure comprises an articulatable receiving structure that is articulatable to adjust an orientation of the portable navigation device supported thereon independent of adjustment of an orientation of said reflective element of said interior rearview mirror assembly.

16. The user-interactive display system of claim 15, wherein said navigation device support structure is articulatable between a stowed position, where said receiving structure is articulated such that said receiving structure and a portable navigation device supported thereon are generally along the windshield at a mounting base of said mirror assembly, and a use position, where said receiving structure is articulated such that said receiving structure and a portable navigation device supported thereon are generally below said reflective element and readily viewable by the driver of the vehicle.

17. The user-interactive display system of claim 15, wherein said user-interactive display system is operable to display information at said portable navigation device in a Consumer Hand-held Display Format when said portable navigation device is not supported on said navigation device support structure and to display information at said portable navigation device in an In-vehicle Display Format when said portable navigation device is supported on said navigation device support structure.

18. The user-interactive display system of claim 10 further comprising a text to voice converter operable to convert textual data associated with the selected item into a converted voice message, and wherein said user input is actuatable by a user so that a user can select at least one of (a) displaying data associated with a selected textual item at said display device and (b) audibly playing data associated with a converted voice message of a selected textual item.