USER-INTERACTIVE DISPLAY SYSTEM FOR VEHICLE

• US 20110202862A1
• Filed: 04/29/2011
• Published: 08/18/2011
• Est. Priority Date: 09/27/2006
• Status: Active Grant

• Current Assignee: Magna Electronics Incorporated (Magna International Incorporated)
• Original Assignee: Donnelly Corporation (Magna International Incorporated)
• Inventors: Lynam, Niall R., Kramer, Mark E., O'Connell, David P., Nise, Vernon R.
• Granted Patent: US 8,904,308 B2
• Time in Patent Office: Days
• US Class Current: 715/771
• CPC Class Codes: B60K 2360/126 Rotatable input devices for instruments
• CPC Class Codes: B60K 2360/135 Joysticks
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/146 Instrument input by gesture
• CPC Class Codes: B60K 2360/1526 Dual-view displays
• CPC Class Codes: B60K 2360/173 Reversing assist
• CPC Class Codes: B60K 2360/21 using cameras
• CPC Class Codes: B60K 2360/777 on or in sun visors
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/22 Display screens
• CPC Class Codes: B60K 35/28 characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver
• CPC Class Codes: B60K 35/60 Instruments characterised by their location or relative disposition in or on vehicles arrangements of lighting devices on dashboards B60Q3/10
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60R 1/12 Mirror assemblies combined with other articles, e.g. clocks
• CPC Class Codes: B60R 11/02 for radio sets, television sets, telephones, or the like; Arrangement of controls thereof
• CPC Class Codes: B60R 11/0235 of flat type, e.g. LCD
• CPC Class Codes: B60R 11/0241 for telephones
• CPC Class Codes: B60R 2001/1253 with cameras, video cameras or video screens
• CPC Class Codes: B60R 2001/1284 : with communication systems other than radio-receivers, e.g. keyless entry systems, navigation systems; with anti-collision systems
• CPC Class Codes: B60R 2011/0026 : Windows, e.g. windscreen
• CPC Class Codes: B60R 2011/0033 : Rear-view mirrors
• CPC Class Codes: B60R 2011/0063 : using adhesive means, e.g. hook and loop fasteners
• CPC Class Codes: B60R 2011/0075 : using a containment or docking space
• CPC Class Codes: B60R 2011/0085 : with adjustment by rotation in their operational position
• CPC Class Codes: B60R 2300/105 : using multiple cameras
• CPC Class Codes: B60R 2300/207 : using multi-purpose displays, e.g. camera image and navigation or video on same display
• CPC Class Codes: B60R 2300/303 : using joined images, e.g. multiple camera images
• CPC Class Codes: B60R 2300/802 : for monitoring and displaying vehicle exterior blind spot views
• CPC Class Codes: B60R 2300/806 : for aiding parking
• CPC Class Codes: B60R 2300/8093 : for obstacle warning
• CPC Class Codes: G01C 21/265 : constructional aspects of navigation devices, e.g. housings, mountings, displays G01C21/3688 takes precedence
• CPC Class Codes: G01C 21/3611 : using character input or menus, e.g. menus of POIs character input methods in general G06F3/0233
• CPC Class Codes: G01C 21/3614 : through interaction with a road map, e.g. selecting a POI icon on a road map
• CPC Class Codes: G01C 21/362 : received from an external device or application, e.g. PDA, mobile phone or calendar application
• CPC Class Codes: G01C 21/3629 : Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G01C 21/3632 : Guidance using simplified or iconic instructions, e.g. using arrows G01C21/365 takes precedence
• CPC Class Codes: G01C 21/3644 : Landmark guidance, e.g. using POIs or conspicuous other objects
• CPC Class Codes: G01C 21/3664 : Details of the user input interface, e.g. buttons, knobs or sliders, including those provided on a touch screen; remote controllers; input using gestures
• CPC Class Codes: G01C 21/367 : Details, e.g. road map scale, orientation, zooming, illumination, level of detail, scrolling of road map or positioning of current position marker
• CPC Class Codes: G01C 21/3682 : output of POI information on a road map G01C21/3614, G01C21/3685 take precedence
• CPC Class Codes: G01C 21/3688 : Systems comprising multiple parts or multiple output devices (not client-server), e.g. detachable faceplates, key fobs or multiple output screens
• CPC Class Codes: G06F 3/01 : Input arrangements or combined input and output arrangements for interaction between user and computer G06F3/16 takes precedence
• CPC Class Codes: G06F 3/017 : Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 : Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 : Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/16 : Sound input; Sound output speech processing G10L
• CPC Class Codes: G06V 20/58 : Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/588 : Recognition of the road, e.g. of lane markings; Recognition of the vehicle driving pattern in relation to the road
• CPC Class Codes: G06V 20/59 : inside of a vehicle, e.g. relating to seat occupancy, driver state or inner lighting conditions
• CPC Class Codes: G06V 20/597 : Recognising the driver's state or behaviour, e.g. attention or drowsiness
• CPC Class Codes: G06V 40/28 : Recognition of hand or arm movements, e.g. recognition of deaf sign language static hand signs G06V40/113
• CPC Class Codes: H04M 1/6091 : including a wireless interface
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 7/183 : for receiving images from a single remote source

Abstract

A user-interactive display system for a vehicle includes a portable hand-held device capable of being carried into and out of the vehicle and a display device viewable by the driver of the vehicle. The portable hand-held device is operable to communicate with a vehicle-based receiver, and the display device is operable to display a listing of choices in response to the communication. A user input of an interior rearview mirror assembly is actuatable by a user to select an item from the displayed listing of choices. The user-interactive display system is operable to at least one of (a) display at the display device data associated with the selected item in response to the user-selection of the selected item from the listing of choices and (b) audibly play at an audio device in the vehicle data associated with the selected item in response to the user-selection of the selected item from the listing of choices.

Claims

1. A user-interactive display system for a vehicle, said user-interactive display system comprising:

a portable hand-held device capable of being carried into and out of the vehicle;

wherein said portable hand-held device is operable to communicate with a vehicle-based receiver;

a display device viewable by the driver of the vehicle, wherein said display device is operable to display a listing of choices in response to said communication;

wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of messages, (b) a listing of phone numbers, (c) a listing of emails and (d) a listing of titles or tracks;

an interior rearview mirror assembly comprising a user input, wherein said user input is actuatable by a user to select an item from said listing of choices displayed by said display device;

wherein said user-interactive display system is operable to at least one of (a) display at said display device data associated with the selected item in response to said user-selection of the selected item from said listing of choices and (b) audibly play at an audio device in the vehicle data associated with the selected item in response to said user-selection of the selected item from said listing of choices; and

a text to voice converter operable to convert textual data associated with the selected item into a converted voice message.

2. The user-interactive display system of claim 1, wherein said user input is actuatable by a user so that a user can select at least one of (a) displaying data associated with a selected textual item at said display device and (b) audibly playing data associated with a converted voice message of a selected textual item.

3. The user-interactive display system of claim 1, wherein said listing of choices displayed by said display device comprises a listing of messages and wherein said listing of messages comprises a listing of voice mail messages.

4. The user-interactive display system of claim 3, wherein said portable hand-held device comprises a portable phone.

5. The user-interactive display system of claim 1, wherein said listing of choices displayed by said display device comprises a listing of emails and wherein said listing of emails comprises at least one of a received email and a transmitted email.

6. The user-interactive display system of claim 1, wherein said listing of choices displayed by said display device is derived, at least in part, from data stored by said portable hand-held device.

7. The user-interactive display system of claim 1, wherein said listing of choices displayed by said display device comprises a listing of titles or tracks and wherein said listing of titles or tracks are associated with data files downloadable from an external provider.

8. The user-interactive display system of claim 1, wherein said user input of said mirror assembly is actuatable to navigate a menu.

9. The user-interactive display system of claim 8, wherein a user can navigate said menu to select an item from said listing of choices.

10. The user-interactive display system of claim 1, wherein said user input comprises at least one of (i) a button, (ii) a control wheel, (iii) a joystick and (iv) a touch sensor.

11. The user-interactive display system of claim 1, wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of voice mail messages, (b) a listing of phone numbers of a portable phone, (c) a listing of received or transmitted emails and (d) a listing of titles or tracks stored in the memory of a portable playback device or downloadable from an external provider.

12. The user-interactive display system of claim 1, further comprising a docking device for said portable hand-held device, said docking device being located in the interior cabin of the vehicle and communicating with said vehicle-based receiver.

13. The user-interactive display system of claim 1, wherein said display device is at or near said interior rearview mirror assembly.

14. The user-interactive display system of claim 13, wherein said display device is at or near a driver side portion of a reflective element of said interior rearview mirror assembly.

15. The user-interactive display system of claim 1, wherein said display device is part of a windshield electronics module of the vehicle.

16. The user-interactive display system of claim 1, wherein said interior rearview mirror assembly includes a video display device operable to display images representative of a scene occurring rearward of the vehicle, said video display device displaying said images on a display screen.

17. The user-interactive display system of claim 16, wherein said video display device comprises a non-electronic graphic overlay means that is viewable when said video display device is activated.

18. The user-interactive display system of claim 1, further comprising a navigation device support structure for supporting a portable navigation device, wherein said navigation device support structure comprises an articulatable receiving structure that is articulatable to adjust an orientation of the portable navigation device supported thereon independent of adjustment of an orientation of a reflective element of said interior rearview mirror assembly, and wherein said navigation device support structure is articulatable between a stowed position, where said receiving structure is articulated such that said receiving structure and the portable navigation device supported thereon are generally along the windshield at a mounting base of said mirror assembly, and a use position, where said receiving structure is articulated such that said receiving structure and the portable navigation device supported thereon are generally below said reflective element and readily viewable by the driver of the vehicle.

19. The user-interactive display system of claim 1, wherein said user-interactive display system is operable to display information at said display device in an In-vehicle Display Format and wherein said portable hand-held device is operable to display information in a Consumer Hand-held Display Format.

20. The user-interactive display system of claim 1, wherein said user input comprises a touch input.

21. The user-interactive display system of claim 20, wherein said display device comprises a touch screen and wherein said touch input is actuatable by a user touching an appropriate location on said touch screen to select an item from said listing of choices displayed by said display device.

22. The user-interactive display system of claim 1, wherein said display device comprises a display screen and wherein said display screen comprises a multi-viewing display screen that is operable to display multiple images for viewing different images from different viewing angles.

23. The user-interactive display system of claim 22, wherein said display device displays said listing of choices at a driver-side portion of said display screen and displays video images at a passenger-side portion of said display screen.

24. The user-interactive display system of claim 22, wherein said multi-viewing display screen comprises a dual-viewing display screen.

25. The user-interactive display system of claim 22, wherein said multi-viewing display screen comprises a triple directional viewing display screen, and wherein said triple directional viewing display screen comprise a display that controls the viewing angle so that said display screen is operable to display different images for viewing from the left, right, and center of the display screen.

26. The user-interactive display system of claim 1, wherein said portable hand-held device is operable to wirelessly communicate with said vehicle-based receiver.

27. A user-interactive display system for a vehicle, said user-interactive display system comprising:

a portable hand-held device capable of being carried into and out of the vehicle;

wherein said portable hand-held device is operable to communicate with a vehicle-based receiver;

a display device viewable by the driver of the vehicle, wherein said display device is operable to display a listing of choices in response to said communication;

wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of messages, (b) a listing of phone numbers, (c) a listing of emails and (d) a listing of titles or tracks;

an interior rearview mirror assembly comprising a user input, wherein said user input is actuatable by a user to select an item from said listing of choices displayed by said display device;

wherein said user-interactive display system is operable to at least one of (a) display at said display device data associated with the selected item in response to said user-selection of the selected item from said listing of choices and (b) audibly play at an audio device in the vehicle data associated with the selected item in response to said user-selection of the selected item from said listing of choices; and

wherein said display device comprises a display screen and wherein said display screen comprises a multi-viewing display screen that is operable to display multiple images for viewing different images from different viewing angles.

28. The user-interactive display system of claim 27, wherein said display device displays said listing of choices at a driver-side portion of said display screen and displays video images at a passenger-side portion of said display screen.

29. The user-interactive display system of claim 27, wherein said multi-viewing display screen comprises a dual-viewing display screen.

30. The user-interactive display system of claim 27, wherein said multi-viewing display screen comprises a triple directional viewing display screen, and wherein said triple directional viewing display screen comprise a display that controls the viewing angle so that said display screen is operable to display different images for viewing from the left, right, and center of the display screen.

31. The user-interactive display system of claim 27, wherein said user-interactive display system comprises a text to voice converter operable to convert textual data associated with the selected item into a converted voice message.

32. The user-interactive display system of claim 27, wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of voice mail messages, (b) a listing of phone numbers of a portable phone, (c) a listing of received or transmitted emails and (d) a listing of titles or tracks stored in the memory of a portable playback device or downloadable from an external provider.

33. The user-interactive display system of claim 27, wherein said user-interactive display system is operable to display information at said display device in an In-vehicle Display Format and wherein said portable hand-held device is operable to display information in a Consumer Hand-held Display Format.

34. The user-interactive display system of claim 27, wherein said user input comprises a touch input.

35. The user-interactive display system of claim 34, wherein said display device comprises a touch screen and wherein said touch input is actuatable by a user touching an appropriate location on said touch screen to select an item from said listing of choices displayed by said display device.

36. The user-interactive display system of claim 27, wherein said user input of said mirror assembly is actuatable to navigate menus of said portable hand-held device to select an item from said listing of choices.

37. The user-interactive display system of claim 27, wherein said portable hand-held device is operable to wirelessly communicate with said vehicle-based receiver.

38. A user-interactive display system for a vehicle, said user-interactive display system comprising:

a portable hand-held device capable of being carried into and out of the vehicle;

wherein said portable hand-held device is operable to communicate with a vehicle-based receiver;

a display device viewable by the driver of the vehicle, wherein said display device is operable to display a listing of choices in response to said communication;

wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of messages, (b) a listing of phone numbers, (c) a listing of emails and (d) a listing of titles or tracks;

an interior rearview mirror assembly comprising a user input, wherein said user input is actuatable by a user to select an item from said listing of choices displayed by said display device;

wherein said user-interactive display system is operable to at least one of (a) display at said display device data associated with the selected item in response to said user-selection of the selected item from said listing of choices and (b) audibly play at an audio device in the vehicle data associated with the selected item in response to said user-selection of the selected item from said listing of choices; and

wherein said user input of said mirror assembly is actuatable to navigate a menu and wherein a user can navigate said menu to select an item from said listing of choices displayed by said display device.

39. The user-interactive display system of claim 38, wherein said user input is actuatable by a user so that a user can select at least one of (a) displaying data associated with a selected textual item at said display device and (b) audibly playing data associated with a converted voice message of a selected textual item.

40. The user-interactive display system of claim 38, wherein said listing of choices displayed by said display device is derived, at least in part, from data stored by said portable hand-held device.

41. The user-interactive display system of claim 38, wherein said listing of choices displayed by said display device comprises a listing of titles or tracks and wherein said listing of titles or tracks are associated with data files downloadable from an external provider.

42. The user-interactive display system of claim 38, wherein said listing of choices displayed by said display device comprises at least one of (a) a listing of voice mail messages, (b) a listing of phone numbers of a portable phone, (c) a listing of received or transmitted emails and (d) a listing of titles or tracks stored in the memory of a portable playback device or downloadable from an external provider.

43. The user-interactive display system of claim 38, wherein said user input comprises a touch input, and wherein said display device comprises a touch screen and wherein said touch input is actuatable by a user touching an appropriate location on said touch screen to select an item from said listing of choices displayed by said display device.