Human machine interface (HMI) control unit for multiple vehicle display devices

• US 10,353,658 B2
• Filed: 09/22/2016
• Issued: 07/16/2019
• Est. Priority Date: 09/22/2016
• Status: Active Grant

• Current Assignee: Toyota Motor Sales USA, Inc. (Toyota Motor Corporation)
• Original Assignee: Toyota Motor Sales USA, Inc. (Toyota Motor Corporation)
• Inventors: Tsai, David, Basra, Steven, McLaughlin, John, Shahid, Shady, McNamara, Greg, Selvaag, Per
• Primary Examiner(s): Trapanese, William C
• Application Number:
  US15/272,699
• Publication Number:
  US 20180081614A1
• Time in Patent Office: 1,027 Days
• Field of Search: None
• CPC Class Codes: B60K 2360/11 Instrument graphical user interfaces or menu aspects
• CPC Class Codes: B60K 2360/113 Scrolling through menu items
• CPC Class Codes: B60K 2360/143 Touch sensitive instrument input devices
• CPC Class Codes: B60K 2360/1438 Touch screens
• CPC Class Codes: B60K 2360/1442 Emulation of input devices
• CPC Class Codes: B60K 2360/145 Instrument input by combination of touch screen and hardware input devices
• CPC Class Codes: B60K 2360/182 Distributing information between displays
• CPC Class Codes: B60K 2360/334 Projection means
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: G01C 21/3688 Systems comprising multiple parts or multiple output devices (not client-server), e.g. detachable faceplates, key fobs or multiple output screens
• CPC Class Codes: G06F 2203/04803 Split screen, i.e. subdividing the display area or the window area into separate subareas
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G09G 5/14 Display of multiple viewports

Abstract

Devices and methods in a configurable human machine interface (HMI) for multiple vehicle display devices are disclosed. An example of the method includes, in the HMI control unit for a plurality of vehicular display devices, receiving action input data from a configurable application input module in a first operational mode. In the first operational mode a first vehicular display device operates as a master vehicular display device relative to a second vehicular display device. The second vehicular display device is mirrored to the first vehicular display device. When action input data indicates a transition from the first operational mode to a second operational mode, the method continues by generating a control message based on the action input data. The control message indicates that the second vehicular display device operates as the master vehicular display device and that the first vehicular display device provides mirrored feedback relating to a subsequent action input data affecting a corresponding graphic user element of the second vehicular display device.

Claims

1. A method in a human machine interface (HMI) control unit for a first vehicular display device and a second vehicular display device, the method comprising:

displaying a graphic user element on the first vehicular display device and designating a corresponding first graphic user interface of a configurable application input module for manipulating the graphic user element of the first vehicular display device in a first operational mode, wherein in the first operational mode, the first vehicular display device operates as a master vehicular display device relative to the second vehicular display device, and the second vehicular display device operates to provide mirrored feedback relating to action input data from the configurable application input module affecting the graphic user element of the first vehicular display device; and

when a command is received to transition from the first operational mode to a second operational mode, displaying a graphic user element on the second vehicular display device and designating a corresponding second graphic user interface of the configurable application input module for manipulating the graphic user element of the second vehicular display device in the second operational mode, wherein in the second operational mode, the second vehicular display device operates as a master vehicular display device relative to the first vehicular display device, and the first vehicular display device operates to provide mirrored feedback relating to subsequent action input data from the configurable application input module affecting the graphic user element of the second vehicular display device.

2. The method of claim 1, further comprising:

when an inactivity time period expires, returning to the first operational mode.

3. The method of claim 1, further comprising:

receiving application selection input data that identifies an application of a plurality of applications of the first vehicular display device;

transmitting, in response to the application selection input data, first mode configuration data to the configurable application input module, wherein the first mode configuration data designates the first graphic user interface of the configurable application input module in the first operational mode; and

when the command is received to transition from the first operational mode to the second operational mode, transmitting second mode configuration data to the configurable application input module to designate the second graphic user interface of the configurable application input module in the second operational mode.

4. The method of claim 3, further comprising:

activating, based on the application selection input data, an application of one of a plurality of display zones of the first vehicular display device; and

activating a feedback application for an application mirror zone of the second vehicular display device relating to the application.

5. The method of claim 3, wherein the application selection input data is received from a hotkey of a plurality of hotkeys, wherein each of the plurality of hotkeys correspondingly defines one of the plurality of applications.

6. The method of claim 1, wherein:

the first vehicular display device is a console display device; and

the second vehicular display device is a heads-up display device.

7. A human machine interface (HMI) control unit comprising:

a communication interface to service communication with vehicular devices;

one or more processors coupled to the communication interface, the one or more processors for controlling operations of the HMI control unit; and

a memory coupled to the one or more processors, the memory for storing data and program instructions used by the one or more processors, wherein the one or more processors are configured to execute instructions stored in the memory to;

display a graphic user element on a first vehicular display device and designate a corresponding first graphic user interface of a configurable application input module for manipulating the graphic user element of the first vehicular display device in a first operational mode, wherein in the first operational mode, the first vehicular display device operates as a master vehicular display device relative to a second vehicular display device, and the second vehicular display device operates to provide mirrored feedback relating to action input data from the configurable application input module affecting the graphic user element of the first vehicular display device; and

when a command is received to transition from the first operational mode to a second operational mode, display a graphic user element on the second vehicular display device and designate a corresponding second graphic user interface of the configurable application input module for manipulating the graphic user element of the second vehicular display device in the second operational mode, wherein in the second operational mode, the second vehicular display device operates as a master vehicular display device relative to the first vehicular display device, and the first vehicular display device operates to provide mirrored feedback relating to subsequent action input data from the configurable application input module affecting the graphic user element of the second vehicular display device.

8. The HMI control unit of claim 7, wherein the one or more processors are further configured to execute further instructions stored in the memory to:

return to the first operational mode upon expiration of an inactivity time period.

9. The HMI control unit of claim 7, wherein the one or more processors are further configured to execute further instructions stored in the memory to:

receive application selection input data that identifies an application of a plurality of applications of the first vehicular display device;

transmit, in response to the application selection input data, first mode configuration data to the configurable application input module, wherein the first mode configuration data designates the first graphic user interface of the configurable application input module in the first operational mode; and

when the command is received to transition from the first operational mode to the second operational mode, transmit second mode configuration data to the configurable application input module to designate the second graphic user interface of the configurable application input module in the second operational mode.

10. The HMI control unit of claim 9, wherein the one or more processors are further configured to execute further instructions stored in the memory to:

activate, based on the application selection input data, an application of one of a plurality of display zones of the first vehicular display device; and

activate a feedback application for an application mirror zone of the second vehicular display device relating to the application.

11. The HMI control unit of claim 9, wherein the application selection input data is received from a hotkey of a plurality of hotkeys, wherein each of the plurality of hotkeys correspondingly defines one of the plurality of applications.

12. The HMI control unit of claim 7, wherein:

the first vehicular display device is a console display device; and

the second vehicular display device is a heads-up display device.

13. A human machine interface (HMI) device for use in a vehicle, the HMI device comprising:

a configurable application input module configured to be accessible through a control surface of the vehicle, the configurable application input module including;

a touch screen display; and

a graphic user interface (GUI) data generator coupled to the touch screen display and operable to generate graphic user interfaces for display by the touch screen display; and

a HMI control unit in communication with the configurable application input module, the HMI control unit including;

a wireless communication interface to service communication with vehicular devices;

one or more processors coupled to the wireless communication interface, the one or more processors for controlling operations of the HMI control unit; and

a memory coupled to the one or more processors, the memory for storing data and program instructions used by the one or more processors, wherein the one or more processors are configured to execute instructions stored in the memory to;

display a graphic user element on a first vehicular display device and designate a corresponding first graphic user interface of the touch screen display for manipulating the graphic user element of the first vehicular display device in a first operational mode, wherein in the first operational mode, the first vehicular display device operates as a master vehicular display device relative to a second vehicular display device, and the second vehicular display device operates to provide mirrored feedback relating to action input data from the configurable application input module via the touch screen display affecting the graphic user element of the first vehicular display device; and

when a command is received to transition from the first operational mode to a second operational mode, display a graphic user element on the second vehicular display device and designate a corresponding second graphic user interface of the touch screen display for manipulating the graphic user element of the second vehicular display device in the second operational mode, wherein in the second operational mode, the second vehicular display device operates as a master vehicular display device relative to the first vehicular display device, and the first vehicular display device operates to provide mirrored feedback relating to subsequent action input data from the configurable application input module via the touch screen display affecting the graphic user element of the second vehicular display device.

14. The HMI device of claim 13, wherein the one or more processors are further configured to execute further instructions stored in the memory to:

return to the first operational mode upon expiration of an inactivity time period.

15. The HMI device of claim 13, wherein the one or more processors are further configured to execute further instructions stored in the memory to:

receive application selection input data that identifies an application of a plurality of applications of the first vehicular display device;

transmit, in response to the application selection input data, first mode configuration data to the GUI data generator, wherein the first mode configuration data designates the first graphic user interface of the touch screen display in the first operational mode; and

when the command is received to transition from the first operational mode to the second operational mode, transmit second mode configuration data to the GUI data generator to designate the second graphic user interface of the touch screen display in the second operational mode.

16. The HMI device of claim 15, wherein the one or more processors are further configured to execute further instructions stored in the memory to:

activate, based on the application selection input data, an application of one of a plurality of display zones of the first vehicular display device; and

activate a feedback application for an application mirror zone of the second vehicular display device relating to the application.

17. The HMI device of claim 15, wherein the application selection input data is received from a hotkey of a plurality of hotkeys, wherein each of the plurality of hotkeys correspondingly defines one of the plurality of applications.

18. The HMI device of claim 14, wherein:

the first vehicular display device is a console display device; and

the second vehicular display device is a heads-up display device.