METHOD AND SYSTEM FOR CONTROLLING A HUMAN-MACHINE INTERFACE HAVING AT LEAST TWO DISPLAYS

• US 20160196098A1
• Filed: 12/29/2015
• Published: 07/07/2016
• Est. Priority Date: 01/02/2015
• Status: Abandoned Application

• Current Assignee: Harman Becker Automotive Systems GmbH (Samsung Electronics Co. Ltd.)
• Original Assignee: Harman Becker Automotive Systems GmbH (Samsung Electronics Co. Ltd.)
• Inventors: Roth, Hans, Reifenrath, Christoph
• Application Number:
  US14/983,327
• Publication Number:
  US 20160196098A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: B60K 2360/149 Instrument input by detecting viewing direction not otherwise provided for
• CPC Class Codes: B60K 2360/186 Displaying information according to relevancy
• CPC Class Codes: B60K 2370/149 Input by detecting viewing direction
• CPC Class Codes: B60K 2370/1529 Head-up displays
• CPC Class Codes: B60K 2370/186 Displaying Information according to relevancy
• CPC Class Codes: B60K 35/00 Instruments specially adapted for vehicles; Arrangement of instruments in or on vehicles
• CPC Class Codes: B60K 35/10 Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor
• CPC Class Codes: B60K 35/23 Head-up displays [HUD] optical aspects of head-up displays G02B27/01
• CPC Class Codes: B60K 35/29 Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions
• CPC Class Codes: B60K 35/81 for controlling displays
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G09G 2320/0626 for control of overall brightness
• CPC Class Codes: G09G 2330/021 Power management, e.g. power saving
• CPC Class Codes: G09G 2340/045 Zooming at least part of an image, i.e. enlarging it or shrinking it
• CPC Class Codes: G09G 2340/0464 Positioning
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2354/00 : Aspects of interface with display user
• CPC Class Codes: G09G 2380/10 : Automotive applications
• CPC Class Codes: G09G 5/00 : Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators image data processing or generation, in general G06T

Abstract

A method and system for controlling a human machine interface disposed in a vehicle and having at least two displays, includes monitoring a gaze direction of a vehicle driver. Based on the monitoring, it is determined which of the at least two displays is closest to the gaze direction of the vehicle driver, and in response to the determining, a functionality of the closest of the at least two displays is automatically altered.

Claims

1. A method configured to control a human machine interface disposed in a vehicle and having at least two displays, the method comprising:

monitoring a gaze direction of a vehicle driver;

based on the monitoring, determining which of the at least two displays is closest to the gaze direction of the vehicle driver; and

in response to the determining, automatically altering a functionality of the closest of the at least two displays.

2. The method of claim 1, wherein monitoring the gaze direction comprises determining at least one of an eye position or a facial position of the vehicle driver.

3. The method of claim 1, wherein altering the functionality of the closest of the at least two displays is disabled unless at least one of the following occurrences is detected:

the vehicle speed exceeds a predefined vehicle speed threshold;

the gaze direction of the vehicle driver is maintained for at least a predefined amount of time; and

a warning signal is issued by a driver assistant system or a vehicle control system.

4. The method of claim 3 wherein the predefined amount of time is based on the vehicle speed.

5. The method of claim 1, wherein automatically altering the functionality of the closest of the at least two displays includes at least one of:

fading in or popping up content being shown on the closest of the at least two displays;

showing any of a textual or pictorial message on the closest of the at least two displays;

magnifying any content being shown on the closest of the at least two displays;

simplifying any content being shown on the closest of the at least two displays; and

changing at least one of alert level, sensitivity timing and alert timing of a driver assistant system or a vehicle control system so that a reaction time increase for the driver is achieved.

6. The method of claim 1, further comprising playing an audible message through an audio system operatively disposed in the vehicle, the audible message including an instruction for the vehicle driver.

7. The method of claim 1, further comprising:

after automatically altering the functionality of the closest of the at least two displays, further monitoring the gaze direction of the vehicle driver;

based on the further monitoring, determining that the gaze direction of the vehicle driver is focused away from the closest of the at least two displays; and

in response to the determining that the gaze direction of the vehicle driver is focused away from the at least two displays, changing the altered functionality of the at least two displays back into a default functionality.

8. The method of claim 1, further comprising:

based on the monitoring, determining at least one of a time period during which the driver is not looking at the street or lane while driving and determining if the driver is looking into one of the rear-view mirrors.

9. A system configured to control a human machine interface disposed in a vehicle and having at least two displays, the system comprising:

a gaze-tracking device operatively disposed in the vehicle, the gaze-tracking device configured to monitor a gaze direction of a vehicle driver while the vehicle is in operation; and

a processor operatively associated with the gaze-tracking device and the at least two displays, the processor configured to, based on the monitoring, determine which of the at least two displays is closest to the gaze direction of the vehicle driver, and configured to, in response to the determining, automatically alter a functionality of the closest of the at least two displays.

10. The system of claim 9, wherein the gaze-tracking device is further configured to determine at least one of an eye position or a facial position of the vehicle driver to monitor the gaze direction.

11. The system of claim 9, wherein the processor is configured to evaluate at least one of a vehicle speed, a timer signal and a warning signal, wherein altering the functionality of the closest of the at least two displays is disabled unless at least one of the following occurrences is detected:

the vehicle speed exceeds a predefined vehicle speed threshold;

the gaze direction of the vehicle driver is maintained for at least a predefined amount of time; and

a warning signal is issued by a driver assistant system or a vehicle control system.

12. The system of claim 11, wherein the predefined amount of time is based on the vehicle speed.

13. The system of claim 9 wherein automatically altering the functionality of the closest of the at least two displays includes at least one of:

fading in or popping up content being shown on the closest of the at least two displays;

showing any of a textual or pictorial message on the closest of the at least two displays;

magnifying any content being shown on the closest of the at least two displays; and

simplifying any content being shown on the closest of the at least two displays.

14. The system of claim 9, further comprising an audio system operatively disposed in the vehicle and configured to play an audible message, the audible message including an instruction for the vehicle driver.

15. The system of claim 9, wherein the processor is further configured to:

after automatically altering the functionality of the closest of the at least two displays, further monitor the gaze direction of the vehicle driver;

based on the further monitoring, determine that the gaze direction of the vehicle driver is focused away from the at least two displays; and

in response to the determining that the gaze direction of the vehicle driver is focused away from the at least two displays, change the altered functionality of the closest of the at least two displays back into a default functionality.

16. A system configured to control a human machine interface disposed in a vehicle and having at least two displays, the system comprising:

a gaze-tracking device operatively disposed in the vehicle, the gaze-tracking device configured to monitor a gaze direction of a vehicle driver while the vehicle is in operation;

a processor operatively associated with the gaze-tracking device and the at least two displays; and

a storage device storing instructions executable by the processor to;

based on the monitoring by the gaze-tracking device, determine a closest display of the at least two displays, the closest display being one of the at least two displays that is closest to the gaze direction of the vehicle driver,

in response to the determining that the gaze direction is directed toward the closest display, monitoring an amount of time that the gaze direction is directed toward the closest display, and

responsive to detecting that the amount of time that the gaze direction is directed toward the closest display exceeds a focus threshold, automatically alter a functionality of the closest display relative to a functionality of other displays of the at least two displays.

17. The system of claim 16, wherein the focus threshold is based on a speed of the vehicle.

18. The system of claim 16, wherein determining that the gaze direction is directed toward the closest display comprises comparing the gaze direction to a range constructed around the center of the closest display, and determining that the gaze direction is directed toward the closest display responsive to determining that the gaze direction falls within the range.

19. The system of claim 16, wherein the instructions are further executable to monitor the gaze direction after altering the functionality of the closest display, and, responsive to determining that the gaze direction is no longer directed toward the closest display, automatically returning the closest display to an original functionality before the functionality was altered.

20. The system of claim 16, wherein automatically altering the functionality of the closest display relative to a functionality of other displays of the at least two displays includes switching off, deactivating, or placing each of the other displays of the at least two displays in a power save mode while maintaining the functionality of the closest display.