System and Method for Supporting Human Machine Interaction

• US 20160011667A1
• Filed: 07/08/2014
• Published: 01/14/2016
• Est. Priority Date: 07/08/2014
• Status: Abandoned Application

• Current Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Electric Research Laboratories, Inc. (Mitsubishi Electric Corporation)
• Inventors: Garaas, Tyler W.
• Application Number:
  US14/325,454
• Publication Number:
  US 20160011667A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus

Abstract

A method for interacting with a set of systems, such as vehicle systems, first determines, using a sensor, a direction of interest of a user, such as the user gaze. One of the systems is selected based on the direction of interest, and a state is changed to correspond to the selected system. Input from the user is acquired using an input device, and then an action is performed on the selected system according to the state and the input.

Claims

1. A method for interacting with a set of systems, comprising steps:

determining, using a sensor, a direction of interest of a user;

selecting one of the systems based on the direction of interest;

determining whether to change to a state corresponding to the selected system;

changing to the state corresponding to the selected system if true;

acquire input from the user using an input device; and

performing an action on the selected system according to the state and the input, wherein the steps are performed in a processor.

2. The method of claim 1, wherein the direction of interest is determined by eye tracking, head-pose tracking, finger tracking, arm tracking, neural pattern tracking or a combination thereof.

3. The method of claim 1, wherein the direction of interest towards a graphical component on a display screen.

4. The method of claim 3, wherein the graphical component is on a head-up display (HUD).

5. The method of claim 1, wherein the direction of interest is towards a physical component of one of the systems.

6. The method of claim 1, wherein the direction of interest is towards a virtual object.

7. The method of claim 1, wherein the user is a driver of a vehicle, and the systems are on-board the vehicle.

8. The method of claim 1, wherein the state is maintained in a finite state machine.

9. The method of claim 8, wherein the finite state machine is non-deterministic.

10. The method claim 1, where the state is probabilistic.

11. The method of claim 1, wherein the input device is arranged on a steering wheel.

12. The arrangement of claim 1, wherein the input device is a speech recognition system.

13. The arrangement of claim 1, wherein the input device is a gesture recognition system.

14. The method of claim 1, wherein the state alters an output of graphical components presented on a display for the user.

15. An apparatus for interacting with a set of systems comprising:

a non-transitory memory;

a sensor; and

a processor connected to the non-transitory memory and the sensor, wherein the processor determines a direction of interest of a user using the sensor, selects one of the systems based on the direction of interest, determines whether to change to a state corresponding to the selected system, changes to the state corresponding to the selected system if true, acquires input from a user using the input device, and performs an action on the selected system according to the state and input.

16. The apparatus of claim 15, wherein the user is a driver of a vehicle, and the systems are on-board the vehicle.