User-input apparatus, method and program for user-input

• US 10,444,831 B2
• Filed: 12/06/2016
• Issued: 10/15/2019
• Est. Priority Date: 12/07/2015
• Status: Active Grant

• Current Assignee: Eyeware Tech SA
• Original Assignee: Eyeware Tech SA
• Inventors: Funes Mora, Kenneth Alberto
• Primary Examiner(s): Butcher, Brian M
• Application Number:
  US15/370,836
• Publication Number:
  US 20170160797A1
• Time in Patent Office: 1,043 Days
• Field of Search: None
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials

Abstract

User-input apparatus for head gesture based control comprising: a camera for recording a head of a user; a database for defining a plurality of gestures of the head of the user and for relating at least some of the defined gestures to a corresponding user command; a detector for detecting one of the gestures defined in the database in the recording of the camera; a controller for identifying a user command in the database related to the detected gesture and for giving out the user command related to the detected gesture; wherein one of the defined gestures of the head is a switching gesture and one of the user commands is a switching command related to the switching gesture, wherein, when the switching command is given out from the controller, the user-input apparatus switches between a use mode for the head gesture based control and a settings mode.

Claims

1. A user-input apparatus for head gesture based control comprising:

a camera for recording a head of a user;

a database for defining a plurality of gestures of the head of the user and for relating at least some of the defined gestures to a corresponding user command;

a detector for detecting one of the gestures defined in the database in the recording of the camera;

a controller for identifying a user command in the database related to the detected gesture and for giving out the user command related to the detected gesture;

a configurator for configuring settings of the user-input apparatus

wherein one of the defined gestures of the head is a switching gesture and one of the user commands is a switching command related to the switching gesture, wherein, when the switching command is given out from the controller, the user-input apparatus switches between a use mode for the head gesture based control and a settings mode for configuring the user-input apparatus in the configurator or changes the settings of the user-input apparatus,

wherein the setting mode is a calibration mode, wherein the user-input apparatus is switched from the use mode into the calibration mode by the switching gesture for calibration of the head gestures of the user-input apparatus, or the calibration of the head gestures of the user-input apparatus are changed, and

wherein the configurator is configured to perform the calibration in the calibration mode without the need of other input operations of the user than gestures of the head of the user.

2. The user-input apparatus according to claim 1, wherein the calibration comprises a detection of user-specific parameters of one or more head gestures.

3. The user-input apparatus according to claim 2, wherein the detection of the user specific parameters of one or more head gestures comprises learning a head rest position.

4. The user-input apparatus according to claim 2, wherein the detection of the user specific parameters of one or more head gestures comprises learning a user-specific speed.

5. The user-input apparatus according to claim 1, wherein the calibration comprises relating user commands to gestures defined in the database.

6. The user-input apparatus according to claim 1, wherein the calibration comprises to newly define or adapt head gestures.

7. The user-input apparatus according to claim 1, wherein the switching command causes in the setting mode to open on a display a window with different settings.

8. The user-input apparatus according to claim 1, wherein the switching command causes to start a head rest pose procedure for detecting the rest pose of the head of the user.

9. The user-input apparatus according to claim 1 having at least two user profiles, wherein the switching command causes to switch from one user profile to another user profile or to calibrate one of the user profiles.

10. The user-input apparatus according to claim 1, wherein the gestures defined in the database comprises a kiss gesture related or to be related to a confirmative user command.

11. The user-input apparatus according to claim 1, wherein the gestures defined in the database distinguish at least two gestures with the same movement, but with at least two different speeds.

12. The user-input apparatus according to claim 1, wherein the camera is configured to record an optical video and a three-dimensional video of the head of the user.

13. The user-input apparatus according to claim 1, wherein the detector is configured to detect gestures of the head of the user by sequentially detecting actual facial landmarks of the head of the user and an actual head position of the head of the user.

14. The user-input apparatus according to claim 1, wherein one of the defined gestures is an online support gesture and one of the user commands is an online support command related to the online support gesture, wherein, when the online support command is given out from the controller, the user-input apparatus connects a remote online support to the user-input apparatus for accessing and controlling the user-input apparatus.