Human interface device and method

• US 10,365,722 B2
• Filed: 04/30/2018
• Issued: 07/30/2019
• Est. Priority Date: 07/19/2013
• Status: Active Grant

• Current Assignee: Microchip Technology Germany GmbH (Microchip Technology Incorporated)
• Original Assignee: Microchip Technology Germany GmbH (Microchip Technology Incorporated)
• Inventors: Heim, Axel
• Primary Examiner(s): Polo, Gustavo
• Application Number:
  US15/966,919
• Publication Number:
  US 20180314338A1
• Time in Patent Office: 456 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04101 2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/044 by capacitive means
• CPC Class Codes: G06F 3/045 using resistive elements, e.g. a single continuous surface or two parallel surfaces put in contact
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method for state tracking based gesture recognition engine for a sensor system has the steps of: defining a plurality of sequential states of a finite-state machine, determining a Sequence Progress Level (SPL) for each state, mapping a state probability distribution to a (single) SPL on run-time, and utilizing the mapped SPL estimate as an output value of the sensor system.

Claims

1. A method for state tracking based gesture recognition engine for a sensor system comprising the steps of:

defining a plurality of sequential states of a first order Markov Model,

determining a Sequence Progress Level (SPL) for each state,

mapping a state probability distribution to an SPL on run-time, and

utilizing the mapped SPL estimate as an output value of the sensor system.

2. The method according to claim 1, wherein a last state is followed by a first state of the plurality of sequential states.

3. The method according to claim 1, wherein the sensor system is a three-dimensional (3-D) sensing system.

4. The method according to claim 3, wherein the 3-D sensor system is a near-field capacitive sensor systems or a mid/far field sensor system.

5. The method according to claim 4, wherein the mid/far field sensor system uses a video or infrared camera system.

6. The method according to claim 4, wherein the near-field capacitive sensor system is a capacitive non-touching 3-D sensor system based on a quasi static electric field measurements.

7. The method according to claim 1, wherein the sensor system is a two-dimensional (2-D) sensing system, a capacitive or resistive touch system or a touchscreen system.

8. The method according to claim 1, wherein the sensor system is a one-dimensional (1-D) sensing system.

9. The method according to claim 1, wherein the plurality of states are states of a circular gesture.

10. The method according to claim 1, wherein a most likely state is computed using a Forward (Baum-Welch) Algorithm.

11. The method according to claim 1, wherein a most likely state and/or a most likely state sequence is computed using a Viterbi Algorithm.

12. The method according to claim 1, wherein the method uses an N-state Hidden Markov Model (HMM) comprising a state transition probability matrix.

13. The method according to claim 12, wherein the state transition probability matrix comprises in each row a maximum probability value.

14. The method according to claim 13, wherein all probabilities of each row add up to 100%.

15. The method according to claim 12, wherein the HMM further uses an observation matrix which indicates the probability of predefined movement directions.

16. The method according to claim 15, wherein the observation matrix comprises in each row a maximum probability value.

17. The method according to claim 16, wherein all probabilities of each row add up to 100%.

18. The method according to claim 12, wherein for each discrete-time instance the data provided by the sensor system is forwarded to the finite state machine which computes a state probability distribution for the N-state HMM.

19. The method according to claim 18, wherein, for each discrete-time instance, a state with the maximum probability is selected and an SPL associated with the state is output.

20. The method according to claim 18, wherein for each time instance an SPL is computed from the state probability distribution and is output.

21. The method according to claim 19, wherein the method distinguishes between a clock-wise circular gesture, a counter-clockwise circular gesture, or a no-movement gesture.

22. The method according to claim 19, wherein a Maximum Likelihood rule is applied to compute the most likely state.

23. The method according to claim 15, wherein, for a plurality of sequential output values a smoothening algorithm is applied during post processing of sequential output values.

24. A method for gesture recognition comprising the method according to claim 1, further comprising a pattern based gesture recognition mode, wherein the method switches between the pattern based gesture recognition mode and a state tracking based gesture recognition mode provided by the state tracking based gesture recognition engine when a predefined condition is met.

25. The method according to claim 24, wherein the state tracking based gesture recognition mode uses an N-state Hidden Markov Model (HMM) comprising a probability matrix.

26. The method according to claim 25, wherein each state is assigned to an observation probability distribution.

27. The method according to claim 25, wherein during the state tracking based gesture recognition mode for each discrete-time instance the data provided by the sensor system is pre-processed and forwarded to the finite state machine which computes a state probability distribution for each state of the N-state HMM.

28. The method according to claim 27, wherein, for each discrete-time instance, a state with the maximum probability is selected and an SPL associated with the state is output.

29. The method according to claim 27, wherein for each time instance a SPL is computed from the state probability distribution and is output.

30. The method according to claim 28, wherein the state tracking based gesture recognition mode distinguishes between a clock-wise circular gesture, a counter-clockwise circular gesture, or a no-movement gesture.

31. The method according to claim 30, wherein the method switches back to the pattern based gesture recognition mode if a predefined time threshold for a no-movement gesture is met.

32. The method according to claim 28, wherein a Maximum Likelihood rule is applied to compute the most likely state.

33. The method according to claim 28, wherein, for a plurality of sequential output values a smoothening algorithm is applied during post processing of sequential output values.

34. The method according to claim 29, wherein, for a plurality of sequential output values a smoothening algorithm is applied during post processing of sequential output values.

35. A method of operating a device configured to implement the method according to claim 1, wherein the output value is used to control a function of the device.

36. The method according to claim 35, wherein the function is increasing or decreasing a volume level, controlling a dimmer, or controlling a scroll function.

37. A method for state tracking based gesture recognition engine for a sensor system comprising the steps of:

defining a plurality of sequential states of a finite-state machine,

determining a Sequence Progress Level (SPL) for each state,

mapping a state probability distribution to a SPL on run-time, and

utilizing a mapped SPL estimate as an output value of the sensor system.