Gesture control

• US 10,459,525 B2
• Filed: 07/09/2015
• Issued: 10/29/2019
• Est. Priority Date: 07/10/2014
• Status: Active Grant

• Current Assignee: Elliptic Laboratories AS
• Original Assignee: Elliptic Laboratories AS
• Inventors: Strutt, Guenael, Bjorne, Joachim, Birkedal, Geir
• Primary Examiner(s): Tran, Tam T
• Application Number:
  US14/795,125
• Publication Number:
  US 20160011672A1
• Time in Patent Office: 1,573 Days
• Field of Search: None
• CPC Class Codes: G06F 2203/04108 Touchless 2D- digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface without distance measurement in the Z direction
• CPC Class Codes: G06F 3/016 Input arrangements with force or tactile feedback as computer generated output to the user
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/043 using propagating acoustic waves
• CPC Class Codes: G06F 3/0485 Scrolling or panning
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

A method of operating a touchless user interface on an electronic device is disclosed. The electronic device is configured to determine information regarding the position and/or movement of an input object. The method has the steps of: deciding that an engagement gesture has been performed; deciding that a related input gesture has been performed; and carrying out an operation on the device on the basis of the input gesture only if the engagement gesture has been recognized and if the input gesture is one of a subset of possible input gestures determined by the engagement gesture.

Claims

1. A method of operating a touchless user interface on an electronic device having a screen, the method comprising the electronic device:

determining information regarding a movement of an input object in a touchless gesture input zone;

determining that said movement of the input object represents an engagement gesture which has been performed and that has crossed at least one boundary of the touchless gesture input zone at a point which is a predetermined lateral distance from an edge of said screen;

determining that a related input gesture has been performed; and

carrying out an operation on the device on the basis of the input gesture only if the engagement gesture has been recognised and if the input gesture is one of a subset of possible input gestures determined by the engagement gesture.

2. The method as claimed in claim 1 further comprising providing feedback to a user that said engagement gesture has been recognized.

3. The method as claimed in claim 2 wherein the feedback is provided to the user once the engagement gesture has been completed.

4. The method as claimed in claim 2 wherein the feedback is provided progressively while the user is performing the engagement gesture.

5. The method as claimed in claim 4 wherein the feedback comprises continuous brightening of a screen backlight as the engagement gesture is performed.

6. The method as claimed in claim 4 wherein the feedback comprises progressive completion of an icon on a screen of the device.

7. The method as claimed in claim 2 wherein the feedback comprises visual feedback.

8. The method as claimed in claim 2 wherein the feedback comprises audio feedback.

9. The method as claimed in claim 2 wherein the feedback comprises haptic feedback.

10. The method as claimed in claim 2 wherein the feedback indicates to the user that the device is ready to process an input gesture.

11. The method as claimed in claim 2 wherein the feedback comprises highlighting an icon on a screen of the device.

12. The method as claimed in claim 2 wherein the feedback comprises a movement of at least one icon on a screen of the device.

13. The method as claimed in claim 2 wherein the feedback comprises a vibration of the device once the engagement gesture is complete.

14. The method as claimed in claim 1 wherein the input gesture must be carried out within a predetermined time limit after the engagement gesture has been performed.

15. The method as claimed in claim 14 wherein the time limit is between 5 and 20 seconds.

16. The method as claimed in claim 1 wherein every input gesture must be preceded by the engagement gesture or a further engagement gesture.

17. The method as claimed in claim 1 wherein the performance of an engagement gesture allows a subset of input gestures to be performed.

18. The method as claimed in claim 17 wherein any of the subset of input gestures performed are processed within a predetermined time limit after the engagement gesture is performed.

19. The method as claimed in claim 17 wherein a time-out limit is applied after a last gesture of the subset was performed, and after said time-out limit a new engagement gesture is required.

20. The method as claimed in claim 17 wherein the subset of gestures is a single gesture.

21. The method as claimed in claim 1 wherein the engagement gesture comprises a movement which is the same as the desired input gesture(s) except that it is carried out in a different direction.

22. The method as claimed in claim 21 wherein the engagement gesture is carried out in the opposite direction to the input gesture.

23. The method as claimed in claim 21 wherein the engagement gesture is carried out perpendicular to the input gesture.

24. The method as claimed in claim 1 wherein the subset of desired input gestures may comprise only one input gesture for each engagement gesture.

25. The method as claimed in claim 1 wherein the input gesture is an extension of the engagement gesture in the same direction.

26. The method as claimed in claim 1 wherein the input gesture is discrete.

27. The method as claimed in claim 1 wherein the input gesture is continuous.

28. The method as claimed in claim 1 wherein the subset of desired input gestures may comprise a plurality of input gestures for each engagement gesture.

29. The method as claimed in claim 1 wherein the touchless user interface is an acoustic system.

30. The method as claimed in claim 29 wherein the acoustic system is an ultrasonic system.

31. The method as claimed in claim 29 wherein the acoustic system comprises at least one of:

transmitters for transmitting signals;

receivers for receiving reflections of the transmitted signals; and

a processor for determining information regarding the position and/or movement of said input object from said reflected signals to determine whether a particular gesture has been carried out.

32. The method as claimed in claim 31 wherein the transmitted signals and received signals are used to calculate channel impulse responses.

33. The method as claimed in claim 32 wherein the calculated channel impulse responses are combined into a matrix of channel impulse responses.

34. The method as claimed in 33 wherein the matrix of channel impulse responses is analysed to determine whether a gesture has been carried out.