TWO-STEP GESTURE RECOGNITION FOR FINE-GRAIN CONTROL OF WEARABLE APPLICATIONS

• US 20170177088A1
• Filed: 12/21/2015
• Published: 06/22/2017
• Est. Priority Date: 12/21/2015
• Status: Abandoned Application

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Miseldine, Philip
• Application Number:
  US14/976,464
• Publication Number:
  US 20170177088A1
• Time in Patent Office: Days
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 1/1694 the I/O peripheral being a single or a set of motion sensors for pointer control or gesture input obtained by sensing movements of the portable computer
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/0485 Scrolling or panning

Abstract

The present disclosure provides methods, devices, systems, and computer program products for providing fine-grain gesture-based control of wearable applications. Methods are provided for multi-step gesture-based control systems of wearable applications with an initial, easy to recognize gesture being used to place the device in a state that subtle gestures can be identified that can control navigation and interactivity on the device that rely on the user being able to view the device. Systems and methods are provided for utilizing data obtained from sensor(s) to determine a gesture to place a wearable device in a state of fine-grain gesture-based control.

Claims

1. A method for fine-grain gesture-based control of a wearable device:

generating signal data from at least one sensor, wherein the generated signal data exceeds a gesture recognition threshold;

comparing the generated signal data to stored signal data representing an initialization gesture; and

activating a fine-grain gesture recognition mode if the generated signal data matches the stored signal data, the fine-grain gesture recognition mode lowering the gesture recognition threshold; and

providing, concurrent with the activation of the fine-grain gesture recognition mode, visual or haptic feedback to the user indicating that the initialization gesture has been recognized.

2. The method of claim 1, wherein the gesture recognition threshold is determined by a comparison of the generated signal data to signals generated as a result of natural body movement.

4. The method of claim 1, further comprising generating additional signal data from the at least one sensor, wherein the additional generated signal data exceeds the lowered gesture recognition threshold.

5. The method of claim 1, further comprising:

generating additional signal data, wherein the generated additional signal data exceeds the gesture recognition threshold;

comparing the generated additional signal data to stored signal data representing a deactivation gesture; and

deactivating fine-grain gesture recognition mode if the generated additional data matches the stored signal data representing the deactivation gesture.

6. The method of claim 5, wherein deactivating fine-grain gesture recognition mode raises the gesture recognition threshold.

19. The method of claim 1, wherein the initialization gesture comprises detecting tapping three times on a screen of the wearable device.

20. The method of claim 1, wherein the initialization gesture comprises detecting movement of an arm for a hand of a user of the wearable device upwards fully followed by downwards fully.

21. The method of claim 5, wherein the deactivation gesture comprises detecting that the wearable device is at a position in which the wearable device is not usable by a user wearing the wearable device.

3. (canceled)

7. A non-transitory computer readable storage medium storing one or more programs configured to be executed by a processor, the one or more programs comprising instructions for:

receiving signal data from at least one sensor that exceeds a gesture recognition threshold;

comparing the received signal data to stored signal data representing an initialization gesture;

activating a fine-grain gesture recognition mode if the received signal data matches the stored signal data, the fine-grain gesture recognition mode lowering the gesture recognition threshold; and

providing, concurrent with the activation of the fine-grain gesture recognition mode, visual or haptic feedback to the user indicating that the initialization gesture has been recognized.

8. The non-transitory computer readable storage medium of claim 7, wherein the gesture recognition threshold is determined by a comparison of the received signal data to signals generated as a result of natural body movement.

10. The non-transitory computer readable storage medium of claim 7, wherein the one or more programs further comprise instructions for generating additional signal data from the at least one sensor, wherein the additional generated signal data exceeds the lowered gesture recognition threshold.

11. The non-transitory computer readable storage medium of claim 7, wherein the one or more programs further comprise instructions for:

receiving additional signal data from the at least one sensor that exceeds the gesture recognition threshold;

comparing the received additional signal data to stored signal data representing a deactivation gesture; and

deactivating fine-grain gesture recognition mode if the received additional data matches the stored data representing the deactivation gesture.

12. The non-transitory computer readable storage medium of claim 11, wherein deactivating fine-grain gesture recognition mode raises the gesture recognition threshold.

9. (canceled)

13. A wearable device comprising:

at least one sensor;

a processor configured to;

receive signal data from the at least one sensor that exceeds a gesture recognition threshold;

compare the received signal data to stored signal data representing an initialization gesture;

activate a fine-grain gesture recognition mode if the received signal data matches the stored signal data, the fine-grain gesture recognition mode lowering the gesture recognition threshold; and

provide, concurrent with the activation of the fine-grain gesture recognition mode, visual or haptic feedback to the user indicating that the initialization gesture has been recognized.

14. The wearable device of claim 13, wherein the gesture recognition threshold is determined by a comparison of the received signal data to signals generated as a result of natural body movement.

16. The wearable device of claim 13, wherein the processor is further configured to receive additional signal data from the at least one sensor that exceeds the lowered gesture recognition threshold.

17. The wearable device of claim 13, wherein the processor is further configured to:

receive additional signal data from at least one sensor that exceeds the gesture recognition threshold;

compare the received additional signal data to stored signal data representing a deactivation gesture; and

deactivate fine-grain gesture recognition mode if the received additional data matches the stored data representing the deactivation gesture.

15. (canceled)

18. The wearable device of claim 18, wherein deactivating fine-grain gesture recognition mode raises the gesture recognition threshold.