User gesture input to wearable electronic device involving movement of device

• US 10,185,416 B2
• Filed: 08/30/2013
• Issued: 01/22/2019
• Est. Priority Date: 11/20/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Mistry, Pranav, Sadi, Sajid, Yao, Lining, Snavely, John
• Primary Examiner(s): Patel, Premal R
• Application Number:
  US14/015,926
• Publication Number:
  US 20140139454A1
• Time in Patent Office: 1,971 Days
• Field of Search: 345173-178
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/041 Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means

Abstract

In one embodiment, a wearable computing device includes one or more sensors, one or more processors, and a memory coupled to the processors that includes instructions executable by the processors. When executing the instructions, the processors detect, by one or more of the sensors of the wearable computing device when worn on a limb of a user, a gesture-recognition-activation event associated with the wearable computing device; detect, by one or more sensors of the wearable computing device when worn on the limb of the user, a movement of the limb; determine a gesture made by the user based at least in part on the movement; and process the gesture as input to the computing wearable computing device.

Claims

1. A wearable device comprising:

one or more sensors;

one or more processors; and

a memory coupled to the processors and comprising instructions executable by the processors, the processors being operable when executing the instructions to;

detect, by a first sensor of the wearable device, a first gesture-related input to the wearable device;

detect, by a second sensor of the wearable device, a second gesture-related input to the wearable device, wherein;

the first gesture-related input is different than the second gesture-related input; and

gesture-related input comprises one or more of the following;

a motion of the wearable device;

an orientation of the wearable device;

a proximity between the wearable device and an object external to the wearable device;

a rotation of a rotatable element of the wearable device;

or

an image of an object in the environment of the wearable device;

analyze the first gesture-related input and the second gesture-related input to determine whether the first gesture-related input and the second gesture-related input correspond to a gesture requiring both inputs; and

in response to a determination that the first gesture-related input and the second gesture-related input correspond to a gesture requiring both inputs, process the gesture as input to the wearable device.

2. The wearable device of claim 1, wherein the orientation of the wearable device comprises a gravity vector associated with the wearable device.

3. The wearable device of claim 1, wherein the gesture-related input further comprises an orientation of the object in the image.

4. The wearable device of claim 3, wherein the object comprises an arm or hand of the user.

5. The wearable device of claim 1, wherein the gesture-related input further comprises a lack of motion of the wearable device.

6. The wearable device of claim 1, wherein the gesture-related input further comprises input from a user on a touch-sensitive display of the wearable device.

7. The wearable device of claim 1, wherein the gesture-related input comprising the motion of the wearable device further comprises a duration of the motion.

8. The wearable device of claim 1, wherein the gesture-related input comprising the motion of the wearable device further comprises an acceleration of the motion.

9. The wearable device of claim 1, wherein the gesture-related input comprising the motion of the wearable device further comprises a distance of the motion.

10. The wearable device of claim 1, wherein at least one of the first gesture-related input or the second gesture-related input is specified at least in part by a setting of a software application associated with the wearable device.

11. The wearable device of claim 1, comprising:

a device body comprising;

a touch-sensitive display;

the rotatable element about the touch-sensitive display; and

an encoder for detecting rotation of the rotatable element;

a band for affixing the device body to a user of the wearable device; and

the sensors, at least one of the sensors comprising an optical sensor in or on the band communicably coupled to the touch-sensitive display.

12. The wearable device of claim 1, wherein:

the object external to the wearable device and the object in the environment of the wearable device comprise a hand of a user of the wearable device;

the first gesture-related input comprises a determination, based on the image, that the hand is covering an optical sensor of the wearable device; and

the second gesture-related input comprises a determination that the hand is near a band of the wearable device.

13. The wearable device of claim 1, wherein:

the processors are further operable when executing the instructions to detect a third gesture-related input to the wearable device;

the first gesture-related input comprises a determination that a hand in the image comprises a first shape;

the second gesture-related input comprises a determination that the wearable device has a first orientation; and

the third gesture-related input comprises a determination of a movement of the hand relative to the wearable device.

14. The wearable device of claim 13, wherein the third gesture-related input further comprises:

a determination that the wearable device moved relative to the hand; and

a determination that the hand moved relative to the wearable device.

15. The wearable device of claim 1, wherein:

the first gesture-related input comprises an orientation of the wearable device; and

the second gesture-related input comprises a movement of the wearable device from the orientation.

16. The wearable device of claim 1, wherein:

the first gesture-related input comprises an orientation of the wearable device; and

the second gesture-related input comprises a motion of the object in the image.

17. The wearable device of claim 16, wherein the object comprises a hand or finger of a user of the wearable device.

18. The wearable device of claim 16, wherein the processors are further operable when executing the instructions to detect a third gesture-related input to the wearable device, the third gesture-related input comprising one or more vibrations generated by the motion of the hand or finger of the user.

19. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

detect, by a first sensor of a wearable device a first gesture-related input to the wearable device;

detect, by a second sensor of the wearable device, a second gesture-related input to the wearable device, wherein;

the first gesture-related input is different than the second gesture-related input; and

gesture-related input comprises one or more of the following;

a motion of the wearable device;

an orientation of the wearable device;

a proximity between the wearable device and an object external to the wearable device;

a rotation of a rotatable element of the wearable device;

or

an image of an object in the environment of the wearable device;

analyze the first gesture-related input and the second gesture-related input to determine whether the first gesture-related input and the second gesture-related input correspond to a gesture requiring both inputs; and

in response to a determination that the first gesture-related input and the second gesture-related input correspond to a gesture requiring both inputs, process the gesture as input to the wearable device.

20. The media of claim 19, wherein the orientation of the wearable device comprises a gravity vector associated with the wearable device.

21. The media of claim 19, wherein the gesture-related input further comprises an orientation of the object in the image.

22. The media of claim 21, wherein the object comprises an arm or hand of the user.

23. The media of claim 19, wherein the gesture-related input further comprises a lack of motion of the wearable device.

24. The media of claim 19, wherein the gesture-related input further comprises input from a user on a touch-sensitive display of the wearable device.

25. The media of claim 19, wherein the gesture-related input comprising the motion of the wearable device further comprises a duration of the motion.

26. The media of claim 19, wherein the gesture-related input comprising the motion of the wearable device further comprises an acceleration of the motion.

27. The media of claim 19, wherein the gesture-related input comprising the motion of the wearable device further comprises a distance of the motion.

28. The media of claim 19, wherein the first gesture-related input or the second gesture-related input is specified at least in part by a setting of a software application associated with the wearable device.

29. The media of claim 19, wherein the wearable device comprises:

a device body comprising;

a touch-sensitive display;

the rotatable element about the touch-sensitive display; and

an encoder for detecting rotation of the rotatable element;

a band for affixing the device body to a user of the wearable device; and

the sensors, at least one of the sensors comprising an optical sensor in or on the band communicably coupled to the touch-sensitive display.

30. A method comprising:

detecting, by a first sensor of a wearable device, a first gesture-related input to the wearable device;

detecting, by a second sensor of the wearable device, a second gesture-related input to the wearable device, wherein;

the first gesture-related input is different than the second gesture-related input; and

gesture-related input comprises one or more of the following;

a motion of the wearable device;

an orientation of the wearable device;

a proximity between the wearable device and an object external to the wearable device;

a rotation of a rotatable element of the wearable device;

or

an image of an object in the environment of the wearable device;

analyzing the first gesture-related input and the second gesture-related input to determine whether the first gesture-related input and the second gesture-related input correspond to a gesture requiring both inputs; and

in response to a determination that the first gesture-related input and the second gesture-related input correspond to a gesture requiring both inputs, processing the gesture as input to the wearable device.

31. The method of claim 30, wherein the orientation of the wearable device comprises a gravity vector associated with the wearable device.

32. The method of claim 30, wherein the gesture-related input further comprises an orientation of the object in the image.

33. The method of claim 32, wherein the object comprises an arm or hand of the user.

34. The method of claim 30, wherein the gesture-related input further comprises a lack of motion of the wearable device.

35. The method of claim 30, wherein the gesture-related input further comprises input from a user on a touch-sensitive display of the wearable device.

36. The method of claim 30, wherein by the gesture-related input comprising the motion of the wearable device further comprises a duration of the motion.

37. The method of claim 30, wherein the gesture-related input comprising the motion of the wearable device further comprises an acceleration of the motion.

38. The method of claim 30, wherein the gesture-related input comprising the motion of the wearable device further comprises a distance of the motion.

39. The method of claim 30, wherein at least one of the first gesture-related input or the second gesture-related input is specified at least in part by a setting of a software application associated with the wearable device.

40. The method of claim 30, wherein the wearable device comprises:

a device body comprising;

a touch-sensitive display;

the rotatable element about the touch-sensitive display; and

an encoder for detecting rotation of the rotatable element;

a band for affixing the device body to a user of the wearable device; and

the sensors, at least one of the sensors comprising an optical sensor in or on the band communicably coupled to the touch-sensitive display.