User gesture input to wearable electronic device involving outward-facing sensor of device

• US 9,477,313 B2
• Filed: 08/30/2013
• Issued: 10/25/2016
• Est. Priority Date: 11/20/2012
• Status: Active Grant

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Mistry, Pranav, Sadi, Sajid, Yao, Lining, Snavely, John
• Primary Examiner(s): PATEL, PREMAL R
• Application Number:
  US14/015,909
• Publication Number:
  US 20140139422A1
• Time in Patent Office: 1,152 Days
• Field of Search: 345/156
• US Class Current: 1/1
• CPC Class Codes: G04C 3/002 Position, e.g. inclination dependent switches
• CPC Class Codes: G04G 17/04 Mounting of electronic components
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/014 Hand-worn input/output arrangements, e.g. data gloves
• CPC Class Codes: G06F 3/015 Input arrangements based on nervous system activity detection, e.g. brain waves [EEG] detection, electromyograms [EMG] detection, electrodermal response detection
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/03547 Touch pads, in which fingers can move on a surface
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04883 for inputting data by handwriting, e.g. gesture or text

Abstract

In one embodiment, a wearable apparatus includes a sensor, a processor coupled to the sensor, and a memory coupled to the processor that includes instructions executable by the processor. When executing the instructions, the processor detects by the sensor movement of at least a portion of an arm of a user; detects, based at least in part on the movement, a gesture made by the user; and processes the gesture as input to the wearable apparatus.

Claims

1. A wearable apparatus comprising:

an optical sensor;

a processor coupled to the optical sensor; and

memory coupled to the processor that comprises instructions executable by the processor, the processor being operable when executing the instructions to;

determine an orientation of the wearable apparatus;

compare the orientation of the wearable apparatus to a predetermined orientation; and

in response to a determination that the orientation of the wearable apparatus corresponds to the predetermined orientation;

detect by the optical sensor at least a portion of a hand of a user;

determine, at least in part based on output from the optical sensor, that the hand detected by the optical sensor is holding a tangible object;

detect, at least in part by the optical sensor, the tangible object held by the hand of the user;

detect, at least in part by the optical sensor, a movement of the tangible object; and

process the movement of the tangible object as input to the wearable apparatus.

2. The wearable apparatus of claim 1, wherein the wearable apparatus is worn on the arm attached to the other hand of the user.

3. The wearable apparatus of claim 1, wherein the processor is further operable when executing the instructions to provide, based on the input, output for display on a display of another device.

4. The wearable apparatus of claim 1, wherein the portion of the hand comprises at least one finger.

5. The wearable apparatus of claim 1, wherein the processor is further operable when executing the instructions to:

detect by the optical sensor a lack of movement of at least a portion of the tangible object; and

process the lack of movement of the tangible object as input to the wearable apparatus.

6. The wearable apparatus of claim 1, wherein the processor is further operable when executing the instructions to process the movement based at least in part on a duration of the movement.

7. The wearable apparatus of claim 1, wherein the processor is further operable when executing the instructions to:

output, based on the input, content on a display of the wearable device.

8. The wearable apparatus of claim 1, wherein the processor is further operable when executing the instructions to:

detect an orientation of the tangible object; and

process the movement based at least in part on the orientation.

9. The wearable apparatus of claim 8, wherein detecting an orientation of the tangible object comprises:

detecting an initial orientation of the tangible object; and

detecting a subsequent orientation of the tangible object.

10. The wearable apparatus of claim 1, wherein the processor is further operable to process the input based at least in part on a setting specified by a software application associated with the wearable apparatus.

11. The wearable apparatus of claim 1, wherein the processor is further operable to:

detect a tangible surface nearby the tangible object;

detect the movement of the tangible object relative to the surface; and

process the relative movement as the input.

12. The wearable apparatus of claim 11, wherein the processor is further operable to process the tangible surface as a virtual keyboard or a virtual display.

13. The wearable apparatus of claim 1, comprising:

a device body comprising;

a touch-sensitive display;

a rotatable element about the touch-sensitive display; and

an encoder for detecting rotation of the rotatable element;

a band for affixing the device body to the user; and

the optical sensor, comprising the optical sensor in or on the band communicably coupled to the touch-sensitive display.

14. One or more computer-readable non-transitory storage media embodying software that is operable when executed to:

determine an orientation of a wearable apparatus;

compare the orientation of the wearable apparatus to a predetermined orientation; and

in response to a determination that the orientation of the wearable apparatus corresponds to the predetermined orientation;

detect, by an optical sensor of the wearable computing apparatus, at least a portion of a hand of a user;

determine, at least in part based on output from the optical sensor, that the hand detected by the optical sensor is holding a tangible object;

detect, at least in part by the optical sensor, the tangible object held by the hand of the user;

detect, at least in part by the optical sensor, a movement of the tangible object; and

process the movement of the tangible object as input to the wearable apparatus.

15. The media of claim 14, wherein the wearable apparatus is worn on the arm attached to the other hand of the user.

16. The media of claim 14, wherein the software is further operable when executed to provide, based on the input, output for display on a display of another device.

17. The media of claim 14, wherein the portion of the hand comprises at least one finger.

18. The media of claim 14, wherein the software is further operable when executed to:

detect by the optical sensor a lack of movement of at least a portion of the tangible object; and

process the lack of movement of the tangible object as input to the wearable apparatus.

19. The media of claim 14, wherein the software is further operable when executed to process the movement based at least in part on a duration of the movement.

20. The media of claim 14, wherein the software is further operable when executed to:

output, based on the input, content on a display of the wearable apparatus.

21. The media of claim 14, wherein the software is further operable when executed to:

detect an orientation of the tangible object; and

process the movement based at least in part on the orientation.

22. The media of claim 21, wherein, to detect an orientation of the tangible object, the software is operable when executed to:

detect an initial orientation of the tangible object; and

detect a subsequent orientation of the tangible object.

23. The media of claim 14, wherein the software is further operable when executed to process the input based at least in part on a setting specified by a software application associated with the wearable apparatus.

24. The media of claim 14, wherein the software is further operable when executed to:

detect a tangible surface nearby the tangible object;

detect the movement of the tangible object relative to the surface; and

process the relative movement as the input.

25. The media of claim 24, wherein:

the software is further operable when executed to process the tangible surface as a virtual keyboard or a virtual display.

26. The media of claim 14, wherein the wearable computing device comprises:

a device body comprising;

a touch-sensitive display;

a rotatable element about the touch-sensitive display; and

an encoder for detecting rotation of the rotatable element;

a band for affixing the device body to the user; and

the optical sensor in or on the band communicably coupled to the touch-sensitive display.

27. A method comprising:

determining an orientation of a wearable apparatus;

comparing the orientation of the wearable apparatus to a predetermined orientation; and

in response to a determination that the orientation of the wearable apparatus corresponds to the predetermined orientation;

detecting, by an optical sensor of the wearable computing device, at least a portion of a hand of a user;

determining, at least in part based on output from the optical sensor, that the hand detected by the sensor is holding the tangible object;

detecting, at least in part by the optical sensor, a tangible object held by the hand of the user;

detecting, at least in part by the optical sensor, a movement of the tangible object; and

processing the movement of the tangible object as input to the wearable device.

28. The method of claim 27, wherein the wearable computing device is worn on the arm attached to the other hand of the user.

29. The method of claim 27, further comprising providing, based on the input, output for display on a display of another device.

30. The method of claim 27, wherein the portion of the hand comprises at least one finger.

31. The method of claim 27, further comprising detecting by the optical sensor a lack of movement of at least some of the portion of the tangible object;

and

processing the lack of movement of the tangible object as input to the wearable apparatus.

32. The method of claim 27, wherein the movement is based at least in part on a duration of the movement.

33. The method of claim 27, further comprising outputting, based on the input, content on a display of the wearable device.

34. The method of claim 27, further comprising detecting an orientation of the portion of the tangible object, wherein the input is further based at least in part on the orientation.

35. The method of claim 34, wherein detecting an orientation of the portion of the arm of the user comprises:

detecting an initial orientation of the tangible object; and

detecting a subsequent orientation of the tangible object.

36. The method of claim 27, further comprising processing the input based at least in part on a setting specified by a software application associated with the wearable device.

37. The method of claim 27, further comprising:

detecting a tangible surface nearby the tangible object;

detecting the movement of the tangible object relative to the surface; and

processing the relative movement as the input.

38. The method of claim 37, further comprising processing the tangible surface as a virtual keyboard or a virtual display.

39. The method of claim 27, wherein the wearable computing device comprises:

a device body comprising;

a touch-sensitive display;

a rotatable element about the touch-sensitive display; and

an encoder for detecting rotation of the rotatable element;

a band for affixing the wearable computing device body to the user; and

the optical sensor, comprising the optical sensor in or on the band communicably coupled to the touch-sensitive display.