Motion and gesture input from a wearable device
First Claim
Patent Images
1. A method of detecting hand gestures performed by a user of an electronic device including a plurality of photodiodes, the method comprising:
- during a first period in which the user performs a first hand gesture, collecting first sensor data from the plurality of photodiodes, the first sensor data indicative of tissue movement caused by the first hand gesture;
during a second period in which the user performs a second hand gesture, collecting second sensor data from the plurality of photodiodes, the second sensor data indicative of tissue movement caused by the second hand gesture;
calculating first optical signal characteristics based on the first sensor data and second optical signal characteristics based on the second sensor data;
assigning some or all of the first optical signal characteristics to a first cluster of optical signal characteristics;
assigning some or all of the second optical signal characteristics to a second cluster of optical signal characteristics;
during a third period, collecting third sensor data from the plurality of photodiodes;
calculating third optical signal characteristics based on the third sensor data;
determining whether the third optical signal characteristics belong to the first cluster, the second cluster, or a third cluster;
in accordance with a determination that the third optical signal characteristics belong to the first cluster, determining that the user has performed the first hand gesture;
in accordance with a determination that the third optical signal characteristics belong to the second cluster, determining that the user has performed the second hand gesture; and
in accordance with a determination that the third optical signal characteristics belong to the third cluster, determining that the user has not performed the first hand gesture or the second hand gesture,wherein each cluster is formed by the respective optical signal characteristics having proximate values.
1 Assignment
0 Petitions
Accused Products
Abstract
This disclosure relates to detecting hand gesture input using an electronic device, such as a wearable device strapped to a wrist. The device can have multiple photodiodes, each sensing light at a different position on a surface of the device that faces skin of a user. Examples of the disclosure detect hand gestures by recognizing patterns in sensor data that are characteristic of each hand gesture, as the tissue expands and contracts and anatomical features in the tissue move during the gesture.
59 Citations
20 Claims
-
1. A method of detecting hand gestures performed by a user of an electronic device including a plurality of photodiodes, the method comprising:
-
during a first period in which the user performs a first hand gesture, collecting first sensor data from the plurality of photodiodes, the first sensor data indicative of tissue movement caused by the first hand gesture; during a second period in which the user performs a second hand gesture, collecting second sensor data from the plurality of photodiodes, the second sensor data indicative of tissue movement caused by the second hand gesture; calculating first optical signal characteristics based on the first sensor data and second optical signal characteristics based on the second sensor data; assigning some or all of the first optical signal characteristics to a first cluster of optical signal characteristics; assigning some or all of the second optical signal characteristics to a second cluster of optical signal characteristics; during a third period, collecting third sensor data from the plurality of photodiodes; calculating third optical signal characteristics based on the third sensor data; determining whether the third optical signal characteristics belong to the first cluster, the second cluster, or a third cluster; in accordance with a determination that the third optical signal characteristics belong to the first cluster, determining that the user has performed the first hand gesture; in accordance with a determination that the third optical signal characteristics belong to the second cluster, determining that the user has performed the second hand gesture; and in accordance with a determination that the third optical signal characteristics belong to the third cluster, determining that the user has not performed the first hand gesture or the second hand gesture, wherein each cluster is formed by the respective optical signal characteristics having proximate values. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A non-transitory computer readable medium, the computer readable medium containing instructions, that, when executed, perform a method comprising:
-
during a first period in which a user performs a first hand gesture, collecting first sensor data from a plurality of photodiodes, the first sensor data indicative of tissue movement caused by the first hand gesture; during a second period in which the user performs a second hand gesture, collecting second sensor data from the plurality of photodiodes, the second sensor data indicative of tissue movement caused by the second hand gesture; calculating first optical signal characteristics based on the first sensor data and second optical signal characteristics based on the second sensor data; assigning some or all of the first optical signal characteristics to a first cluster of optical signal characteristics; assigning some or all of the second optical signal characteristics to a second cluster of optical signal characteristics; during a third period, collecting third sensor data from the plurality of photodiodes; calculating third optical signal characteristics based on the third sensor data; determining whether the third optical signal characteristics belong to the first cluster, the second cluster, or a third cluster; in accordance with a determination that the third optical signal characteristics belong to the first cluster, determining that the user has performed the first hand gesture; in accordance with a determination that the third optical signal characteristics belong to the second cluster, determining that the user has performed the second hand gesture; and in accordance with a determination that the third optical signal characteristics belong to the third cluster, determining that the user has not performed the first hand gesture or the second hand gesture, wherein each cluster is formed by the respective optical signal characteristics having proximate values. - View Dependent Claims (16, 17, 18, 19)
-
-
20. An electronic device comprising:
-
one or more processors; memory; a plurality of photodiodes; and one or more programs, wherein the one or more programs are stored in the memory and are configured to be executed by the one or more processors, which when executed by the one or more processors, cause the electronic device to perform a method comprising; during a first period in which a user performs a first hand gesture, collecting first sensor data from the plurality of photodiodes, the first sensor data indicative of tissue movement caused by the first hand gesture; during a second period in which the user performs a second hand gesture, collecting second sensor data from the plurality of photodiodes, the second sensor data indicative of tissue movement caused by the second hand gesture; calculating first optical signal characteristics based on the first sensor data and second optical signal characteristics based on the second sensor data; assigning some or all of the first optical signal characteristics to a first cluster of optical signal characteristics; assigning some or all of the second optical signal characteristics to a second cluster of optical signal characteristics; during a third period, collecting third sensor data from the plurality of photodiodes; calculating third optical signal characteristics based on the third sensor data; determining whether the third optical signal characteristics belong to the first cluster, the second cluster, or a third cluster; in accordance with a determination that the third optical signal characteristics belong to the first cluster, determining that the user has performed the first hand gesture; in accordance with a determination that the third optical signal characteristics belong to the second cluster, determining that the user has performed the second hand gesture; and in accordance with a determination that the third optical signal characteristics belong to the third cluster, determining that the user has not performed the first hand gesture or the second hand gesture, wherein each cluster is formed by the respective optical signal characteristics having proximate values.
-
Specification