Trainable sensor-based gesture recognition
First Claim
1. A method of performing an action associated with a gesture performed by a user of a device having a processor and a sensor providing a sensor output, the method comprising:
- executing on the processor instructions that cause the device to;
transition the device to a training mode upon receiving, from the user, a training start, request;
during the training mode;
while the user performs the gesture, monitor the sensor to detect an identified sensor output identifying the gesture during a training period between the training start request and the training completion request;
identify, during the training period, a restricted period that is shorter than the training period and during which the identified sensor output identifies the gesture;
associate with the gesture the identified sensor output of the sensor during the restricted period; and
associate an action with the gesture;
transition the device to a recognition mode upon receiving, from the user, a training completion request; and
during the recognition mode;
monitor the sensor output of the sensor; and
upon detecting that the sensor output matches the identified sensor output associated with the gesture, perform the action associated with the gesture.
3 Assignments
0 Petitions
Accused Products
Abstract
In many computing scenarios, a device comprises at least one sensor, and is configured to recognize a gesture performed by a user according to the sensor output of the sensor, and to perform a particular action upon recognizing the gesture. However, many devices are preconfigured with such gestures, and the recognition is specific to the sensors of the device, and is not specific to the manner in which a particular user performs the gesture. Presented herein are techniques for enabling a device to recognize a new gesture by monitoring the sensor output of any sensors provided by the device while the user performs the gesture, optionally requesting repeated gesture performances until reaching a recognition confidence. Once trained to recognize the gesture according to the sensor outputs of the particular sensors of the device, the device may subsequently recognize the gesture performed by the user and execute an associated action.
-
Citations
20 Claims
-
1. A method of performing an action associated with a gesture performed by a user of a device having a processor and a sensor providing a sensor output, the method comprising:
executing on the processor instructions that cause the device to; transition the device to a training mode upon receiving, from the user, a training start, request; during the training mode; while the user performs the gesture, monitor the sensor to detect an identified sensor output identifying the gesture during a training period between the training start request and the training completion request; identify, during the training period, a restricted period that is shorter than the training period and during which the identified sensor output identifies the gesture; associate with the gesture the identified sensor output of the sensor during the restricted period; and associate an action with the gesture; transition the device to a recognition mode upon receiving, from the user, a training completion request; and during the recognition mode; monitor the sensor output of the sensor; and upon detecting that the sensor output matches the identified sensor output associated with the gesture, perform the action associated with the gesture. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
13. A device that performs actions associated with gestures performed by a user, the device comprising:
-
a memory; at least two sensors providing at least two sensor outputs; a gesture trainer that; while the user performs the gesture, monitors the at least two sensors to detect one or more identified sensor outputs identifying the gesture, the detecting the one or more identified sensor output comprises; identifying, at least one recognizing sensor providing an identified sensor output identifying the gesture; and identifying at least one non-recognizing sensor that does not provide an identified sensor output identifying the gesture; and stores in the memory the one or more identified sensor outputs that together identify the gesture, the storing excluding, the identified sensor output of the at least one non-recognizing sensor; an action associator that, upon receiving from the user an action to be associated with the gesture, stores in the memory an association of the action with the gesture; and a gesture recognizer that; monitors the at least two sensor outputs of the at least two sensors to detect the one or more identified sensor outputs identifying the gesture; and performs the action associated in the memory with the gesture associated with the one or more identified sensor outputs. - View Dependent Claims (14, 15)
-
-
16. A tangible computer-readable memory device storing instructions that, when executed on a processor of a computing device having a sensor, cause the computing device to perform actions associated with gestures performed by a user, by:
-
transitioning to a training mode upon receiving. from the user, a training start request; during the training mode; while the user performs the gesture, monitoring the sensor to detect an identified sensor output identifying the gesture during a training period between the training start request and the training completion request; identifying, during the training, period, a restricted period that is shorter than the training period and during which the identified sensor output identifies the gesture; associating with the gesture the identified sensor output of the sensor during the restricted period; and associating an action with the gesture; transitioning to a recognition mode upon receiving, from the user, a training completion request; and during the recognition mode; monitoring the sensor output of the sensor; and upon detecting that the sensor output matches the identified sensor output associated with the gesture, performing the action associated with the gesture. - View Dependent Claims (17, 18, 19, 20)
-
Specification