HANDHELD COMPUTER SYSTEMS AND TECHNIQUES FOR CHARACTER AND COMMAND RECOGNITION RELATED TO HUMAN MOVEMENTS
First Claim
1. A handheld device, comprising:
- inertial sensors including a gyroscope and an accelerometer for providing data related to a trajectory of a movement of the handheld device; and
a processor coupled to the handheld device and operational in a training mode and a recognition mode,wherein in the training mode, the processor receives the data from the inertial sensors, converts the data into a first set of values corresponding to a first plurality of discreet features, associate the first set of values with a command or a character, and stores the first set of values and the command or character in a training database, andwherein in the recognition mode, the processor receives the data from the inertial sensors, converts the data into a second set of values corresponding to a plurality of second discreet features, compares the second set of values to a plurality of training sets of values in the training device including the second set of values, matches the first set of values to the second set of values, and executes the command or displaying the character.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for human hand gesture recognition through a training mode and a recognition mode are disclosed. In the training mode, a user can move a handheld device with a hand gesture intended to represent a command. Sensors within the handheld device can record raw data, which can be processed to obtain a set of values corresponding to a set of discrete features, which is stored in a database and associated with the intended command. The process is repeated for various hand gestures representing different commands. In the recognition mode, the user can move the handheld device with a hand gesture. A computer system can compare a set of values corresponding to a set of discrete features derived from the hand gesture with the sets of values stored in the database, select a command with the closest match and displays and/or executes the command.
-
Citations
44 Claims
-
1. A handheld device, comprising:
-
inertial sensors including a gyroscope and an accelerometer for providing data related to a trajectory of a movement of the handheld device; and a processor coupled to the handheld device and operational in a training mode and a recognition mode, wherein in the training mode, the processor receives the data from the inertial sensors, converts the data into a first set of values corresponding to a first plurality of discreet features, associate the first set of values with a command or a character, and stores the first set of values and the command or character in a training database, and wherein in the recognition mode, the processor receives the data from the inertial sensors, converts the data into a second set of values corresponding to a plurality of second discreet features, compares the second set of values to a plurality of training sets of values in the training device including the second set of values, matches the first set of values to the second set of values, and executes the command or displaying the character. - View Dependent Claims (2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14)
-
-
7. (canceled)
-
15. A method for gesture recognition comprising:
-
entering a training mode, wherein the training mode comprises; obtaining first training data related to a first trajectory of a first movement of a handheld device by using a gyroscope; converting the first training data into first values corresponding to a first set of a plurality of discrete features; associating the first values with a first command or a first character; saving the first values and the first command or the first character in a database; obtaining second training data related to a second trajectory of a second movement of the handheld device by using the gyroscope; converting the second training data into second values corresponding to a second set of the plurality of discrete features; associating the second values with a second command or a second character; and saving the second values and the second command or second character in the database; and entering a recognition mode, comprising; obtaining trajectory data related to a third trajectory of a third movement of the handheld device by using the gyroscope; converting the third trajectory data into third values corresponding to a third set of the plurality of discrete features; comparing the third values with the first values and the second values stored in the database; matching the third values with the first values or the second values; and displaying the first character or the second character or executing the first command or the second command based on the matching, wherein the first data, the second data, and the trajectory data are related to rotational and linear movements of the handheld device. - View Dependent Claims (16, 17, 18, 19)
-
-
20. A handheld device, comprising:
-
a gyroscope; an accelerometer; a compass, wherein the gyroscope, the accelerometer and the compass provide data related to a trajectory of a movement of the handheld device; a processor coupled to the gyroscope, the accelerometer and the compass configured to receive the data from the gyroscope, the accelerometer and the compass; a programmable module coupled to the processor that includes a look up table that associates a plurality of discreet features with a plurality of characters or commands; and a memory coupled to the processor including a database that stores a plurality of sets of values corresponding to the plurality of discrete features associated with the plurality of characters or commands;
whereinthe processor is operable in a training mode to populate the database by receiving a first data from the gyroscope, the accelerometer, and the compass, converting the first data into a first set of values corresponding to a first plurality of discreet features, consulting the look up table and associating the first set of values with a first command or a character based on the first plurality of discreet features, and storing the first set of values and the command or character in the database, and the processor is operable in a recognition mode to determine a tilt of the handheld device, receive a second data from the gyroscope, the accelerometer, and the compass, convert the second data into a second set of values corresponding to a second plurality of discreet features based on the tilt of the handheld device, matching the second set of values to one of the plurality of sets of values in the database, and displaying the associated character or executing the associated command. - View Dependent Claims (21)
-
-
22. A method for authentication a user comprising:
-
obtaining a first information from a gyroscope related to a first trajectory of a first movement of a handheld device; populating a training database with the first information from the first trajectory and authentication information for a user; obtaining a second information from the gyroscope related to a second trajectory of a second movement of the handheld device; comparing the second information with the database; and authenticating the user based on the comparison. - View Dependent Claims (23, 24)
-
-
25. A handheld device, comprising:
-
a first processor; a first component coupled to the first processor, wherein the first component is in a sleep mode; a first programmable module that stores a look up table that associates a plurality of movements with a plurality of commands; and a gyroscope that provides first information related to a first movement of the handheld device to the first processor, wherein the first processor receives the first information from the gyroscope, determines the first movement, consults the loop up table and matches the first movement to a first command from the plurality of commands, and causes the first component to enter into an active mode of operation from the sleep mode in response to the first movement. - View Dependent Claims (27, 28, 29, 30, 31, 32, 33)
-
-
26. (canceled)
-
34. A method for managing power for a handheld device, comprising:
-
receiving first information from a gyroscope regarding a first movement of a handheld device at a microprocessor; switching a first processor associated with the microprocessor from a sleep mode of operation to an active mode of operation; consulting a look up table comprising a plurality of movements associated with a plurality of commands; matching the first movement to a first command from the plurality of commands; switching a first component to an active mode of operations in response to the command, wherein the command is a trigger to switch from the sleep mode to the active mode. - View Dependent Claims (35, 37, 38, 39, 40, 41)
-
-
36. (canceled)
-
42. A method for managing power for a mobile phone, comprising:
-
detecting a first position of a mobile phone by using a gyroscope; consulting a look up table and matching the first position with a first command; causing a component of the mobile phone to enter into a sleep mode of operation in response to the first command; detecting a second position of the mobile phone by using the gyroscope; consulting the look up table and matching the second position with a second command; causing the component of the mobile phone to enter into an active mode of operation in response to the second command. - View Dependent Claims (43)
-
-
44. (canceled)
Specification