Methods and Apparatus for Recognition of Start and/or Stop Portions of a Gesture Using an Auxiliary Sensor
First Claim
Patent Images
1. An apparatus capable of interacting with at least one controllable device based upon a pose of at least a portion of a human body, the apparatus comprising:
- one or more sensors that are sized for wearing on the human body, each of the one or more sensors emitting sensor data;
an auxiliary sensor sized for wearing on the human body that receives a first specific input based on one of a tactile switch and capacitive touch input and generates a gesture start signal; and
a detection unit that operates upon the sensor data to determine the pose of at least the portion of the human body and is capable of interacting with the at least one controllable device, the detection unit including;
a memory that stores at least one or more characteristics of human anatomy that are associated with the human body using at least a partial skeletal rendering of a human; and
a detection processor, automatically operating under software control, that inputs, aggregates and fuses the sensor data from each of the one or more sensors using the at least one or more characteristics of human anatomy stored in the memory to determine the pose of at least the portion of the human body based upon a locality of said one or more sensors, wherein the detection processor begins to input, aggregate and fuse the sensor data upon receipt of the gesture start signal and ceases to input the sensor data upon receipt of a gesture stop signal;
wherein at least some of the one or more sensors, the auxiliary sensor, and the detection unit are packaged in an integrated mechanical assembly.
1 Assignment
0 Petitions
Accused Products
Abstract
Described are apparatus and methods for reconstructing a gesture by aggregating various data from various sensors, including data for recognition of start and/or stop portions of the gesture using an auxiliary sensor, such as a capacitive touch sensor or a MEMS sensor,
In a specific embodiment, power savings features are included to preserve the energy stored on the battery of a sensing device, which power savings features are enhanced using an auxiliary sensor, such as a capacitive touch sensor or a MEMS sensor.
-
Citations
21 Claims
-
1. An apparatus capable of interacting with at least one controllable device based upon a pose of at least a portion of a human body, the apparatus comprising:
-
one or more sensors that are sized for wearing on the human body, each of the one or more sensors emitting sensor data; an auxiliary sensor sized for wearing on the human body that receives a first specific input based on one of a tactile switch and capacitive touch input and generates a gesture start signal; and a detection unit that operates upon the sensor data to determine the pose of at least the portion of the human body and is capable of interacting with the at least one controllable device, the detection unit including; a memory that stores at least one or more characteristics of human anatomy that are associated with the human body using at least a partial skeletal rendering of a human; and a detection processor, automatically operating under software control, that inputs, aggregates and fuses the sensor data from each of the one or more sensors using the at least one or more characteristics of human anatomy stored in the memory to determine the pose of at least the portion of the human body based upon a locality of said one or more sensors, wherein the detection processor begins to input, aggregate and fuse the sensor data upon receipt of the gesture start signal and ceases to input the sensor data upon receipt of a gesture stop signal; wherein at least some of the one or more sensors, the auxiliary sensor, and the detection unit are packaged in an integrated mechanical assembly. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. An method for interacting with at least one controllable device based upon a pose of at least a portion of a human body, the method comprising:
-
sensing, using one or more sensors that are sized for wearing on the human body, sensor data from each of the one or more sensors; sensing, using an auxiliary sensor sized for wearing on the human body a first specific input based on one of a tactile switch and capacitive touch input and generating a gesture start signal; and determining the pose of at least the portion of the human body based upon the sensor data, under processor and software control, the step of determining operating to; associate at least one or more characteristics of human anatomy with the human body using at least a partial skeletal rendering of a human; and automatically determine, under the processor and software control the pose of at least the portion of the human body based upon a locality of said one or more sensors and the input from the auxiliary sensor, the step of automatically determining including inputting, aggregating and fusing the sensor data from each of the one or more sensors using the at least one or more characteristics of human anatomy to determine the pose, wherein the step of automatically determining begins to input, aggregate and fuse the sensor data upon receipt of the gesture start signal and ceases to input the sensor data upon receipt of a gesture stop signal, and wherein the at least one or more characteristics of human anatomy that are associated with the human body that are stored in the memory include at least one of (a) a range of motion of human skeletal joints and (b) limitations in the speed human bones can move relative to each other; and wherein at least some of the one or more sensors, the auxiliary sensor, he processor and the software are packaged in an integrated detection unit mechanical assembly. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
Specification