SYSTEM AND METHOD FOR DETERMINING 3D ORIENTATION OF A POINTING DEVICE
First Claim
1. A handheld device comprising:
- a sensor for generating a first output associated with motion associated of said handheld device;
an accelerometer for detecting acceleration of said handheld device and outputting at least one second output; and
a processing unit for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including calculating;
3 Assignments
0 Petitions
Accused Products
Abstract
The present invention is directed toward a system and process that controls a group of networked electronic components using a multimodal integration scheme in which inputs from a speech recognition subsystem, gesture recognition subsystem employing a wireless pointing device and pointing analysis subsystem also employing the pointing device, are combined to determine what component a user wants to control and what control action is desired. In this multimodal integration scheme, the desired action concerning an electronic component is decomposed into a command and a referent pair. The referent can be identified using the pointing device to identify the component by pointing at the component or an object associated with it, by using speech recognition, or both. The command may be specified by pressing a button on the pointing device, by a gesture performed with the pointing device, by a speech recognition event, or by any combination of these inputs.
12 Citations
16 Claims
-
1. A handheld device comprising:
-
a sensor for generating a first output associated with motion associated of said handheld device; an accelerometer for detecting acceleration of said handheld device and outputting at least one second output; and a processing unit for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including calculating;
-
-
2. A system comprising:
-
(a) a handheld device including; a sensor for generating a first output associated with motion associated of said handheld device; and an accelerometer for detecting acceleration of said handheld device and outputting at least one second output; and (b) a processing unit for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including calculating;
-
-
3. A method comprising:
-
generating, from a first sensor, a first output associated with motion associated of a handheld device; detecting, by a second sensor, acceleration of said handheld device and outputting at least one second output; and processing said first output and said at least one second output, said processing including calculating;
-
-
4. A pointing device comprising:
-
a sensor for generating a first output associated with motion associated of said pointing device; an accelerometer for detecting acceleration of said pointing device and outputting at least one second output; and a microcontroller for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including calculating a rotation matrix value for the pointing device based on pitch of the pointing device and sensor values associated with at least one of said first output and said at least one second output, wherein the pitch is associated with an orientation in which said pointing device is being held.
-
-
5. A system comprising:
-
(a) a pointing device including; a sensor for generating a first output associated with motion associated of said pointing device; and an accelerometer for detecting acceleration of said pointing device and outputting at least one second output; and (b) a microcontroller for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including calculating a rotation matrix value for the pointing device based on pitch of the pointing device and sensor values associated with at least one of said first output and said at least one second output, wherein the pitch is associated with an orientation in which said pointing device is being held.
-
-
6. A method comprising:
-
generating, from a first sensor, a first output associated with motion associated of a pointing device; detecting, by a second sensor, acceleration of said pointing device and outputting at least one second output; and processing said first output and said at least one second output, said processing including calculating a rotation matrix value for the pointing device based on pitch of the pointing device and sensor values associated with at least one of said first output and said at least one second output, wherein the pitch is associated with an orientation in which said pointing device is being held.
-
-
7. A system comprising:
-
(a) a handheld device including; a sensor for generating a first output associated with motion of said handheld device; and an accelerometer for detecting acceleration of said handheld device and outputting at least one second output; and (b) a processing unit for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including; determining an orientation in which said handheld device is held using said at least one second output; and compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of said orientation.
-
-
8. A method comprising:
-
generating, from a first sensor, a first output associated with motion of a handheld device; detecting, by a second sensor, acceleration of said handheld device and outputting at least one second output; and processing said first output and said at least one second output, said processing including; determining an orientation in which said handheld device is held using said at least one second output; and compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of said orientation.
-
-
9. A system comprising:
-
(a) a pointing device including; a sensor for generating a first output associated with motion of said pointing device; and an accelerometer for detecting acceleration of said pointing device and outputting at least one second output; and (b) a microcontroller for receiving and processing said first output from said sensor and said at least one second output from said accelerometer, said processing including; determining an orientation in which said pointing device is held using said at least one second output; and correcting said first output based on said determined orientation by performing a two-dimensional rotation normalization on said first output to generate an output which is substantially independent of said orientation.
-
-
10. A method comprising:
-
generating, from a first sensor, a first output associated with motion of a pointing device; detecting, by a second sensor, acceleration of said pointing device and outputting at least one second output; and processing said first output and said at least one second output, said processing including; determining an orientation in which said pointing device is held using said at least one second output; and correcting said first output based on said determined orientation by performing a two-dimensional rotation normalization on said first output to generate an output which is substantially independent of said orientation.
-
-
11. A method for using a free space pointing device comprising the steps of:
-
detecting movement of said free space pointing device using an accelerometer and at least one other sensor; determining an orientation, in which said free space pointing device is held, based on an output of said accelerometer; compensating said at least one other sensor'"'"'s detected movement based on said determined orientation by performing a two-dimensional rotational transform on said at least one other sensor'"'"'s detected movement to generate an output which is substantially independent of a tilt of said free space pointing device with reference to a predetermined axis; and determining a gesture associated with the detected movement.
-
-
12. A handheld device comprising:
-
a sensor configured to generate a first output associated with motion of said handheld device; an accelerometer configured to detect acceleration of said handheld device and outputting at least one second output; and a processing unit configured to receive and process said first output from said sensor and said at least one second output from said accelerometer, said process including; determining an orientation in which said handheld device is held using said at least one second output; compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of a tilt of said handheld device with reference to a predetermined axis; and determining a gesture associated with the detected movement.
-
-
13. A method comprising:
-
generating, from a first sensor, a first output associated with motion of a handheld device; detecting, by a second sensor, acceleration of said handheld device and outputting at least one second output; and processing said first output and said at least one second output, said processing including; determining an orientation in which said handheld device is held using said at least one second output; compensating said first output based on said determined orientation by performing a two-dimensional rotational transform on said first output to generate an output which is substantially independent of a tilt of said handheld device with reference to a predetermined axis; and determining a gesture associated with the motion of the handheld device.
-
-
14. A method for using a pointing device comprising the steps of:
-
detecting movement of said pointing device using an accelerometer and at least one other sensor; determining an orientation, in which said pointing device is held, based on an output of said accelerometer; correcting said at least one other sensor'"'"'s detected movement based on said determined orientation by performing a two-dimensional rotational normalization on said at least one other sensor'"'"'s detected movement to generate an output which is substantially independent of a pitch of said pointing device with reference to a predetermined axis; and recognizing a gesture associated with the detected movement.
-
-
15. A pointing device comprising:
-
a sensor configured to generate a first output associated with motion of said pointing device; an accelerometer configured to detect acceleration of said pointing device and outputting at least one second output; and a microcontroller configured to receive and process said first output from said sensor and said at least one second output from said accelerometer, said process including; determining an orientation in which said pointing device is held using said at least one second output; correcting said first output based on said determined orientation by performing a two-dimensional rotational normalization on said first output to generate an output which is substantially independent of a pitch of said pointing device with reference to a predetermined axis; and recognizing a gesture associated with the motion of the pointing device.
-
-
16. A method comprising:
-
generating, from a first sensor, a first output associated with motion of a pointing device; detecting, by a second sensor, acceleration of said pointing device and outputting at least one second output; and processing said first output and said at least one second output, said processing including; determining an orientation in which said pointing device is held using said at least one second output; correcting said first output based on said determined orientation by performing a two-dimensional rotational normalization on said first output to generate an output which is substantially independent of a pitch of said pointing device with reference to a predetermined axis; and recognizing a gesture associated with the motion of the pointing device.
-
Specification