Manipulating objects displayed on a display screen
First Claim
1. One or more computer-readable storage media in a computing device, having computer-useable instructions embodied thereon for performing a method of determining a location where a pointing device is directed, the method comprising:
- receiving a message at the computing device from the pointing device;
extracting sensor data from the message, wherein the sensor data includes data provided by an output of an accelerometer;
identifying a position of the pointing device in three-dimensional space;
identifying an orientation of the pointing device in three-dimensional space using the sensor data;
determining a location to which the pointing device is directed by utilizing the identified position of the pointing device and the identified orientation of the pointing device; and
altering an object on a display screen at the location where the pointing device is directed.
1 Assignment
0 Petitions
Accused Products
Abstract
The present invention is directed toward a system and process that controls a group of networked electronic components using a multimodal integration scheme in which inputs from a speech recognition subsystem, gesture recognition subsystem employing a wireless pointing device and pointing analysis subsystem also employing the pointing device, are combined to determine what component a user wants to control and what control action is desired. In this multimodal integration scheme, the desired action concerning an electronic component is decomposed into a command and a referent pair. The referent can be identified using the pointing device to identify the component by pointing at the component or an object associated with it, by using speech recognition, or both. The command may be specified by pressing a button on the pointing device, by a gesture performed with the pointing device, by a speech recognition event, or by any combination of these inputs.
-
Citations
27 Claims
-
1. One or more computer-readable storage media in a computing device, having computer-useable instructions embodied thereon for performing a method of determining a location where a pointing device is directed, the method comprising:
-
receiving a message at the computing device from the pointing device; extracting sensor data from the message, wherein the sensor data includes data provided by an output of an accelerometer; identifying a position of the pointing device in three-dimensional space; identifying an orientation of the pointing device in three-dimensional space using the sensor data; determining a location to which the pointing device is directed by utilizing the identified position of the pointing device and the identified orientation of the pointing device; and altering an object on a display screen at the location where the pointing device is directed. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. One or more computer-readable storage media in a computerized base station, the computer-readable storage media having computer-useable instructions embodied thereon for performing a method of manipulating an object displayed on a display screen, the method comprising:
-
receiving a message at the computerized base station, the message including orientation data; identifying acceleration data from the orientation data; determining a motion of a pointing device in 3-dimensional space, based upon the acceleration data; receiving button data in the message from the pointing device; and determining from the button data, if a button on the pointing device is selected; and manipulating the object displayed on the display screen in accordance with the motion of the pointing device. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20)
-
-
21. A device for manipulating an object displayed on a display screen comprising:
-
a transceiver, which receives a signal; a demodulator, which demodulates the received signal; a controller, which outputs a data message including acceleration data from the demodulated signal and information indicating whether a button on a pointing device has been selected; a memory, which stores the outputted data message; and a processor, which accesses the memory to process the outputted data message, the processing including a determination of a motion of the pointing device in three-dimensional space based upon the acceleration data in the outputted data message, and wherein the processing further includes manipulating the object displayed on the display screen in accordance with the motion of the pointing device. - View Dependent Claims (22, 23, 24, 25, 26)
-
-
27. A system for manipulating an object displayed on a display screen comprising:
-
a transceiver, which receives a signal; one or more infrared lights that are detected by a camera in order to produce position data; a demodulator, which demodulates the received signal; a controller, which outputs a data message including acceleration data, the position data from the demodulated signal, and information indicating whether a button on a pointing device has been selected; a memory, which stores the outputted data message; and a processor, which accesses the memory to process the outputted data message, the processing including the determination of a motion of a pointing device in three-dimensional space based upon the acceleration data in the outputted data message and a position of the pointing device in three-dimensional space based upon the position data, and wherein the processing further includes manipulating the object displayed on the display screen in accordance with the motion and the position of the pointing device.
-
Specification