MANIPULATING OBJECTS DISPLAYED ON A DISPLAY SCREEN

• US 20110001696A1
• Filed: 09/13/2010
• Published: 01/06/2011
• Est. Priority Date: 02/07/2002
• Status: Abandoned Application

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Wilson, Andrew
• Application Number:
  US12/880,901
• Publication Number:
  US 20110001696A1
• Time in Patent Office: Days
• US Class Current: 345/156
• CPC Class Codes: G06F 2203/0381 Multimodal input, i.e. interface arrangements enabling the user to issue commands by simultaneous use of input devices of different nature, e.g. voice plus gesture on digitizer
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06F 3/038 Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
• CPC Class Codes: G08C 17/00 Arrangements for transmitting signals characterised by the use of a wireless electrical link
• CPC Class Codes: G08C 2201/31 Voice input
• CPC Class Codes: G08C 2201/32 Remote control based on movements, attitude of remote control device
• CPC Class Codes: G08C 2201/41 Remote control of gateways
• CPC Class Codes: G08C 2201/50 Receiving or transmitting feedback, e.g. replies, status updates, acknowledgements, from the controlled devices

Abstract

Embodiments of the present invention is directed toward determining a location where a pointing device is directed. In one embodiment, the method includes receiving a message at the computing device from the pointing device. Sensor data is extracted from the message, the sensor data comprising accelerometer data, gyroscope data, or a combination thereof. A position of the pointing device in three-dimensional space is identified. An orientation of the pointing device in three-dimensional space is identified using the sensor data. A location to which the pointing device is directed is determined by utilizing the identified position of the pointing device and the identified orientation of the pointing device, and an object on a display screen at the location where the pointing device is directed is altered.

Claims

1. One or more computer-readable storage media in a computing device, having computer-useable instructions embodied thereon for performing a method of determining a location where a pointing device is directed, the method comprising:

receiving a message at the computing device from the pointing device;

extracting sensor data from the message, wherein the sensor data comprises accelerometer data, gyroscope data, or a combination thereof;

identifying a position of the pointing device in three-dimensional space;

identifying an orientation of the pointing device in three-dimensional space using the sensor data;

determining a location to which the pointing device is directed by utilizing the identified position of the pointing device and the identified orientation of the pointing device; and

altering an object on a display screen at the location where the pointing device is directed.

2. The one or more computer-readable storage media of claim 1, wherein the step of identifying a position further comprises receiving data at the computing device associated with one or more infrared lights detected by a camera.

3. The one or more computer-readable storage media of claim 1, wherein the step of identifying a position further comprises:

receiving data at the computing device associated with one or more infrared lights detected by a camera, wherein the data describes one or more images; and

analyzing the one or more images to identify the position.

4. The one or more computer-readable storage media of claim 1, wherein the received message includes gyroscope data and the step of extracting further comprises extracting the gyroscope data from the received message.

5. The one or more computer-readable storage media of claim 1, wherein the received message includes acceleration data and the step of extracting further comprises extracting the acceleration data from the received message.

6. The one or more computer-readable storage media of claim 5 further comprising receiving normalization data at the computing device prior to receiving the message.

7. The one or more computer-readable storage media of claim 6, wherein the step of receiving normalization data further comprises receiving calibration data at the computing device via an output of an accelerometer in the pointing device.

8. The one or more computer-readable storage media of claim 6, wherein the step of identifying an orientation further comprises identifying data associated with a motion about a x-axis, a y-axis, and a z-axis with respect to a pre-defined coordinate system.

9. The one or more computer-readable storage media of claim 1 further comprising:

identifying a new orientation of the pointing device in three-dimensional space using new sensor data in a subsequent message; and

determining a change in orientation of the pointing device using the orientation and the new orientation.

10. One or more computer-readable storage media in a computerized base station, the computer-readable storage media having computer-useable instructions embodied thereon for performing a method of manipulating an object displayed on a display screen, the method comprising:

receiving a message at the computerized base station, the message including orientation data;

identifying acceleration data and gyroscope data from the orientation data;

determining a motion of a pointing device in 3-dimensional space based on the acceleration data and the gyroscope data; and

manipulating the object displayed on the display screen in accordance with the motion of the pointing device.

11. The one or more computer-readable storage media of claim 10 further comprising:

receiving button data in the message from the pointing device; and

determining from the button data, if a button on the pointing device is selected.

12. The one or more computer-readable storage media of claim 10, wherein the step of manipulating further comprises manipulating the object displayed on the display screen in accordance with the motion of the pointing device and the selection of the button.

13. The one or more computer-readable storage media of claim 10 further comprising identifying if the orientation data exceeds one or more thresholds.

14. The one or more computer-readable storage media of claim 10, wherein the motion of the pointing device comprises an upward motion, a downward motion, a lateral motion, or a rotation motion.

15. The one or more computer-readable storage media of claim 14, wherein the rotation motion comprises rotating the pointing device about an axis.

16. A device for manipulating an object displayed on a display screen comprising:

a transceiver, which receives a signal;

a demodulator, which demodulates the received signal;

a controller, which outputs a data message including one or more of acceleration data or gyroscope data from the demodulated signal and information indicating whether a button has been selected;

a memory, which stores the outputted data message; and

a processor, which accesses the memory to process the outputted data message, the processing including a determination of a motion of a pointing device in three-dimensional space based upon the one or more of acceleration data or gyroscope data in the outputted data message, and wherein the processing further includes manipulating the object displayed on the display screen in accordance with the motion of the pointing device.

17. The device of claim 16, wherein the processor records the one or more acceleration data or gyroscope data in the outputted data message if the information indicates that the button on the pointing device has been selected.

18. The device of claim 17, wherein the memory further stores one or more thresholds and wherein the processor further processes the one or more thresholds and the one or more acceleration data or gyroscope data in the outputted data message.

19. The device of claim 16, wherein the memory further stores calibration data and wherein the processor further processes the calibration data and the one or more acceleration data or gyroscope data in the outputted data message in order to determine the motion of the pointing device in three-dimensional space.

20. The device of claim 16, wherein when the processor processes the outputted data message to determine the motion of the pointing device in three-dimensional space, the processing includes processing data associated with a motion about an x-axis, a y-axis, and a z-axis with respect to a pre-defined coordinate system.