Direct navigation of two-dimensional control using a three-dimensional pointing device

• US 8,384,698 B2
• Filed: 11/22/2010
• Issued: 02/26/2013
• Est. Priority Date: 08/10/2004
• Status: Expired due to Fees

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Kong, Yuan
• Primary Examiner(s): Nguyen, Chanh
• Assistant Examiner(s): JOHNSON, ALLISON WALTHALL
• Application Number:
  US12/952,021
• Publication Number:
  US 20110063217A1
• Time in Patent Office: 827 Days
• Field of Search: 345156-159, 345/179, 715/863
• US Class Current: 345/179
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

Direct and absolute pointing is provided for with respect to a two-dimensional information display surface, much like how one would point a laser pointer or flashlight at a desired point. The displayed control may be moved by manipulating the pointing device in three dimensions. The translational position of the pointing device may be measured in three dimensions. Also, the three-dimensional orientation of the pointing device may be measured. A computing device may receive this information from the pointing device and determine where the pointing device is pointing to. If the pointing device is pointing at a display, then the computing device may cause the control to be displayed at the position to which the pointing device is pointing. In addition, the control may be displayed at an orientation that depends upon the orientation of the pointing device.

Claims

1. In a computing device, a method comprising:

calibrating a device using a coordinate system and known reference locations to enable the device to control a visual indicium based on one or more of a translational position or an orientation of the device, the calibrating comprising;

defining as zero with respect to the coordinate system, a first X position, a first Y position, a first orientation about an X axis, and a first orientation about a Y axis, responsive to the device being directed to a first reference location of the known reference locations;

defining as zero with respect to the coordinate system and responsive to the device being directed to a second reference location of the known reference locations, one of;

a second X position and a second orientation about the Y axis;

or

a second Y position and a second orientation about the X axis; and

calculating a distance from the device to a plane in which the first reference location and the second reference location exist;

defining as zero with respect to the coordinate system and responsive to the device being directed to a third reference location of the known reference locations, the other of;

the second X position and the second orientation about the Y axis;

or

the second Y position and the second orientation about the X axis; and

controlling the visual indicium on a display based on movement of the device and relative to the coordinate system.

2. The method of claim 1, wherein controlling the visual indicium comprises:

determining the translational position of the device based with reference to a first degree of freedom, a second degree of freedom, and a third degree of freedom;

determining the orientation of the device with reference to a fourth degree of freedom, a fifth degree of freedom, and a sixth degree of freedom; and

determining an orientation of the visual indicium based on the orientation of the device along the sixth degree of freedom.

3. The method of claim 2, wherein the device has a body, a linear axis being defined that is fixed with respect to the body, and wherein controlling the visual indicium comprises determining a translational position for the visual indicium by determining a projected location on the display to which the linear axis projects and defining the translational position of the visual indicium to be the projected location.

4. The method of claim 1, further comprising calibrating the device along the first, second, third, fourth, and fifth degrees of freedom and using the known reference locations.

5. The method of claim 4, further comprising controlling the display to display an element at each of the known reference locations.

6. The method of claim 4, wherein the known reference locations are locations apart from the display.

7. The method of claim 1, wherein the visual indicium comprises a mouse pointer.

8. The method of claim 1, wherein the display includes a plurality of display screens.

9. A computer-readable memory device storing computer-executable instructions for performing the steps recited in claim 1.

10. A computer-implemented method comprising:

calibrating a device using a coordinate system and known reference locations by;

defining as zero with respect to the coordinate system, a first X position, a first Y position, a first orientation about an X axis, and a first orientation about a Y axis, responsive to the device being directed to a first reference location of the known reference locations;

defining as zero with respect to the coordinate system and responsive to the device being directed to a second reference location of the known reference locations, one of;

a second X position and a second orientation about the Y axis;

or

a second Y position and a second orientation about the X axis; and

calculating a distance from the device to a plane in which the first reference location and the second reference location exist;

defining as zero with respect to the coordinate system and responsive to the device being directed to a third reference location of the known reference locations, the other of;

the second X position and the second orientation about the Y axis;

or

the second Y position and the second orientation about the X axis; and

receiving data representing a translational position and an orientation of the device along at least five degrees of freedom relative to the coordinate system; and

determining a position for a visual indicium based on the translational position and the orientation of the device along the at least five degrees of freedom.

11. The method of claim 10, further comprising

determining an orientation for the visual indicium based on an orientation of the device along a sixth degree of freedom.

12. The method of claim 10, wherein the pointing device includes a linear axis fixed with respect to the device, the method further comprising determining a translational position of the visual indicium by determining a projected location of the axis outside of the device, the translational position of the visual indicium being based on the projected location.

13. A computer-readable memory device storing computer-executable instructions for performing the steps recited in claim 10.

14. A computer-implemented method comprising:

calibrating a device using a coordinate system and known reference locations by;

defining a first position for the device in the coordinate system responsive to the device being directed to a first reference location of the known reference locations, the first position for the device being defined as zero for a first X coordinate, a first Y coordinate, a first orientation about an X axis, and a first orientation about a Y axis;

defining a second position for the device in the coordinate system responsive to the device being directed to a second reference location of the known reference locations, the second position for the device being defined as zero for one of;

a second X coordinate and a second orientation about the Y axis;

or

a second Y coordinate and a second orientation about the X axis; and

calculating a distance from the device to a plane in which the first reference location and the second reference location exist;

defining a third position for the device in the coordinate system responsive to the device being directed to a third reference location of the known reference locations, the third position for the device being defined as zero for the other of;

the second X coordinate and the second orientation about the Y axis;

or

the second Y coordinate and the second orientation about the X axis; and

determining a translational position of the device relative to the coordinate system based on the first position and the second position;

determining an orientation of the device relative to the coordinate system based on the first position and the second position; and

controlling a visual indicium based on the translational position and the orientation of the device.

15. A system comprising:

one or more computer-readable memory devices storing computer-executable instructions configured to be executed by a computer to cause the computer to perform a method, comprising;

calibrating a device using a coordinate system and known reference locations to enable the device to control a visual indicium based on one or more of a translational position or an orientation of the device, the calibrating comprising;

defining as zero with respect to the coordinate system, a first X position, a first Y position, a first orientation about an X axis, and a first orientation about a Y axis, responsive to the device being directed to a first reference location of the known reference locations;

defining as zero with respect to the coordinate system and responsive to the device being directed to a second reference location of the known reference locations, one of;

a second X position and a second orientation about the Y axis;

or

a second Y position and a second orientation about the X axis;

calculating a distance from the device to a plane in which the first reference location and the second reference location exist; and

defining as zero with respect to the coordinate system and responsive to the device being directed to a third reference location of the known reference locations, the other of;

the second X position and the second orientation about the Y axis;

or

the second Y position and the second orientation about the X axis; and

receiving a signal from the device that includes data representing a translational position and an orientation of the device relative to the coordinate system; and

determining a position of a visual indicium based on the translational position and the orientation of the device.

16. The system of claim 15, further comprising the device, wherein the device includes a body and a sensor that is physically coupled to the body, and wherein receiving the signal from the device comprises receiving the signal from the sensor.

17. The system of claim 16, wherein the body has a first end and a second that define a linear axis passing through the first end and the second end, the method further comprising determining a translational position of the visual indicium by determining a projected location of the axis outside of the body and determining the translational position of the visual indicium based on the projected location.

18. The system of claim 17, wherein the device further includes a light source physically coupled to the body, the light source being configured to emit a focused beam of light directed along the axis.

19. The system of claim 18, wherein the light source comprises a laser source.

20. The system of claim 16, wherein the method further comprises:

receiving data representing an orientation of the body along a sixth degree of freedom; and

determining an orientation of the visual indicium based the orientation of the body along the sixth degree of freedom.

21. The system of claim 16, wherein the sensor is configured to magnetically sense at least one of the translational position or the orientation of the body.

22. The system of claim 15, wherein the method further comprises sending a second signal that includes information indicating a translational position of the visual indicium.