Camera and Acceleration Based Interface for Presentations

• US 20070236451A1
• Filed: 04/07/2006
• Published: 10/11/2007
• Est. Priority Date: 04/07/2006
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Corporation
• Inventors: Ofek, Eyal, Hsu, Feng-Hsiung
• Granted Patent: US 7,852,315 B2
• Time in Patent Office: Days
• US Class Current: 345/157
• CPC Class Codes: G06F 3/0304 Detection arrangements using opto-electronic means constructional details of pointing devices not related to the detection arrangement using opto-electronic means G06F3/033; optical digitisers G06F3/042
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Abstract

Systems and methods for a camera and acceleration based interface for presentations are described. In one aspect, a handheld device is utilized capture optical information. The optical information is then used to identify the location of a cursor that is presented on a display surface. While a user moves the handheld device, inertial information corresponding to the movement is accumulated on the handheld device. The optical and accumulated inertial information is used to modify position of the cursor with respect to the display surface.

Claims

1. A method implemented at least in part by a computing device, the method comprising:

capturing, by a handheld device, optical information to identify at least a current position of a cursor presented on a presentation displayed on a display surface;

accumulating, by the handheld device, inertial information comprising accumulated motion of the handheld device; and

utilizing a combination of the optical information and the inertial information to modify position of the cursor from the current position to a different position with respect to the presentation.

2. The method of claim 1, wherein the display surface is a projection surface or a non-projection surface.

3. The method of claim 1, further comprising capturing, by optical sensors, the optical information.

4. The method of claim 1, further comprising accumulating, by an accelerometer, the inertial information.

5. The method of claim 1, further comprising capturing the optical information and accumulating the inertial information responsive to an action by the user.

6. The method of claim 1, further comprising wherein utilizing the combination of the optical information and the inertial information further comprises:

determining whether the optical information is sufficient to reliably determine a new position for the cursor;

responsive to determining that the optical information is sufficient, evaluating only the optical information to determine the new position;

responsive to the determining that the optical information is not sufficient, considering a combination of the inertial information and the optical information to determine the new position.

7. The method of claim 6, wherein the operations of determining, evaluating, and considering are performed by one of the computing device or the handheld device.

8. The method of claim 6, further comprising calculating the new position using a projective homography indicating a transformation between optical sensors associated with the handheld device and a coordinate system associated with the presentation.

9. The method of 8, further comprising calculating the transformation based on user motions that pan the handheld device:

with respect to the presentation.

10. A computer-readable storage medium comprising computer-program instructions that when executed by a processor perform operations for:

presenting a presentation on a display surface;

receiving optical information from a handheld device, the optical information identifying at least a current position of a cursor presented on a presentation displayed on a display surface;

receiving accumulated inertial information comprising accumulated motion of the handheld device;

utilizing a combination of the optical information and the inertial information to modify position of the cursor from the current position to a different position with respect to the presentation; and

wherein the cursor is used as one or more of a virtual laser pointer and an element for a user to control the presentation.

11. The computer-readable storage medium of claim 10, wherein a camera is used to capture the optical information.

12. The computer-readable storage medium of claim 10, wherein an accelerometer is used to accumulate the inertial information.

13. A computer-readable storage medium as recited in claim 10, wherein the presentation is a slideshow presentation.

14. A computer-readable medium as recited in claim 10, wherein the display surface is a projection surface.

15. The computer-readable storage medium of claim 10, wherein the computer-program instructions further comprise instructions for:

determining whether the optical information is sufficient to reliably determine a new position for the cursor;

responsive to determining that the optical information is sufficient, evaluating only the optical information to determine the new position;

responsive to determining that the optical information is not sufficient, considering a combination of the inertial information and the optical information to determine the new position.

16. The computer-readable storage medium of claim 15, wherein the computer-program instructions further comprise instructions for calculating the new position using a projective homography indicating a transformation between optical sensors associated with the handheld device and a coordinate system associated with the presentation.

17. A system comprising:

a handheld computing device coupled to a remote computing device;

wherein the handheld computing device is configured to acquire optical and inertial information, the optical information for use by the remote computing device to determine an initial position of a cursor on a displayed presentation;

wherein the remote computing device is configured, when the optical information is sufficient to track the cursor with respect to the displayed presentation, to use the optical information to control position of the cursor from one or more of the initial position and subsequent cursor positions with respect to the displayed presentation; and

wherein the remote computing device is configured, when the optical information is not sufficient to track the cursor with respect to the displayed presentation, to use a combination of the optical information and at the inertial information to control position of the cursor from one or more of the initial position and subsequent cursor positions with respect to the displayed presentation.

18. The system of claim 17, wherein the optical information is acquired by optical sensors coupled to the handheld computing device, and wherein the inertial information is acquired by one or more accelerometers coupled to the handheld computing device

19. The system of claim 17, wherein the displayed presentation is a slideshow presentation.

20. The system of claim 17, wherein the remote computing device is further configured to control the position using a protective homography indicating a transformation between optical sensors associated with the handheld device and a coordinate system associated with the presentation.