Camera and acceleration based interface for presentations
First Claim
Patent Images
1. A method implemented at least in part by a computing device, the method comprising:
- without knowledge of a position of any specific point of a display surface;
capturing, by a mobile handheld device, optical information of a cursor presented on a presentation displayed on the display surface by a remote computing device, wherein the optical information comprises two or more images;
evaluating the optical information to minimize differences between the two or more images to estimate a projective transformation between the two or more images to identify a current position of the cursor;
accumulating, by the mobile handheld device, inertial information comprising accumulated motion of the mobile handheld device;
the remote computing device utilizing the optical information, the inertial information, or a combination thereof to modify a position of the cursor from the current position to a different position with respect to the presentation, the utilizing further comprising;
determining whether the optical information is sufficient to reliably determine a new position for the cursor;
responsive to determining that the optical information is sufficient, evaluating only the optical information to determine the new position;
responsive to the determining that the optical information is not sufficient, evaluating the inertial information to estimate the new position by accumulating angular accelerations from a previous image of the two or more images to estimate a rotation angle to a current image of the two or more images; and
determining the new position by a product of the rotation angle and a resolution of the current image divided by an angle of the camera.
2 Assignments
0 Petitions
Accused Products
Abstract
Systems and methods for a camera and acceleration based interface for presentations are described. In one aspect, a handheld device is utilized capture optical information. The optical information is then used to identify the location of a cursor that is presented on a display surface. While a user moves the handheld device, inertial information corresponding to the movement is accumulated on the handheld device. The optical and accumulated inertial information is used to modify position of the cursor with respect to the display surface.
-
Citations
19 Claims
-
1. A method implemented at least in part by a computing device, the method comprising:
without knowledge of a position of any specific point of a display surface; capturing, by a mobile handheld device, optical information of a cursor presented on a presentation displayed on the display surface by a remote computing device, wherein the optical information comprises two or more images; evaluating the optical information to minimize differences between the two or more images to estimate a projective transformation between the two or more images to identify a current position of the cursor; accumulating, by the mobile handheld device, inertial information comprising accumulated motion of the mobile handheld device; the remote computing device utilizing the optical information, the inertial information, or a combination thereof to modify a position of the cursor from the current position to a different position with respect to the presentation, the utilizing further comprising; determining whether the optical information is sufficient to reliably determine a new position for the cursor; responsive to determining that the optical information is sufficient, evaluating only the optical information to determine the new position; responsive to the determining that the optical information is not sufficient, evaluating the inertial information to estimate the new position by accumulating angular accelerations from a previous image of the two or more images to estimate a rotation angle to a current image of the two or more images; and determining the new position by a product of the rotation angle and a resolution of the current image divided by an angle of the camera. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
8. The method of 7, further comprising calculating the transformation based on user motions that pan the mobile handheld device with respect to the presentation.
-
9. A computer-readable storage medium comprising computer-program instructions that, when executed by a processor, perform acts comprising:
without knowledge of a position of any specific point of a display surface; presenting a presentation on the display surface; receiving by a camera optical information from a mobile handheld device of a cursor presented on the presentation displayed on the display surface by a remote computing device, wherein the optical information comprises two or more images; evaluating the optical information to minimize differences between the two or more images to estimate a projective transformation between the two or more images to identify a current position of the cursor; receiving accumulated inertial information comprising accumulated motion of the handheld device; the remote computing device utilizing at least part of the optical information and the inertial information to modify a position of the cursor from the current position to a different position with respect to the presentation, the utilizing further comprising; determining whether the optical information is sufficient to reliably determine a new position for the cursor; responsive to determining that the optical information is sufficient, evaluating only the optical information to determine the new position; responsive to the determining that the optical information is not sufficient, evaluating the inertial information to estimate the new position by accumulating angular accelerations from a previous image of the two or more images to estimate a rotation angle to a current image of the two or more images; and determining the new position by a product of the rotation angle and a resolution of the current image divided by an angle of the camera, wherein the mobile handheld device is used as one or more of a virtual laser pointer and an element for a user to control the presentation. - View Dependent Claims (10, 11, 12, 13, 14, 15)
-
16. A system comprising:
-
a remote computing device; and a handheld computing device, wherein the handheld computing device comprises; one or more optical sensors; and one or more inertial sensors; wherein the handheld computing device is configured to acquire, without knowledge of a position of any specific point of a display surface, optical and inertial information using the one or more optical sensors and the one or more inertial sensors respectively, the optical information, comprising two or more images, for use by the remote computing device to minimize differences between the two or more images to estimate a projective transformation between the two or more images to determine an initial position of a cursor on a displayed presentation; wherein the remote computing device is configured, when the optical information is sufficient to track the cursor with respect to the displayed presentation, to use the optical information to control a position of the cursor from one or more of the initial position and subsequent cursor positions with respect to the displayed presentation; and wherein the remote computing device is configured, when the optical information is not sufficient to track the cursor with respect to the displayed presentation, to use a combination of the optical information and the inertial information to control the position of the cursor from one or more of the initial position and subsequent cursor positions with respect to the displayed presentation and to evaluate the inertial information to estimate the subsequent cursor positions by accumulating angular accelerations from a previous image of the two or more images to estimate a rotation angle to a current image of the two or more images, the subsequent cursor positions being determined by a product of the rotation angle and a resolution of the current image divided by an angle of the camera. - View Dependent Claims (17, 18, 19)
-
Specification