NATURAL USER INTERFACES FOR MOBILE IMAGE VIEWING
First Claim
1. A computer-implemented process for viewing large scale imagery on a mobile device, comprising:
- tracking a mobile device'"'"'s orientation and position;
using a camera and viewer tracker on the mobile device to track a user'"'"'s face looking at a screen on the mobile device;
computing a viewing angle and a viewing distance between the user and the screen on the mobile device by using the tracked orientation and position of the mobile device, and the tracked position of the user'"'"'s face relative to screen of the mobile device; and
computing image transformations of an imagery rendered on the screen of the mobile device using the computed viewing angle and viewing distance to allow the user to control viewing of the rendered imagery.
2 Assignments
0 Petitions
Accused Products
Abstract
The mobile image viewing technique described herein provides a hands-free interface for viewing large imagery (e.g., 360 degree panoramas, parallax image sequences, and long multi-perspective panoramas) on mobile devices. The technique controls the imagery displayed on a display of a mobile device by movement of the mobile device. The technique uses sensors to track the mobile device'"'"'s orientation and position, and front facing camera to track the user'"'"'s viewing distance and viewing angle. The technique adjusts the view of a rendered imagery on the mobile device'"'"'s display according to the tracked data. In one embodiment the technique can employ a sensor fusion methodology that combines viewer tracking using a front facing camera with gyroscope data from the mobile device to produce a robust signal that defines the viewer'"'"'s 3D position relative to the display.
-
Citations
20 Claims
-
1. A computer-implemented process for viewing large scale imagery on a mobile device, comprising:
-
tracking a mobile device'"'"'s orientation and position; using a camera and viewer tracker on the mobile device to track a user'"'"'s face looking at a screen on the mobile device; computing a viewing angle and a viewing distance between the user and the screen on the mobile device by using the tracked orientation and position of the mobile device, and the tracked position of the user'"'"'s face relative to screen of the mobile device; and computing image transformations of an imagery rendered on the screen of the mobile device using the computed viewing angle and viewing distance to allow the user to control viewing of the rendered imagery. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9)
-
-
10. A computer-implemented process for viewing large scale imagery on a mobile device, comprising:
-
tracking a mobile device'"'"'s orientation and position with a gyroscope on the mobile device; using a front-facing camera and viewer tracker on the mobile device to track a user'"'"'s face looking at a screen on the mobile device; using the mobile device'"'"'s orientation and position from the gyroscope and the position of the user'"'"'s face obtained by the viewer tracker to determine a combined position and rate control for viewing imagery on the screen of the mobile device. using the combined position and rate control to compute image transformations of the imagery rendered on the screen of the mobile device to allow the user to display different viewpoints of the rendered imagery. - View Dependent Claims (11, 12, 13, 14)
-
-
15. A system for viewing large scale imagery, comprising:
-
a general purpose computing device; a computer program comprising program modules executable by the general purpose computing device, wherein the computing device is directed by the program modules of the computer program to, track a mobile device'"'"'s orientation and position; use a camera and viewer tracker on the mobile device to track a user'"'"'s face looking at a screen on the mobile device; use the mobile device'"'"'s tracked orientation and position, and the position of the user'"'"'s face obtained by the viewer tracker, to determine a combined position and rate control for viewing imagery on the screen of the mobile device, using the combined position and rate control to compute image transformations of the imagery rendered on the screen of the mobile device to allow the user to display different view points of the rendered imagery. - View Dependent Claims (16, 17, 18, 19, 20)
-
Specification