Optical flow based tilt sensor
First Claim
Patent Images
1. A computer-implemented method comprising:
- capturing images from a moving mobile camera;
identifying a first stationary feature that is present in the images captured from the moving mobile camera;
identifying a second stationary feature that is present in the images captured from the moving mobile camera, the second stationary feature being different than and spaced apart from the first stationary feature;
determining a description of motion of the moving mobile camera in a depth direction based on changes in distance between the first stationary feature and the second stationary feature within the captured images, the depth direction being a direction of movement toward and away from the first stationary feature and the second stationary feature;
rendering a user interface for an application on an interface device, the user interface including an object; and
automatically controlling movement of the object rendered in the user interface in a manner corresponding to the determined motion of the moving mobile camera in the depth direction.
2 Assignments
0 Petitions
Accused Products
Abstract
A method is described for determining a description of motion of a moving mobile camera to determine a user input to an application. The method may involve capturing a series of images from a moving mobile camera and comparing stationary features present in the series of images. Optical flow analysis may be performed on the series of images to determine a description of motion of the moving mobile camera. Based on the determined motion, a user input to an application may be determined and the application may respond to the user input, for example, by updating a user interface of the application.
-
Citations
23 Claims
-
1. A computer-implemented method comprising:
-
capturing images from a moving mobile camera; identifying a first stationary feature that is present in the images captured from the moving mobile camera; identifying a second stationary feature that is present in the images captured from the moving mobile camera, the second stationary feature being different than and spaced apart from the first stationary feature; determining a description of motion of the moving mobile camera in a depth direction based on changes in distance between the first stationary feature and the second stationary feature within the captured images, the depth direction being a direction of movement toward and away from the first stationary feature and the second stationary feature; rendering a user interface for an application on an interface device, the user interface including an object; and automatically controlling movement of the object rendered in the user interface in a manner corresponding to the determined motion of the moving mobile camera in the depth direction. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A system comprising:
-
a handheld device; a camera positioned on the handheld device; and at least one processor configured to; capture images from the camera; identify a first stationary feature that is present in the images captured from the moving mobile camera; identify a second stationary feature that is present in the images captured from the moving mobile camera, the second stationary feature being different than and spaced apart from the first stationary feature; determine a description of motion of the handheld device in a depth direction based on changes in distance between the first stationary feature and the second stationary feature within the captured images, the depth direction being a direction of movement toward and away from the first stationary feature and the second stationary feature; render a user interface for an application on a display device, the user interface including an object; and automatically control movement of the object rendered in the user interface in a manner corresponding to the determined motion of the handheld device in the depth direction.
-
-
23. A computer program product tangibly embodied in a non-transitory machine readable medium, the computer program product comprising, instructions that, when read by a machine, operate to cause data processing apparatus to:
-
capture images from a moving mobile camera; identify a first stationary feature that is present in the images captured from the moving mobile camera; identify a second stationary feature that is present in the images captured from the moving mobile camera, the second stationary feature being different than and spaced apart from the first stationary feature; determine a description of motion of the moving mobile camera in a depth direction based on changes in distance between the first stationary feature and the second stationary feature within the captured images, the depth direction being a direction of movement toward and away from the first stationary feature and the second stationary feature; render a user interface for an application on an interface device, the user interface including an object; and automatically control movement of the object rendered in the user interface in a manner corresponding to the determined motion of the moving mobile camera in the depth direction.
-
Specification