IMAGE MATCHING IN SUPPORT OF MOBILE NAVIGATION
First Claim
7. A method for navigation using a mobile device of a user, the method comprising:
- obtaining mobile device information, the mobile device information comprising mobile device location and mobile device pose;
receiving a map corresponding to a user request;
receiving a matched image corresponding to the map; and
displaying the matched image together with the map,wherein the matched image is selected from a database including database images by matching the mobile device pose and the mobile device location respectively to camera orientation and camera location associated as metadata with each of the database images.
2 Assignments
0 Petitions
Accused Products
Abstract
Method, apparatus and system for improving navigation using mobile devices by adding previously captured media to navigation maps provided by mobile device. Added media include still images and video clips. Media captured at the same location using various camera orientations are available in an image database. Images in database include metadata indicating location, orientation and other parameters associated with each image. User location and pose are matched against metadata indicating location and camera orientation of captured images. User motion may also be matched to metadata indicating camera motion of stored video clips. Other parameters like lighting, seasonal factors, and tasks of walking, biking or driving may also be matched. User pose may be derived from an accelerometer embedded in the mobile device. Some or all of user parameters desired by user may be directly input to mobile device by user instead of being automatically detected by mobile device.
-
Citations
20 Claims
-
7. A method for navigation using a mobile device of a user, the method comprising:
-
obtaining mobile device information, the mobile device information comprising mobile device location and mobile device pose; receiving a map corresponding to a user request; receiving a matched image corresponding to the map; and displaying the matched image together with the map, wherein the matched image is selected from a database including database images by matching the mobile device pose and the mobile device location respectively to camera orientation and camera location associated as metadata with each of the database images. - View Dependent Claims (1, 2, 3, 4, 5, 6, 8, 9, 10, 11, 12, 13, 14, 15, 16)
-
-
15-1. The method of claim 7,
wherein the obtaining of the mobile device information comprises detecting the mobile device location and mobile device acceleration, and wherein the mobile device pose is derived from the mobile device acceleration.
-
17. A database system comprising:
-
an input interface for receiving captured image data and receiving camera location data and camera orientation data corresponding to the captured image data; a first processor for associating the camera location data and the camera orientation data, as associated metadata, with a corresponding captured image data; a database for storing the captured image data together with the associated metadata as stored images; and a receiver for receiving user requests including user pose and user location; a second processor for determining matched images, the matched images matching the user pose and the user location to the camera location data and camera orientation data of the stored images; and a transmitter for transmitting the matched images to a user sending the user request.
-
-
18. A mobile device for navigation, the mobile device comprising:
-
a global positioning system module for detecting mobile device location; an accelerometer for detecting mobile device acceleration; a processor for deriving user pose from the mobile device acceleration; a transceiver for transmitting a user request and receiving a map corresponding to the user request and receiving a matched image corresponding to the map; and a display for displaying the matched image together with the map, wherein the matched image is selected from a database including database images by matching the user pose and the user device location respectively to camera orientation and camera location associated as metadata with each of the database images.
-
-
19. A navigation system comprising:
-
a mobile device having navigation capabilities; and an image database in communication with the mobile device, wherein the mobile device collects and transmits mobile device location data and mobile device pose data to a machine having access to the image database, wherein the mobile device location data and the mobile device pose data are matched to metadata indicating camera location and camera orientation associated with an image in the images database to obtain matched images, wherein the matched image is transmitted to the mobile device, and wherein the matched image is displayed with a map on the mobile device. - View Dependent Claims (20)
-
Specification