Mobile imaging device as navigator

• US 8,798,323 B2
• Filed: 08/08/2012
• Issued: 08/05/2014
• Est. Priority Date: 06/20/2008
• Status: Active Grant

• Current Assignee: R2 Solutions LLC (Acacia Research Corporation)
• Original Assignee: Yahoo! Inc. (Apollo Global Management, Inc.)
• Inventors: Soderstrom, Gustav
• Primary Examiner(s): GORADIA, SHEFALI DINESH
• Application Number:
  US13/570,070
• Publication Number:
  US 20120299960A1
• Time in Patent Office: 727 Days
• Field of Search: 382/100, 382/104, 345/629, 455/456.3
• US Class Current: 382/104
• CPC Class Codes: G01C 21/005 with correlation of navigation data from several sources, e.g. map or contour matching G01C21/30 takes precedence
• CPC Class Codes: G01C 21/20 Instruments for performing navigational calculations G01C21/24, G01C21/26 take precedence
• CPC Class Codes: G06F 16/29 Geographical information databases
• CPC Class Codes: G06F 16/9537 Spatial or temporal dependent retrieval, e.g. spatiotemporal queries
• CPC Class Codes: G06T 7/246 using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/73 using feature-based methods

Abstract

Embodiments of the invention are directed to obtaining information based on directional orientation of a mobile imaging device, such as a camera phone. Visual information is gathered by the camera and used to determine a directional orientation of the camera, to search for content based on the direction, to manipulate 3D virtual images of a surrounding area, and to otherwise use the directional information. Direction and motion can be determined by analyzing a sequence of images. Distance from a current location, inputted search parameters, and other criteria can be used to expand or filter content that is tagged with such criteria. Search results with distance indicators can be overlaid on a map or a camera feed. Various content can be displayed for a current direction, or desired content, such as a business location, can be displayed only when the camera is oriented toward the desired content.

Claims

1. A server device, comprising:

one or more physical storage devices configured to store executable-instructions; and

a central processing unit that executes the executable-instructions to perform actions, including;

receiving a geographic position of a mobile device;

receiving a change in an orientational direction of the mobile device from a first direction to a second direction, the orientational direction being determined at least in part using an imaging component of the mobile device;

performing a search for content information based on the received geographic position and change in orientational direction of the mobile device; and

providing the content information to the mobile device.

2. The server device of claim 1, wherein the central processing unit executes the executable-instructions to perform actions, further including:

receiving a distance perimeter from the mobile device, usable to limit content information provided to within the distance perimeter.

3. The server device of claim 1, wherein providing the content information further comprises tagging the content information with geographic position information relative to the position and orientational direction of the mobile device.

4. The server device of claim 1, wherein the mobile device provides selectable tabs for display of types of information, including at least one of a restaurant tab or a people tab.

5. The server device of claim 1, wherein providing the content information to the mobile device further allows the mobile device to superimpose the content information onto a map display.

6. The server device of claim 1, wherein providing the content information to the mobile device further allows the mobile device to display at least some of the content information in an x-ray mode that displays obstructions to reveal what is behind the obstruction in a particular direction.

7. The server device of claim 1, wherein at least some of the content information includes merchant information including a distance and orientation between a merchant and the mobile device.

8. An apparatus comprising a non-transitory computer readable medium, having computer-executable instructions stored thereon, that in response to execution by a mobile device, cause the mobile device to perform operations, comprising:

sending a geographic position of the mobile device;

sending a change in an orientational direction of the mobile device from a first direction to a second direction, the orientational direction being determined at least in part using an imaging component of the mobile device;

performing a search for content information based on the received geographic position and change in orientational direction of the mobile device; and

displaying the content information at the mobile device.

9. The apparatus of claim 8, wherein at least some of the content information is obtained local to the mobile device.

10. The apparatus of claim 8, wherein performing the search further comprises receiving at least keyword usable to refine the search for content information.

11. The apparatus of claim 8, wherein the content information further includes at least one of a movement, network interaction, purchase, or game activity of a second mobile device.

12. The apparatus of claim 8, wherein the mobile device performs actions, further including:

receiving a distance perimeter from the mobile device, usable to limit content information provided to within the distance perimeter.

13. The apparatus of claim 8, wherein displaying the content information further comprises tagging the content information with geographic position information relative to the position and orientational direction of the mobile device.

14. The apparatus of claim 8, wherein performing the search further comprises using a selectable tab for inputting a person'"'"'s identifier for narrowing a result of the search.

15. The apparatus of claim 8, wherein displaying the content information further includes inhibiting display of at least some of the content information based on a distance between an item within the content information and the mobile device.

16. A mobile device, comprising:

an imaging component; and

a processor device that performs actions, including;

determining a geographic position of the mobile device;

determining a change in an orientational direction of the mobile device from a first direction to a second direction, the orientational direction being determined at least in part using the imaging component of the mobile device;

performing a search for content information based on the received geographic position and change in orientational direction of the mobile device; and

displaying the content information at the mobile device.

17. The mobile device of claim 16, wherein performing the search further includes using a distance perimeter to filter results in the content information.

18. The mobile device of claim 16, wherein displaying the content information includes displaying geographic position information of at least one item within the displayed content information.

19. The mobile device of claim 16, wherein the content information includes merchant information including an orientation between a merchant and the mobile device.

20. The mobile device of claim 16, wherein information about the change of the orientational direction includes information about a third direction that is between the first direction and the second direction, the information about the third direction being used to refine the search for content information.