DEVICE FOR MAPPING PHYSICAL WORLD WITH VIRTUAL INFORMATION

• US 20140349683A1
• Filed: 05/23/2013
• Published: 11/27/2014
• Est. Priority Date: 05/23/2013
• Status: Active Grant

• Current Assignee: Cellco Partnership, Inc. (Verizon Communications Inc.)
• Original Assignee: Cellco Partnership, Inc. (Verizon Communications Inc.)
• Inventors: D'ARGENIO, Michael J., Frazier, Kristopher T., Katai, Lonnie
• Granted Patent: US 9,589,189 B2
• Time in Patent Office: Days
• US Class Current: 455/456.3
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/488 Data services, e.g. news ticker systems specially adapted for using meteorological information in broadcast systems H04H60/71
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

A device is configured to determine a geographic location of a user device and determine, based on the geographic location of the user device, that the user device is within a threshold distance of a structure that includes a quantity of objects. The device is configured to receive, from the user device, an image of an object of the quantity of objects, and analyze, based on receiving the image of the object and based on the user device being within the threshold distance of the structure, the image to identify the object. The device is configured to receive user information associated with the user device, determine, based on the user information, object information associated with the object; and provide the object information for display on the user device.

Claims

1. A device, comprising:

one or more processors to;

determine a geographic location of a user device;

determine, based on the geographic location of the user device, that the user device is within a threshold distance of a structure that includes a plurality of objects;

receive, from the user device, an image of an object of the plurality of objects;

analyze, based on receiving the image of the object and based on the user device being within the threshold distance of the structure, the image to identify the object;

receive user information associated with the user device;

determine, based on the user information, object information associated with the object; and

provide the object information for display on the user device.

2. The device of claim 1, where the one or more processors, when receiving the image of the object, are further to:

receive a user input identifying the object; and

where the one or more processors, when analyzing the image to identify the object, are further to;

analyze the image based on the user input.

3. The device of claim 1, where the one or more processors, when providing the object information, are further to:

provide the object information to be overlaid on a real-time image of the object on a display of the user device.

4. The device of claim 1, where the one or more processors, when analyzing the image to identify the object, are further to:

determine an object location associated with the object; and

where the one or more processors, when providing the object information for display on the user device, are further to;

provide the object information for display on the user device based on the object location.

5. The device of claim 1, where the one or more processors, when receiving the user information, are further to:

detect a movement of the user device; and

where the one or more processors, when providing the object for display on the user device, are further to;

provide the object information based on detecting the movement of the user device.

6. The device of claim 1, where the one or more processors, when determining that the user device is within the threshold distance of the structure, are further to:

determine an object location associated with the object;

determine that the user device is within a threshold proximity of the object based on the object location and the geographic location; and

where the one or more processors, when analyzing the image to identify the object, are further to;

analyze the image based on determining that the user device is within the threshold proximity of the object.

7. The device of claim 1, where the one or more processors, when determining that the user device is within the threshold distance of the structure, are further to:

determine a boundary associated with the structure; and

determine that the user device is inside the boundary.

8. A computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by a processor, cause the processor to;

determine a geographic location of a user device;

determine that the user device is within a threshold distance of a structure that houses a plurality of objects;

receive, from the user device, an image of an object of the plurality of objects;

analyze, based on receiving the image of the object and based on the user device being within the threshold distance of the structure, the image to identify the object;

receive user information associated with the user device;

determine, based on the user information, object information associated with the object,

the object information including information relevant to a user of the user device; and

provide the object information for display on the user device.

9. The computer-readable medium of claim 8, where the one or more instructions, that cause the processor to receive the image of the object, further cause the processor to:

receive a user input identifying the object; and

where the one or more instructions, that cause the processor to analyze the image to identify the object, further cause the processor to;

analyze the image based on the user input.

10. The computer-readable medium of claim 8, where the one or more instructions, that cause the processor to provide the object information, further cause the processor to:

provide the object information to be overlaid on a real-time image of the object on a display of the user device.

11. The computer-readable medium of claim 8, where the one or more instructions, that cause the processor analyze the image to identify the object, further cause the processor to:

determine an object location associated with the object; and

where the one or more instructions, that cause the processor to provide the object information for display on the user device, further cause the processor to;

provide the object information for display on the user device based on the object location.

12. The computer-readable medium of claim 8, where the one or more instructions, that cause the processor to receive the user information, further cause the processor to:

detect a movement of the user device; and

where the one or more instructions, that cause the processor to provide the object for display on the user device, further cause the processor to;

provide the object information based on detecting the movement of the user device.

13. The computer-readable medium of claim 8, where the one or more instructions, that cause the processor to determine that the user device is within the threshold distance of the structure, further cause the processor to:

determine an object location associated with the object;

determine that the user device is within a threshold proximity of the object based on the object location and the geographic location; and

where the one or more instructions, that cause the processor to analyze the image to identify the object, further cause the processor to;

analyze the image based on determining that the user device is within the threshold proximity of the object.

14. The computer-readable medium of claim 8, where the one or more instructions, that cause the processor to determine that the user device is within the threshold distance of the structure, further cause the processor to:

determine a boundary associated with the structure; and

determine that the user device is inside the boundary.

15. A method, comprising:

determining, by a device, a geographic location of a user device;

determining, by the device, that the user device is within a boundary of a structure that houses a plurality of objects;

receiving, by the device and from the user device, an image of an object of the plurality of objects;

analyzing, by the device and based on receiving the image of the object and based on the user device being within the boundary of the structure, the image to identify the object;

receiving, by the device, user information associated with the user device;

determining, by the device and based on the user information, object information associated with the object; and

providing, by the device, the object information for display on the user device.

16. The method of claim 15, where receiving the image of the object further comprises:

receiving a user input identifying the object; and

where analyzing the image to identify the object further comprises;

analyzing the image based on the user input.

17. The method of claim 15, where providing the object information further comprises:

providing the object information to be overlaid on a real-time image of the object on a display of the user device.

18. The method of claim 15, where analyzing the image to identify the object further comprises:

determining an object location associated with the object; and

where providing the object information for display on the user device further comprises;

providing the object information for display on the user device based on the object location.

19. The method of claim 15, where receiving the user information further comprises:

detecting a movement of the user device; and

where providing the object for display on the user device further comprises;

providing the object information based on detecting the movement of the user device.

20. The method of claim 15, where determining that the user device is within the boundary of the structure further comprises:

determining an object location associated with the object; and

determining that the user device is within a threshold proximity of the object based on the object location and the geographic location; and

where analyzing the image to identify the object further comprises;

analyzing the image based on determining that the user device is within the threshold proximity of the object.