Device for mapping physical world with virtual information

• US 9,589,189 B2
• Filed: 05/23/2013
• Issued: 03/07/2017
• Est. Priority Date: 05/23/2013
• Status: Active Grant

• Current Assignee: Cellco Partnership, Inc. (Verizon Communications Inc.)
• Original Assignee: Cellco Partnership, Inc. (Verizon Communications Inc.)
• Inventors: D'Argenio, Michael J., Frazier, Kristopher T., Katai, Lonnie
• Primary Examiner(s): Magloire, Vladimir
• Assistant Examiner(s): DONADO, FRANK E
• Application Number:
  US13/901,139
• Publication Number:
  US 20140349683A1
• Time in Patent Office: 1,384 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/434 using image data, e.g. images, photos, pictures taken by a user
• CPC Class Codes: G06V 20/20 in augmented reality scenes
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04N 21/4126 The peripheral being portable, e.g. PDAs or mobile phones
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/4524 involving the geographical location of the client retrieval from the Internet by querying based on geographical locations G06F16/9537; systems specially adapted for using geographical information in broadcast systems H04H60/70; protocols in which the network application is adapted for the location of the user terminal in communication control or processing H04L67/52; services making use of the location of users or terminals in wireless networks H04W4/02; locating users or terminals in wireless networks H04W64/00
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/488 Data services, e.g. news ticker systems specially adapted for using meteorological information in broadcast systems H04H60/71
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/029 Location-based management or tracking services

Abstract

A device is configured to determine a geographic location of a user device and determine, based on the geographic location of the user device, that the user device is within a threshold distance of a structure that includes a quantity of objects. The device is configured to receive, from the user device, an image of an object of the quantity of objects, and analyze, based on receiving the image of the object and based on the user device being within the threshold distance of the structure, the image to identify the object. The device is configured to receive user information associated with the user device, determine, based on the user information, object information associated with the object; and provide the object information for display on the user device.

Claims

1. A device, comprising:

one or more processors to;

determine a geographic location of a user device;

determine, based on the geographic location of the user device and based on an object location associated with an object, that the user device is within a threshold distance of the object;

determine that the user device is inside a structure that includes a plurality of objects based on determining that the user device is within the threshold distance of the object,

the plurality of objects including the object, and

the structure being a stadium;

receive, from the user device, an image, of a player inside the stadium, captured by a camera, associated with the user device, directed, by a user, at the player after determining that the user device is within the threshold distance of the object,

the player being the object;

analyze, based on receiving the image of the object and based on the user device being inside the structure, the image for characteristics specific to the player;

determine, based on analyzing the image for the characteristics, object information associated with the player; and

provide the object information, for display on the user device, based on determining the object information,

the object information including information regarding a quantity of interactions of the player with other players.

2. The device of claim 1,

where the one or more processors are further to:

receive a user input identifying the object; and

where the one or more processors, when analyzing the image to identify the object, are to;

analyze the image based on the user input.

3. The device of claim 1, where the one or more processors, when providing the object information, are to:

provide the object information to be overlaid on a real-time image of the object on a display of the user device.

4. The device of claim 1,

where the one or more processors are further to:

determine an object location associated with the object; and

where the one or more processors, when providing the object information for display on the user device, are further to;

provide the object information for display on the user device based on the object location.

5. The device of claim 1,

where the one or more processors are further to:

detect a movement of the user device; and

where the one or more processors, when providing the object for display on the user device, are to;

provide the object information based on detecting the movement of the user device.

6. The device of claim 1, where the one or more processors, when determining that the user device is inside the structure, are to:

determine a boundary associated with the structure; and

determine that the user device is inside the boundary.

7. The device of claim 1, where the information regarding the quantity of the interactions is provided by a sensor, associated with the player to which the camera is directed, that is capable of detecting the interactions of the player with the other players.

8. A non-transitory computer-readable medium storing instructions, the instructions comprising:

one or more instructions that, when executed by a processor, cause the processor to;

determine a geographic location of a user device;

determine, based on the geographic location of the user device and based on an object location associated with an object, that the user device is within a threshold distance of the object;

determine that the user device is inside a structure that includes a plurality of objects based on determining that the user device is within the threshold distance of the object,

the plurality of objects including the object;

receive, from the user device, an image, of a player inside the structure, captured by a camera directed, by a user, at the player after determining that the user device is within the threshold distance of the object,

the player being the object;

analyze the image to identify the object;

determine object information associated with the object; and

provide the object information for display on the user device,

the object information including information regarding a quantity of interactions of the player with other players.

9. The non-transitory computer-readable medium of claim 8,

where the one or more instructions further cause the processor to:

receive a user input identifying the object; and

where the one or more instructions, that cause the processor to analyze the image to identify the object, cause the processor to;

analyze the image based on the user input.

10. The non-transitory computer-readable medium of claim 8, where the one or more instructions, that cause the processor to provide the object information, cause the processor to:

provide the object information to be overlaid on a real-time image of the object on a display of the user device.

11. The non-transitory computer-readable medium of claim 8,

where the one or more instructions further cause the processor to:

determine an object location associated with the object; and

where the one or more instructions, that cause the processor to provide the object information for display on the user device, cause the processor to;

provide the object information for display on the user device based on the object location.

12. The non-transitory computer-readable medium of claim 8,

where the one or more instructions further cause the processor to:

detect a movement of the user device; and

where the one or more instructions, that cause the processor to provide the object for display on the user device, cause the processor to;

provide the object information further based on detecting the movement of the user device.

13. The non-transitory computer-readable medium of claim 8, where the information regarding the quantity of the interactions is provided by a sensor, associated with the player to which the camera is directed, that is capable of detecting the interactions of the player with the other players.

14. The non-transitory computer-readable medium of claim 8, where the one or more instructions, that cause the processor to determine that the user device is inside the structure, cause the processor to:

determine a boundary associated with the structure; and

determine that the user device is inside the boundary.

15. A method, comprising:

determining, by a device, a geographic location of a user device;

determining, by the device, based on the geographic location of the user device, and based on an object location associated with the object, that the user device is within a threshold distance of the object;

determining, by the device, that the user device is within a boundary of a structure that houses a plurality of objects based on determining that the user device is within the threshold distance of the object,

the plurality of objects including the object;

receiving, by the device and from the user device, an image, of a player inside the structure, captured by a camera directed, by a user, at the player,

the player being the object;

analyzing, by the device, the image to identify the object;

determining, by the device, object information associated with the object; and

providing, by the device, the object information for display on the user device,

the object information including information regarding a quantity of interactions of the player with other players.

16. The method of claim 15, further comprising:

receiving a user input identifying the object,

where analyzing the image to identify the object comprises;

analyzing the image based on the user input.

17. The method of claim 15, where providing the object information comprises:

providing the object information to be overlaid on a real-time image of the object on a display of the user device.

18. The method of claim 15, further comprising:

determining an object location associated with the object,

where providing the object information for display on the user device comprises;

providing the object information for display on the user device based on the object location.

19. The method of claim 15, further comprising:

detecting a movement of the user device,

where providing the object for display on the user device comprises;

providing the object information further based on detecting the movement of the user device.

20. The method of claim 15, where the information regarding the quantity of interactions is provided by a sensor, associated with the player to which the camera is directed, that is capable of detecting the interactions of the player with the other players.