Personal augmented reality

• US 10,614,602 B2
• Filed: 12/13/2016
• Issued: 04/07/2020
• Est. Priority Date: 12/29/2011
• Status: Active Grant

• Current Assignee: eBay Inc.
• Original Assignee: eBay Inc.
• Inventors: Zises, Matthew Scott
• Primary Examiner(s): Patel, Nirav G
• Application Number:
  US15/377,651
• Publication Number:
  US 20170091975A1
• Time in Patent Office: 1,211 Days
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 3/40 Scaling of whole images or parts thereof, e.g. expanding or contracting
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

Image data comprising an image of an environment is received from a mobile video device located at the environment. An image of a marker is extracted from the received image for use in identifying the location of the mobile video device. A location associated with the marker is extracted from a database and the extracted location is sent as the location of the mobile video device. Also received is a request for information about an item in the environment that is of interest to a user of the mobile video device. A location in the environment associated with the item of interest is identified, and the information indicating the location of the item is transmitted to the mobile device for display within an image of the environment on the mobile video device. The item of interest may be displayed as an augmented reality within an image of the environment.

Claims

1. A method of augmenting a user'"'"'s viewing experience of a sporting event played with a ball and at least one player, the method comprising:

receiving, from a user device located at an environment at which the user is viewing the sporting event, image data describing an image that includes the environment and the at least one player;

receiving a request, from the same user device, for an item of information comprising statistics that relate to the at least one player, for placement into an image of the environment at the same user device;

responsive to receiving the request, accessing a database to retrieve the item of information for the at least one player;

generating a scaled image of the item of information based on dimensions of the image of the environment as output by the same user device;

transmitting the scaled image to the same user device for placement into the display of the image of the environment to cause generation of an augmented reality image; and

transmitting information to the same user device describing a trajectory of the ball and causing a representation of the trajectory of the ball to be included in the augmented reality image.

2. The method of claim 1 wherein request comprises an image of a uniform number of the at least one player.

3. The method of claim 1 wherein the request comprises an image of the at least one player'"'"'s face and the statistics relating to the at least one player are determined using a facial recognition algorithm.

4. The method of claim 1 wherein the augmented reality image comprises an arrow or other location indicator pointing to the at least one player.

5. The method of claim 1 wherein the sporting event is a baseball game, and the item of information includes one of statistics of relevant teams, statistics by positions played by players of the relevant teams, pitching rotation of pitchers playing for the relevant teams, current league standings of the relevant teams, or possible playoff scenarios for the relevant teams.

6. The method of claim 1, further including targeting an advertisement to the user device based on the user'"'"'s purchase history, interest, or location.

7. The method of claim 1 wherein the information describing the trajectory of the ball is ascertained from a tracking device included in the ball.

8. One or more computer-readable hardware storage device having stored therein a set of instructions which, when executed by one or more processors of a computer, causes the computer to execute operations comprising:

receiving, from a user device located at an environment at which a user is viewing a sporting event, image data describing an image that includes the environment and a player in the sporting event;

receiving a request, from the same user device, for an item of information comprising statistics that relates to the player, for placement into the image of the environment;

responsive to receiving the request from the same user device, performing recognition on the image to recognize the player and accessing a database to retrieve the item of information for the player;

generating a scaled image of the item of information based on dimensions of the image of the environment as output by the same user device;

transmitting the scaled image to the same user device for placement into the image of the environment to generate an augmented reality image; and

transmitting information to the same user device describing a trajectory of a ball for the sporting event and causing a representation of the trajectory of the ball to be included in the augmented reality image.

9. The one or more computer-readable hardware storage device of claim 8 wherein the request comprises an image of a uniform number of the player.

10. The one or more computer-readable hardware storage device of claim 8 wherein the request comprises an image of the player'"'"'s face and the statistics relating to the player are determined using a facial recognition algorithm.

11. The one or more computer-readable hardware storage device of claim 8, the operations further comprising targeting an advertisement to the user device based on the user'"'"'s purchase history, interest, or location.

12. The one or more computer-readable hardware storage device of claim 8 wherein the augmented reality image comprises an arrow or other location indicator pointing to the player.

13. The one or more computer-readable hardware storage device of claim 8 wherein the trajectory of the ball is ascertained from a tracking device included in the ball.

14. A system for augmenting a user'"'"'s viewing experience of a sporting event played with a ball and at least one player, the system comprising:

one or more processors;

one or more computer-readable storage media storing instructions which, when executed by the one or more processors, implement a method comprising;

receiving, from a user device located at an environment at which the user is viewing the sporting event, image data describing an image that includes the environment and the at least one player;

receiving a request, from the same user device, for an item of information comprising statistics that relate to the at least one player, for placement into an image of the environment at the same user device;

responsive to receiving the request, accessing a database to retrieve the item of information for the at least one player;

generating a scaled image of the item of information based on dimensions of the image of the environment as output by the same user device;

transmitting the scaled image to the same user device for placement into the display of the image of the environment to cause generation of an augmented reality image; and

transmitting information to the same user device describing a trajectory of the ball and causing a representation of the trajectory of the ball to be included in the augmented reality image.

15. The system of claim 14 wherein request comprises an image of a uniform number of the at least one player.

16. The system of claim 15 wherein the request comprises an image of the at least one player'"'"'s face and the statistics relating to the at least one player are determined using a facial recognition algorithm.

17. The system of claim 15 wherein the augmented reality image comprises an arrow or other location indicator pointing to the at least one player.

18. The system of claim 15 wherein the sporting event is a baseball game, and the item of information includes one of statistics of relevant teams, statistics by positions played by players of the relevant teams, pitching rotation of pitchers playing for the relevant teams, current league standings of the relevant teams, or possible playoff scenarios for the relevant teams.

19. The system of claim 15, further including targeting an advertisement to the user device based on the user'"'"'s purchase history, interest, or location.

20. The system of claim 15 wherein the trajectory of the ball is ascertained from an RFID chip included in the ball.