Augmented reality experience unlock via target image detection

• US 10,706,459 B2
• Filed: 06/19/2018
• Issued: 07/07/2020
• Est. Priority Date: 06/20/2017
• Status: Active Grant

• Current Assignee: Nike, Inc.
• Original Assignee: Nike, Inc.
• Inventors: Faris, Ron, House, Jett, Uhrmacher, Aaron
• Primary Examiner(s): Fadok, Mark A
• Application Number:
  US16/011,872
• Publication Number:
  US 20180365760A1
• Time in Patent Office: 749 Days
• CPC Class Codes: G06F 16/27 Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0631 Item recommendations
• CPC Class Codes: G06Q 30/0643 Graphical representation of items or shoppers
• CPC Class Codes: G06Q 50/01 Social networking
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

Systems and methods for unlocking selective access for purchasing consumer products through augmented reality are disclosed. A user'"'"'s mobile device may use augmented reality to capture an image and recognize a target in the image. Upon recognition of a target in the image, the device may overlay a three-dimensional model of a consumer product, and unlock the user access to purchase the consumer product shown.

Claims

1. A method comprising:

displaying an image, on a first display screen of a first device operated by a first user or on an online platform accessible to a second device operated by a second user that is different from the first user;

capturing the image, by the second device and from the first display screen displaying the image or from the online platform displaying the image;

determining, by the second device, that the image is a target image;

transmitting, by the second device and to a database, one or more messages indicating that the image is a target image;

receiving, by the second device and from the database, instructions to unlock access to the second user to a product;

overlaying, by the second device responsive to receiving the instructions, a first image of the product on a display image; and

outputting, on a second display screen of the second device, the first image of the product on the display image.

2. The method of claim 1, wherein overlaying a first image of the product on the display image comprises projecting a three-dimensional image of the product onto the target image.

3. The method of claim 2, further comprising:

outputting, by the second device and to a graphical user interface, a user input to allow the second user to select the three-dimensional image of the product.

4. The method of claim 1, wherein determining that the image is the target image comprises communicating with the database to determine that the image is the target image.

5. The method of claim 1, further comprising:

granting, by the second device, the second user access to purchase the product.

6. The method of claim 1, wherein the online platform is a social media platform.

7. The method of claim 1, wherein the second device is a mobile device.

21. The method of claim 1, wherein the image is captured using image capture hardware of the second device.

22. The method of claim 1, wherein the access to the product is required for the second user to obtain the product.

23. The method of claim 1, wherein the image is shared to the online platform by the first user using the first device.

8. An apparatus comprising:

a first display device configured to be operated by a first user;

one or more processors;

memory storing computer-readable instructions that, when executed by the one or more processors, cause the apparatus to;

capture an image from a second display device displaying the image or from an online platform displaying the image that is accessible to the apparatus, where the second display device is configured to be operated by a second user that is different from the first user;

determine that the image is a target image;

transmit, to a database, one or more messages indicating that the image is a target image;

receive, from the database, confirmation that the image is the target image and instructions to unlock access to a product;

overlay, responsive to receiving the confirmation, a first image of the product on a display image to generate an overlaid image;

display, on the first display device of the apparatus, the overlaid image;

share, to an online platform, the overlaid image;

determine, based on the sharing, that access to the product has been unlocked; and

display, on the first display device, a first graphical user interface indicating that access to the product by the first user has been unlocked.

9. The apparatus of claim 8, wherein overlaying a first image of the product on the display image comprises projecting a three-dimensional image of the product onto the target image.

10. The apparatus of claim 9, the memory storing computer-readable instructions that, when executed by the one or more processors, cause the apparatus to:

output, to the first graphical user interface, a user input to allow the first user to select the three-dimensional image of the product.

11. The apparatus of claim 8, wherein determining that the image is the target image comprises communicating with the database to determine that the image is the target image.

12. The apparatus of claim 8, the memory storing computer-readable instructions that, when executed by the one or more processors, cause the apparatus to:

grant the first user access to purchase the product.

13. The apparatus of claim 8, wherein the image is captured from a social media platform.

24. The apparatus of claim 8, wherein unlocking the access to the product is required for the first user to obtain the product.

25. The apparatus of claim 8, wherein the computer-readable instructions, when executed by the one or more processors, cause the apparatus to capture the image using image capture hardware of the first display device.

26. The apparatus of claim 8, wherein the image was shared to the online platform by a second apparatus including the second display device.

14. A system comprising:

a first computing device configured to be operated by a first user, wherein the first computing device is configured to;

display an image on a first display screen of the first computing device;

transmit the image to an online platform for displaying the image on the online platform; and

a second computing device configured to be operated by a second user that is different from the first user, wherein the online platform is accessible to the second computing device, and the second computing device is configured to;

capture the image from the first display screen displaying the image or from the online platform displaying the image;

determine that the image is a target image;

transmit, to a database, one or more messages indicating that the image is a target image;

receive, from the database, instructions to unlock access to the second user to a product;

overlay, responsive to receiving the instructions, a first image of the product on a display image; and

output the first image of the product on the display image to a second display screen of the second computing device.

15. The system of claim 14, wherein overlaying a first image of the product on the display image comprises projecting a three-dimensional image of the product onto the target image.

16. The system of claim 15, wherein the second computing device is further configured to:

output, to a graphical user interface, a user input to allow the second user to select the three- dimensional image of the product.

17. The system of claim 14, wherein determining that the image is the target image comprises communicating with the database to determine that the image is the target image.

18. The system of claim 14, wherein the second computing device is further configured to:

grant the second user access to purchase the product.

19. The system of claim 14, wherein the online platform is a social media platform.

20. The system of claim 14, wherein one or more of the first computing device and the second computing device is a mobile device.

27. The system of claim 14, wherein the second computing device is configured to capture the image using image capture hardware of the second computing device.

28. The system of claim 14, wherein the access to the product is required for the second user to obtain the product.