Providing advertisements in an augmented reality environment

• US 9,536,251 B2
• Filed: 11/15/2011
• Issued: 01/03/2017
• Est. Priority Date: 11/15/2011
• Status: Active Grant

• Current Assignee: R2 Solutions LLC (Acacia Research Corporation)
• Original Assignee: Excalibur IP, LLC (Acacia Research Corporation)
• Inventors: Huang, Wyatt (Ling-Wei), Chang, Balduran (Chia-Chun), Huang, Connie (Shih-Ting)
• Primary Examiner(s): Jarrett, Scott L
• Application Number:
  US13/296,236
• Publication Number:
  US 20130124326A1
• Time in Patent Office: 1,876 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/005 Input arrangements through a video camera
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06K 7/1417 2D bar codes
• CPC Class Codes: G06Q 30/0252 based on events or environment, e.g. weather or festivals
• CPC Class Codes: G06Q 30/0255 based on user history
• CPC Class Codes: G06Q 30/0261 based on user location
• CPC Class Codes: G06Q 30/0267 Wireless devices
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text

Abstract

A computer-implemented method for providing advertisements in an augmented reality environment to a user includes receiving data related to a marker, the marker placed amongst one or more physical objects captured by the video camera. The computer-implemented method also includes retrieving dynamic digital content associated with the marker. Further, the computer-implemented method includes displaying the dynamic digital content amongst the one or more physical objects. Furthermore, the computer-implemented method includes receiving a user interaction with the dynamic digital content. Moreover, the computer-implemented method includes performing an action based on the user interaction.

Claims

1. A computer-implemented method for providing dynamic digital content within an augmented reality environment by an augmented reality framework, comprising:

receiving, from a client device connected to an augmented reality network in communication with the augmented reality framework, image data captured by a video camera device of the client device that depicts a marker, wherein the marker includes a specific pattern corresponding to a first dynamic digital content and the marker covers, at least in part, a physical product;

receiving, from the client device, first factor information corresponding to a first user;

retrieving first dynamic digital content from a database based on the specific pattern of the marker and the first factor information;

transmitting the first dynamic digital content to the client device for generating a first augmented reality environment on the client device that combines a first current video stream captured by the video camera device and a first virtual video stream including the first dynamic digital content;

receiving, from the client device, second factor information corresponding to a second user;

retrieving second dynamic digital content from the database based on the second factor information;

transmitting the second dynamic digital content to the client device for generating a display of a second augmented reality environment on the client device that combines a second current video stream captured by the video camera device and a second virtual video stream including the second dynamic digital content, wherein the second dynamic digital content is dynamically updated from the first dynamic digital content based on the specific pattern of the marker and the second factor information, the second dynamic digital content having display attributes displayable in accordance with a display capability of the client device;

receiving a user interaction with the second dynamic digital content detected by the client device; and

performing an action based on the user interaction.

2. The method of claim 1, wherein the first dynamic digital content comprises an advertisement related to the physical product.

3. The method of claim 1, further comprising:

converting the marker to a network address, wherein the dynamic digital content is retrieved using the network address.

4. The method of claim 1, wherein the marker comprises a QR code marker.

5. The method of claim 1, wherein a video renderer running on the client device is configured to combine the second current video stream and the second virtual video stream into a single video stream.

6. The method of claim 1, further comprising:

adjusting the second dynamic digital content based on detected movements of the video camera device in relation to the markers.

7. A non-transitory computer-readable medium storing instructions that when executed by a processor included in an augmented reality framework, performs a method for providing dynamic digital content within an augmented reality environment, comprising:

receiving, from a client device connected to an augmented reality network in communication with the augmented reality framework, image data related to a marker captured by the video camera device as covering, at least in part, a physical product, wherein the marker depicts a specific pattern corresponding to dynamic digital content;

receiving, from the client device, first factor information corresponding to a first user;

retrieving first dynamic digital content from a database based on the specific pattern of the marker and the first factor information;

transmitting the first dynamic digital content to the client device for generating a first augmented reality environment on the client device that combines a first current video stream captured by the video camera device and a first virtual video stream including the first dynamic digital content;

receiving, from the client device, second factor information corresponding to a second user;

retrieving second dynamic digital content from the database based on the second factor information;

transmitting the second dynamic digital content to the client device for generating a display of a second augmented reality environment on the client device that combines a second current video stream captured by the video camera device and a second virtual video stream including the second dynamic digital content, wherein the second dynamic digital content is dynamically updated from the first dynamic digital content based on the specific pattern of the marker and the second factor information, the second dynamic digital content having display attributes displayable in accordance with a display capability of the client device;

receiving a user interaction with the second dynamic digital content detected by the client device; and

performing an action based on the user interaction.

8. The non-transitory computer-readable medium of claim 7, wherein the first dynamic digital content comprises an advertisement related to the physical product.

9. The non-transitory computer-readable medium of claim 7, further comprising:

converting the marker to a network address, wherein the dynamic digital content is retrieved using the network address.

10. The non-transitory computer-readable medium of claim 7, wherein the marker comprises a QR code marker.

11. The non-transitory computer-readable medium of claim 7, wherein a video renderer running on the client device is configured to combine the second current video stream and the second virtual video stream into a single video stream.

12. The non-transitory computer-readable medium of claim 7, further comprising:

adjusting the second dynamic digital content based on movements of the video camera device in relation to the markers.

13. A computing device within an augmented reality framework for providing dynamic digital content within an augmented reality environment, comprising:

a network interface in communication with a client device through an augmented reality network, and configured to;

receive, from the client device, image data captured by a video camera device of the client device that depicts a marker, wherein the marker includes a specific pattern corresponding to a first dynamic digital content and the marker covers, at least in part, a physical product;

receive, from the client device, first factor information corresponding to a first user;

retrieve first dynamic digital content from a database, wherein the first dynamic digital content is received based on the specific pattern of the marker and the first factor information;

receive, from the client device, second factor information corresponding to a second user;

retrieve second dynamic digital content from a database, wherein the second dynamic digital content is received based on the specific pattern of the marker and the second factor information; and

a dynamic digital content processor configured to;

control the network interface to transmit the first dynamic digital content to the client device for generating a first augmented first augmented reality environment for presentation on the client device that combines a first current video stream captured by the video camera device and a first virtual video stream including the first dynamic digital content;

control the network interface to transmit the second dynamic digital content to the client device for generating a second augmented first augmented reality environment for presentation on the client device that combines a second current video stream captured by the video camera device and a second virtual video stream including the second dynamic digital content, wherein the second dynamic digital content is dynamically updated from the first dynamic digital content based on the specific pattern of the marker and the second factor information, wherein the second dynamic digital content having display attributes displayable in accordance with a display capability of the client device;

receive a user interaction with the second dynamic digital content detected by the client device; and

control an interaction module to perform an action based on the user interaction.

14. The computing device of claim 13, wherein the first dynamic digital content comprises an advertisement related to the physical product.

15. The computing device of claim 13, wherein the computing device comprises a mobile computing device.