AUGMENTED REALITY CREATION AND CONSUMPTION

• US 20140079281A1
• Filed: 09/17/2012
• Published: 03/20/2014
• Est. Priority Date: 09/17/2012
• Status: Abandoned Application

• Current Assignee: Gravity Jack, Inc.
• Original Assignee: Gravity Jack, Inc.
• Inventors: Williams, Mitchell Dean, Poindexter, Shawn David, Wilding, Matthew Scott, Hamming, Benjamin William, Rollins, Marc Andrew, Ridgway, Randal Sewell, Richey, Aaron Luke, Buck, Damon John
• Application Number:
  US13/621,793
• Publication Number:
  US 20140079281A1
• Time in Patent Office: Days
• US Class Current: 382/103
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures
• CPC Class Codes: G06V 20/20 in augmented reality scenes

Abstract

Architectures and techniques for augmenting content on an electronic device are described herein. In particular implementations, a user may use a portable device (e.g., a smart phone, tablet computer, etc.) to capture images of an environment, such as a room, outdoors, and so on. As the images of the environment are captured, the portable device may send information to a remote device (e.g., server) to determine whether augmented reality content is associated with a textured target in the environment (e.g., a surface or portion of a surface). When such a textured target is identified, the augmented reality content may be sent to the portable device. The augmented reality content may be displayed in an overlaid manner on the portable device as real-time images are displayed.

Claims

1. A portable computing device comprising:

a display;

a camera;

one or more processors; and

memory, communicatively coupled to the one or more processors, storing executable instructions that, when executed by the one or more processors, perform acts comprising;

capturing an image with the camera, the image representing a textured target in an environment in which the portable computing device is located;

identifying features in the image that correspond to points of interest;

sending feature information representing the features to a remote computing device to identify the textured target and obtain content associated with the textured target;

receiving the content that is associated with the textured target from the remote computing device; and

simultaneously displaying the content and a substantially real-time image of the environment on the display.

2. The portable computing device of claim 1, wherein displaying the content includes displaying the content over the real-time image at a location that is related to a displayed location of the textured target.

3. The portable computing device of claim 2, wherein the content is displayed at the displayed location of the textured target or within a predetermined proximity to the displayed location of the textured target.

4. The portable computing device of claim 1, wherein the textured target comprises a surface or a portion of a surface within the environment that has a particular textured characteristic.

5. The portable computing device of claim 1, wherein the feature information comprises one or more feature descriptors describing the features.

6. The portable computing device of claim 1, wherein the content comprises item details for an item related to the textured target, interactive content that is selectable by a user, or social media content associated with the textured target.

7. A computer-implemented method comprising:

under control of a client computing device configured with computer-executable instructions,

obtaining an image through a camera of the client computing device, the image at least partly representing an environment in which the client computing device is located;

identifying features in the image that correspond to points of interest;

identifying a textured target associated with the features; and

displaying content that is associated with the textured target on a display of the client computing device while displaying the image or another image of the environment on the display.

8. The method of claim 7, wherein displaying the content comprises displaying the content over the image or the other image at a location that is related to a displayed location of the textured target.

9. The method of claim 8, wherein the content is displayed at the displayed location of the textured target or within a predetermined proximity to the displayed location of the textured target.

10. The method of claim 7, wherein the content comprises item details for an item related to the textured target, interactive content that is selectable by a user, or social media content associated with the textured target.

11. The method of claim 7, wherein the client computing device comprises a smart phone or a tablet computer.

12. The method of claim 7, further comprising:

before displaying the content, determining a geographical location of the client computing device, the content that is displayed on the display of the client computing device being based at least in part on the geographical location of the client computing device.

13. A method comprising:

receiving input from a user through an interface, the input requesting to search for a textured target that is associated with content;

searching in an environment of the user to identify the textured target that is associated with content;

upon identifying the textured target within the environment, displaying information in the interface indicating that the content is available for download;

receiving through the interface input from the user requesting to download the content; and

upon receiving the input requesting to download the content, downloading the content and displaying the content in the interface while a substantially real-time image of the environment is displayed in the interface.

14. The method of claim 13, wherein searching in the environment to identify the textured target comprises:

obtaining an image that at least partly includes the textured target;

identifying features in the image that correspond to points of interest;

sending feature information representing the features to a remote computing device; and

receiving information from the remote computing device indicating that the textured target is identified.

15. The method of claim 13, wherein upon initializing searching for the textured target, displaying information in the interface indicating that the search is being performed.

16. The method of claim 13, wherein the content comprises item details for an item related to the textured target, interactive content that is selectable by a user, or social media content associated with the textured target.

17. One or more computer-readable storage media storing computer-readable instructions that, when executed, instruct one or more processors to perform operations comprising:

receiving input from a user through an interface, the input requesting to identify social media content within an environment of the user;

searching in the environment of the user to identify social media content that is associated with a geographical location being imaged;

upon identifying the social media content, displaying social media information in the interface at a location in a substantially real-time image of the environment, the location corresponding to the geographical location of the social media content.

18. The one or more computer-readable storage media of claim 17, wherein the social media information indicates that a post from a user of a social network has been associated with the geographical location.

19. The one or more computer-readable storage media of claim 17, wherein the social media information indicates an identity of a user of a social network that is associated with the geographical location.

20. The one or more computer-readable storage media of claim 17, wherein the operations further comprise:

upon displaying the social media information, receiving a selection of the social media information from the user through the interface; and

upon receiving the selection of the social media information, displaying the social media content.

21. The one or more computer-readable storage media of claim 20, wherein the social media content comprises a post from another user or profile information of the other user.

22. The one or more computer-readable storage media of claim 17, wherein searching in the environment to identify the social media content comprises:

obtaining an image of the environment of the user;

determining a geographical location associated with one or more pixels in the image;

sending the geographical location associated with the one or more pixels to a remote computing device; and

receiving the social media information from the remote computing device or another remote computing device, the social media information being associated with the geographical location of the one or more pixels.

23. A computer-implemented method comprising:

under control of a client computing device configured with computer-executable instructions,

obtaining an image through a camera of the client computing device, the image at least partly representing an environment in which the client computing device is located;

identifying features in the image that correspond to points of interest;

identifying a textured target associated with the features;

determining a geographical location associated with the image or the client computing device; and

simultaneously displaying content and a substantially real-time image of the environment, the content being based at least in part on the identified textured target and the geographical location.