Landmark triggered image augmentation

• US 9,031,328 B2
• Filed: 01/18/2013
• Issued: 05/12/2015
• Est. Priority Date: 01/18/2013
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Schonfeld, Robert D., Eatedali, Josiah, Hollestelle, Scott C.
• Primary Examiner(s): Carter, Aaron W
• Assistant Examiner(s): Harandi, Siamak
• Application Number:
  US13/745,612
• Publication Number:
  US 20140205195A1
• Time in Patent Office: 844 Days
• Field of Search: None
• US Class Current: 382/209
• CPC Class Codes: G06F 2218/08 Feature extraction
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

System, method, and computer program product to provide an augmented image, by receiving an image, analyzing the image to identify at least two augmentation triggers comprising: (i) a predefined object in the image, and (ii) a predefined landmark in the image, and generating an augmented image based on the analysis of the image, comprising affecting the predefined object with a retrieved augmentation image and adding a fictional character to the augmented image.

Claims

1. A computer-implemented method to augment an image, the method comprising:

receiving the image;

analyzing the image to identify at least two augmentation triggers comprising;

(i) a predefined object in the image, and (ii) a predefined landmark in the image; and

generating an augmented image responsive to identifying the predefined object and the predefined landmark in the image and by operation of one or more computer processors, wherein generating the augmented image comprises;

affecting the predefined object with a retrieved augmentation image; and

adding a fictional character to the augmented image.

2. The method of claim 1, wherein the predefined object is at least partially obscured by the augmentation image, wherein the predefined landmark is identified by an application, wherein the application is configured to independently identify each individual predefined landmark selected from a representation of:

(i) a movie, (ii) a fictional character, (iii) a video game, and (iv) a musician, respectively.

3. The method of claim 2, wherein the application is configured to independently select, as the augmentation image, each individual entity selected from:

(i) a depiction of a real world handheld object, and (ii) a depiction of a virtual hand held object;

wherein the application is configured to independently add each individual fictional character selected from;

(i) a movie character, (ii) a video game character, (iii) an animated character, and (iv) a television character.

4. The method of claim 3, wherein the predefined object is at least one of:

(i) a tangible media containing a movie, (ii) a tangible media containing a musical album, (iii) a tangible media containing a video game, (iv) a toy, (v) a clothing item, and (vi) a tangible consumer product.

5. The method of claim 4, wherein the fictional character is absent from the image.

6. The method of claim 5, wherein the application is configured to transmit the augmented image to a recipient via at least one of (i) an email, (ii) a social media account, and (iii) an image sharing account.

7. The method of claim 6, further comprising providing a locator configured to output the nearest predefined landmark in response to receiving input describing a user'"'"'s location.

8. The method of claim 7, further comprising, determining whether a status of the predefined landmark is active, wherein the predefined landmark comprises an indoor predefined landmark.

9. A computer program product to augment an image, the computer program product comprising:

a non-transitory computer-readable storage medium having computer-readable program code embodied therewith, the computer-readable program code comprising;

computer-readable program code configured to receive an image;

computer-readable program code configured to analyze the image to identify at least two augmentation triggers comprising;

(i) a predefined object in the image, and (ii) a predefined landmark in the image; and

computer-readable program code configured to generate an augmented image responsive to identifying the predefined object and the predefined landmark in the image, wherein generating the augmented image comprises;

affecting the predefined object with a retrieved augmentation image; and

adding a fictional character to the augmented image.

10. The computer program product of claim 9, wherein the predefined object is at least partially obscured by the augmentation image, wherein the predefined landmark is identified by an application, wherein the application is configured to independently identify each individual predefined landmark selected from a representation of:

(i) a movie, (ii) a fictional character, (iii) a video game, and (iv) a musician, respectively.

11. The computer program product of claim 10, wherein the application is configured to independently select, as the augmentation image, each individual entity selected from:

(i) a depiction of a real world handheld object, and (ii) a depiction of a virtual hand held object;

wherein the application is configured to independently add each individual fictional character selected from;

(i) a movie character, (ii) a video game character, (iii) an animated character, and (iv) a television character.

12. The computer program product of claim 11, wherein the predefined object is at least one of:

(i) a tangible media containing a movie, (ii) a tangible media containing a musical album, (iii) a tangible media containing a video game, (iv) a toy, (v) a clothing item, and (vi) a tangible consumer product.

13. The computer program product of claim 12, wherein the fictional character is absent from the image.

14. The computer program product of claim 13, wherein the application is configured to independently transmit the augmented image via each medium selected from:

(i) an email, (ii) a social media account, and (iii) an image sharing account.

15. The computer program product of claim 14, further comprising a locator configured to output the nearest predefined landmark in response to receiving input describing a user'"'"'s location.

16. The computer program product of claim 15, further comprising determining whether a status of the predefined landmark is active, wherein the predefined landmark comprises an indoor predefined landmark.

17. A system, comprising:

one or more computer processors; and

a memory containing a program, which, when executed by the one or more computer processors, performs an operation to augment an image, the operation comprising;

receiving the image;

analyzing the image to identify at least two augmentation triggers comprising;

(i) a predefined object in the image, and (ii) a predefined landmark in the image; and

generating an augmented image responsive to identifying the predefined object and the predefined landmark in the image, comprising;

affecting the predefined object with a retrieved augmentation image; and

adding a fictional character to the augmented image.

18. The system of claim 17, wherein the predefined object is at least partially obscured by the augmentation image, wherein the predefined landmark is identified by an application, wherein the application is configured to independently identify each individual predefined landmark selected from a representation of:

(i) a movie, (ii) a fictional character, (iii) a video game, and (iv) a musician, respectively.

19. The system of claim 18, wherein the application is configured to independently select, as the augmentation image, each individual entity selected from:

(i) a depiction of a real world handheld object, and (ii) a depiction of a virtual hand held object;

wherein the application is configured to independently add each individual fictional character selected from;

(i) a movie character, (ii) a video game character, (iii) an animated character, and (iv) a television character.

20. The system of claim 19, wherein the predefined object is at least one of:

(i) a tangible media containing a movie, (ii) a tangible media containing a musical album, (iii) a tangible media containing a video game, (iv) a toy, (v) a clothing item, and (vi) a tangible consumer product.

21. The system of claim 20, wherein the fictional character is absent from the image.

22. The system of claim 21, wherein the application is configured to independently transmit the augmented image via each medium selected from:

(i) an email, (ii) a social media account, and (iii) an image sharing account.

23. The system of claim 22, further comprising a locator configured to output the nearest predefined landmark in response to receiving input describing a user'"'"'s location.

24. The system of claim 23, further comprising determining whether a status of the predefined landmark is active, wherein the predefined landmark comprises an indoor landmark.