Positioning of projected augmented reality content

• US 9,721,391 B2
• Filed: 05/11/2015
• Issued: 08/01/2017
• Est. Priority Date: 05/13/2014
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Monaghan, David Robert James, Yee, Belinda Margaret, De Lellis, Oscar Alejandro
• Primary Examiner(s): Gray, Ryan M
• Application Number:
  US14/709,267
• Publication Number:
  US 20150332507A1
• Time in Patent Office: 813 Days
• Field of Search: None
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06F 3/14 Digital output to display device ; Cooperation and interconnection of the display device with other functional units
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/41 based on statistical description of texture
• CPC Class Codes: G09G 2370/022 Centralised management of display operation, e.g. in a server instead of locally
• CPC Class Codes: G09G 3/002 to project the image of a two-dimensional display, such as an array of light emitting or modulating elements or a CRT
• CPC Class Codes: H04N 9/3188 Scale or resolution adjustment scaling in general G06T3/40; resolution modifying circuits for displays in general G09G5/391
• CPC Class Codes: H04N 9/3194 including sensor feedback

Abstract

A method of displaying augmented reality content on a physical surface is disclosed. A surface complexity measure is determined for the physical surface from a captured image of the physical surface. A content complexity measure is determined for the augmented reality content to be applied to the physical surface. The content complexity measure represents an amount of fine detail in the augmented reality content. The method determines if the amount of fine detail in the augmented reality content is to be modified, based on a function of the surface complexity measure and said content complexity measure. A display attribute of the augmented reality content is adjusted to modify the fine detail in the augmented reality content. The modified augmented reality content is displayed on the physical surface.

Claims

1. A method of displaying augmented reality content on a physical surface, the method comprising:

determining a surface complexity measure for said physical surface from a captured image of said physical surface, said surface complexity measure representing an amount of fine detail in said captured image;

determining a content complexity measure for the augmented reality content to be applied to said physical surface, said content complexity measure representing an amount of fine detail in said augmented reality content;

adjusting a display attribute of said augmented reality content, based on a comparison of said surface complexity measure and said content complexity measure, to modify the fine detail in said augmented reality content thereby improving the legibility of the augmented reality content against said physical surface; and

displaying the modified augmented reality content on said physical surface.

2. The method according to claim 1, wherein the display attribute is a size of the content.

3. The method according to claim 1, further comprising capturing an image of a portion of the physical surface.

4. The method according to claim 3, further comprising dividing the image into tiles.

5. The method according to claim 1, further comprising selecting a region of the physical surface for displaying the modified augmented reality content.

6. The method according to claim 5, further comprising determining a geometric centre of the region.

7. The method according to claim 5, further comprising identifying an image on a printed document.

8. The method according to claim 5, wherein the region is based on a user gesture.

9. The method according to claim 1, further comprising comparing the surface complexity measure to the content complexity measure to determine if the amount of fine detail in said augmented reality content is to be modified.

10. The method according to claim 1, further comprising projecting the modified augmented reality content.

11. The method according to claim 1, wherein the modified augmented reality content is displayed on the physical surface within a selected region of said physical surface.

12. The method according to claim 1, wherein the content complexity measure is standard deviation.

13. The method according to claim 1, wherein the content complexity measure is entropy.

14. A system for displaying augmented reality content on a physical surface, the system comprising:

a memory for storing data and a computer program;

a processor coupled to the memory for executing said computer program, said computer program comprising instructions for;

determining a surface complexity measure for said physical surface from a captured image of said physical surface, said surface complexity measure representing an amount of fine detail in said captured image;

determining a content complexity measure for the augmented reality content to be applied to said physical surface, said content complexity measure representing an amount of fine detail in said augmented reality content;

adjusting a display attribute of said augmented reality content, based on a comparison of said surface complexity measure and said content complexity measure, to modify the fine detail in said augmented reality content thereby improving the legibility of the augmented reality content against said physical surface; and

displaying the modified augmented reality content on said physical surface.

15. A non-transitory computer readable medium having a computer program stored thereon for displaying augmented reality content on a physical surface, the program comprising:

code for determining a surface complexity measure for said physical surface from a captured image of said physical surface, said surface complexity measure representing an amount of fine detail in said captured image;

code for determining a content complexity measure for the augmented reality content to be applied to said physical surface, said content complexity measure representing an amount of fine detail in said augmented reality content;

code for adjusting a display attribute of said augmented reality content, based on a comparison of said surface complexity measure and said content complexity measure, to modify the fine detail in said augmented reality content thereby improving the legibility of the augmented reality content against said physical surface; and

code for displaying the modified augmented reality content on said physical surface.