Time constrained augmented reality

• US 20150206353A1
• Filed: 12/22/2014
• Published: 07/23/2015
• Est. Priority Date: 12/23/2013
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Calisa, Rajanish, Grasso, Matthew John, Yee, Belinda Margaret, Monaghan, David Robert James, De Lellis, Oscar Alejandro
• Granted Patent: US 9,633,479 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 3/147 using display panels
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00

Abstract

A method of displaying virtual content on an augmented reality device (101) is disclosed. The virtual content is associated with a scene. An image of a scene captured using the augmented reality device (101) is received. A viewing time of the scene is determined, according to a relative motion between the augmented reality device and the scene. Virtual content is selected, from a predetermined range of virtual content, based on the determined viewing time. The virtual content is displayed on the augmented reality device (101) together with the image of the scene.

Claims

1. A method of displaying virtual content on an augmented reality device, the virtual content being associated with a scene, the method comprising:

receiving an image of a scene captured using the augmented reality device;

determining a viewing time of the scene, according to a relative motion between the augmented reality device and the scene;

selecting virtual content, from a predetermined range of virtual content, based on the determined viewing time; and

displaying the virtual content on the augmented reality device together with the image of the scene.

2. A method according to claim 1, wherein the viewing time is determined by at least determining a change in pose.

3. A method according to claim 1, wherein depth information is used to determine distance between an object in the scene and the augmented reality device.

4. A method according to claim 1, wherein depth information is used to determine distance between an object in the scene and the augmented reality device, the viewing time being determined by determining a relative velocity based on a change in said distance.

5. A method according to claim 1, wherein the virtual content is selected based on a complexity measure of the virtual content.

6. A method according to claim 1, wherein the virtual content is selected based on a complexity measure of the virtual content, and wherein the complexity measure provides an indication of an amount of detail in the virtual content.

7. A method according to claim 1, wherein the virtual content is selected based on a complexity measure of the virtual content, and wherein the complexity measure is a network limitation.

8. A method according to claim 1, wherein the virtual content is selected based on a complexity measure of the virtual content, and wherein the complexity measure is a device capability.

9. A method according to claim 1, wherein the virtual content is selected based on a complexity measure of the virtual content, and wherein the complexity measure is an environmental limitation.

10. A method according to claim 1, wherein the virtual content is selected based on a complexity measure of the virtual content, and wherein the complexity measure is an indication is a measure of time to perform an action.

11. A method according to claim 1, wherein the relative motion is a relative velocity.

12. A method according to claim 1, further comprising retrieving a viewing radius associated with the scene.

13. A method according to claim 1, further comprising determining if a real-world distance is within a viewing radius associated with the scene.

14. The method according to claim 1, wherein the scene captured using the augmented reality device includes an identifier and the viewing time of the scene is further determined based on timetable information related to the identifier.

15. The method according to claim 1, wherein the viewing time is further determined based on historical viewing times of the virtual content.

16. A system for displaying virtual content on an augmented reality device, the virtual content being associated with a scene, the system comprising:

a memory for storing data and a computer program;

a processor coupled to the memory for executing the computer program, the computer program comprising instructions for;

receiving an image of a scene captured using the augmented reality device;

determining a viewing time of the scene, according to a relative motion between the augmented reality device and the scene;

selecting virtual content, from a predetermined range of virtual content, based on the determined viewing time; and

displaying the virtual content on the augmented reality device together with the image of the scene.

17. An apparatus for displaying virtual content on an augmented reality device, the virtual content being associated with a scene, the apparatus comprising:

means for receiving an image of a scene captured using the augmented reality device;

means for determining a viewing time of the scene, according to a relative motion between the augmented reality device and the scene;

means for selecting virtual content, from a predetermined range of virtual content, based on the determined viewing time; and

means for displaying the virtual content on the augmented reality device together with the image of the scene.

18. A computer readable medium having a computer program stored thereon for displaying virtual content on an augmented reality device, the virtual content being associated with a scene, the program comprising:

code for receiving an image of a scene captured using the augmented reality device;

code for determining a viewing time of the scene, according to a relative motion between the augmented reality device and the scene;

code for selecting virtual content, from a predetermined range of virtual content, based on the determined viewing time; and

code for displaying the virtual content on the augmented reality device together with the image of the scene.