Augmented reality system

• US 7,301,547 B2
• Filed: 03/22/2002
• Issued: 11/27/2007
• Est. Priority Date: 03/22/2002
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Junkins, Stephen, Martins, Fernando C. M., Plumb, Jason E.
• Primary Examiner(s): YANG, RYAN R
• Application Number:
  US10/104,471
• Publication Number:
  US 20030179218A1
• Time in Patent Office: 2,076 Days
• Field of Search: 345/632, 345/633, 345/848, 345/419, 382/216
• US Class Current: 345/633
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 2210/04 Architectural design, interior design
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering

Abstract

A virtual reality system surveys a real-world environment, generates 3D data that defines the real-world environment, renders a virtual 3D environment using the 3D data, retrieves a virtual object from a database comprised of pre-stored virtual objects, renders the virtual object in the virtual 3D environment, and re-positions the virtual object in the virtual 3D environment.

Claims

1. A method comprising:

generating a virtual three-dimensional environment using information from a single device, wherein the virtual three-dimensional environment is navigable to simulate movement in three dimensions in a real-world environment, and wherein generating comprises;

determining a position of the device using the information; and

identifying content of the virtual three-dimensional environment by using the information to locate at least three points of a plane in the real-world environment that behave similarly during motion relative to the position of the device;

retrieving a virtual object; and

rendering the virtual object in the virtual three-dimensional environment for display to a user;

wherein the simulated movement is independent of the position of the device.

2. The method of claim 1, wherein generating the virtual three-dimensional environment comprises:

surveying the real-world environment using the device;

generating three-dimensional data that defines the real-world environment using the position, the three-dimensional data corresponding to the content; and

rendering the virtual three-dimensional environment using the three-dimensional data.

3. The method of claim 1, further comprising:

scaling the virtual object in accordance with a size of the virtual three-dimensional environment.

4. The method of claim 3, wherein scaling comprises:

obtaining a size of a target in the real-world; and

changing a size of the virtual object in accordance with the size of the target.

5. The method of claim 1, further comprising:

illuminating the virtual object in the virtual three-dimensional environment to simulate lighting in the real-world environment.

6. The method of claim 1, wherein the virtual object is retrieved from a database comprised of pre-stored virtual objects.

7. A method comprising:

generating, using information from a single device, three-dimensional data that defines the real-world environment, wherein generating comprises;

determining a position of the device using the information; and

identifying, and generating three-dimensional data for, content of the virtual three-dimensional environment by using the information to locate at least three points of a plane in a real-world environment that behave similarly during motion relative to the position of the device;

rendering a virtual three-dimensional environment using the three-dimensional data for display to a user, wherein the virtual three-dimensional environment is navigable to simulate movement in three dimensions in the real-world environment;

retrieving a virtual object from a database comprised of pre-stored virtual objects;

rendering the virtual object in the virtual three-dimensional environment; and

re-positioning the virtual object in the virtual three-dimensional environment;

wherein the simulated movement is independent of the position of the device.

8. The method of claim 7, further comprising:

illuminating the virtual object in the virtual three-dimensional environment to simulate lighting in the real-world environment.

25. The method of claim 7, wherein the position of the device is used in rendering the virtual object.

9. An article comprising a computer-readable medium that stores executable instructions to:

generate a virtual three-dimensional environment using information from a single device, wherein the virtual three-dimensional environment is navigable to simulate movement in three dimensions in a real-world environment, and wherein generating comprises;

determining a position of the device using the information; and

identifying content of the virtual three-dimensional environment by using the information to locate at least three points of a plane in the real-world environment that behave similarly during motion relative to the position of the device;

retrieve a virtual object; and

render the virtual object in the virtual three-dimensional environment for display to a user;

wherein the simulated movement is independent of the position of the device.

10. The article of claim 9, wherein generating the virtual three-dimensional environment comprises:

generating three-dimensional data that defines the real-world environment using the position, the three-dimensional data corresponding to the content; and

rendering the virtual three-dimensional environment using the three-dimensional data.

11. The article of claim 9, further comprising instructions that cause the computer to:

scale the virtual object in accordance with a size of the virtual three-dimensional environment.

12. The article of claim 11, wherein scaling comprises:

obtaining a size of a target in the real-world; and

changing a size of the virtual object in accordance with the size of the target.

13. The article of claim 9, further comprising instructions that cause the computer to:

illuminate the virtual object in the virtual three-dimensional environment to simulate lighting in the real-world environment.

14. The article of claim 9, wherein the virtual object is retrieved from a database comprised of pre-stored virtual objects.

15. An article comprising a computer-readable medium that stores executable instructions to:

generate, using information from a single device, three-dimensional data that defines the real-world environment, wherein generating comprises;

determining a position of the device using the information; and

identifying, and generating three-dimensional data for, content of the virtual three-dimensional environment by using the information to locate at least three points of a plane in a real-world environment that behave similarly during motion relative to the position of the device;

render a virtual three-dimensional environment using the three-dimensional data for display to a user, wherein the virtual three-dimensional environment is navigable to simulate movement in three dimensions in the real-world environment;

retrieve a virtual object from a database comprised of pre-stored virtual objects;

render the virtual object in the virtual three-dimensional environment; and

re-position the virtual object in the virtual three-dimensional environment;

wherein the simulated movement is independent of the position of the device.

16. The article of claim 15, further comprising instructions that cause the computer to:

illuminate the virtual object in the virtual three-dimensional environment to simulate lighting in the real-world environment.

26. The article of claim 15, wherein the position of the device is used in rendering the virtual object.

17. An apparatus comprising:

a memory that stores executable instructions; and

a processor that executes the instructions to;

generate a virtual three-dimensional environment using information from a single device, wherein the virtual three-dimensional environment is navigable to simulate movement in three dimensions in a real-world environment, and wherein generating comprises;

determining a position of the device using the information; and

identifying content of the virtual three-dimensional environment by using the information to locate at least three points of a plane in the real-world environment that behave similarly during motion relative to the position of the device;

retrieve a virtual object; and

render the virtual object in the virtual three-dimensional environment for display to a user;

wherein the simulated movement is independent of the position of the device.

18. The apparatus of claim 17, wherein generating the virtual three-dimensional environment comprises:

generating three-dimensional data that defines the real-world environment using the position, the three-dimensional data corresponding to the content; and

rendering the virtual three-dimensional environment using the three-dimensional data.

19. The apparatus of claim 17, wherein the processor executes instructions to:

scale the virtual object in accordance with a size of the virtual three-dimensional environment.

20. The apparatus of claim 19, wherein scaling compnses:

obtaining a size of a target in the real-world; and

changing a size of the virtual object in accordance with the size of the target.

21. The apparatus of claim 17, wherein the processor executes instructions to:

illuminate the virtual object in the virtual three-dimensional environment to simulate lighting in the real-world environment.

22. The apparatus of claim 17, wherein the virtual object is retrieved from a database comprised of pre-stored virtual objects.

23. An apparatus comprising:

memory that stores executable instructions; and

a processor that executes the instructions to;

generate, using information from a single device, three-dimensional data that defines the real-world environment, wherein generating comprises;

determining a position of the device using the information; and

identifying, and generating three-dimensional data for, content of the virtual three-dimensional environment by using the information to locate at least three points of a plane in a real-world environment that behave similarly during motion relative to the position of the device;

render a virtual three-dimensional environment using the three-dimensional data for display to a user, wherein the virtual three-dimensional environment is navigable to simulate movement in three dimensions in the real-world environment;

retrieve a virtual object from a database comprised of pre-stored virtual objects;

render the virtual object in the virtual three-dimensional environment; and

re-position the virtual object in the virtual three-dimensional environment;

wherein the simulated movement is independent of the position of the device.

24. The apparatus of claim 23, wherein the processor executes instructions to:

illuminate the virtual object in the virtual three-dimensional environment to simulate lighting in the real-world environment.

27. The apparatus of claim 23, wherein the position of the device is used in rendering the virtual object.