Method for occlusion of movable objects and people in augmented reality scenes

• US 6,822,648 B2
• Filed: 04/16/2002
• Issued: 11/23/2004
• Est. Priority Date: 04/17/2001
• Status: Expired due to Fees

• Current Assignee: Information Decision Technologies LLC
• Original Assignee: Information Decision Technologies LLC
• Inventors: Furlong, Todd Joseph, Walker, John Franklin, Ebersole, John Franklin, Ebersole, John Franklin Jr.
• Primary Examiner(s): Zimmerman, Mark
• Assistant Examiner(s): Santiago, Enrique L
• Application Number:
  US10/123,364
• Publication Number:
  US 20020149581A1
• Time in Patent Office: 952 Days
• Field of Search: 345/419, 345/473, 345/474, 345/420, 345/421, 345/427, 345/706, 345/757
• US Class Current: 345/421
• CPC Class Codes: G06T 15/40 Hidden part removal

Abstract

The purpose of the invention is to create a method to allow a real person or movable physical object to occlude virtual objects in a augmented reality application using a single tracking data sensor for objects or only head tracking data for a real person. The method involves occluding virtual objects with a real world human in augmented reality. The method comprises creating an orthogonal plane billboard with soft texture edges representing a user'"'"'s head; creating an orthogonal plane billboard with soft texture edges representing a user'"'"'s torso; positioning and orienting the head billboard using motion tracker data; positioning and orienting the torso billboard relative to the head billboard; displaying the head and torso billboards in real-time 3-D to correspond to the location of a real person; and mixing the resulting image with a live image of a real person.

Claims

1. A method of occluding virtual objects with a real world human in augmented reality comprising:

a. Creating a set of three orthogonal planes that are texture-mapped with soft texture edges representing a user'"'"'s head;

b. Creating a set of three orthogonal planes that are texture-mapped with soft texture edges representing a user'"'"'s torso;

c. Positioning and orienting the set of three orthogonal planes representing the user'"'"'s head using motion tracker data;

d. Positioning and orienting the set of three orthogonal planes representing the user'"'"'s torso relative to the set of three orthogonal planes representing the user'"'"'s head;

e. Displaying the two sets of three orthogonal planes each representing the user'"'"'s head and torso in real-time 3-D to correspond to the location of a real person; and

f. Mixing the resulting image with a live image of a real person.

2. A method of occluding virtual objects with a movable real-world physical object in augmented reality comprising:

a. Creating at least one set of three orthogonal planes that are texture-manned with soft texture edges representing the object;

b. Positioning and orienting the at least one set of three orthogonal planes that represent the object using motion tracker data;

c. Displaying the at least one set of three orthogonal planes that represent the object in real-time 3-D to correspond to the location of the object; and

d. Mixing the resulting image with a live image of the real object.

3. The method of claim 2 in which the movable real world physical object has a joint connecting two parts, one part of which is tracked and the other part of which is connected to the first part by a joint but which is not separately tracked.

4. The method of claim 3 in which the movable real world physical object is a human with a head and a torso.

5. The method of claim 4 in which the head is tracked.

6. The method of claim 2 in which the texture maps fade to transparent at their edges.

7. The method of claim 2 in which at least one set of three orthogonal planes define twelve quadrants bounded by the intersections of the planes.

8. The method of claim 7 in which the texture maps in each quadrant are rendered from back to front.

9. The method of claim 8 in which the texture maps are rendered with depth buffering.

10. The method of claim 2 in which the planes are displayed relative to a view plane of a virtual viewpoint looking at the object.

11. The method of claim 10 in which a plane is rendered to be transparent when it is perpendicular to the view plane of the virtual viewpoint.

12. The method of claim 11 in which the texture map of a plane that is parallel to the view plane of the virtual viewpoint is rendered as opaque.

13. The method of claim 12 in which a linear fade is used to fade the texture map between transparent and opaque as the plane is turned relative to the view plane of the virtual viewpoint.

14. The method of claim 2 in which the edges of the texture maps are blurred.

15. The method of claim 14 in which the blurring comprises a linear fading from solid white to solid black.

16. The method of claim 14 in which the blurring spans what is equivalently approximately one-half inch in real distance.