Real-time virtual viewpoint in simulated reality environment

• US 20020158873A1
• Filed: 01/28/2002
• Published: 10/31/2002
• Est. Priority Date: 01/26/2001
• Status: Abandoned Application

• Current Assignee: Zaxel Systems, Inc.
• Original Assignee: Zaxel Systems, Inc.
• Inventors: Williamson, Todd
• Application Number:
  US10/060,008
• Publication Number:
  US 20020158873A1
• Time in Patent Office: Days
• US Class Current: 345/427
• CPC Class Codes: G06T 15/20 Perspective computation
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 7/564 from contours
• CPC Class Codes: G06T 7/85 Stereo camera calibration

Abstract

In one aspect of the present invention, the inventive system is capable of inserting video images of human being, animals or other living beings or life forms, and any clothing or objects that they bring with them, into a virtual environment. It is possible for others participating in the environment to see that person as they currently look, in real-time, and from any viewpoint. In another aspect of the present invention, the inventive system that was developed is capable of capturing and saving information about a real object or group of interacting objects (i.e., non-life forms). These objects can then be inserted into a virtual environment at a later time. It is possible for participants in the environment to see the (possibly moving) objects from any viewpoint, exactly as they would appear in real life. Since the system is completely modular, multiple objects can be combined to produce a composite scene. The object can be a human being performing some rote action if desired. These rote actions can be combined.

Claims

1. A method of rendering video images of a subject at virtual viewpoint in a simulated reality environment, comprising the steps of:

(a) arranging a plurality of video cameras at different views about the subject;

(b) digitally capturing video images of the subject at the different views;

(c) modeling 3D video image of the subject in real-time;

(d) computing virtual images for a viewer at different viewpoints;

(g) incorporating the virtual images into the simulated reality environment in accordance with viewer'"'"'s viewpoint.