Method and system for high performance computer-generated virtual environments

• US 5,905,499 A
• Filed: 07/05/1995
• Issued: 05/18/1999
• Est. Priority Date: 07/05/1995
• Status: Expired due to Term

• Current Assignee: Fakespace, Incorporated
• Original Assignee: Fakespace, Incorporated
• Inventors: Bolas, Mark T., McDowall, Ian E.
• Primary Examiner(s): Buchel, Jr., Rudolph J.
• Application Number:
  US08/498,221
• Time in Patent Office: 1,413 Days
• Field of Search: 395/130, 395/125, 345/419, 345/420, 345/430, 345/433, 345/434-435
• US Class Current: 345/419
• CPC Class Codes: G06T 15/10 Geometric effects
• CPC Class Codes: H04N 13/279 the virtual viewpoint locations being selected by the viewers or determined by tracking
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/366 using viewer tracking

Abstract

A computer system and computer-implemented method for rendering images in real-time with a three-dimensional appearance. Using a database including at least one pair of texture maps uses as a stereo pair behind a portal to simulate a scene. An input database can be processed to generate a processed database by performing texture mapping to replace at least one portion of the input data representing a view (or object) by data indicative of a pair of texture maps and an associated polygon or polygons. One of the texture maps represents the view (object) from a left-eye viewpoint; the other represents the view (object) from a right-eye viewpoint. In some embodiments, to generate the texture map pairs, the input database analyzed to produce the images. In other embodiments the images are from photographs or other sources.

Claims

1. A method for rendering a virtual environment comprising a first environment and a second environment wherein said second environment can image of a group of real world objects, wherein the group of real world objects has a three dimensional appearance, said method comprising the steps of

supplying a database with a plurality of stereoscopic pairs of texture maps for associated polygons, wherein at least some of the polygons correspond to the group of real world objects, and at least some of the pairs of texture maps comprise an image of the group of objects;

supplying to a computer system, from the database, a selected pair of texture maps and an associated polygon or polygons, which correspond to the group of real world objects; and

operating the computer system to display the selected pair of texture maps and the associated pylygon or polygons wherein said associated polygon or polygons comprise a non-flat backdrop viewable through a portal in the first environment, wherein at least a portion of the non-flat backdrop is located in a plane differing from the plane of the portal, wherein the pair of texture maps and the associated polygon or polygons which correspond to the group of objects determine the stereoscopic view of the second environment.

2. The method of claim 1, wherein step (b) includes the step of:

displaying the stereoscopic view on a displayed billboard as part of said larger image.

3. The method of claim 1, wherein the region is surrounded by a border.

4. The method of claim 1, also including the step of:

(c) processing an input image database to generate the database, wherein step (c) includes the step of performing texture mapping to replace a portion of the input image database by data indicative of said pair of texture maps and said associated polygon or polygons.

5. The method of claim 4, wherein one texture map of the pair of texture maps represents a view from a left-eye viewpoint, and wherein another texture map of the pair of texture maps represents the view from a right-eye viewpoint.

6. The method of claim 4, also including the step of:

storing the processed database in a data storage device.

7. The method of claim 6, wherein step (b) includes the step of:

reading the selected pair of texture maps and the associated polygon or polygons from the data storage device and processing said selected pair of texture maps and said associated polygon or polygons sufficiently rapidly to support real time interactive display of the stereoscopic view.

8. The method of claim 1, wherein step (b) includes the step of:

generating a virtual environment including said stereoscopic view.

9. A method for rendering a virtual environment comprising a first environment and a environment, wherein said second environment comprises an image of a group of real world objects, wherein the group of real world objects has a three dimensional appearance, said method comprising the steps of:

supplying a database with a plurality of stereoscopic pairs of texture maps and associated polygons, wherein at least some of the polygons correspond to the group of real world objects, and at least some of the pairs of texture maps comprise an image of the group of objects;

supplying to a computer system, from the database, a sequence of selected subsets of texture mapped data, each of the subsets of texture mapped data consisting of a pair of texture maps and an associated polygon or polygons which correspond to the group of real world objects; and

operating the computer system to display a sequence of the selected subsets of texture mapped data, wherein said associated polygon or polygons comprise a non-flat backdrop viewable through a portal in the first environment, wherein at least a portion of the non-flat backdrop is located in a plane differing from the plane of the portal, where each of the subsets of texture mapped data determines one of the stereoscopic views of the group of objects in the sequence in the second environment.

10. The method of claim 9, also including the step of:

(c) processing an input image database to generate the processed database, wherein step (c) includes the step of performing texture mapping to replace portions of the input image database by said subsets of texture mapped data.

11. The method of claim 10, also including the step of:

storing the processed database in a data storage device.

12. The method of claim 11, wherein step (b) includes the step of:

reading the sequence of selected subsets of texture mapped data from the data storage device and processing said sequence of selected subsets of texture mapped data sufficiently rapidly to support real time display of said sequence of stereoscopic views.

13. The method of claim 9, wherein step (b) includes the step of:

displaying said sequence of stereoscopic view on a displayed billboard as part of said larger image.

14. A method for rendering images within a virtual environment, said method comprising the steps of:

displaying a first set of images, said first set of images including a portal;

processing an input image database of images comprising a plurality of polygons associated with an image in the database to generate a processed database, by processing the input image database in linear hierarchical fashion to perform texture mapping on at least one of the images of the input image database to replace said at least one of the images by data indicative of at least one texture map and an associated polygon or polygons;

storing the processed database in a memory device; and

reading said at least one texture map and the associated polygon or polygons from the memory and processing said at least one texture map and said associated polygon or polygons to display an image determined by said at least one texture map and said associated polygon or polygons; and

displaying the texture map and associated polygon or polygons as a non-flat backdrop viewable through the portal of the first set of images.

15. The method of claim 14, wherein each of the images represents a displayed region having a plurality of vertices.

16. The method of claim 14, wherein the processing step includes the step of performing texture mapping on at least one of the images of the input image database to replace said at least one of the images by data indicative of a pair of texture maps and an associated polygon or polygons, and

wherein the step of reading at least on texture map further includes the step of reading the pair of texture maps and the associated polygon or polygons from the memory and processing said pair of texture maps and said associated polygon or polygons to display a stereoscopic view determined by said pair of texture maps and said associated polygon or polygons.

17. The method of claim 16, wherein the texture mapping operation of step (a) includes the step of generating renderings of said at least one of the images from a pair of eye positions.

18. The method of claim 17, wherein the step of generating said renderings is not performed in real time, and wherein the renderings include attributes not available in real time.

19. The method of claim 14, wherein the input image database is a CAD database.

20. The method of claim 14, wherein:

step (a) includes the step of performing texture mapping on a number of the images of the input image database to generate a sequence of subsets of texture mapped data, where each of the subsets of texture mapped data consists of a pair of texture maps and an associated polygon or polygons; and

step (c) includes the steps of sequentially reading ones of the subsets of texture mapped data from the memory and processing said subsets to display a sequence of stereoscopic views.

21. The method of claim 20, wherein step (c) includes the step of:

generating a virtual environment including said sequence of stereoscopic views.