3-Dimensional model composed against textured midground image and perspective enhancing hemispherically mapped backdrop image for visual realism

• US 5,694,533 A
• Filed: 07/19/1996
• Issued: 12/02/1997
• Est. Priority Date: 06/05/1991
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony United Kingdom Limited (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony United Kingdom Limited (Sony Group Corp.)
• Inventors: Richards, John William, David, Morgan William Amos
• Primary Examiner(s): Fetting, Anton W.
• Application Number:
  US08/684,510
• Time in Patent Office: 501 Days
• Field of Search: 395/119, 395/120, 395/125-127, 395/129, 395/130, 395/135, 348/43, 348/117, 348/123, 434/43
• US Class Current: 345/420
• CPC Class Codes: G06T 15/10 Geometric effects

Abstract

A modelling system for producing a 2-D image of a 3-D scene includes a 3-D computer graphics modeler for producing a view from a selectable viewpoint and in a selectable direction of a 3-D computer graphics model of an object for forming a foreground image, a source of backdrop video data, digital video effects apparatus for manipulating the backdrop video data to produce a background image and a compositor for keying the foreground image into the background image to form the 2-D image. The modelling system is able to produce in real time photo-realistic representations of computer models of objects such as buildings and the like in a real world environment. It is possible to include moving foreground objects in the model for virtual reality applications. It is also possible in real time to move around the model by changing the selected viewpoint and/or direction, the modelling system responding to these changes to produce the appropriate output images. A modified modelling system also provides for the inclusion of mid-ground information.

Claims

1. A modelling system for producing an output image of a 3-D scene, the modelling system comprising:

a 3-D computer graphics modeller for producing a computer-generated foreground architectural image that is a 2-dimensional projection of a 3-dimensional architectural object as viewed from a selectable viewpoint and in a selectable direction;

a source of video data;

digital video effects apparatus for receiving the video data from the source of video data and for projecting the received video data by mapping said video data onto a tube, mapping the tube onto a hemisphere to form a compressed image and correcting for artifacts introduced into the compressed image to produce a synthesized background image so as to surround the 3-dimensional architectural object; and

means for composing the output image from the computer-generated foreground architectural image and the synthesized background image on the basis of key signals supplied to the means for composing from the 3-D computer graphics modeller.

2. A modelling system as claimed in claim 1, wherein, before the video data is received by the digital video effects apparatus, the video data comprises a plurality of still video images.

3. A modelling system as claimed in claim 1, wherein the output image includes stereoscopic images of the 3-D scene.

4. A modelling system as claimed in claim 1, further comprising sensing means for sensing at least one of movement and a direction of view of a user of the modelling system;

and wherein the 3-D computer graphics modeller includes means, responsive to the sensing means, for determining the selected viewpoint and the selected direction.

5. A modelling system for producing an output image of a 3-D scene, the modelling system comprising:

a 3-D computer graphics modeller for producing a computer generated foreground architectural image that is a 2-dimensional projection of a 3-dimensional architectural object as viewed from a selected viewpoint and in a selected direction, the architectural image being formed of first image pixels, the computer graphics modeller also producing first position information indicative of positions of the first image pixels;

a source of first video data;

first digital video effects apparatus for receiving the first video data from the source of first video data and for projecting the received first video data by mapping said video data onto a tube, mapping the tube onto a hemisphere to form a compressed image and correcting for artifacts introduced into the compressed image to produce a synthesized background image so as to surround the architectural object;

a source of second video data;

second digital video effects apparatus for projecting the second video data onto a 3-dimensional topographical surface to form a 3-dimensional landscape and for producing a third image that is a 2-dimensional projection of the 3-dimensional landscape as viewed from the selected viewpoint and in the selected direction, the 3-dimensional topographical surface being defined between the 3-dimensional architectural object and the synthesized background image, the third image being formed of third image pixels, the second digital video effects apparatus also producing second position information indicative of positions of the third image pixels;

a 3-D combiner connected to receive the computer-generated foreground architectural image and the third image for forming a combined image from the computer generated foreground architectural image and the third image on the basis of the first and second position information; and

means for composing the output image from the combined image and the synthesized background image on the basis of key signals supplied to the means for composing from the 3-D combiner.