System for displaying realistic virtual three-dimensional images in real time

• US 6,653,990 B1
• Filed: 10/23/2000
• Issued: 11/25/2003
• Est. Priority Date: 03/06/1998
• Status: Expired due to Fees

• Current Assignee: Societe Rasterland SA
• Original Assignee: Societe Rasterland SA
• Inventors: Lestruhaut, Olivier
• Primary Examiner(s): NGUYEN, CHANH DUY
• Application Number:
  US09/623,639
• Time in Patent Office: 1,128 Days
• Field of Search: 345/7, 345/8, 345/9, 345/419, 345/418, 345/426, 345/629, 345/630, 345/634, 345/638, 359/13, 359/14, 359/630, 348/42, 348/47, 348/48, 348/51, 348/52
• US Class Current: 345/8
• CPC Class Codes: G06T 15/10 Geometric effects

Abstract

The invention concerns a device for displaying computer-assisted realistic virtual three-dimensional images, and pictured by computerisation into a real environment, characterised in that it comprises in combination: means for detecting and monitoring in real time the user'"'"'s position in the geographical site for implanting the virtual objects, relative to an arbitrary reference point; means for detecting and monitoring in real time the position of the users'"'"' field of vision (top, bottom, right, left) relative to a reference point located with respect to the user, video means for capturing and monitoring in real time the images perceived by the user, means for computing virtual images in real time taking into account the user'"'"'s position and the field of vision previously detected; means for mixing the resulting computed virtual video image previously captured, such that the virtual image is pictured on the video image realistically and non-transparently. The aim is to transmit towards individual and portable display means the image thus computed, combining the real external landscape and the images of virtual objects, to a moving user.

Claims

1. A device for displaying realistic three-dimensional images to a plurality of users, comprising:

a database shared by all the users storing visual characteristics and positions, in a real geographical environment, of each one of a plurality of virtual objects;

for each one of the plurality of users,

a video camera for providing at least one image of a real geographical environment,

a positioning device for determining the user'"'"'s position,

an orientation device for determining the user'"'"'s field of view,

a computer for calculating an image for a right eye of the user and an image for the left eye of the user,

each calculated image representing an image provided by the camera in which the virtual objects are inserted based on the visual characteristics and position of the virtual objects provided by the shared database, the position of the user and the field of view of the user, and

a display that displays each of the images calculated by the computer, each virtual object being inserted in the images displayed by the display of each user at an angle depending on the respective position of said user and of said virtual object.

2. A device according to claim 1, further comprising, for each user, a helmet comprising the display that includes a screen positioned in front of each eye of the user.

3. A device according to claim 1, wherein the positioning device comprises a receiver that receives signals from earth satellites.

4. A device according to claim 1, wherein the positioning device comprises tracking video cameras in the geographical environment, the position of the tracking video cameras being precisely known, and a computer that processes images provided by the tracking video cameras to determine the position of the user in the geographical environment.

5. A device according to claim 1, further comprising a scanner for scanning a map of the geographical site and providing a scanned image.

6. A device according to claim 5, further comprising a vectorization device that vectorizes the scanned image.

7. A device according to claim 5, further comprising a georeferencing device that provides two-dimensional geographical references to the scanned image.

8. A device according to claim 7, further comprising an elevation device for providing a geographical reference in a third dimension to the two-dimensional geographical references.

9. A device according to claim 1, further comprising a sun position detector that determines the position of the sun, the computer calculating images including lighting effects taking into account the position of the sun.

10. A device according to claim 1, wherein the computer calculates images that are representative of at least one parameter representing a configuration of the device for displaying realistic three-dimensional images.

11. A device according to claims 1, further comprising an input device for inputting user'"'"'s commands.

12. A device according to claim 1, wherein the database stores data representing at least one movement of at least one virtual object.

13. A process for displaying realistic three-dimensional images to a plurality of users, comprising:

for each one of the plurality of users,

a step of reading, in a database shared by all the users, visual characteristics and positions, in a real geographical environment, of each one of a plurality of virtual objects,

a step of providing at least one image of a real geographical environment,

a step of determining the user'"'"'s position,

a step of determining the user'"'"'s field of view,

a step of calculating an image for a right eye of the user and an image for the left eye of the user,

each calculated image representing an image provided by the camera in which the virtual objects are inserted based on the visual characteristics and positions of the virtual objects, the position of the user and the field of view of the user,

each virtual object being inserted in the images displayed by the display of each user at an angle depending on the respective position of said user and of said virtual object and

a step of displaying each of the images calculated by the computer.

14. A computer readable medium having embedded thereon a computer program for causing a computer to:

display realistic three-dimensional images to a plurality of users, comprising,

the computer program reading, in a database shared by all the users, visual characteristics and positions, in a real geographical environment, of each one of a plurality of virtual objects,

providing at least one image of a real geographical environment,

determining the user'"'"'s position,

determining the user'"'"'s field of view,

calculating an image for a right eye of the user and an image for the left eye of the user, each calculated image representing an image provided by the camera in which the virtual objects are inserted based on the visual characteristics and positions of the virtual objects, the position of the user and the field of view of the user, each virtual object being inserted in the images displayed by the display of each user at an angle depending on the respective position of said user and of said virtual object and

displaying each of the images calculated by the computer.