METHOD AND SYSTEM FOR SINGLE-PASS RENDERING FOR OFF-AXIS VIEW
First Claim
1. A system for providing review of a trainee being trained in simulation, said system comprising:
- a computerized simulator displaying to the trainee a real-time OTW scene of a virtual world rendered from scene data stored in a computer-accessible memory defining said virtual world; and
a review system having a storage device storing or a display device displaying a view of the OTW scene from a time-variable detected viewpoint of the pilot, said view of the OTW scene being rendered from said scene data in a single rendering pass.
1 Assignment
0 Petitions
Accused Products
Abstract
A system and method are provided for review of a trainee being trained in simulation. The system has a computerized simulator displaying to the trainee a real-time out-the-window (OTW) scene of video made up of a series of images each rendered in real-time from stored scene data. A review system stores or displays a view of the OTW scene video as seen from a time-variable detected viewpoint of the trainee. Each frame of this video is independently rendered in a single pass from the scene data using a projection matrix that is derived from a detected eyepoint and line of sight of the trainee. A HUD display with imagery superimposed on the OTW view may advantageously combined with the perspective-distorted imagery of the review system. The video displayed or stored by the review system accurately records or displays the OTW scene as seen by the trainee.
78 Citations
21 Claims
-
1. A system for providing review of a trainee being trained in simulation, said system comprising:
-
a computerized simulator displaying to the trainee a real-time OTW scene of a virtual world rendered from scene data stored in a computer-accessible memory defining said virtual world; and a review system having a storage device storing or a display device displaying a view of the OTW scene from a time-variable detected viewpoint of the pilot, said view of the OTW scene being rendered from said scene data in a single rendering pass. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A system for providing simulation of a vehicle to a user, said system comprising:
-
a simulated cockpit configured to receive the user and to interact with the user so as to simulate the vehicle according to simulation software running on a simulator computer system; a computer-accessible data storage memory device storing scene data defining a virtual simulation environment for the simulation, said scene data being modified by the simulation software so as to reflect the simulation of the vehicle, and including object data defining positions and appearance of virtual objects in a three-dimensional virtual simulation environment, said object data including for each of the virtual objects a respective set of coordinates corresponding to a location of the virtual object in the virtual simulation environment; an OTW image generating system cyclically rendering a series of OTW view frames of an OTW video from the scene data, each OTW view frame corresponding to a respective view at a respective instant in time of virtual objects in the virtual simulation environment from a design eyepoint located in the virtual simulation environment and corresponding to a predetermined point in the simulated vehicle as said point is defined in the virtual simulation environment; a video display device having at least one screen visible to the user when in the simulated cockpit, said OTW video being displayed on the screen so as to be viewed by the user; a viewpoint tracker detecting a current position and orientation of the user'"'"'s viewpoint and transmitting a viewpoint tracking signal containing position data and orientation data derived from said detected current position and current orientation; a head-up display device viewed by the user such that the user can thereby see frames of HUD imagery, said HUD imagery including visible information superimposed over corresponding virtual objects in the OTW view video irrespective of movement of the eye of the user in the simulated cockpit; a review station image generating system generating frames of review station video in a single rendering pass from the scene data, said frames each corresponding to a rendered view of virtual objects of the virtual simulation environment as seen on the display device from a rendering viewpoint derived from the position data at a respective time instant in a respective rendering duty cycle combined with the HUD imagery; said rendering of the frames of the review station video comprising determining a location of at least some of the virtual objects of the scene data in the frame from vectors derived by calculating a multiplication of coordinates of each of said some of the virtual objects by a perspective-distorted projection matrix derived in the associated rendering duty cycle from the position and orientation data of the viewpoint tracking signal; and a computerized instructor station system with a review display device receiving the review station video and displaying the review station video in real time on said review display device so as to be viewed by an instructor. - View Dependent Claims (14, 15)
-
-
16. A method for providing instructor review of a trainee in a simulator, said method comprising the steps of:
-
rendering sequential frames of an OTW view video in real time from stored simulator scene data; displaying said OTW video to the trainee on a screen; detecting a current position and orientation of a viewpoint of the trainee continually; and rendering sequential frames of a review video each corresponding to a view of the trainee of the OTW view video as seen on the screen from the detected eyepoint, wherein said rendering is performed in a single rendering pass from said stored simulator scene data. - View Dependent Claims (17, 18, 19, 20)
-
-
21. A method of providing a simulation of an aircraft for a user in a simulated cockpit with supervision or analysis by an instructor at an instruction station with a monitor, said method comprising:
-
formulating scene data stored in a computer-accessible memory device than defines positions and appearances of virtual objects in a 3-D virtual environment in which the simulation takes place; generating an out-the-window view video comprising a first sequence of frames each rendered in real time from the scene data as a respective view for a respective instant in time from a design eyepoint in the aircraft being simulated as said design eyepoint is defined in a coordinate system in the virtual environment; displaying the out-the-window view video on a screen of a video display device associated with the simulated cockpit so as to be viewed by the user; detecting repeatedly a time-varying position and orientation of a head or eye of the user using a tracking device in the simulated cockpit and producing viewpoint data defining said position and orientation; generating in real time an instructor-view video comprising a second sequence of frames each rendered in a single pass from the scene data based on the viewpoint data, wherein each frame corresponds to a respective view of the out-the-window video at a respective instant in time as seen from a viewpoint as defined by the viewpoint data on the screen of the video display device; and displaying the instructor-view video to the instructor on said monitor.
-
Specification