Vehicle operations simulator with augmented reality

• US 7,246,050 B2
• Filed: 06/16/2006
• Issued: 07/17/2007
• Est. Priority Date: 10/23/2000
• Status: Expired due to Fees

• Current Assignee: David R. Sheridan
• Original Assignee: David R. Sheridan
• Inventors: Sheridan, Thomas B.
• Primary Examiner(s): FERRIS III, FRED O
• Application Number:
  US11/454,601
• Publication Number:
  US 20070136041A1
• Time in Patent Office: 396 Days
• Field of Search: 703/6, 703/7, 703/8, 434/29, 434/44, 434/61, 701/1, 701/24
• US Class Current: 703/8
• CPC Class Codes: G09B 9/05 the view from a vehicle being simulated G09B9/052, G09B9/058 take precedence

Abstract

This invention provides in a safe and effective manner the experience of observing potential collision obstacles or other hazard images to the human operator of an otherwise conventional vehicle, (such as an automobile or aircraft) moving in a normal manner in a natural environment (such as an outdoor test track). The invention incorporates in addition to the mobile vehicle, computer-based image generation devices, and position, velocity, acceleration, measurement instruments to enable the simulated visual hazard images, including operator perception of and response to those hazard images. Making the actual moving vehicle part of the simulated hazard encounter means the vestibular (motion) cues and visual cues of the natural environment are very realistic, while only the computer-generated hazard images imposed on the natural environment view are virtual. The system results in a safe and cost efficient way of producing a realistic experience of vehicle operation encounters, including both the observation and response.

Claims

1. A mobile vehicle operation and hazard encounter simulator comprising:

a vehicle having at least one vehicle control and operated to move freely in a natural environment and thereby provide normal non-visual motion cues;

a scene generator;

a scene display in communication with said scene generator and viewable by a vehicle operator;

an environment view being presented on said scene display created at least in part by said scene generator; and

at least one virtual image not existing in said natural environment and visually superposed on said natural environment by the scene generator into said environment view and presented on said scene display so as to appear fixed or moving in a controlled fashion in said environment view,

wherein said mobile vehicle operation and hazard encounter simulator carries said vehicle operator and is controlled by said vehicle operator in accordance with said environment view, said vehicle responding to actuation of said at least one vehicle control and said environment view responding to at least one of said at least one vehicle control, operator movement, and vehicle movement.

2. The mobile vehicle operation and hazard encounter simulator of claim 1, wherein at least one object from said natural environment is captured with a video camera and input to said scene generator.

3. The vehicle operation and hazard encounter simulator of claim 1, wherein said at least one object from said natural environment is visible to said vehicle operator through a partially transparent viewing screen.

4. The vehicle operation and hazard encounter simulator of claim 1, further comprising an instrument attached to and measuring a position change of said simulator relative to said natural environment in at most six degrees of freedom by sensing at least one of acceleration, velocity, and position, wherein an output of said instrument proportionately repositions said virtual image on said scene display in an opposite direction from said position change.

5. The vehicle operation and hazard encounter simulator of claim 4, further comprising a computer-based model of position response to said at least one vehicle control, wherein an output of said computer-based model proportionately repositions said virtual image on said scene display in an opposite direction to said position change.

6. The vehicle operation and hazard encounter simulator of claim 4, further comprising a device capable of detecting relative motion of objects in said natural environment and measuring said position change relative to said natural environment in at most six degrees of freedom, wherein an output of said device proportionately repositions said virtual image on said scene display in an opposite direction to said position change.

7. The vehicle operation and hazard encounter simulator of claim 1, wherein said scene display is affixed to at least one of said vehicle operation and hazard encounter simulator and a head-mounted display worn by said vehicle operator.

8. The vehicle operation and hazard encounter simulator of claim 1, further comprising at least one of an electromagnetic position sensor and a mechanical arm with angle sensor attached to and responding to changes in position of said vehicle operator'"'"'s head in relation to said simulator in up to six degrees of freedom.

9. The vehicle operation and hazard encounter simulator of claim 1, wherein said environment view comprises only elements generated by said scene generator.

10. The vehicle operation and hazard encounter simulator of claim 1, wherein said environment view is a composite of at least one element from said scene generator and at least one element from the natural environment.

11. The vehicle operation and hazard encounter simulator of claim 10, wherein said scene generator includes a mechanism for maintaining equivalent light brightness between at least one element from said scene display and said natural environment.

12. The vehicle operation and hazard encounter simulator of claim 1, wherein a part of said environment view differs in a controlled fashion from actual behavior of said simulator.

13. The vehicle operation and hazard encounter simulator of claim 12, wherein said simulator responds to an actuation of said at one vehicle control in accordance with movement represented in said environment view rather than actual movement of said simulator.

14. The vehicle operation and hazard encounter simulator of claim 1, further comprising a secondary vehicle control for said simulator, said secondary vehicle control being actuated by a second operator.

15. The vehicle operation and hazard encounter simulator of claim 14, wherein said simulator selectively responds to said secondary vehicle control or said at least one vehicle control when said secondary vehicle control is actuated.

16. The vehicle operation and hazard encounter simulator of claim 1, further comprising a parameter-constraining apparatus limiting at least one of said simulator movement and actuation of said at least one vehicle control.

17. The vehicle operation and hazard encounter simulator of claim 1, wherein said scene display includes at least one of a mirror, a flat opaque viewing screen, a curved opaque viewing screen, an electronic monitor display, and a partially transparent half-silvered mirror.

18. A method for simulating hazard encounter in operation of a vehicle moving in a natural environment comprising:

(a) generating an environment view, wherein at least a part of said environment view comprises a virtual image not existing in the natural environment but visually superposed on an operator'"'"'s display of the natural environment so as to appear fixed or moving in a controlled fashion in said environment view;

(b) presenting the environment view to an operator carried by said vehicle, said vehicle operating in the natural environment;

(c) the operator actuating controls for said vehicle, movement of said vehicle responding to actuated controls;

(d) altering said environment view in response to at least one of vehicle movement, actuated controls, operator head movement, and operator movement within said vehicle.

19. The vehicle method of claim 18, further comprising an instrument attached to and measuring a position change of said vehicle relative to said natural environment in at most six degrees of freedom by sensing at least one of acceleration, velocity, and position, wherein output of said instrument proportionately repositions said virtual image on the operator'"'"'s display of the natural environment in an opposite direction to said position change of said vehicle.

20. The method of claim 18 wherein elements presented in said environment view differ in a controlled fashion from an environment view commensurate with actual behavior of said vehicle.