Head mounted display-based training tool
First Claim
1. A training tool, comprising:
- a head mount for securing a head mounted display (HMD) on a head of a trainee, wherein said HMD comprises;
an external environment sensor configured to;
wirelessly detect, in a real training scene, an existence of a real object that is not attached to a sensor;
determine position information that identifies a position of the real object in said real training scene; and
update a database to add the real object to the database, wherein adding the real object comprises storing in the database object information that identifies the existence of the real object and the position of the real object;
a simulator comprising at least one processor, said simulator configured to generate virtual image data that depicts a virtual object in a particular location based on the position of the real object;
a display device coupled to receive said virtual image data from said simulator; and
a system for determining position and orientation of said HMD coupled to said simulator;
wherein a field of view (FOV) of said HMD includes said virtual object from said display device and a view of said real training scene, and wherein said simulator modifies said virtual image data responsive to changes in simulator input signals.
1 Assignment
0 Petitions
Accused Products
Abstract
A head mounted display (HMD)-based training tool includes a HMD, sensor components, and electronics components. The sensor components include an external environment sensor for obtaining data of a real training scene. The electronics components include a simulator including at least one processor coupled to receive the real training scene data. The simulator generates virtual image data based on simulator input signals, where the virtual image data represents at least one virtual object. A display device is coupled to receive the virtual image data from the simulator. A field of view (FOV) of the HMD includes the virtual object from the display device and a real-world view of the real training scene, wherein the simulator modifies the virtual image data responsive to changes in the simulator input signals.
38 Citations
23 Claims
-
1. A training tool, comprising:
-
a head mount for securing a head mounted display (HMD) on a head of a trainee, wherein said HMD comprises; an external environment sensor configured to; wirelessly detect, in a real training scene, an existence of a real object that is not attached to a sensor; determine position information that identifies a position of the real object in said real training scene; and update a database to add the real object to the database, wherein adding the real object comprises storing in the database object information that identifies the existence of the real object and the position of the real object; a simulator comprising at least one processor, said simulator configured to generate virtual image data that depicts a virtual object in a particular location based on the position of the real object; a display device coupled to receive said virtual image data from said simulator; and a system for determining position and orientation of said HMD coupled to said simulator; wherein a field of view (FOV) of said HMD includes said virtual object from said display device and a view of said real training scene, and wherein said simulator modifies said virtual image data responsive to changes in simulator input signals. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method comprising:
-
wirelessly detecting, in a real training scene, by a position detection system in a head mounted display (HMD), an existence of a real object that is not attached to a sensor based on wireless signals received from the real training scene; determining position information that identifies a position of the real object in said real training scene based on the wireless signals; updating a database to add the real object to the database, wherein adding the real object comprises storing in the database object information that identifies the existence of the real object and the position of the real object; generating virtual image data that depicts a virtual object in a particular location based on the position of the real object; and displaying in a field of view (FOV) of said HMD the virtual object together with a view of the real training scene. - View Dependent Claims (14, 15, 16, 17, 18, 19, 20, 21, 22, 23)
-
Specification