OPTICALLY AUGMENTING ELECTROMAGNETIC TRACKING IN MIXED REALITY
First Claim
1. A mixed reality system comprising:
- a head-mounted display (HMD) device comprising;
a location sensor from which the HMD device determines a location of the location sensor in space; and
a base station mounted at a fixed position relative to the HMD device a predetermined offset from the location sensor and configured to emit an electromagnetic field; and
an electromagnetic field sensor affixed to an object and configured to sense a strength of the electromagnetic field, the base station and electromagnetic field sensor together forming a magnetic tracking system;
wherein the HMD device includes a processor configured to;
determine a location of the electromagnetic field sensor relative to the base station based on the sensed strength; and
determine a location of the electromagnetic field sensor in space based on the relative location, the predetermined offset, and the location of the location sensor in space; and
wherein the mixed reality system comprises an optical tracking system comprising at least one marker and at least one optical sensor configured to capture optical data, and the processor is further configured to augment the magnetic tracking system based on the optical data and a location of the optical sensor or marker.
1 Assignment
0 Petitions
Accused Products
Abstract
A mixed reality system may comprise a head-mounted display (HMD) device with a location sensor and a base station, mounted a predetermined offset from the location sensor, that emits an electromagnetic field (EMF). An EMF sensor affixed to an object may sense the EMF, forming a magnetic tracking system. The HMD device may determine a relative location of the EMF sensor therefrom and determine a location of the EMF sensor in space based on the relative location, the predetermined offset, and the location of the location sensor. An optical tracking system comprising a marker an optical sensor configured to capture optical data may be included to augment the magnetic tracking system based on the optical data and a location of the optical sensor or marker. The HMD device may display augmented reality images and overlay a hologram corresponding to the location of the EMF sensor over time.
-
Citations
20 Claims
-
1. A mixed reality system comprising:
-
a head-mounted display (HMD) device comprising; a location sensor from which the HMD device determines a location of the location sensor in space; and a base station mounted at a fixed position relative to the HMD device a predetermined offset from the location sensor and configured to emit an electromagnetic field; and an electromagnetic field sensor affixed to an object and configured to sense a strength of the electromagnetic field, the base station and electromagnetic field sensor together forming a magnetic tracking system; wherein the HMD device includes a processor configured to; determine a location of the electromagnetic field sensor relative to the base station based on the sensed strength; and determine a location of the electromagnetic field sensor in space based on the relative location, the predetermined offset, and the location of the location sensor in space; and wherein the mixed reality system comprises an optical tracking system comprising at least one marker and at least one optical sensor configured to capture optical data, and the processor is further configured to augment the magnetic tracking system based on the optical data and a location of the optical sensor or marker. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method of locating an object in a mixed reality system, the method comprising:
-
determining a location of a location sensor of a head-mounted display (HMD) device in space; emitting an electromagnetic field from a base station mounted at a fixed position relative to the HMD device a predetermined offset from the location sensor; sensing a strength of the electromagnetic field with an electromagnetic field sensor affixed to the object, the base station and electromagnetic field sensor together forming a magnetic tracking system; determining, with a processor of the HMD device, a location of the electromagnetic field sensor relative to the base station based on the sensed strength; determining, with the processor, a location of the electromagnetic field sensor in space based on the relative location, the predetermined offset, and the location of the location sensor in space; and using an optical tracking system comprising at least one marker and at least one optical sensor configured to capture optical data, augmenting the magnetic tracking system based on the optical data and a location of the optical sensor or marker. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19)
-
-
20. A mixed reality system comprising:
-
a head-mounted display (HMD) device comprising; a location sensor from which the HMD device determines a location of the location sensor in space; a base station mounted at a fixed position relative to the HMD device a predetermined offset from the location sensor and configured to emit an electromagnetic field; at least one optical sensor configured to capture optical data; and an at least partially see-through display configured to display augmented reality images; an electromagnetic field sensor affixed to an object and configured to sense a strength of the electromagnetic field, the base station and electromagnetic field sensor together forming a magnetic tracking system; and at least one marker on the object, the optical sensor and the marker together forming optical tracking system;
whereinthe object includes a processor configured to determine a location of the electromagnetic field sensor relative to the base station based on the sensed strength; the HMD device includes a processor configured to; determine a location of the electromagnetic field sensor in space based on the relative location, the predetermined offset, and the location of the location sensor in space; and augment the magnetic tracking system based on the optical data and a location of the optical sensor marker; and the at least partially see-through display is configured to overlay a hologram that corresponds to the location of the electromagnetic field sensor in space over time.
-
Specification