Spatial location presentation in head worn computing

• US 10,558,420 B2
• Filed: 10/17/2014
• Issued: 02/11/2020
• Est. Priority Date: 02/11/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Inventors: Osterhout, Ralph F., Lohse, Robert Michael
• Primary Examiner(s): Abaza, Ayman A
• Application Number:
  US14/517,219
• Publication Number:
  US 20150302646A1
• Time in Patent Office: 1,943 Days
• Field of Search: 348116
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 2027/0194 with combiner of laminated type, for optical or mechanical aspects
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 26/0833 the reflecting element being a micromechanical device, e.g. a MEMS mirror, DMD G02B26/0825 takes precedence; micromechanical devices in general B81B
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 27/1033 having a single light modulator for all colour channels
• CPC Class Codes: G02B 27/283 used for beam splitting or combining
• CPC Class Codes: G06F 3/1423 controlling a plurality of local displays, e.g. CRT and flat panel display
• CPC Class Codes: G06F 3/1454 involving copying of the display data of a local workstation or window to a remote workstation or window so that an actual copy of the data is displayed simultaneously on two or more displays, e.g. teledisplay
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2210/62 Semi-transparency

Abstract

A method of receiving a geo-spatial position from a first and second head-worn computer with see-through displays, and receiving orientation information from the first head-worn computer indicating an orientation of the first head-worn computer, presenting content in the first person'"'"'s display indicative of the second person'"'"'s location, wherein the content is aligned with a displayed straight virtual target line and positioned within the first person'"'"'s field of view such that the content is perceived to be in a position associated with the second person'"'"'s location and maintaining the displayed straight virtual target line and content position until receiving an indication that the second person has moved.

Claims

1. A method, comprising:

receiving a first geo-spatial position of a first wearable head device configured to be worn by a first person and a second geo-spatial position from a second wearable head device configured to be worn by a second person, each of the first and second wearable head devices with a respective see-through display;

receiving plan data indicating an expected movement of a second wearable head device;

determining, based on the plan data and the second geo-spatial position, a predicted geo-spatial position of the second wearable head device;

presenting, via the see-through display of the first wearable head device, a virtual content, wherein;

the virtual content is aligned with a first vector from the first geo-spatial position to the predicted geo-spatial position, and

the virtual content is presented at a position on the see-through display associated with the predicted geo-spatial position;

receiving, from a location remote to the first wearable head device, an indication that the second wearable head device is at a third geo-spatial position, different from the predicted geo-spatial position; and

in response to receiving the indication that the second wearable head device is at the third geo-spatial position, forgoing presenting the virtual content at the predicted geo-spatial position via the see-through display of the first wearable head device.

2. The method of claim 1, further comprising:

in response to receiving the indication that the second wearable head device is at the third geo-spatial position, aligning the virtual content with a second vector based on the third-geo spatial position and presenting the aligned virtual content via the see-through display of the first wearable head device.

3. The method of claim 1, wherein the indication that the second wearable head device is at a third geo-spatial position is received by the first wearable head device.

4. The method of claim 1, wherein the location remote to the first wearable head device comprises a server.

5. The method of claim 1, further comprising:

in accordance with a determination that a geo-spatial position of the second wearable head device is unavailable, receiving orientation information from an IMU of the second wearable head device,

wherein the indication that the second wearable head device is at the third geo-spatial position comprises the orientation information.

6. The method of claim 1, wherein each of the first wearable head device and the second wearable head device comprises a respective in-line eye imaging system.

7. The method of claim 6, further comprising verifying an identity of the first person using the in-line eye imaging system of the first wearable head device.

15. The method of claim 1, wherein the plan data is received from the second wearable head device.

16. The method of claim 1, wherein the plan data is received from a location remote to the first wearable head device and further remote to the second wearable head device.

8. A first wearable head device configured to be worn by a first person, comprising:

one or more processors configured to;

transmit a first geo-spatial position of the first wearable head device,

receive a second geo-spatial position of a second wearable head device configured to be worn by a second person,

receive plan data indicating an expected movement of a second wearable head device,

determine, based on the plan data and the second geo-spatial position, a predicted geo-spatial position of the second wearable head device, and

receive, from a location remote to the first wearable head device, an indication that the second wearable head device is at a third geo-spatial position, different from the second geo-spatial position; and

a see-through display configured to;

present a virtual content on the see-through display at a position associated with the predicted geo-spatial position, wherein the virtual content is aligned with a first vector from the first geo-spatial position to the predicted geo-spatial position, and

in response to receiving the indication that the second wearable head device is at the third geo-spatial position, forgo presenting the virtual content at the predicted geo-spatial position.

9. The first wearable head device of claim 8, wherein the see-through display is further configured to:

in response to receiving the indication that the second wearable head device is at the third geo-spatial position, align the virtual content with a second vector based on the third geo-spatial position and present the aligned virtual content.

10. The first wearable head device of claim 8, wherein the indication that the second wearable head device is at a third geo-spatial position is received by the first wearable head device.

11. The first wearable head device of claim 8, wherein the location remote to the first wearable head device comprises a server.

12. The first wearable head device of claim 8, the one or more processors further configured to:

in accordance with a determination that a geo-spatial position of the second wearable head device is unavailable, receive orientation information from an IMU of the second wearable head device,

wherein the indication that the second wearable head device is at the third geo-spatial position comprises the orientation information.

13. The first wearable head device of claim 8, further comprising an in-line eye imaging system.

14. The first wearable head device of claim 13, wherein the in-line eye imaging system is configured to verify an identity of the first person.

17. The first wearable head device of claim 8, wherein the plan data is received from the second wearable head device.

18. The first wearable head device of claim 8, wherein the plan data is received from a location remote to the first wearable head device and further remote to the second wearable head device.