SENSOR DEPENDENT CONTENT POSITION IN HEAD WORN COMPUTING

• US 20150279108A1
• Filed: 11/19/2014
• Published: 10/01/2015
• Est. Priority Date: 03/28/2014
• Status: Active Grant

• Current Assignee: Mentor Acquisition One, LLC (Magic Leap, Inc.)
• Original Assignee: Osterhout Design Group
• Inventors: Border, John N., Lohse, Robert Michael
• Granted Patent: US 9,423,612 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0174 holographic
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 1/163 Wearable computers, e.g. on a belt
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06F 3/017 Gesture based interaction, e.g. based on a set of recognized hand gestures interaction based on gestures traced on a digitiser G06F3/04883
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2215/16 Using real world measurements to influence rendering
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 2013/405 the images being stereoscopic or three dimensional

Abstract

Aspects of the present invention relate to methods and systems for positioning content within an FOV of a HWC based on sensor feedback.

Claims

1. A head-worn computer, comprising:

a. a see-through display adapted to present content to an eye of a user wearing the head-worn computer and adapted to provide the user with a see-through view of an environment proximate the user;

b. a processor adapted to control a position of the content within a field of view of the see-through display; and

c. a sensor system adapted to detect data of a forward motion speed of the head-worn computer indicative of a forward motion speed of the user, wherein the sensor system provides the data to the processor and the processor controls the position of the content within the field of view of the see-through display based on the data.

3. The head-worn computer of claim 1, wherein the position of the content is regulated as follows:

a. The position of the content is not adjusted when the forward movement speed is indicative of a forward movement speed of the user below a threshold; and

b. The position of the content is moved from a neutral position to a position closer to an outer edge of the field of view of the see-through display when the forward movement speed is indicative of a forward movement speed of the user above a threshold.

4. The head-worn computer of claim 1, wherein the position of the content is further dependent on a magnitude of the forward movement speed, wherein the higher the magnitude of the speed the greater a distance the processor will move the content from a neutral position.

5. The head-worn computer of claim 1, wherein the processor is further adapted to predict a user activity based on the forward movement speed and wherein the position of the content is further based on the predicted activity.

6. The head-worn computer of claim 5, wherein the prediction of the activity is that the user is moving in a vehicle.

7. The head-worn computer of claim 5, wherein the prediction of the activity is that the user is walking.

8. The head-worn computer of claim 5, wherein the prediction of the activity is that the user is running.

9. The head-worn computer of claim 1, further comprising an eye imaging system adapted to determine a position of the eye of the user, wherein the content position is further determined based on the position of the eye.

10. The head-worn computer of claim 9, wherein the eye imaging system is adapted to capture images of the eye of the user, wherein light associated the images of the eye travel along an optical path that is at least partly in-line with an optical path followed by light associated with the content presented to the eye of the user, such that the images of the eye are captured from a position directly in front of the eye and the position of the eye is determined from the captured images of the eye.

11. The head-worn computer of claim 1, further comprising an eye imaging system adapted to monitor a movement of the eye of the user, wherein the content position is further determined based on the movement of the eye of the user.

12. The head-worn computer of claim 11, wherein a rate of content position change is reduced when there is a rapid eye movement.

13. The head-worn computer of claim 1, further comprising a change of direction sensor system adapted to monitor a lateral movement of head-worn computer, wherein the content position is further determined based on the lateral movement of the head-worn computer.

14. The head-worn computer of claim 13, wherein a rate of position change of the content is reduced when there is a rapid lateral movement.

15. The head-worn computer of claim 1, wherein the processor is further adapted to position second content in relation to an object in the environment, such that the second content maintains a relative position with the object in the environment irrespective of the forward movement speed of the head-worn computer.

16. The head-worn computer of claim 1, further comprising a sight-heading sensor to monitor a direction the user is looking, wherein the content position is further determined based on the direction the user is looking.

20. The head-worn computer of claim 14, wherein at a higher magnitude of forward speed of movement, the content is moved beyond edge of the field of view of the see-through display.

2. (canceled)

17-19. -19. (canceled)