Active Stabilization for Heads-Up Displays

• US 20140247286A1
• Filed: 02/20/2012
• Published: 09/04/2014
• Est. Priority Date: 02/20/2012
• Status: Abandoned Application

• Current Assignee: Google LLC (Alphabet Inc.)
• Original Assignee: Google Inc. (Alphabet Inc.)
• Inventors: Chi, Liang-Yu (Tom)
• Application Number:
  US13/400,230
• Publication Number:
  US 20140247286A1
• Time in Patent Office: Days
• US Class Current: 345/672
• CPC Class Codes: G02B 2027/0127 comprising devices increasing the depth of field
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G09G 2320/00 Control of display operating conditions
• CPC Class Codes: G09G 3/003 to produce spatial visual effects

Abstract

Methods and systems for active stabilization for heads-up displays are described. A wearable computing device may include a head-mounted display (HMD) with an eye-tracking system. The wearable computing device may generate a display of content at a given location in a display area of the HMD. A user may be wearing the HMD and may be subjected to mechanical jostling resulting in a movement of the HMD with respect to a gaze axis of an eye of the user. The wearable computing device may receive information relating to the gaze axis from the eye-tracking system and may receive information relating to the movement of the HMD from sensors coupled to the HMD. The wearable computing device may adjust the given location of the displayed content in the display area to compensate for such movement. The content may thus appear stable to the user.

Claims

1. A method, comprising:

causing content to be displayed at a first location within a display area of a head-mounted display (HMD);

receiving movement information relating to movement of the HMD;

receiving gaze information relating to a gaze axis from an eye-tracking system coupled to the HMD, wherein the movement information and the gaze information indicate relative motion of the HMD with respect to the gaze axis; and

adjusting a location of the displayed content from the first location to a second location within the display area, based on the relative motion of the HMD with respect to the gaze axis.

2. The method of claim 1, wherein adjusting the location of the displayed content from the first location to the second location comprises applying a transform to the displayed content.

3. The method of claim 2, wherein the transform comprises an offset associated with a shift of the HMD with respect to the gaze axis.

4. The method of claim 2, wherein the transform comprises a rotational adjustment associated with a rotation of the HMD with respect to the gaze axis.

5. The method of claim 2, wherein the transform comprises a scale factor associated with a change in a viewing distance.

6. The method of claim 2, wherein the transform includes one or more of:

(i) an offset based on a speed of the movement of the HMD, (ii) a rotational adjustment based on a rotational speed of the movement of HMD with respect to the gaze axis, and (iii) a scale factor based on a rate of change in a viewing distance.

7. The method of claim 1, wherein the eye-tracking system comprises at least one sensor configured to provide the gaze information.

8. The method of claim 1, wherein the movement information includes information relating to a relative position of the HMD with respect to the gaze axis.

9. The method of claim 1, wherein the movement information includes information associated with one or more of (i) speed, and (ii) acceleration of the movement of the HMD.

10. The method of claim 1, wherein adjusting the location of the displayed content from the first location to the second location comprises causing the displayed content to be stable with respect to the gaze axis.

11. A non-transitory computer readable memory having stored thereon instructions executable by a computing device to cause the computing device to perform functions comprising:

receiving information relating to a first position of a head-mounted display (HMD) coupled to a wearable computing system;

receiving, from an eye-tracking system coupled to the wearable computing system, gaze information relating to a gaze axis;

causing content to be displayed at a first location within a display area of the HMD, based on a first relative position of the HMD with respect to the gaze axis of the eye;

receiving information relating to a movement of the HMD to a second relative position with respect to the gaze axis; and

adjusting a location of the displayed content from the first location to a second location within the display area, based on the second relative position of the HMD with respect to the gaze axis.

12. The non-transitory computer readable memory of claim 11, wherein the function of adjusting the location of the displayed content from the first location to the second location within the display area comprises applying a transform to the displayed content, wherein the transform includes one or more of:

(i) an offset associated with a shift of the HMD with respect to the gaze axis, (ii) a rotational adjustment associated with a rotation of the HMD with respect to the gaze axis, and (iii) a scale factor associated with a change in a viewing distance.

13. The non-transitory computer readable memory of claim 11, wherein the function of adjusting the location of the displayed content from the first location to the second location within the display area comprises adjusting the location based on a rate of motion of the HMD from the first position to the second position.

14. The non-transitory computer readable memory of claim 11, wherein the function of adjusting the location of the displayed content from the first location to the second location comprises stabilizing the displayed content with respect to the gaze axis.

15. A system, comprising:

a head-mounted display (HMD);

an eye-tracking system, wherein the eye-tracking system is configured to provide gaze information relating to a gaze axis; and

a computing device in communication with the HMD and the eye-tracking system, wherein the computing device is configured to;

cause content to be displayed at a first location within a display area of the HMD;

receive movement information relating to movement of the HMD;

receive the gaze information relating to the gaze axis from the eye-tracking system, wherein the movement information and the gaze information indicate relative motion of the HMD with respect to the gaze axis; and

adjust a location of the displayed content from the first location to a second location within the display area, based on the relative motion of the HMD with respect to the gaze axis.

16. The system of claim 15, further comprising a sensor coupled to the computing device, wherein the computing device is configured to receive the movement information from the sensor.

17. The system of claim 15, wherein the computing device is configured to adjust the location of the displayed content from the first location to the second location within the display area by applying a transform to the displayed content, wherein the transform includes one or more of:

(i) an offset associated with a shift of the HMD with respect to the gaze axis, (ii) a rotational adjustment associated with a rotation of the HMD with respect to the gaze axis, and (iii) a scale factor associated with a change in a viewing distance.

18. The system of claim 15, further comprising a sensor coupled to the computing device, wherein the computing device is configured to receive the movement information from the sensor including one or more of (i) rotational speed, and (ii) rotational acceleration associated with the movement of the HMD.

19. The system of claim 15, wherein the computing device is further configured to cause the displayed content to be fixed relative to the gaze axis despite the relative motion of the HMD with respect to the gaze axis.

20. The system of claim 15, wherein the eye-tracking system comprises a camera, and wherein the computing device is configured to determine the gaze axis based on one or more images captured by the camera.