Fixed-distance virtual and augmented reality systems and methods

• US 10,649,211 B2
• Filed: 07/31/2017
• Issued: 05/12/2020
• Est. Priority Date: 08/02/2016
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Miller, Samuel A, Welch, William Hudson
• Primary Examiner(s): Lin, Chun-Nan
• Application Number:
  US15/665,335
• Publication Number:
  US 20180039083A1
• Time in Patent Office: 1,016 Days
• CPC Class Codes: G02B 2027/0125 Field-of-view increase by wavefront division
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0181 Adaptation to the pilot/driver
• CPC Class Codes: G02B 2027/0185 Displaying image at variable distance
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/0346 with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
• CPC Class Codes: G06Q 20/085 involving remote charge determination or related payment systems
• CPC Class Codes: G06Q 20/204 comprising interface for record bearing medium or carrier for electronic funds transfer or payment credit
• CPC Class Codes: G06Q 40/08 Insurance

Abstract

A fixed-distance display system includes a light source configured to generate a light beam. The system also includes a light guiding optical element configured to propagate at least a portion of the light beam by total internal reflection. The system further includes a first inertial measurement unit configured to measure a first value for calculating a head pose of a user. Moreover, the system includes a camera configured to capture an image for machine vision optical flow analysis. The display system is configured to display virtual images only within a tolerance range of a single predetermined optical plane.

Claims

1. A fixed-distance display system, comprising:

a light source configured to generate a light beam;

a light guiding optical element configured to propagate at least a portion of the light beam by total internal reflection;

a first inertial measurement unit configured to measure a first value for calculating a head pose of a user a third inertial measurement unit configured to measure a third value for calculating a body pose of the user; and

a camera configured to capture an image for machine vision optical flow analysis,

wherein the fixed-distance display system is configured to display a body-centric virtual user interface in a field of view of the user based on the head pose of the user relative to the body pose of the user;

wherein the body-centric virtual user interface is displayed at a fixed distance and in a fixed position relative to a body of the user,

wherein the body-centric virtual user interface is displayed at a distance and in a position relative to a head of the user that varies with movement of the head of the user such that when the head of the user moves relative to the body of the user, the body-centric virtual user interface moves in the field of view of the user, and

wherein the fixed-distance display system is configured to display three dimensional virtual images having dimensions that do not exceed 0.2 diopters to 0.6 diopters.

2. The system of claim 1, wherein the first inertial measurement unit is disposed adjacent the user'"'"'s head.

3. The system of claim 2, further comprising a second inertial measurement unit configured to measure a second value for calculating the head pose of the user.

4. The system of claim 3, wherein the second inertial measurement unit is disposed adjacent the user'"'"'s head.

5. The system of claim 1, wherein the third inertial measurement unit is disposed adjacent the user'"'"'s waist.

6. The system of claim 5, wherein the first inertial measurement unit, the second inertial measurement unit, the third inertial measurement unit, and the camera are configured to match the field of view of the user to the user'"'"'s body position.

7. The system of claim 1, wherein the body-centric virtual user interface comprises a plurality of user interface objects displayed in an arc around the body of the user at the fixed distance.

8. A computer program product embodied in a non-transitory computer readable medium, the computer readable medium having stored thereon a sequence of instructions which, when executed by a processor causes the processor to execute a method for displaying, the method comprising:

generating a light beam,

propagating at least a portion of the light beam by total internal reflection;

measuring a first value relating to a head pose;

calculating the head pose of a user based on the first value;

measuring a third value relating to a body pose;

calculating the body pose of the user based on the third value;

capturing an image;

performing machine vision optical flow analysis based on the image;

displaying a body-centric virtual user interface in a field of view of the user based on the head pose of the user relative to the body pose of the user at a fixed distance and in a fixed position relative to a body of the user, and

displaying three dimensional virtual images having dimensions that do not exceed 0.2 diopters to 0.6 diopters,

wherein the body-centric virtual user interface is displayed at a distance and in a position relative to a head of the user that varies with movement of the head of the user such that when the head of the user moves relative to the body of the user, the body-centric virtual user interface moves in the field of view of the user.

9. The computer program product of claim 8, wherein the body-centric virtual user interface comprises a plurality of user interface objects displayed in an arc around the body of the user at the fixed distance.