RENDERING BASED ON PREDICTED HEAD MOVEMENT IN AUGMENTED OR VIRTUAL REALITY SYSTEMS

• US 20150235453A1
• Filed: 05/06/2015
• Published: 08/20/2015
• Est. Priority Date: 03/15/2013
• Status: Abandoned Application

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Schowengerdt, Brian T., Miller, Samuel A.
• Application Number:
  US14/704,979
• Publication Number:
  US 20150235453A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G09G 2320/0266 Reduction of sub-frame artefacts
• CPC Class Codes: G09G 3/007 Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels

Abstract

One embodiment is directed to a user display device comprising a housing frame mountable on the head of the user, a lens mountable on the housing frame and a projection sub system coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on at least one of a detection of a head movement of the user and a prediction of a head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object.

Claims

1. A projector apparatus to project at least virtual images in an augmented reality system, the projector apparatus comprising:

a projector element;

a support that supports the projector element with the projector element moveable in at least one axis of freedom;

at least one actuator coupled to selectively move the projector element; and

a control subsystem communicatively coupled to control the actuator such that the projector element is moved in response to at least one of a detection of a head movement of an end user that exceeds a nominal head movement value and a prediction of a head movement of the end user that is predicted to exceed the nominal head movement value.

2. The projector apparatus of claim 1, wherein the projector element further comprises at least a first optical fiber, the first optical fiber having a back end and a front end, the back end coupled to receive images, the front end positioned to transmit images therefrom.

3. The projector apparatus of claim 2, wherein the support element comprises a piezoelectric collar that receives at least the first optical fiber proximate but spaced rear-wardly from the front end of the first optical fiber such that a portion of the first optical fiber proximate the front end thereof extends from the piezoelectric collar and is free to oscillate with a defined resonance frequency.

4. The projector apparatus of claim 3, wherein the support element comprises a gimbal and the projector element is translatable along at least one axis.

5. The projector apparatus of claim 3, wherein the support element comprises a gimbal and the projector element is translatable rotatable about at least one axis.

6. The projector apparatus of claim 3, wherein the support element comprises a gimbal and the projector element is moveable in at least three axes of freedom.

7. The projector apparatus of claim 1, wherein the control subsystem is communicatively coupled to receive head tracking data supplied via at least one transducer, the head tracking data indicative of at least an orientation of a head of the end user.

8. The projector apparatus of claim 1, wherein the at least one control subsystem:

for each of at least some of a plurality of images presented to the end user, determines a location of appearance of a virtual object in a field of view of the end user relative to an end user frame of reference;

assesses whether the determined location requires the end user to turn a head of the end user; and

predicts the occurrence of the head movement based on the assessment.

9. The projector apparatus of claim 1, further comprising a processor to modify at least a portion of the virtual image based at least in part on at least one of the detected head movement and the predicted head movement.

10. The projector apparatus of claim 1, further comprising at least a pair of cameras to track a movement of the user'"'"'s eyes, wherein the at least one of the detected head movement and predicted head movement is determined based at least in part on the tracked movement of the user'"'"'s eyes.