PRESENTING VIRTUAL OBJECTS BASED ON HEAD MOVEMENTS IN AUGMENTED OR VIRTUAL REALITY SYSTEMS

• US 20150235451A1
• Filed: 05/06/2015
• Published: 08/20/2015
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Schowengerdt, Brian T., Miller, Samuel A.
• Granted Patent: US 10,553,028 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G09G 2320/0266 Reduction of sub-frame artefacts
• CPC Class Codes: G09G 3/007 Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels

Abstract

One embodiment is directed to a user display device comprising a housing frame mountable on the head of the user, a lens mountable on the housing frame and a projection sub system coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on at least one of a detection of a head movement of the user and a prediction of a head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object.

Claims

1. A method of operation in a virtual image presentation system, the method comprising:

for each of a plurality of frames, determining a respective resolution for each of at least two portions of the respective frame in response to a detected head movement of an end user; and

presenting the virtual objects based on the determined respective resolutions of the at least two portions of the respective frame.

2. The method of claim 1, wherein the portion of the respective frame is at least one of a field of the frame, a line of the frame, a pixel of the frame.

3. The method of claim 1, further comprising:

adjusting a characteristic of a drive signal between presenting a first portion of a the frame and a second portion of the frame to create a variable resolution in the image of the virtual object.

4. The method of claim 3, wherein the characteristic of the drive signal is an amplitude of the drive signal.

5. The method of claim 3, further comprising:

rendering the frames with the respective resolutions pixel data using a spiral scan pattern,

6. The method of claim 1, further comprising:

assessing a point of attention in at least a first image for the end user, based on at least one of a processed eye tracking data, a determined location of appearance of a virtual object in a field of view of the end user relative to an end user frame of reference, a determined location of appearance of the virtual object when newly introduced in the field of view of the end user, and a determined location of appearance of the virtual object in a new position in an image relative to a position of the virtual object in at least one previous image.

7. The method of claim 6, wherein the processing eye tracking data tracking data is indicative of at least one of an orientation of the user'"'"'s eyes and an orientation of the user'"'"'s head.

8. The method of claim 6, further comprising:

increasing the resolution in at least one subsequent image in a portion of the at least one subsequent image that is at least proximate to the assessed point of attention relative to other portions of the at least one subsequent image.

9. The method of claim 6, further comprising:

decreasing the resolution in at least one subsequent image in a portion of the at least one subsequent image that is distal to the assessed point of attention relative to other portions of the at least one subsequent image.

10. The method of claim 3, wherein the at least one characteristic of the drive signal is a slope of the drive signal.