ADJUSTING PIXELS TO COMPENSATE FOR SPACING IN AUGMENTED OR VIRTUAL REALITY SYSTEMS

• US 20150235583A1
• Filed: 05/03/2015
• Published: 08/20/2015
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Magic Leap, Inc.
• Original Assignee: Magic Leap, Inc.
• Inventors: Schowengerdt, Brian T., Miller, Samuel A.
• Granted Patent: US 10,453,258 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/01 Head-up displays
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 1/60 Memory management
• CPC Class Codes: G06T 19/00 Manipulating 3D models or images for computer graphics
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G06T 2219/024 Multi-user, collaborative environment
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G09G 2320/0266 Reduction of sub-frame artefacts
• CPC Class Codes: G09G 3/007 Use of pixel shift techniques, e.g. by mechanical shift of the physical pixels or by optical shift of the perceived pixels

Abstract

One embodiment is directed to a user display device comprising a housing frame mountable on the head of the user, a lens mountable on the housing frame and a projection sub system coupled to the housing frame to determine a location of appearance of a display object in a field of view of the user based at least in part on at least one of a detection of a head movement of the user and a prediction of a head movement of the user, and to project the display object to the user based on the determined location of appearance of the display object.

Claims

1. A method of operation in a virtual image presentation system, the method comprising:

detecting an indication that a spacing as presented to an end user between some pixels in a frame will differ from a spacing between other pixels in the frame;

adjusting a first set of pixels based on the detected indication; and

providing at least a portion of at least one subsequent frame with the adjusted first set of pixels to at least partially compensate for the difference in spacing as presented to the end user.

2. The method of claim 1, wherein the pixel characteristics are perceptible to the end user.

3. The method of claim 1, wherein the set of pixel characteristics is at least one of a perceived size and a perceived intensity. 38. The method of claim 1, further comprising detecting a head movement exceeding a nominal head movement value.

4. The method of claim 1, further comprising:

selecting a first set of pixels of the frame based on a direction of the detected head movement, wherein the direction of the first set of pixels is the same as the direction of the detected head movement; and

increasing a size of the first set of pixels of the at least one subsequent frame.

5. The method of claim 1, further comprising adjusting a variable focus element of the first set of pixels.

6. The method of claim 1, further comprising adjusting a variable size source of the first set of pixels.

7. The method of claim 1, further comprising adjusting a jitter of the first set of pixels.

8. The method of claim 1, further comprising:

selecting a first set of pixels of the frame based on a direction of the detected head movement wherein the direction of the first set of pixels is the same as the direction of the detected head movement; and

increasing an intensity of the first set of pixels of the at least one subsequent frame in response to the detected head movement.

9. The method of claim 1, further comprising:

selecting a first set of pixels of the frame based on a direction of the detected head movement wherein the direction of the first set of pixels is the opposite as the direction of the detected head movement; and

decreasing a size of the first set of pixels of the at least one subsequent frame in response to the detected head movement.

10. The method of claim 1, further comprising:

selecting a first set of pixels of the frame based on a direction of the detected head movement wherein the direction of the first set of pixels is the opposite as the direction of the detected head movement; and

decreasing an intensity of the first set of pixels of the at least one subsequent frame in response to the detected head movement.

11. The method of claim 1, wherein the detected indication is based on detecting that a head movement attribute of the user has exceeded a nominal value of the head movement attribute.

12. The method of claim 11, wherein the head movement attribute is at least one of a speed of the head movement and an acceleration of the head movement. 48.

The method of claim 1, wherein the detected indication is based on a signal received through an inertial sensor.

13. The method of claim 1, wherein the detected indication is based on a signal received through an imager.

14. The method of claim 1, wherein the at least one subsequent frame is provided based on at least one of a raster scan type frame, a spiral scan type frame and a Lissajous scan type frame.

15. A method of operation in a virtual image presentation system, the method comprising:

rendering a first complete frame to an image buffer, wherein the first complete frame includes pixel information for sequential presentation of pixels to form an image of a virtual object;

starting a presentation of the first complete frame; and

dynamically interrupting the presenting of the first complete frame before completion of the presentation of the first complete frame by a presentation of an update to the first complete frame in which a portion of the pixel information has changed from the first complete frame.

16. The method of claim 15, wherein a pixel information of the updated first complete frame is different in at least one respect from the pixel information of the first complete frame.

17. The method of claim 15, wherein the updated first complete frame is presented in lieu of a counterpart portion of the first complete frame.

18. The method of claim 17, further comprising presenting a second field of the updated first complete frame in lieu of a counterpart field of the first complete frame.

19. The method of claim 17, further comprising presenting a portion of a field of the updated first complete frame in lieu of a counterpart portion of a counterpart field of the first complete frame.

20. The method of claim 17, further comprising presenting a portion of a field of the updated first complete frame of a raster scan in lieu of a counterpart portion of a counterpart field of the first complete frame of the raster scan.

21. The method of claim 17, further comprising presenting a line of the updated first complete frame in lieu of a counterpart line of the first complete frame.

22. The method of claim 17, further comprising presenting a spiral line of the updated first complete frame in lieu of a counter spiral line of the first complete frame.

23. The method of claim 17, further comprising presenting a portion of a line of the updated first complete frame in lieu of a counterpart portion of a counterpart line of the first complete frame.

24. The method of claim 17, further comprising presenting at least one pixel of the updated first complete frame in lieu of a counterpart pixel of the first complete frame.

25. The method of claim 17, further comprising presenting one full cycle of a Lissajous pattern scan of the updated first complete frame in lieu of a counter part one full cycle of a Lissajous pattern scan of the first complete frame.

26. The method of claim 15, wherein the dynamic interruption of the presentation of the first complete frame is in response to a detected head movement of the end user exceeding a nominal head movement value.