HEAD MOUNTED DISPLAY CALIBRATION

• US 20160225191A1
• Filed: 02/02/2016
• Published: 08/04/2016
• Est. Priority Date: 02/02/2015
• Status: Abandoned Application

• Current Assignee: RPX Corporation
• Original Assignee: DAQRI, LLC
• Inventors: Mullins, Brian
• Application Number:
  US15/013,333
• Publication Number:
  US 20160225191A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 27/0179 Display position adjusting means not related to the information to be displayed
• CPC Class Codes: G06F 3/011 Arrangements for interaction with the human body, e.g. for user immersion in virtual reality blind teaching G09B21/00
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence

Abstract

Techniques of head mounted display calibration are disclosed. In some example embodiments, corresponding intrinsic calibration procedures are performed for each component in a plurality of components of a head mounted display, with each intrinsic calibration procedure comprising determining one or more intrinsic calibration parameters for the corresponding component, and a plurality of extrinsic calibration procedures are performed among the plurality of components, with each extrinsic calibration procedure comprising determining one or more extrinsic calibration parameters. An augmented reality function of the head mounted display is configured based on the determined intrinsic calibration parameters and the determined extrinsic calibration parameters, with the configured augmented reality function being configured to cause the display of virtual content on the head mounted display using the determined intrinsic and extrinsic calibration parameters in conjunction with the plurality of components.

Claims

1. A system comprising:

at least one processor; and

a non-transitory computer-readable medium storing executable instructions that, when executed, cause the at least one processor to perform operations comprising;

performing a corresponding intrinsic calibration procedure for each component in a plurality of components of a head mounted display independently of any calibration procedure for any of the other components in the plurality of components, each corresponding intrinsic calibration procedure comprising determining one or more corresponding intrinsic calibration parameters for the corresponding component based on a calculated difference between sensed data of the corresponding component and reference data;

performing a plurality of extrinsic calibration procedures among the plurality of components, each extrinsic calibration procedure comprising determining one or more corresponding extrinsic calibration parameters based on a calculated difference between sensed data of one of the plurality of components and sensed data of another one of the plurality of components; and

configuring an augmented reality function of the head mounted display based on the determined intrinsic calibration parameters and the determined extrinsic calibration parameters, the configured augmented reality function being configured to cause the display of virtual content on the head mounted display using the determined intrinsic and extrinsic calibration parameters in conjunction with the plurality of components.

2. The system of claim 1, wherein the configuring of the augmented reality function comprises configuring the augmented reality function to offset sensed data from the plurality of components based on the determined intrinsic and extrinsic calibration parameters.

3. The system of claim 1, wherein the plurality of components comprises an inertial measurement unit (IMU), a range sensor, a camera for eye tracking, and at least one externally-facing camera for capturing visual content external of the head mounted display.

4. The system of claim 3, wherein the plurality of components further comprises at least one of a projector and a display surface.

5. The system of claim 1, wherein configuring the augmented reality function comprises configuring the head mounted display based on the determined intrinsic calibration parameters and the determined extrinsic calibration parameters.

6. The system of claim 5, wherein configuring the head mounted display comprises configuring the plurality of components.

7. The system of claim 1, wherein configuring the augmented reality function comprises configuring a computing device that is remote from the head mounted display and communicates with the head mounted display via wireless communication, the computing device being configured to provide the augmented reality function to the head mounted display.

8. A computer-implemented method comprising:

performing a corresponding intrinsic calibration procedure for each component in a plurality of components of a head mounted display independently of any calibration procedure for any of the other components in the plurality of components, each corresponding intrinsic calibration procedure comprising determining one or more corresponding intrinsic calibration parameters for the corresponding component based on a calculated difference between sensed data of the corresponding component and reference data;

performing a plurality of extrinsic calibration procedures among the plurality of components, each extrinsic calibration procedure comprising determining one or more corresponding extrinsic calibration parameters based on a calculated difference between sensed data of one of the plurality of components and sensed data of another one of the plurality of components; and

configuring, by a machine having a memory and at least one processor, an augmented reality function of the head mounted display based on the determined intrinsic calibration parameters and the determined extrinsic calibration parameters, the configured augmented reality function being configured to cause the display of virtual content on the head mounted display using the determined intrinsic and extrinsic calibration parameters in conjunction with the plurality of components.

9. The computer-implemented method of claim 8, wherein the configuring of the augmented reality function comprises configuring the augmented reality function to offset sensed data from the plurality of components based on the determined intrinsic and extrinsic calibration parameters.

10. The computer-implemented method of claim 8, wherein the plurality of components comprises an inertial measurement unit (IMU), a range sensor, a camera for eye tracking, and at least one externally-facing camera for capturing visual content external of the head mounted display.

11. The computer-implemented method of claim 10, wherein the plurality of components further comprises at least one of a projector and a display surface.

12. The computer-implemented method of claim 8, wherein configuring the augmented reality function comprises configuring the head mounted display based on the determined intrinsic calibration parameters and the determined extrinsic calibration parameters.

13. The computer-implemented method of claim 12, wherein configuring the head mounted display comprises configuring the plurality of components.

14. The computer-implemented method of claim 8, wherein configuring the augmented reality function comprises configuring a computing device that is remote from the head mounted display and communicates with the head mounted display via wireless communication, the computing device being configured to provide the augmented reality function to the head mounted display.

15. A non-transitory machine-readable storage device storing a set of instructions that, when executed by at least one processor, causes the at least one processor to perform operations comprising:

performing a corresponding intrinsic calibration procedure for each component in a plurality of components of a head mounted display independently of any calibration procedure for any of the other components in the plurality of components, each corresponding intrinsic calibration procedure comprising determining one or more corresponding intrinsic calibration parameters for the corresponding component based on a calculated difference between sensed data of the corresponding component and reference data;

performing a plurality of extrinsic calibration procedures among the plurality of components, each extrinsic calibration procedure comprising determining one or more corresponding extrinsic calibration parameters based on a calculated difference between sensed data of one of the plurality of components and sensed data of another one of the plurality of components; and

configuring an augmented reality function of the head mounted display based on the determined intrinsic calibration parameters and the determined extrinsic calibration parameters, the configured augmented reality function being configured to cause the display of virtual content on the head mounted display using the determined intrinsic and extrinsic calibration parameters in conjunction with the plurality of components.

16. The storage device of claim 15, wherein the configuring of the augmented reality function comprises configuring the augmented reality function to offset sensed data from the plurality of components based on the determined intrinsic and extrinsic calibration parameters.

17. The storage device of claim 15, wherein the plurality of components comprises an inertial measurement unit (IMU), a range sensor, a camera for eye tracking, and at least one externally-facing camera for capturing visual content external of the head mounted display.

18. The storage device of claim 17, wherein the plurality of components further comprises at least one of a projector and a display surface.

19. The storage device of claim 15, wherein configuring the augmented reality function comprises configuring the head mounted display based on the determined intrinsic calibration parameters and the determined extrinsic calibration parameters.

20. The storage device of claim 19, wherein configuring the head mounted display comprises configuring the plurality of components.