Optical see-through display calibration
First Claim
1. A method of calibrating an optical see-through display (OSD), the method comprising:
- guiding a user to align a first virtual target on the OSD to a real-world target;
collecting, while guiding the user, a first plurality of real-world target poses, each real-world target pose having a first plurality of point correspondences to the OSD;
receiving an indication of a correct alignment between the first virtual target and the real-world target;
guiding the user to align a second virtual target on the OSD to the real-world target, the second virtual target having a different position than the first virtual target;
collecting, while guiding the user, a second plurality of real-world target poses, each real-world target pose having a second plurality of point correspondences to the OSD;
receiving an indication of a correct alignment between the second virtual target and the real-world target;
iteratively refining an estimated eye position with respect to the OSD according to;
a set of positioning parameters, anda set of point correspondences to the OSD selected from the first and second plurality of point correspondences to the OSD, wherein the iteratively refining includes a rigid geometric transformation between an image sensor and a position of an eye pupil; and
providing, in response to refining the estimated eye position, an initial OSD calibration profile comprising the estimated eye position.
1 Assignment
0 Petitions
Accused Products
Abstract
Disclosed are a system, apparatus, and method for calibrating an optical see-through display (OSD). The OSD virtual display size is estimated as a starting point for determining an eye to camera distance. In response to determining the eye to camera distance and comparing the result with a measured eye to camera distance an updated display size may be determined. A user'"'"'s head movement may be tracked in order to determine when a visual alignment based calibration routine is complete. When a user is not viewing a calibration target a request is sent to prompt the user to realign the OSD. When a user is still after a period of alignment with the OSD, the alignment and calibration procedure may be assumed as complete. A buffer may receive calibration values from before and after the calibration procedure is complete and the values may be averaged or filtered for accuracy.
-
Citations
30 Claims
-
1. A method of calibrating an optical see-through display (OSD), the method comprising:
-
guiding a user to align a first virtual target on the OSD to a real-world target; collecting, while guiding the user, a first plurality of real-world target poses, each real-world target pose having a first plurality of point correspondences to the OSD; receiving an indication of a correct alignment between the first virtual target and the real-world target; guiding the user to align a second virtual target on the OSD to the real-world target, the second virtual target having a different position than the first virtual target; collecting, while guiding the user, a second plurality of real-world target poses, each real-world target pose having a second plurality of point correspondences to the OSD; receiving an indication of a correct alignment between the second virtual target and the real-world target; iteratively refining an estimated eye position with respect to the OSD according to; a set of positioning parameters, and a set of point correspondences to the OSD selected from the first and second plurality of point correspondences to the OSD, wherein the iteratively refining includes a rigid geometric transformation between an image sensor and a position of an eye pupil; and providing, in response to refining the estimated eye position, an initial OSD calibration profile comprising the estimated eye position. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A device comprising:
-
a processor; a storage device coupled to the processor and configurable for storing instructions, which, when executed by the processor cause the processor to; guide a user to align a first virtual target on the OSD to a real-world target; collect, while guiding the user, a first plurality of real-world target poses, each real-world target pose having a first plurality of point correspondences to the OSD; receive an indication of a correct alignment between the first virtual target and the real-world target; guide the user to align a second virtual target on the OSD to the real-world target, the second virtual target having a different position than the first virtual target; collect, while guiding the user, a second plurality of real-world target poses, each real-world target pose having a second plurality of point correspondences to the OSD; receive an indication of a correct alignment between the second virtual target and the real-world target; iteratively refine an estimated eye position with respect to the OSD according to; a set of positioning parameters, and a set of point correspondences to the OSD selected from the first and second plurality of point correspondences to the OSD, wherein the iteratively refining includes a rigid geometric transformation between an image sensor and a position of an eye pupil; and provide, in response to refining the estimated eye position, an initial OSD calibration profile comprising the estimated eye position. - View Dependent Claims (12, 13, 14, 15, 16, 17, 18, 19, 20)
-
-
21. A machine readable non-transitory storage medium having stored therein program instructions that are executable by a processor to:
-
guide a user to align a first virtual target on the OSD to a real-world target; collect, while guiding the user, a first plurality of real-world target poses, each real-world target pose having a first plurality of point correspondences to the OSD; receive an indication of a correct alignment between the first virtual target and the real-world target; guide the user to align a second virtual target on the OSD to the real-world target, the second virtual target having a different position than the first virtual target; collect, while guiding the user, a second plurality of real-world target poses, each real-world target pose having a second plurality of point correspondences to the OSD; receive an indication of a correct alignment between the second virtual target and the real-world target; iteratively refine an estimated eye position with respect to the OSD according to; a set of positioning parameters, and a set of point correspondences to the OSD selected from the first and second plurality of point correspondences to the OSD, wherein the iteratively refining includes a rigid geometric transformation between an image sensor and a position of an eye pupil; and provide, in response to refining the estimated eye position, an initial OSD calibration profile comprising the estimated eye position. - View Dependent Claims (22, 23, 24, 25)
-
-
26. An apparatus for calibrating an optical see-through display, the apparatus comprising:
-
means for guiding a user to align a first virtual target on the OSD to a real-world target; means for collecting, while guiding the user, a first plurality of real-world target poses, each real-world target pose having a first plurality of point correspondences to the OSD; means for receiving an indication of a correct alignment between the first virtual target and the real-world target; means for guiding the user to align a second virtual target on the OSD to the real-world target, the second virtual target having a different position than the first virtual target; means for collecting, while guiding the user, a second plurality of real-world target poses, each real-world target pose having a second plurality of point correspondences to the OSD; means for receiving an indication of a correct alignment between the second virtual target and the real-world target; means for iteratively refining an estimated eye position with respect to the OSD according to; a set of positioning parameters, and a set of point correspondences to the OSD selected from the first and second plurality of point correspondences to the OSD, wherein the means for iteratively refining includes means for utilizing a rigid geometric transformation between an image sensor and a position of an eye pupil; and means for providing, in response to refining the estimated eye position, an initial OSD calibration profile comprising the estimated eye position. - View Dependent Claims (27, 28, 29, 30)
-
Specification