Dynamic vergence and focus control for head-mounted displays
First Claim
1. A method of compensating for changes in vergence of a virtual object as seen by a user viewing a real object through a see-through head-mounted display (ST-HMD) system having movable left and right eyepieces set to an interpupilary distance (IPD) of the user, the method comprising:
- providing tracking information to a controller by tracking movements of the ST-HMD that cause a change in the vergence;
calculating from the tracking information a viewing vector of the ST-HMD relative to a position on the real object;
calculating from the viewing vector and the IPD a new vergence and a distance D from the ST-HMD to the real object; and
offsetting the virtual object in the right and left eyepieces so that the user sees the virtual object on the real object with the new vergence.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods for dynamically controlling vergence and focus for a see-through head-mounted display (ST-HMD) used as part of an augmented reality (AR) system are disclosed. The ST-HMD (40) allows a user (30) to view left and right images (150L, 150R) through corresponding left and right eyepieces (104L, 104R) so that a single virtual object (150V) based on the right and left images as seen at a real object such as a screen (20). When the user moves relative to the real object, however, the vergence changes and the virtual object does not appear in focus at the real object. Changes in the vergence are compensated by tracking the user'"'"'s head position with a tracking unit (350) and providing the tracking data to a controller (180). Based on the tracking data and the interpupilary distance (IPD) of the user, the controller calculates the offset (H) needed to be imparted to the images formed in the eyepieces to maintain the vergence of the virtual object at the real object even when the user'"'"'s position changes relative to the real object.
350 Citations
16 Claims
-
1. A method of compensating for changes in vergence of a virtual object as seen by a user viewing a real object through a see-through head-mounted display (ST-HMD) system having movable left and right eyepieces set to an interpupilary distance (IPD) of the user, the method comprising:
-
providing tracking information to a controller by tracking movements of the ST-HMD that cause a change in the vergence;
calculating from the tracking information a viewing vector of the ST-HMD relative to a position on the real object;
calculating from the viewing vector and the IPD a new vergence and a distance D from the ST-HMD to the real object; and
offsetting the virtual object in the right and left eyepieces so that the user sees the virtual object on the real object with the new vergence. - View Dependent Claims (2, 3, 4)
-
-
5. A method of maintaining vergence in an augmented reality (AR) system having a screen and a see-through head-mounted display (ST-HMD) worn by a user, the method comprising:
-
generating left and right virtual objects in corresponding left and right eyepieces of the ST-HMD so that the user can see a registered virtual object when viewing the screen through the eyepieces;
tracking movement of the ST-HMD as the user views the registered virtual object on the screen;
calculating a vergence for the ST-HMD based on the tracked movements; and
adjusting the left and right virtual objects to maintain vergence so that the user sees the registered virtual object on the screen even if the ST-HMD moves relative to the screen. - View Dependent Claims (6, 7, 8, 9)
-
-
10. A see-through head-mounted display (ST-HMD) system capable of compensating for changes in vergence of the ST-HMD relative to a real object, comprising:
-
left and right eyepieces having corresponding left and right flat panel displays (FPDs) having corresponding array of pixels that are selectively addressable to support corresponding left and right images, the eyepieces being adapted for a user to view the left and right images as a registered virtual object when viewing the real object;
left and right video electronics units respectively operably coupled to the left and right FPDs and adapted to provide to the left and right FPDs respective left and right video electrical signals representative of the left and right images;
a controller operably coupled to the left and right video electronics and adapted to provide the left and right video electronics with a video stream of the left and right images;
a head-tracking unit adapted to provide information about the user'"'"'s position while viewing the registered virtual object at the real object; and
wherein the controller is adapted to calculate, based on the user'"'"'s position information, a shift in the position of the left and right images on the respective left and right FPDs and provide a correction signal representative of same to the left and right video electronics units to effectuate the image shift so as to maintain vergence of the registered virtual object at the real object as viewed by the user. - View Dependent Claims (11, 12)
-
-
13. A see-through head-mounted display (ST-HMD) system that allows a user to view a virtual object at a real object with substantially constant vergence, comprising:
-
a housing adapted to support the ST-HMD on the user'"'"'s head;
right and left eyepieces operably coupled to the housing and positioned so as to provide the user with a view of the real object through the eyepieces, the eyepieces being adapted to provide respective left and right images that when viewed by the viewer form the virtual object;
a head tracking unit adapted to provide position information of the ST-HMD as the user views the real object; and
a controller operably coupled to the head tracking unit and the right and left eyepieces and adapted to effectuate a shift in the left and right images to compensate for changes in vergence due to movement of the user. - View Dependent Claims (14, 15, 16)
-
Specification