Method and apparatus for individualized three dimensional display calibration
First Claim
1. A method, comprising:
- defining, by a processor, a first coordinate in three-dimensional (3D) space to display a virtual object to a viewer, wherein the three-dimensional space is an augmented reality environment or a virtual reality environment;
displaying, by a display, the virtual object at the first coordinate in the 3D space;
sensing, by a sensor, an end-effector interacting with the virtual object when the virtual object is displayed at the first coordinate;
determining, by the processor, that the end-effector is pointing to a second coordinate in the 3D space that is different than the first coordinate where the virtual object is displayed;
determining, by the processor, an offset value between the first coordinate where the virtual object is located and the second coordinate where the end-effector is pointing to, wherein the offset value indicates a difference in a first coordinate and the second coordinate;
determining, by the processor, a third coordinate in the 3D space, wherein the third coordinate is the first coordinate of the first coordinate adjusted by the offset value so that the viewer perceives the virtual object as being located at the first coordinate in the 3D space;
displaying, by the display, the virtual object at the third coordinate in the 3D space;
sensing, by the sensor, the end-effector interacting with the virtual object when the virtual object is displayed at the third coordinate;
determining, by the processor, whether the end-effector is pointing to the first coordinate in the 3D space when the virtual object is displayed at the third coordinate;
in response to the end-effector pointing to the first coordinate in the 3D space, continuing to display the virtual object at the third coordinate; and
in response to the end-effector pointing to a coordinate in the 3D space that is not the first coordinate, iteratively adjusting, by the processor, a coordinate that the virtual object is displayed at until the end-effector points to the first coordinate.
3 Assignments
0 Petitions
Accused Products
Abstract
A target is outputted to an ideal position in 3D space. A viewer indicates the apparent position of the target, and the indication is sensed. An offset between the ideal and apparent positions is determined, and an adjustment determined from the offset such that the apparent position of the ideal position with the adjustment matches the ideal position without the adjustment. The adjustment is made to the first entity and/or a second entity, such that the entities appear to the viewer in the ideal position. The indication may be monocular with a separate indication for each eye, or binocular with a single viewer indication for both eyes. The indication also may serve as communication, such as a PIN input, so that calibration is transparent to the viewer. The method may be continuous, intermittent, or otherwise ongoing over time.
-
Citations
52 Claims
-
1. A method, comprising:
-
defining, by a processor, a first coordinate in three-dimensional (3D) space to display a virtual object to a viewer, wherein the three-dimensional space is an augmented reality environment or a virtual reality environment; displaying, by a display, the virtual object at the first coordinate in the 3D space; sensing, by a sensor, an end-effector interacting with the virtual object when the virtual object is displayed at the first coordinate; determining, by the processor, that the end-effector is pointing to a second coordinate in the 3D space that is different than the first coordinate where the virtual object is displayed; determining, by the processor, an offset value between the first coordinate where the virtual object is located and the second coordinate where the end-effector is pointing to, wherein the offset value indicates a difference in a first coordinate and the second coordinate; determining, by the processor, a third coordinate in the 3D space, wherein the third coordinate is the first coordinate of the first coordinate adjusted by the offset value so that the viewer perceives the virtual object as being located at the first coordinate in the 3D space; displaying, by the display, the virtual object at the third coordinate in the 3D space; sensing, by the sensor, the end-effector interacting with the virtual object when the virtual object is displayed at the third coordinate; determining, by the processor, whether the end-effector is pointing to the first coordinate in the 3D space when the virtual object is displayed at the third coordinate; in response to the end-effector pointing to the first coordinate in the 3D space, continuing to display the virtual object at the third coordinate; and in response to the end-effector pointing to a coordinate in the 3D space that is not the first coordinate, iteratively adjusting, by the processor, a coordinate that the virtual object is displayed at until the end-effector points to the first coordinate. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21)
-
-
22. A method, comprising:
-
defining, by a processor, a first coordinate in an augmented reality environment or a virtual reality environment to display a first virtual object to a viewer; displaying, by a display, the first virtual object at the first coordinate in the augmented reality environment or the virtual reality environment; sensing, by a sensor, an end-effector interacting with the virtual object when the virtual object is displayed at the first coordinate; determining, by the processor, that the end-effector is pointing to a second coordinate in the 3D space that is different than the first coordinate where the virtual object is displayed; determining, by the processor, an offset value between the first coordinate where the virtual object is located and the second coordinate where the end-effector is pointing to, wherein the offset value indicates a difference in a first coordinate and the second coordinate determining, by the processor, a third coordinate in the augmented reality environment or the virtual reality environment, wherein the third coordinate is the first coordinate of the first coordinate adjusted by the offset value so that the viewer perceives the virtual object as being located at the first coordinate in the augmented reality environment or the virtual reality environment; generating a second virtual object that is different than the first virtual object; defining, by the processor, a fourth coordinate in the augmented reality environment or the virtual reality environment to display the second virtual object to the viewer; adjusting the fourth coordinate that the second virtual object is displayed at based on the offset value; displaying, by the display, the first virtual object at the first coordinate in the augmented reality environment or the virtual reality environment; and displaying the second virtual object at the adjusted fourth coordinate. - View Dependent Claims (23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38)
-
-
39. An apparatus comprising:
-
a first three-dimensional (3D) display operable to output a virtual object at a first coordinate in three-dimensional (3D) space to a first eye of a viewer; a second 3D display operable to output the virtual object at a second coordinate in the 3D space to a second eye of the viewer, wherein the first coordinate is different than the first coordinate; a first sensor configured to measure the first coordinate of an end-effector interacting with the virtual object relative to the first eye when the virtual object is displayed at the first coordinate; a second sensor configured to measure the second coordinate of the end-effector interacting with the virtual object relative to the second eye when the virtual object is displayed at the second coordinate; a processor coupled to the first 3D display, the second 3D display, the first sensor, and the second sensor, wherein the processor is configured to; determine that the end-effector is pointing to a third coordinate on the first 3D display that is different than the first coordinate where the virtual object is displayed; determine that the end-effector is pointing to a fourth coordinate on the second 3D display that is different than the second coordinate where the virtual object is displayed; determine a first offset value between the first coordinate where the virtual object is located and the third coordinate where the end-effector is pointing to on the first display, wherein the first offset value indicates a difference in the first coordinate and the third coordinate; determine a second offset value between the second coordinate where the virtual object is located and the fourth coordinate where the end-effector is pointing to on the second display, wherein the second offset value indicates a difference in the second coordinate and the fourth coordinate; determine a fifth coordinate in the 3D space, wherein; the fifth coordinate is the first coordinate adjusted by the first offset value so that the viewer perceives the virtual object as being located at the first coordinate on the first 3D display; the first 3D display is to display the virtual object at the fifth coordinate on the first 3D display; and determine a sixth coordinate in the 3D space, wherein; the sixth coordinate is the second coordinate adjusted by the second offset value so that the viewer perceives the virtual object as being located at the second coordinate on the second 3D display; and the second 3D display is to display the virtual object at the sixth coordinate on the second 3D display. - View Dependent Claims (40, 41, 42, 43, 44, 45)
-
-
46. An apparatus, comprising:
-
a stereo display pair comprising a first display to display a virtual object to a first eye of a viewer at a first coordinate of the first display and a second display to display the virtual object to a second eye of the viewer at a second coordinate of the second display; a sensor configured to; measure the first coordinate an end-effector interacting with the virtual object relative to the first eye of when the virtual object is displayed at the first coordinate; measure the second coordinate of the end-effector interacting with the virtual object relative to the second eye when the virtual object is displayed at the second coordinate; and a processor coupled to the stereo display and the sensor, wherein the processor is configured to; determine that the end-effector is pointing to a third coordinate on the first 3D display that is different than the first coordinate where the virtual object is displayed; determine that the end-effector is pointing to a fourth coordinate on the second 3D display that is different than the second coordinate where the virtual object is displayed; determine a first offset value between the first coordinate where the virtual object is located and the third coordinate where the end-effector is pointing to on the first display, wherein the first offset value indicates a difference in the first coordinate and the third coordinate; determine a second offset value between the second coordinate where the virtual object is located and the fourth coordinate where the end-effector is pointing to on the second display, wherein the second offset value indicates a difference in the second coordinate and the fourth coordinate, and simultaneously adjust the first coordinate by the first offset value and the second coordinate by the second offset value such that the first display and the second display simultaneously display the virtual object at the adjusted first coordinate and the adjusted second coordinate, respectively. - View Dependent Claims (47, 48, 49, 50, 51, 52)
-
Specification