METHOD AND APPARATUS FOR INDIVIDUALIZED THREE DIMENSIONAL DISPLAY CALIBRATION

• US 20170099482A1
• Filed: 10/02/2015
• Published: 04/06/2017
• Est. Priority Date: 10/02/2015
• Status: Active Grant

• Current Assignee: West Texas Technology Partners LLC
• Original Assignee: Atheer, Inc.
• Inventors: Fateh, Sina, Abercrombie, Nathan, Itani, Sleiman
• Granted Patent: US 10,368,059 B2
• Time in Patent Office: Days
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/327 Calibration thereof
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 2213/002 Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices

Abstract

A target is outputted to an ideal position in 3D space. A viewer indicates the apparent position of the target, and the indication is sensed. An offset between the ideal and apparent positions is determined, and an adjustment determined from the offset such that the apparent position of the ideal position with the adjustment matches the ideal position without the adjustment. The adjustment is made to the first entity and/or a second entity, such that the entities appear to the viewer in the ideal position. The indication may be monocular with a separate indication for each eye, or binocular with a single viewer indication for both eyes. The indication also may serve as communication, such as a PIN input, so that calibration is transparent to the viewer. The method may be continuous, intermittent, or otherwise ongoing over time.

Claims

1. A machine-implemented method, comprising:

outputting a first entity in an ideal position in three-dimensional space;

sensing a viewer indication of an apparent position of said first entity;

determining an offset between said ideal position and said apparent position;

determining an adjustment from said offset, such that an apparent position of said ideal position with said adjustment is substantially similar to said ideal position absent said adjustment; and

thereafter applying said adjustment to at least one of said first entity and a second entity.

2. The method of claim 1, comprising:

outputting said first entity in said ideal position comprises outputting said first entity to first and second displays of a stereo display pair.

3. The method of claim 1, wherein:

outputting said first entity in said ideal position comprises outputting said first entity in a first ideal position to a first display of a stereo display pair, and outputting said first entity in a second ideal position to a second display of said stereo display pair.

4. The method of claim 2, wherein:

said first and second ideal positions are substantially two-dimensional.

5. The method of claim 1, wherein:

outputting said first entity in said ideal position comprises;

outputting said first entity in a first ideal position to a first eye of said viewer but not a second eye of said viewer; and

outputting said first entity in a second ideal position to said second eye of said viewer but not said first eye of said viewer.

6. The method of claim 5, comprising:

outputting said first entity substantially simultaneously to said first eye and said second eye;

wherein sensing said viewer indication of said apparent position of said first entity comprises sensing a substantially simultaneous viewer first indication of a first apparent position of said first entity to said first eye and viewer second indication of a second apparent position of said first entity to said second eye.

7. The method of claim 5, comprising:

outputting said first entity sequentially to said first eye and said second eye;

wherein sensing said viewer indication of said apparent position of said first entity comprises sequentially sensing a viewer first indication of a first apparent position of said first entity to said first eye, and a viewer second indication of a second apparent position of said first entity to said second eye.

8. The method of claim 7, comprising:

outputting substantially nothing to said second eye while outputting said first entity to said first eye; and

outputting substantially nothing to said first eye while outputting said first entity to said second eye.

9. The method of claim 7, comprising:

substantially obstructing said second eye while outputting said first entity to said first eye; and

substantially obstructing said first eye while outputting said first entity to said second eye.

10. The method of claim 1, wherein:

said viewer indication comprises at least one of a viewer posture and a viewer gesture.

11. The method of claim 1, wherein:

said viewer indication comprises said viewer substantially aligning an end-effector with said apparent position of said first entity.

12. The method of claim 6, wherein:

said viewer first indication comprises said viewer substantially aligning a first end-effector with said first apparent position of said first entity; and

said viewer second indication comprises said viewer substantially aligning said first end-effector with said second apparent position of said first entity, substantially simultaneously to said viewer substantially aligning said first end-effector with said first apparent position of said first entity.

13. The method of claim 7, wherein:

said viewer first indication comprises said viewer substantially aligning a first end-effector with said first apparent position of said first entity; and

said viewer second indication comprises said viewer substantially aligning said first end-effector with said second apparent position of said first entity.

14. The method of claim 7, wherein:

said viewer first indication comprises said viewer substantially aligning a first end-effector with said first apparent position of said first entity; and

said viewer second indication comprises said viewer substantially aligning a second end-effector with said second apparent position of said first entity.

15. The method of claim 1, wherein:

said entity comprises at least one of a virtual reality entity and an augmented reality entity.

16. The method of claim 1, comprising:

outputting said first entity to a stereo display.

17. The method of claim 1, comprising:

outputting said first entity to a see-through display.

18. The method of claim 1, comprising:

sensing said viewer indication of said apparent position through stereo imaging.

19. The method of claim 1, comprising:

sensing said viewer indication of said apparent position through depth imaging.

20. The method of claim 1, wherein:

said viewer indication comprises a viewer communication with said processor in addition to said indication of said apparent position.

21. The method of claim 1, wherein:

said viewer communication comprises at least one of;

activating a device in communication with said processor;

activating a data entity comprising executable instructions instantiated on said processor;

waking said device in communication with said processor;

waking said data entity comprising executable instructions instantiated on said processor;

unlocking said device in communication with said processor;

unlocking said data entity comprising executable instructions instantiated on said processor;

addressing said device in communication with said processor;

addressing said data entity comprising executable instructions instantiated on said processor;

identifying a user of said device in communication with said processor;

identifying said user of said data entity comprising executable instructions instantiated on said processor;

entering a security verification for said device in communication with said processor; and

entering said security verification for said data entity comprising executable instructions instantiated on said processor.

22. A machine-implemented method, comprising:

establishing a substantially three-dimensional combined ideal position;

determining from said combined ideal position a substantially two-dimensional first ideal position for a first display of a stereo display pair;

determining from said combined ideal position a substantially two-dimensional second ideal position for a second display of said display stereo pair;

outputting a first entity substantially to said first ideal position in said first display;

outputting said first entity substantially to said second ideal position in said second display;

sensing a viewer indication of an apparent position;

determining a first position offset substantially representing a difference between said apparent position and said first ideal position;

determining a second position offset substantially representing a difference between said apparent position and said second ideal position;

determining an adjustment for said combined ideal position from said first and second position offsets, such that an apparent position of said combined ideal position with said adjustment is substantially similar to said ideal position absent said adjustment;

applying said adjustment to a three dimensional position of at least one of said first entity and a second entity;

outputting said at least one of said first entity and said second entity, with said adjustment applied thereto, to said stereo display pair.

23. The method of claim 22, comprising:

sequentially outputting said first and second entities;

outputting said first entity in said first display while not outputting said second target in said second display; and

outputting said second entity in said second display while not outputting said first target in said first display.

24. The method of claim 23, comprising:

outputting said first target in said first display while outputting substantially nothing in said second display; and

outputting said second target in said second display while outputting substantially nothing in said first display.

25. The method of claim 23, comprising:

outputting said first target in said first display while substantially obstructing said second display; and

outputting said second target in said second display while substantially obstructing said first display.

26. The method of claim 22, wherein:

sensing said viewer indication comprises sensing a viewer first indication of said first target and a viewer second indication of said second target.

27. The method of claim 22, comprising:

outputting said first target in said first display and substantially simultaneously outputting said second target in said second display.

28. The method of claim 22, wherein:

sensing said viewer indication comprises sensing substantially simultaneous indication of said first and second targets.

29. The method of claim 22, wherein:

said viewer indication comprises at least one of a group consisting of a viewer posture and a viewer gesture.

30. The method of claim 22, wherein:

said viewer indication comprises said viewer substantially aligning an end-effector with said apparent position of said first entity.

31. The method of claim 26, wherein:

said viewer first indication comprises said viewer substantially aligning a first end-effector with said first apparent position of said first entity; and

said viewer second indication comprises said viewer substantially aligning said first end-effector with said second apparent position of said first entity, substantially simultaneously to said viewer substantially aligning said first end-effector with said first apparent position of said first entity.

32. The method of claim 26, wherein:

said viewer first indication comprises said viewer substantially aligning a first end-effector with said first apparent position of said first entity; and

said viewer second indication comprises said viewer substantially aligning said first end-effector with said second apparent position of said first entity.

33. The method of claim 26, wherein:

said viewer first indication comprises said viewer substantially aligning a first end-effector with said first apparent position of said first entity; and

said viewer second indication comprises said viewer substantially aligning a second end-effector with said second apparent position of said first entity.

34. The method of claim 27, wherein:

said viewer first indication comprises said viewer substantially aligning a first end-effector with said first apparent position of said first entity; and

said viewer second indication comprises said viewer substantially aligning said first end-effector with said second apparent position of said first entity, substantially simultaneously to said viewer substantially aligning said first end-effector with said first apparent position of said first entity.

35. The method of claim 22, wherein:

said entity comprises at least one of a group consisting of a virtual reality entity and an augmented reality entity.

36. The method of claim 22, wherein:

said first and second displays comprise see-through displays.

37. The method of claim 22, comprising:

sensing said viewer indication of said apparent position through stereo imaging.

38. The method of claim 22, comprising:

sensing said viewer indication of said apparent position through depth imaging.

39. An apparatus comprising:

a processor;

a 3D display in communication with said processor, said display being adapted to output a first entity at an ideal position;

a sensor in communication with said processor, said sensor being adapted to determine a viewer indication of an apparent position of said first entity;

an offset determiner instantiated on the processor, said offset determiner comprising executable instructions, said difference determiner being adapted to determine an offset between said ideal position and said apparent position;

an adjustment determiner instantiated on said processor, said adjustment determiner comprising executable instructions, said adjustment determiner being adapted to determine an adjustment from said offset such that an apparent position of said ideal position with said adjustment is substantially similar to said ideal position absent said adjustment; and

an adjustment applier instantiated on the processor, said adjustment applier comprising executable instructions, said adjustment applier being adapted to apply said adjustment to at least one of a group consisting of said first entity and a second entity.

40. The apparatus of claim 39, wherein:

said display comprises a stereo display.

41. The apparatus of claim 39, wherein:

said display comprises a see-through display.

42. The apparatus of claim 39, wherein:

said sensor comprises an imager.

43. The apparatus of claim 39, wherein:

the sensor comprises a stereo imager pair.

44. The apparatus of claim 39, wherein:

said sensor comprises a depth imager.

45. The apparatus of claim 39, wherein:

said processor, said display, and said sensor are disposed on a head-mounted display.

46. An apparatus, comprising:

a processor;

a stereo display pair in communication with said processor, said stereo display pair comprising first and second displays, said stereo display pair being adapted to output at least one entity;

a sensor in communication with said processor, said sensor being adapted to determine a viewer indication of an apparent position;

a position establisher instantiated on said processor, said position establisher comprising executable instructions, said position establisher being adapted to establish a substantially three-dimensional combined ideal position;

a stereo position determiner instantiated on said processor, said stereo position determiner comprising executable instructions, said stereo position determiner being adapted to determine a substantially two-dimensional first ideal position in said first display substantially corresponding with said combined ideal position, and to determine a substantially two-dimensional second ideal position for in said second display substantially corresponding with said combined ideal position;

an outputter instantiated on said processor, said outputter comprising executable instructions, said outputter being adapted to output a first target substantially to said first ideal position in said first display, and to output a second target substantially to said second ideal position in said second display;

an offset determiner instantiated on said processor, said offset determiner comprising executable instructions, said offset determiner being adapted to determine a first position offset substantially representing a difference between said apparent position and said first ideal position, and to determine a second position offset substantially representing a difference between said apparent position and said second ideal position;

an adjustment determiner instantiated on said processor, said adjustment determiner comprising executable instructions, said adjustment determiner being adapted to determine an adjustment for said combined ideal position from said first and second position offsets such that an apparent position of said ideal position with said adjustment is substantially similar to said ideal position absent said adjustment; and

an adjustment applier instantiated on the processor, said adjustment applier comprising executable instructions, said adjustment applier being adapted to apply said adjustment to at least one said entity.

47. The apparatus of claim 46, wherein:

said first and second displays comprise see-through displays.

48. The apparatus of claim 46, wherein:

said sensor comprises an imager.

49. The apparatus of claim 46, wherein:

the sensor comprises a stereo imager pair.

50. The apparatus of claim 46, wherein:

said sensor comprises a depth imager.

51. An apparatus, comprising:

means for establishing a substantially three-dimensional combined ideal position;

means for determining from said combined ideal position a substantially two-dimensional first ideal position for a first display of a stereo display pair;

means for determining from said combined ideal position a substantially two-dimensional second ideal position for a second display of said display stereo pair;

means for outputting a first target substantially to said first ideal position in said first display;

means for outputting a second target substantially to said second ideal position in said second display;

means for sensing a viewer indication of an apparent position;

means for determining a first position offset substantially representing a difference between said apparent position and said first ideal position;

means for determining a second position offset substantially representing a difference between said apparent position and said second ideal position;

means for determining an adjustment, such that an apparent position of said ideal position with said adjustment is substantially similar to said ideal position absent said adjustment;

means for applying said adjustment to a three dimensional position of at least one output entity; and

means for outputting said at least one output entity to said stereo display pair.

52. A machine-implemented method, comprising:

outputting to a stereo display of a head mounted display a calibration target in an ideal position in three-dimensional space;

sensing with a depth imager of said head mounted display a viewer indication of an apparent position of said first entity;

determining computationally in a processor of said head mounted display an offset between said ideal position and said apparent position;

determining computationally in said processor an adjustment from said offset, such that an apparent position of said ideal position with said adjustment is substantially similar to said ideal position absent said adjustment;

thereafter applying said adjustment in said processor to at least one of said calibration target and a data entity; and

outputting said at least one of said calibration target and said data entity, with said adjustment applied thereto, to said stereo display.

53. A machine-implemented method, comprising:

in a processor of a head mounted display, computationally determining a substantially three-dimensional combined ideal position for a calibration target;

in said processor, computationally determining from said combined ideal position a substantially two-dimensional first ideal position for a first display of a stereo display pair of said head mounted display;

in said processor, computationally determining from said combined ideal position a substantially two-dimensional second ideal position for a second display of said stereo display pair;

outputting said target substantially to said first ideal position in said first display;

outputting said target substantially to said second ideal position in said second display;

sensing with a sensor of said head mounted display a viewer indication of an apparent position of said target;

in said processor, computationally determining a first position offset substantially representing a difference between said apparent position and said first ideal position;

in said processor, computationally determining a second position offset substantially representing a difference between said apparent position and said second ideal position;

in said processor, computationally determining an adjustment for said combined ideal position from said first and second position offsets, such that an apparent position of said combined ideal position with said adjustment is substantially similar to said ideal position absent said adjustment;

in said processor, applying said adjustment to a three dimensional position of said target;

outputting said target, with said adjustment applied thereto, to said stereo display pair.