Methods and systems for creating free space reflective optical surfaces

• US 8,781,794 B2
• Filed: 08/17/2011
• Issued: 07/15/2014
• Est. Priority Date: 10/21/2010
• Status: Active Grant

• Current Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Original Assignee: Lockheed Martin Corporation (Martin Marietta Corporation)
• Inventors: Harrison, Gregory A., Smith, David Alan, Wiese, Gary E.
• Primary Examiner(s): Chad, Aniss
• Application Number:
  US13/211,389
• Publication Number:
  US 20120123742A1
• Time in Patent Office: 1,063 Days
• Field of Search: 703/1, 345 7- 8, 359/13, 359630-631
• US Class Current: 703/1
• CPC Class Codes: G02B 2027/0123 comprising devices increasing the field of view
• CPC Class Codes: G02B 2027/013 comprising a combiner of particular shape, e.g. curvature
• CPC Class Codes: G02B 27/0012 Optical design, e.g. procedures, algorithms, optimisation routines
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06F 30/00 Computer-aided design [CAD]

Abstract

Computer-based methods and associated computer systems are disclosed for designing free space reflective optical surfaces (13) for use in head-mounted displays (HMDs). The reflective optical surface (13) produces a virtual image of a display surface (11) for viewing by a user'"'"'s eye (15). The method includes using one or more computers to: (i) represent the display surface (11) by display objects (25); (ii) represent the free space reflective optical surface (13) by surface elements (23); and (iii) iteratively calculate spatial locations, normals, and radii of curvature for the surface elements (23) which will cause a virtual image of each display object (25) to be displayed to a nominal user'"'"'s eye (15) in a desired direction of gaze of the eye (15).

Claims

1. A computer-based method for designing a free space reflective optical surface for use in a head-mounted display that reflects a virtual image of a display surface for viewing at a preselected spatial location by a user'"'"'s eye, the method comprising using one or more computers to perform the steps of:

(a) representing, by the one or more computers, the display surface by a plurality of display objects based on optical properties not tied to a particular substrate or plane;

(b) representing, by the one or more computers, the free space reflective optical surface, not tied to a particular substrate or plane, by a plurality of surface elements, each surface element being characterized by (i) a spatial location relative to the display surface, a nominal user'"'"'s eye, and the preselected spatial location of the virtual image, (ii) a normal, and (iii) a radius of curvature;

(c) associating, by the one or more computers, each display object with at least one surface element in the direction of which a virtual image of the display object at the preselected spatial location will be displayed to the nominal user'"'"'s eye, each surface element being associated with a single display object;

(d) for each surface element;

(i) defining an initial spatial location of the surface element;

(ii) calculating, by the one or more computers, an initial direction of the surface element'"'"'s normal using the surface element'"'"'s initial spatial location, the location of the display object with which the surface element is associated, and the location of a center of rotation of the nominal user'"'"'s eye so that light from the display object that reflects off of the surface element will pass through said center of rotation; and

(iii) calculating, by the one or more computers, an initial radius of curvature for the surface element so that the virtual image of the display object is at the preselected spatial location; and

(iv) calculating, by the one or more computers, a final spatial location of the surface element, a final direction of the surface element'"'"'s normal, and a final radius of curvature for the surface element and a set of surrounding surface elements by iteratively adjusting the spatial locations of the surface elements until an error function satisfies a predetermined criterion; and

(e) calculating a smoothed free space reflective optical surface based on the final spatial locations, the final directions of the normals, and the final radii of curvature of the plurality of surface elements.

2. The method of claim 1 wherein in step (d)(iv), the iterative adjusting of the spatial location of at least a first surface element is based at least in part on the radius of curvature and the normal of at least one second surface element, the first surface element being a nearest neighbor of the second surface element.

3. The method of claim 2 wherein the iterative adjusting of the spatial location of the first surface element is based on a calculated deviation of the element'"'"'s spatial location from a sphere whose radius equals the second element'"'"'s radius of curvature and whose center is along the second element'"'"'s normal.

4. The method of claim 3 wherein the iterative adjusting comprises less than the entire calculated deviation.

5. The method of claim 1 wherein the iterative adjusting of the spatial location of the first surface element comprises iterative adjusting of a plurality of first surface elements is based at least in part on the radius of curvature and the normal of at least one second surface element, each of the plurality of first surface elements being a nearest neighbor of the second surface element.

6. The method of claim 5 wherein the plurality of first surface elements constitutes all of the nearest neighbors of the second surface element.

7. The method of claim 5 wherein the iterative adjusting of the spatial locations of the first surface elements is based on calculated deviations of the elements'"'"' spatial locations from a sphere whose radius equals the second element'"'"'s radius of curvature and whose center is along the second element'"'"'s normal.

8. The method of claim 7 wherein the iterative adjusting comprises less than the entire calculated deviations.

9. The method of claim 7 wherein the error function is based on the calculated deviations.

10. The method of claim 9 wherein the error function is based on a sum of absolute values of the calculated deviations.

11. The method of claim 10 wherein the predetermined criterion is a numerical value for the sum of absolute values.

12. The method of claim 5 wherein the iterative adjusting of the spatial locations of the first surface elements is weighted so that the iterative adjusting of at least one of the first surface elements is greater or smaller than it would have been without weighting.

13. The method of claim 5 wherein the second surface element is an edge surface element or a corner surface element and the iterative adjusting of the spatial location of at least one first surface element is weighted so that the iterative adjusting is greater than it would have been without weighting.

14. The method of claim 1 wherein when measured from the center of rotation of the nominal user'"'"'s eye, an angle between at least two of the plurality of surface elements is greater than or equal to 100 degrees.

15. The method of claim 1 wherein when measured from the center of rotation of the nominal user'"'"'s eye, an angle between at least two of the plurality of surface elements is greater than or equal to 150 degrees.

16. The method of claim 1 wherein when measured from the center of rotation of the nominal user'"'"'s eye, an angle between at least two of the plurality of surface elements is greater than or equal to 200 degrees.

17. The method of claim 1 further comprising producing the free space reflective optical surface.

18. A computer program product embodied in a non-transitory computer readable medium operable by at least one processor for designing a free space reflective optical surface for use in a head-mounted display that reflects a virtual image of a display surface for viewing at a preselected spatial location by a user'"'"'s eye, the computer program product comprising instructions that configure the at least one processor to:

represent the display surface by a plurality of display objects based on optical properties not tied to a particular substrate or plane;

represent the free space reflective optical surface, not tied to a particular substrate or plane, by a plurality of surface elements, each surface element being characterized by (i) a spatial location relative to the display surface, a nominal user'"'"'s eye, and the preselected spatial location of the virtual image, (ii) a normal, and (iii) a radius of curvature;

associate each display object with at least one surface element in the direction of which a virtual image of the display object at the preselected spatial location will be displayed to the nominal user'"'"'s eye, each surface element being associated with a single display object;

for each surface element;

define an initial spatial location of the surface element;

calculate an initial direction of the surface element'"'"'s normal using the surface element'"'"'s initial spatial location, the location of the display object with which the surface element is associated, and the location of a center of rotation of the nominal user'"'"'s eye so that light from the display object that reflects off of the surface element will pass through said center of rotation;

calculate an initial radius of curvature for the surface element so that the virtual image of the display object is at the preselected spatial location; and

calculate a final spatial location of the surface element, a final direction of the surface element'"'"'s normal, and a final radius of curvature for the surface element and a set of surrounding surface elements by iteratively adjusting the spatial locations of the surface elements until an error function satisfies a predetermined criterion; and

calculate a smoothed free space reflective optical surface based on the final spatial locations, the final directions of the normals, and the final radii of curvature of the plurality of surface elements.

19. A system for designing a free space reflective optical surface for use in a head-mounted display that reflects a virtual image of a display surface for viewing at a preselected spatial location by a user'"'"'s eye, comprising:

a processor; and

a memory unit coupled to the processor, said memory unit storing a computer program which includes programming instructions for performing the method of;

representing the display surface by a plurality of display objects based on optical properties not tied to a particular substrate or plane;

representing the free space reflective optical surface, not tied to a particular substrate or plane, by a plurality of surface elements, each surface element being characterized by (i) a spatial location relative to the display surface, a nominal user'"'"'s eye, and the preselected spatial location of the virtual image, (ii) a normal, and (iii) a radius of curvature;

associating each display object with at least one surface element in the direction of which a virtual image of the display object at the preselected spatial location will be displayed to the nominal user'"'"'s eye, each surface element being associated with a single display object;

for each surface element;

defining an initial spatial location of the surface element;

calculating an initial direction of the surface element'"'"'s normal using the surface element'"'"'s initial spatial location, the location of the display object with which the surface element is associated, and the location of a center of rotation of the nominal user'"'"'s eye so that light from the display object that reflects off of the surface element will pass through said center of rotation; and

calculating an initial radius of curvature for the surface element so that the virtual image of the display object is at the preselected spatial location; and

calculating a final spatial location of the surface element, a final direction of the surface element'"'"'s normal, and a final radius of curvature for the surface element and a set of surrounding surface elements by iteratively adjusting the spatial locations of the surface elements until an error function satisfies a predetermined criterion; and

calculating a smoothed free space reflective optical surface based on the final spatial locations, the final directions of the normals, and the final radii of curvature of the plurality of surface elements.