Method and apparatus for the perception of computer-generated imagery

• US 4,984,179 A
• Filed: 09/07/1989
• Issued: 01/08/1991
• Est. Priority Date: 01/21/1987
• Status: Expired due to Term

• Current Assignee: Intel Corporation
• Original Assignee: W Industries Limited
• Inventors: Waldern, Jonathan D.
• Primary Examiner(s): Teska, Kevin J.
• Application Number:
  US07/404,101
• Time in Patent Office: 488 Days
• Field of Search: 434/40, 434/43, 434/44, 434/42, 434/69, 351/210, 350/174, 358/104, 358/250, 358/183, 340/980, 340/705, 340/709, 340/945, 364/514, 364/521, 364/578, 364/516, 364/550
• US Class Current: 715/848
• CPC Class Codes: G02B 2027/0132 comprising binocular systems
• CPC Class Codes: G02B 2027/0134 of stereoscopic type
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 2027/0187 slaved to motion of at least a part of the body of the user, e.g. head, eye
• CPC Class Codes: G02B 2027/0198 System for aligning or maintaining alignment of an image in a predetermined direction
• CPC Class Codes: G02B 27/0093 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 30/34 Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
• CPC Class Codes: G06F 3/012 Head tracking input arrangements
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays

Abstract

The invention relates to a 3-dimensional computer graphics system in which an operator can effectively interact with a virtual model generated and displayed by a computer. In one embodiment the operator wears a helmet fitted with means which enable both the location of his head and its coordinates relative to the virtual model to be monitored and the information sent to computer. The helmet carries miniature VDUs which direct separate images to his individual eyes so that the image is perceived stereoscopically. The movement of the operator'"'"'s eyes is also monitored by means mounted within housings of the helmet and data representing the operator'"'"'s direction of vision sent to the computer. The data transmitted to the computer is used to modify the image of the model as perceived by the operator to enhance its realism.

Claims

1. A method for presenting different computer-generated images of an object to respective eyes of a person viewing said object whereby said object is perceived stereoscopically, the method comprising:

locating in a fixed relation to each eye of said person means to project a different image of said object into said eye,

monitoring a line of sight of each said eye and an angle of convergence of said lines of sight,

computer-generating two different images of said object as viewed by said eyes at the same spatial coordinates relative to said person, and

modifying each image according to variations in the relationship between said spatial coordinates and said angle of convergence.

2. A method as claimed in claim 1, and additionally comprising monitoring movements of said person'"'"'s head and variations of said person'"'"'s field of view, and modifying said images accordingly.

3. A method as claimed in claim 1, wherein movements of each eyeball are monitored and said images are calculated to have depth of focus cues and parallax separation determined by a detected intersection of the lines of sight of said eyes.

4. A method as claimed in claim 3, wherein said eyeball monitoring is effected by determining a position of a pupil of each said eye with reference to a center of a retina thereof and outputting deviations of said pupil from a line perpendicular to said retina to said computer means as horizontal and vertical coordinates.

5. A three-dimensional display system comprising:

location means for maintaining a fixed relation relative to the two eyes of a user,

means to project different images of a three-dimensional object into said eyes,

means for monitoring a line of sight of each said eye of said user and for monitoring an angle of convergence of said lines of sight,

computer means for generating two different images of the three-dimensional object, said images having common spatial coordinates, and for modifying said images in response to variations of a relationship between said spatial coordinates and said angle of convergence,

such that the image presented to each eye is of said three-dimensional object as seen by said eye at a distance from said user determined by said angle of convergence whereby said user perceives said object stereoscopically.

6. A system as claimed in claim 5, wherein said means for monitoring said lines of sight comprises a pair of light sources and charge couple devices mounted on said location means, said charge coupled devices being responsive to reflections of said light sources from said eyes to monitor movement thereof, means being provided to output signals of said charge couple devices as a cartesian coordinate to said computer means.

7. A system as claimed in claim 5, wherein said computer means is a fast-access digital storage graphic imagery medium having standard computer graphic algorithms.

8. A system as claimed in claim 5, wherein said means to project individual images into respective eyes of said user comprises a pair of high-resolution, miniature VDUs mounted on opposite sides of said location means to face forwardly and a pair of mirror lenses having fixed positions in front of said location means such as to reflect images of the respective VDUs into respective eyes of said user.