Passive virtual reality

• US 5,422,653 A
• Filed: 01/07/1993
• Issued: 06/06/1995
• Est. Priority Date: 01/07/1993
• Status: Expired due to Term

• Current Assignee: Simulated Percepts, LLC
• Original Assignee: Francis J. Maguire
• Inventors: Maguire, Francis J. Jr.
• Primary Examiner(s): Weldon, Ulysses
• Assistant Examiner(s): Luu, Matthew
• Application Number:
  US08/001,736
• Time in Patent Office: 880 Days
• Field of Search: 345/7, 345/8, 345/9, 359/13, 359/630, 359/462, 359/478, 351/208, 351/209, 351/210
• US Class Current: 345/9
• CPC Class Codes: G02B 30/34 Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
• CPC Class Codes: G09G 2310/0205 Simultaneous scanning of several lines in flat panels
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: G09G 3/20 for presentation of an assembly of a number of characters, e.g. a page, by composing the assembly by combination of individual elements arranged in a matrix no fixed position being assigned to or needed to be assigned to the individual characters or partial characters
• CPC Class Codes: H04N 13/156 Mixing image signals
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/289 Switching between monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/322 using varifocal lenses or mirrors
• CPC Class Codes: H04N 13/324 Colour aspects
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/398 : Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 19/597 : specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2013/0081 : Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0088 : Synthesising a monoscopic image signal from stereoscopic images, e.g. synthesising a panoramic or high resolution monoscopic image
• CPC Class Codes: H04N 23/55 : Optical parts specially adapted for electronic image sensors; Mounting thereof
• CPC Class Codes: H04N 23/63 : by using electronic viewfinders
• CPC Class Codes: H04N 25/00 : Circuitry of solid-state image sensors [SSIS]; Control thereof
• CPC Class Codes: H04N 7/002 : Special television systems not provided for by H04N7/007 - H04N7/18 still pictures via a television channel H04N1/00098
• CPC Class Codes: Y10S 715/961 : Operator interface with visual structure or function dictated by intended use
• CPC Class Codes: Y10S 715/965 : for process control and configuration
• CPC Class Codes: Y10S 715/967 : Visual or iconic programming

Abstract

A method and apparatus for providing, in response to image signals originating in an object space, mixed image signals for providing nonuniform resolution images for stimulating simulated active percepts for passive perception by a viewer in an image space. The images have a highly detailed component which has its image content changed according to changes in the direction of a simulated observer'"'"'s eye position in an object space. The images may be provided stereoscopically. The images may be provided at various apparent distances and the relationship between accommodation and convergence may be preserved. Audio waves for directionally simulating that which would be heard by the simulated observer may be provided.

Claims

1. A method, comprising the steps of:

receiving an image signal encoded with image information for successive images, each image having nonuniform resolution comprising an area of greater resolution in a position in the image and within a surrounding area of lesser resolution together being simulative of retinal resolution, wherein the position of the area of greater resolution in the image changes between the successive images, said changes in the position of the area of greater resolution being indicative of changes in direction of a visual axis of an eye,

decoding the input image signal, for providing a decoded image signal, and

providing, in response to the decoded image signal, successive light images with said image information simulative of retinal resolution having areas of greater and lesser resolution, for viewing by the viewer with a visual axis of an eye of the viewer directed toward the area of greater resolution, wherein said image changes between the successive images are indicative of changes in direction of a visual axis of an eye, but other than an eye of the viewer, for emulation by the visual axis of the eye of the viewer.

2. The method of claim 1, wherein the changes in the position of the area of greater resolution in the image are such that a visual axis of the eye of the viewer may analogously follow the direction of the visual axis of the eye other than the eye of the viewer by following the area of greater resolution of the successive images such that the area of greater resolution is for being cast on a fovea of a retina of the eye of the viewer and the area of lesser resolution is for being cast on the remainder of the retina of the eye of the viewer.

3. The method of claim 1, further comprising the step of providing the successive light images at various apparent distances for accommodation by the eye of the viewer at the various apparent distances.

4. The method of claim 1, wherein the area of greater resolution is mobile with respect to the area of lesser resolution to simulate movement of the eye other than the eye of the viewer with respect to an orbit of the eye other than the eye of the viewer, area of lesser resolution encompassing a field of view which changes to simulate movement of a head of the orbit.

5. The method of claim 1, wherein the area of greater resolution is immobile with respect to the area of lesser resolution and wherein the areas of greater and lesser resolution are jointly mobile to simulate eye movement with respect to an orbit of the eye other than the eye of the viewer, the successive light images encompassing a field of view which changes to simulate movement of the eye other than the eye of the viewer with respect to a head of the orbit.

6. The method of claim 1, wherein the successive light images are provided for panoramic presentation to the eye of the viewer.

7. The method of claim 1, wherein said step of receiving comprises the step of:

receiving said input image signal encoded with stereo image information for successive stereo images, each with areas of lesser and greater resolution corresponding to visual axes of separate eyes other than eyes of the viewer;

decoding the input image signal for providing a decoded stereo image signal;

providing, in response to the decoded image signal, successive stereo light images for display to the viewer.

8. The method of claim 7, further comprising the step of providing the successive stereo light images at various apparent distances for accommodation by the viewer at the various apparent distances.

9. The method of claim 8, wherein said step of providing said successive stereo light images at various apparent distances for accommodation by the viewer using a normal relationship between accommodation and convergence.

10. The method of claim 7, wherein the successive stereo light images are provided from a pair of stereo image displays, one display for each of separate eyes of the viewer.

11. The method of claim 7, wherein successive stereo light images are provided from a single image source.

12. The method of claim 7, further comprising the step of providing the viewer with a plurality of audio waves corresponding to the stereo light images.

13. The method of claim 1, further comprising the step of providing said image signal which comprises the steps of:

responding to reflected light, for providing an optical image signal;

impinging said optical image signal upon a surface sensitive thereto;

responding to said impinging optical image signal by converting said optical image signal to an electrical image signal;

providing an eye direction signal having a magnitude indicative of the direction of said visual axis of an eye other than the eye of the viewer;

providing said image signal encoded with image information for successive images having both display format control signals and image information bearing signal intelligence encoded therein, the display format control signals provided in accordance with a preselected repetitive format, the image information bearing signals derived in response to the electrical image signal, each electrical image signal having said areas of greater and lesser resolution.

30. The method of claim 1, wherein the area of greater resolution is formed of scanning lines that are finer and more closely spaced than scanning lines of the area of lesser resolution.

31. The method of claim 1, wherein the area of greater resolution is formed by a central area of an area scanned by a spiral scanning line and the area of lesser resolution is formed by an area outside said central area.

32. The method of claim 1, wherein the area of greater resolution is formed of concentric circular scanning lines that are finer and more closely spaced than surrounding concentric circular scanning lines of the area of lesser resolution.

14. Apparatus, comprising:

a receiver, responsive to an image signal encoded with nonuniform resolution image information for successive images, for decoding the image signal, for providing a decoded image signal, and

a display, responsive to the decoded image signal, for providing successive light images for viewing by a viewer, each image having nonuniform resolution comprising an area of greater resolution in a changing position in the image and within a surrounding area of lesser resolution together being simulative of retinal resolution for viewing by the viewer along a visual axis of an eye of the viewer directed toward the area of greater resolution, wherein the position of the area of greater resolution in the image changes between the successive images, said changes in the position of the area of greater resolution being indicative of changes in direction of a visual axis of an eye other than the eye of the viewer, for emulation by the visual axis of the viewer.

15. The apparatus of claim 14, further comprising means for providing the successive light images at various apparent distances for accommodation by the eye of the viewer at the various apparent distances.

16. The apparatus of claim 14, wherein the image information in the area of greater resolution is encoded as a plurality of closely spaced mosaic elements for presentation surrounded by the area of lesser resolution encoded as a plurality of more widely spaced mosaic elements.

17. The apparatus of claim 15, wherein the means for providing the successive images at various apparent distances comprises at least one variable magnification lens.

18. The apparatus of claim 14, wherein the means for providing the successive images at various apparent distances comprises a varifocal mirror.

19. The apparatus of claim 14, wherein the area of greater resolution is mobile with respect to the area of lesser resolution for simulating movement of the eye other than the eye of the viewer with respect to an orbit of the eye other than the eye of the viewer, the area of lesser resolution encompassing a field of view which changes for simulating movement of an associated head of the orbit.

20. The apparatus of claim 14, wherein the area of greater resolution is immobile with respect to the area of lesser resolution and wherein the greater and lesser detailed components are jointly mobile for simulating movement of the eye other than the eye of the viewer with respect to an associated eye orbit.

21. The apparatus of claim 14, wherein the successive light images are provided for panoramic presentation to the eye of the viewer.

22. The apparatus of claim 14, wherein said image information for successive images is stereo image information.

23. The apparatus of claim 22, further comprising means for providing said successive light images at various apparent distances for accommodation by the eyes of the viewer at said various apparent distances.

24. The apparatus of claim 23, wherein said successive light images are presented at various apparent distances in such a way as to preserve a normal relationship between accommodation and convergence in the viewer.

25. The apparatus of claim 22, wherein the successive light images are provided from separate stereo image sources for providing the stereo image information.

26. The apparatus of claim 22, wherein the successive light images are provided from a single image source.

27. The apparatus of claim 22, further comprising means for providing the viewer with a plurality of audio waves from various directions.

28. The apparatus of claim 14, further comprising means for providing the image signal encoded with nonuniform resolution image information for successive images comprising:

a lens, responsive to reflected light from illuminated objects, for providing a light image thereof;

a light sensitive surface, responsive to the light image for converting the light image to an electrical signal image stored by the surface;

means for providing an eye direction signal indicative of the direction of the visual axis of the eye other than an eye of the viewer;

a camera controller, responsive to the electrical signal image for providing the image signal.

29. The apparatus of claim 14, wherein the display is a head mounted display.