Apparatus and method for presenting successive images

• US 5,644,324 A
• Filed: 03/03/1993
• Issued: 07/01/1997
• Est. Priority Date: 03/03/1993
• Status: Expired due to Term

• Current Assignee: Simulated Percepts, LLC
• Original Assignee: Francis J. Maguire
• Inventors: Maguire, Jr., Francis J.
• Primary Examiner(s): Powell, Mark R.
• Assistant Examiner(s): Luu, Matthew
• Application Number:
  US08/025,975
• Time in Patent Office: 1,581 Days
• Field of Search: 345/7, 345/8, 345/9, 359/13, 359/630, 359/462, 359/478, 359/470, 351/208, 351/209, 351/210, 348/42, 348/51
• US Class Current: 345/9
• CPC Class Codes: G02B 30/24 involving temporal multiplexing, e.g. using sequentially activated left and right shutters
• CPC Class Codes: G09G 3/003 to produce spatial visual effects
• CPC Class Codes: H04N 13/117 the virtual viewpoint locations being selected by the viewers or determined by viewer tracking
• CPC Class Codes: H04N 13/161 Encoding, multiplexing or demultiplexing different image signal components for multi-view video sequence encoding H04N19/597
• CPC Class Codes: H04N 13/167 Synchronising or controlling image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/286 having separate monoscopic and stereoscopic modes
• CPC Class Codes: H04N 13/296 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 13/305 using lenticular lenses, e.g. arrangements of cylindrical lenses
• CPC Class Codes: H04N 13/322 using varifocal lenses or mirrors
• CPC Class Codes: H04N 13/337 using polarisation multiplexing
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/366 using viewer tracking
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 2013/0081 Depth or disparity estimation from stereoscopic image signals
• CPC Class Codes: H04N 2013/0096 : Synchronisation or controlling aspects
• CPC Class Codes: H04N 5/7491 : of head mounted projectors

Abstract

A method and apparatus for providing, in response to successive image signals and a control signal, the successive images at various apparent distances. The relationship between accommodation and convergence may be preserved. The images may have a highly detailed component which has its image content changed according to changes in the direction of a monitored one or more visual axes. The images may be provided stereoscopically.

Claims

1. A method, comprising the steps of:

providing, in response to a combined image and control signal (11), an image distance control signal (3) indicative of varying image distances, an image signal (8), and an image control signal (9);

providing, in response to the image signal (8) and the image control signal (9), successive input images (4);

providing, in response to the image distance control signal (3) and the successive input images (4), corresponding successive output images (2) at varying apparent distances for viewing along a visual axis (6) of an eye (5) of a viewer with correspondingly varying accommodation; and

monitoring (44,

     46) at least one eye of a pair of eyes (19,20) of the viewer (16) in an image space (17) for providing the image distance control signal (36) indicative of varying image distances.

20. The method of claim 1, further comprising the step of providing, in response to the image distance control signal, the successive output images at the varying apparent distances for viewing by the viewer with correspondingly varying accommodation while maintaining a normal relationship between accommodation and convergence for the viewer.

2. A method, comprising the steps of:

providing, in response to a combined image and control signal (11), an image distance control signal (3) indicative of varying image distances, an image signal (8), and an image control signal (9);

providing, in response to the image signal (8) and the image control signal (9), successive input images (4); and

providing, in response to the image distance control signal (3) and the successive input images (4), corresponding successive output images (2) at varying apparent distances for viewing along a visual axis (6) of an eye (5) of a viewer with correspondingly varying accommodation; and

monitoring at least one eye (62) of an observer (60) in an object space (20) for providing the image distance control signal indicative of varying image distances.

21. The method of claim 2, further comprising the step of providing, in response to the image distance control signal, the successive output images at the varying apparent distances for viewing by the viewer with corresponding accommodation while maintaining a normal relationship between accommodation and convergence for the viewer.

3. Apparatus, comprising:

means (10), responsive to a combined image and control signal (11), for providing an image distance control signal (3) indicative of varying image distances, an image signal (8), and an image control signal (9);

means (7), responsive to the image signal (8) and the image control signal (9), for providing successive images (4);

means (1) for providing, in response to the image distance control signal (3) and in response to the successive images (4), successive output images (2) at successive varying apparent distances for viewing along a visual axis (6) of an eye (5) of a viewer with correspondingly varying accommodation; and

means (44,

     46) for monitoring at least one eye of a pair of eyes (19,

     20) of the viewer (16) in an image space (17) for providing the image distance control signal (40, 42,

     36).

5. The apparatus of claim 3, wherein the image control signal (9) is indicative of changes in direction of at least said visual axis and wherein said means for providing the successive input images is responsive to said image control signal (9) for changing a relative position within each of the successive input images of an area of nonuniformity in resolution of image information.

6. The apparatus of claim 3, wherein the means (1) for providing successive output images (2) is for providing the successive images as mixed images having nonuniform resolution as the viewer accommodates on the mixed images (600, 604a;

602, 604b).

7. The apparatus of claim 6, wherein the mixed images have a high resolution component (604a, 604b) that changes position within said successive output images with respect to a low resolution component (600, 602).

8. The apparatus of claim 6, wherein the mixed images have a high resolution component (604a, 604b) and a low resolution component (600, 602) that together change position within said successive output images.

18. The apparatus of claim 5, wherein said successive output optical images are provided at said apparent distances so as to preserve a normal relationship between accommodation and convergence in the viewer'"'"'s eye.

23. The apparatus of claim 3, wherein said successive output images are provided at said successively varying apparent distances for providing a normal relationship between accommodation and convergence for eyes of the viewer.

4. Apparatus, comprising:

means (10), responsive to a combined image and control signal (11), for providing an image distance control signal (3) indicative of varying image distances, an image signal (8), and an image control signal (9);

means (7), responsive to the image signal (8) and the image control signal (9), for providing successive input images (4);

means (1) for providing, in response to the image distance control signal (3) and in response to the successive input images (4), successive output images (2) at successively varying apparent distances for viewing along a visual axis (6) of an eye (5) of a viewer with correspondingly varying accommodation; and

means (76) for monitoring at least one eye (62) of an observer (60) in an object space (20) for providing the control signal (80) indicative of varying image distances.

24. The apparatus of claim 4, wherein said corresponding successive output images are provided at said successive varying apparent distances for providing a normal relationship between accommodation and convergence for eyes of the viewer.

9. Apparatus, comprising:

means (10), responsive to a combined image and the image control signal (9), for providing successive input images (4);

means (1) for providing, in response to the image distance control signal (3) and in response to the successive input images (4), successive output images (2) at successively varying apparent distances for viewing along a visual axis (6) of an eye (5) of a viewer with correspondingly varying accommodation, wherein said means for providing successive input images includes means (18, 21, 22;

476;

502,

     504) for providing additional successive input images; and

wherein said

means for providing, in response to the control image distance signal and in response to the additional successive input images, includes means for providing the additional successive input images at successive varying apparent distances for viewing by the viewer along a second visual axis of a second eye of the viewer with correspondingly varying accommodation.

10. The apparatus of claim 9, further comprising means (38) for changing a position within each of the successive input images and within each of said additional successive input images of a high resolution component, according to sensed changes in direction of said visual axes of the viewer in response to the control signal, for viewing by the viewer.

11. The apparatus of claim 9, wherein the means for providing said successive images and said additional successive images is carried out such that a normal relationship between accommodation and convergence is represented.

26. The apparatus of claim 11, further comprising means (38) for changing a position within each of the successive input images and within each of said additional successive input images of a high resolution component, according to sensed changes in direction of said visual axes of the viewer in response to the control signal, for viewing by the viewer.

12. Apparatus, comprising:

an image source (7), responsive to an image signal (8) and to an image control signal (9), for providing successive input optical images (4); and

means (1), responsive to the successive optical input images (4), and responsive to a distance control signal (3), for providing corresponding successive output optical images (2) at varying apparent distances, for viewing along a visual axis of an eye (5) with correspondingly varying accommodation;

wherein said means (1) is responsive to the successive input optical images (4) and to the distance control signal (3) for providing the corresponding successive output optical images (2) at varying apparent distances for viewing by said eye with corresponding accommodation while providing a normal relationship between accommodation and convergence for said eye.

13. Apparatus, comprising:

an image source (7), responsive to an image signal (8) and to an image control signal (9), for providing successive input optical images (4); and

means (1), responsive to the successive optical input images (4), and responsive to a distance control signal (3), for providing corresponding successive output optical images (2) at varying apparent distances, for viewing along a visual axis (6). of an eye (5) with correspondingly varying accommodations;

wherein each optical image has nonuniform resolution comprising a lesser detailed component surrounding a highly detailed component, said lesser and highly detailed components together being simulative of retinal resolution for viewing by said eye along said visual axis wherein at least said highly detailed component changes position within each of said optical images according to sensed changes in direction of said visual axis of said eye.

14. The apparatus of claim 13, wherein the highly detailed component is mobile with respect to the lesser detailed component.

15. The apparatus of claim 13, wherein the highly detailed component and the lesser detailed component jointly change position within said optical images.

16. Apparatus, comprising:

an image source (7), responsive to an image signal (8) and to an image control signal (9), for providing successive input optical images (4);

means (1), responsive to the successive optical input images (4), and responsive to a distance control signal (3), for providing corresponding successive output optical images (2) at varying apparent distances, for viewing along a visual axis (6) of an eye (5) with correspondingly varying accommodation;

a second image source for providing additional successive input optical images of the object space in the image space for presentation to a second eye; and

a second means, responsive to the additional successive input optical images, and responsive to a second distance control signal, for providing corresponding additional successive output optical images at varying apparent distances, for viewing along a visual axis of said second eye with correspondingly varying accommodation.

17. The apparatus of claim 16, wherein said second means is responsive to the second distance control signal, for providing the additional successive output optical images at varying apparent distances for viewing by the second eye with correspondingly varying accommodation while providing a normal relationship between accommodation and convergence for the viewer'"'"'s remaining eye.

27. The apparatus of claim 16, wherein each optical image has nonuniform resolution comprising a lesser detailed component surrounding a highly detailed component, said lesser and highly detailed components together being simulative of retinal resolution for viewing by said eye along said visual axis wherein at least said highly detailed component changes position within each of said optical images according to sensed changes in direction of said visual axis of said eye.

28. The apparatus of claim 17, wherein each optical image has nonuniform resolution comprising a lesser detailed component surrounding a highly detailed component, said lesser and highly detailed components together being simulative of retinal resolution for viewing by said eye along said visual axis wherein at least said highly detailed component changes position within each of said optical images according to sensed changes in direction of said visual axis of said eye.

19. A method, comprising the steps of:

providing, in response to a combined image and control signal (11), an image distance control signal (3) indicative of varying image distances, an image signal (8), and an image control signal (9);

providing, in response to the image signal (8) and the image control signal (9), successive input images (4); and

providing in responsive to the image distance control signal (3) and the successive input images (4), corresponding successive output images (2) at varying apparent distances for viewing along a visual axis (6) of an eye (5) of a viewer with correspondingly varying accommodation; and

providing, in response to the image distance control signal, the successive output images at the varying apparent distances for viewing by the viewer with a normal relationship between accommodation and convergence for the viewer.

22. Apparatus, comprising:

means (10), responsive to a combined image and control signal (11), for providing an image distance control signal (3) indicative of varying image distances, an image signal (8), and an image control signal (9);

means (7), responsive to the image signal (8) and the image control signal (9), for providing successive input images (4);

means (1) for providing, in response to the image distance control signal (3) and in response to the successive input images (4), successive output images (2) at successively varying apparent distances for viewing along a visual axis (6) of an eye (5) of a viewer with correspondingly varying accommodation; and

means for providing, in response to the control signal, the corresponding successive output images at the varying apparent distances for viewing by the viewer with corresponding accommodation while providing a normal relationship between accommodation and convergence for the viewer.

25. Apparatus, comprising:

an image source (7), responsive to an image signal (8) and to an image control signal (9), for providing successive input optical images (4);

means (1), responsive to the successive optical input images (4), and responsive to a distance control signal (3), for providing corresponding successive output optical images (2) at varying apparent distances in an image space; and

eye monitoring means (44,

     46) for monitoring at least one eye of a pair of eyes (19,

     20) of the viewer (16) in the image space (17), for providing the distance control signal.

31. The apparatus of claim 25, wherein said successive output images are provided at said successively varying apparent distances for providing a normal relationship between accommodation and convergence for eyes of the viewer.

34. The apparatus of claim 25, wherein the means (1) for providing successive output images (2) is for providing the successive images as mixed images having nonuniform resolution as the viewer accommodates on the mixed images (600, 604a;

602, 604b).

35. The apparatus of claim 25, wherein said means for providing successive input images includes means (18, 21, 22;

476;

502,

     504) for providing additional successive input images; and

wherein said

means for providing, in response to the control image distance signal and in response to the additional successive input images, includes means for providing the additional successive input images at successive varying apparent distances for viewing by the viewer along a second visual axis of a second eye of the viewer with correspondingly varying accommodation.

38. The apparatus of claim 31, wherein the means (1) for providing successive output images (2) is for providing the successive images as mixed images having nonuniform resolution as the viewer accommodates on the mixed images (600, 604a;

602, 604b).

39. The apparatus of claim 35, further comprising means (38) for changing a position within each of the successive input images and within each of said additional successive input images of a high resolution component, according to sensed changes in direction of said visual axis of the viewer in response to the control signal, for viewing by the viewer.

41. The apparatus of claim 35, wherein the means for providing said successive images and said additional successive images is carried out such that a normal relationship between accommodation and convergence is represented.

44. The apparatus of claim 41, further comprising means (38) for changing a position within each of the successive input images and within each of said additional successive input images of a high resolution component, according to sensed changes in direction of said visual axes of the viewer in response to the control signal, for viewing by the viewer.

29. Apparatus for using an eye monitoring signal from means (76) for eye monitoring, comprising:

an image source (7), responsive to an image signal (8) and to an image control signal (9), for providing successive input optical images (4); and

means (1), responsive to the successive optical input images (4), and responsive to a distance control signal (3), for providing corresponding successive output optical images (2) at varying apparent distances, for viewing along a visual axis (6) of an eye (5) with correspondingly varying accommodation, wherein the apparatus is for location in an image space (22), wherein the distance control signal is provided by means (76) for monitoring at least one eye (62) of an observer (60) in an object space (20) separate from the image space and wherein said means for monitoring is likewise separate from said apparatus.

32. The apparatus of claim 29, wherein said successive output images are provided at said successively varying apparent distances for providing a normal relationship between accommodation and convergence for eyes of the viewer.

36. The apparatus of claim 29, wherein said means for providing successive input images includes means (18, 21, 22;

476;

502,

     504) for providing additional successive input images; and

wherein said

means for providing, in response to the control image distance signal and in response to the additional successive input images, includes means for providing the additional successive input images at successive varying apparent distances for viewing by the viewer along a second visual axis of a second eye of the viewer with correspondingly varying accommodation.

40. The apparatus of claim 36, further comprising means (38) for changing a position within each of the successive input images and within each of said additional successive input images of a high resolution component, according to sensed changes in direction of said visual axis of the viewer in response to the control signal, for viewing by the viewer.

42. The apparatus of claim 36, wherein the means for providing said successive images and said additional successive images is carried out such that a normal relationship between accommodation and convergence is represented.

30. Apparatus, comprising:

an image source (7), responsive to an image signal (8) and to an image control signal (9), for providing successive input optical images (4) in an image space (22); and

means (1), responsive to the successive optical input images (4), and responsive to a distance control signal (3), for providing corresponding successive output optical images (2) at varying apparent distances in the image space, for passive viewing in the image space along a visual axis (6) of an eye (5) of a viewer with correspondingly varying accommodation, wherein the distance control signal is indicative of corresponding active viewing at correspondingly varying distances in an object space, said varying distances in the object space selected without monitoring any eye, and wherein said eye (5) of said viewer passively varies said accommodation in response to said successive output images (2) at said varying apparent distances in the image space.

33. The apparatus of claim 30, wherein said successive output images are provided at said successively varying apparent distances for providing a normal relationship between accommodation and convergence for eyes of the viewer.

37. The apparatus of claim 30, wherein said means for providing successive input images includes means (18, 21, 22;

476;

502,

     504) for providing additional successive input images; and

wherein said

means for providing, in response to the control image distance signal and in response to the additional successive input images, includes means for providing the additional successive input images at successive varying apparent distances for viewing by the viewer along a second visual axis of a second eye of the viewer with correspondingly varying accommodation.

43. The apparatus of claim 37, wherein the means for providing said successive images and said additional successive images is carried out such that a normal relationship between accommodation and convergence is represented.