Stereoscopic video display apparatus

• US 5,825,456 A
• Filed: 05/23/1996
• Issued: 10/20/1998
• Est. Priority Date: 05/24/1995
• Status: Expired due to Term

• Current Assignee: Olympus Optical Corporation Limited (Olympus Corporation)
• Original Assignee: Olympus Optical Corporation Limited (Olympus Corporation)
• Inventors: Iba, Yoichi, Tabata, Seiichiro
• Primary Examiner(s): Mai, Huy
• Application Number:
  US08/652,822
• Time in Patent Office: 880 Days
• Field of Search: 351/158, 351/201, 359/462, 359/468, 359/469, 348/42, 348/51, 348/54, 348/55, 348/115
• US Class Current: 351/201
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/344 with head-mounted left-right displays
• CPC Class Codes: H04N 13/383 for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof

Abstract

An apparatus for displaying a stereoscopic image including right-eye and left-eye image display devices displaying right-eye and left-eye images, respectively, right-eye and left-eye magnifying lenses forming enlarged virtual right-eye and left-eye images, respectively, an eye point camera for detecting a point in a sight at which a viewer gazes, a parallax calculating circuit for deriving a parallax of the gazed point, a image shift amount calculating circuit for calculating an amount of image shift in accordance with the parallax, and an image shift circuits for shifting the right-eye and left-eye images horizontally in opposite direction by the same amount such that a distance of convergence with respect to the gazing point is substantially fixed. It is preferable to shift the right-eye and left-eye images such that the distance of convergence becomes substantially equal to a viewing distance from eyes of the viewer to a virtual image plane.

Claims

1. A stereoscopic video display apparatus comprising:

a displaying means for displaying a right-eye image to be exclusively seen by a right eye of a viewer and a left-eye image to be exclusively seen by a left eye of the viewer, said right-eye and left-eye images being derived from a video signal supplied to the stereoscopic video display apparatus from an applied video signal source, said right-eye and left-eye images composing a stereoscopic image to be seen by the viewer; and

an image shifting means for performing a horizontal shift on at least one of said right-eye image and left-eye image displayed on said displaying means;

wherein;

said image shifting means comprises controlling means for controlling the horizontal shift such that a distance of convergence caused by the right-eye image and the left-eye image displayed on the displaying means is maintained substantially constant on a time domain despite a change in the video signal.

2. An apparatus according to claim 1, wherein said controlling means maintains the distance of convergence to be substantially equal to a constant viewing distance.

3. An apparatus according to claim 2, wherein the apparatus further comprises right-eye and left-eye optical systems for forming enlarged virtual images of the right-eye and left-eye images which are seen by the right and left eye of a viewer, respectively, and a supporting means for supporting said displaying means and optical systems.

4. An apparatus according to claim 2, wherein said controlling means shifts at least one of the right-eye and left-eye images such that the following condition is satisfied:

space="preserve" listing-type="equation">1/L-2<

1/L.sub.H <

1/L+2 for L≦

0.5

space="preserve" listing-type="equation">0<

1/L.sub.H <

1/L+2 for L>

0.5

wherein L_H (m) is the distance of convergence and L(m) is the viewing distance.

5. An apparatus according to claim 4, wherein said controlling means shifts at least one of the right-eye and left-eye images such that the distance of convergence after the image shift in the horizontal direction becomes larger in accordance with an increase of the distance of convergence prior to the image shift.

6. An apparatus according to claim 2, wherein the apparatus further comprises a means for denoting a part of an image display area of the image displaying means, a means for calculating a parallax of said denoted part of the image display area, and a means for determining an amount of the image shift in accordance with said parallax, and said image shifting means shifts at least one of the right-eye and left-eye images by an amount determined by said means for determining the amount of the image shift.

7. An apparatus according to claim 6, wherein said means for denoting the part of the image display area comprises a gazing point detecting means for detecting a point in sight at which the viewer gazes.

8. An apparatus according to claim 7, wherein said gazing point detecting means comprises a means for measuring an angle of a line of sight of one of the right and left eyes of the viewer and a means for detecting coordinates (x, y) of the gazing point, and said parallax calculating means derives the parallax by taking a correlation between the right-eye image and the left-eye image.

9. An apparatus according to claim 8, wherein said parallax calculating means extracts horizontal line image signals from the right-eye and left-eye images in accordance with a vertical coordinate y, and calculates a correlation between the horizontal line image signals in accordance with a horizontal coordinate x to derive the parallax.

10. An apparatus according to claim 8, wherein said image shifting means shifts both the right-eye and left-eye images by the same amount but in opposite directions.

11. An apparatus according to claim 8, wherein said image shifting means shifts the other of the right-eye and left-eye images.

12. An apparatus according to claim 8, wherein said means for measuring an angle of a line of sight of one of the right and left eyes of the viewer comprises an eye point camera having a light source for emitting light onto an eyeball of the viewer and a photodetector for receiving light reflected by the eyeball, said photodetector including first and second linear photo-sensor arrays and first and second cylindrical lenses.

13. An apparatus according to claim 12, wherein

said parallax calculating means extracts horizontal line image signals from the right-eye and left-eye images in accordance with a vertical coordinate y, and calculates a correlation between the horizontal line image signals in accordance with a horizontal coordinate x to derive the parallax;

and

said horizontal line image signals of the right-eye and left-eye images corresponding to the vertical coordinate y are extracted in accordance with an output signal from said first linear photo-sensor array, and said correlation is calculated in accordance with an output signal from said second linear photo-sensor array.

14. An apparatus according to claim 2, wherein a black stripe having a width substantially equal to an amount of the image shift is displayed at a right hand side of the image when the image is shifted leftward, and a black stripe having a width substantially equal to an amount of the image shift is displayed at a left hand side of the image when the image is shifted rightward.

15. An apparatus according to claim 2, wherein the right-eye and left-eye images define frames which are not fused.

16. An apparatus according to claim 1, wherein said displaying means includes a right-eye image display device and a left-eye image display device, said apparatus further comprises a right-eye magnifying lens for generating a virtual image of the right-eye image which can be seen by the right eye of the viewer and a left-eye magnifying lens for generating a virtual image of the left-eye image which can be seen by the left eye of the viewer, and said image shifting means shifts at least one of the right-eye and left-eye images displayed on the right-eye and left-eye image display devices, respectively to satisfy the following condition;

space="preserve" listing-type="equation">1/L-2<

(tan θ

.sub.R +tan θ

.sub.L)/d<

1/L+2 (L≦

0.5)

space="preserve" listing-type="equation">0<

(tan θ

.sub.R +tan θ

.sub.L)/d<

1/L+2 (L>

0.5)

wherein L(m) is a distance from the right and left eyes of the viewer to a plane on which said virtual images are formed, θ

_R is an angle between a line of sight of the right eye of the viewer and a normal line to said plane, θ

_L is an angle between a line of sight of the left eye of the viewer and said plane, and d(m) is a distance between the right and left eyes of the viewer.

17. An apparatus according to claim 16, wherein said apparatus further comprising a means for supporting said display devices and magnifying lenses on a head or face of the viewer.

18. An apparatus according to claim 16, wherein said image shifting means shifts at least one of the right-eye and left-eye images such that a value proportional to a convergence angle (tan θ

_R +tan θ

_L)/d after the image shift in the horizontal direction becomes larger in accordance with an increase of a value proportional to a convergence angle (tan θ

'"'"'_R +tan θ

'"'"'_L)/d prior to the image shift, wherein θ

'"'"'_R is an angle between a line of sight of the right eye of the viewer and a normal line to a virtual image plane prior to the image shift and θ

'"'"'_L is an angle between a line of sight of the left eye of the viewer and said plane prior to the image shift.

19. An apparatus according to claim 16, wherein the apparatus further comprises a means for denoting parts of image display areas of the image display devices, a means for calculating a parallax of said denoted parts of the image display areas, and a means for determining an amount of the image shift in accordance with said parallax, and said image shifting means shifts at least one of the right-eye and left-eye images by an amount determined by said means for determining the amount of the image shift.

20. An apparatus according to claim 19, wherein said means for denoting the part of the image display area comprises a gazing point detecting means for detecting a point in sight at which the viewer gazes.

21. An apparatus according to claim 20, wherein said gazing point detecting means comprises a means for measuring an angle of a line of sight of one of the right and left eyes of the viewer and a means for detecting coordinates (x, y) of the gazing point, and said parallax calculating means derives the parallax by taking a correlation between the right-eye image and the left-eye image.

22. An apparatus according to claim 21, wherein said parallax calculating means extracts horizontal line image signals from the right-eye and left-eye images in accordance with a vertical coordinate y, and determines a correlation between the horizontal line image signals in accordance with a horizontal coordinate x to derive the parallax.

23. An apparatus according to claim 21, wherein said image shifting means shifts both the right-eye and left-eye images by the same amount but in opposite directions.

24. An apparatus according to claim 21, wherein said image shifting means shifts the other of the right-eye and left-eye images.

25. An apparatus according to claim 21, wherein said means for measuring an angle of a line of sight of one of the right and left eyes of the viewer comprises an eye point camera having a light source for emitting light onto an eyeball of the viewer and a photodetector for receiving light reflected by the eyeball, said photodetector including first and second linear photo-sensor arrays and first and second cylindrical lenses.

26. An apparatus according to claim 25, wherein:

said parallax calculating means extracts horizontal line image signals from the right-eye and left-eye images in accordance with a vertical coordinate y, and calculates a correlation between the horizontal line image signals in accordance with a horizontal coordinate x to derive the parallax; and

said horizontal line image signals of the right-eye and left-eye images corresponding to the vertical coordinate y are extracted in accordance with an output signal from said first linear photo-sensor array, and said correlation is calculated in accordance with an output signal from said second linear photo-sensor array.

27. An apparatus according to claim 16, wherein a black stripe having a width substantially equal to an amount of the image shift is displayed at a right hand side of the image when the image is shifted leftward, and a black stripe having a width substantially equal to an amount of the image shift is displayed at a left hand side of the image when the image is shifted rightward.

28. An apparatus according to claim 16, wherein the right-eye and left-eye images define frames which are not fused.

29. An apparatus according to claim 28, wherein said right-eye and left-eye magnifying lenses are arranged such that optical axes of these lenses diverge toward the virtual image plane.

30. A stereoscopic video display apparatus comprising:

a displaying means for displaying a right-eye image to be exclusively seen by a right eye of a viewer and a left-eye image to be exclusively seen by a left eye of the viewer, said right-eye and left-eye images composing a stereoscopic image;

an image shifting means for performing a horizontal shift on at least one of said right-eye image and said left-eye image displayed on said displaying means such that a distance of convergence is maintained substantially constant on a time domain and becomes substantially identical with a viewing distance;

denoting means for denoting a part of an image display area of the displaying means;

parallax calculating means for calculating a parallax of the part of the image display area denoted by the denoting means; and

determining means for determining an amount of the horizontal shift in accordance with the parallax, the image shifting means shifting at least one of the right-eye and left-eye images by said amount determined by the determining means.

31. A stereoscopic video display apparatus comprising:

a displaying means for displaying a right-eye image to be exclusively seen by a right eye of a viewer and a left-eye image to be exclusively seen by a left eye of the viewer, said right-eye and left-eye images composing a stereoscopic image; and

an image shifting means for performing a horizontal shift on at least one of said right-eye image and said left-eye image displayed on said displaying means such that a distance of convergence is maintained substantially constant on a time domain and becomes substantially identical with a viewing distance;

the displaying means displaying a black stripe having a width substantially equal to an amount of the horizontal shift (i) at a right side of said at least one of the right-eye image and the left-eye image when the horizontal shift is leftward and (ii) at a left side of said at least one of the right-eye image and the left-eye image when the horizontal shift is rightward.

32. A stereoscopic video display apparatus comprising:

a displaying means for displaying a right-eye image to be exclusively seen by a right eye of a viewer and a left-eye image to be exclusively seen by a left eye of the viewer, said right-eye and left-eye images composing a stereoscopic image, said displaying means comprising a right-eye image display device and a left-eye image display device;

an image shifting means for performing a horizontal shift on at least one of said right-eye image and left-eye image displayed on said displaying means such that a distance of convergence is maintained substantially constant on a time domain;

a right-eye magnifying lens for generating a virtual image of the right-eye image which can be seen by the right eye of the viewer;

a left-eye magnifying lens for generating a virtual image of the left-eye image which can be seen by the left eye of the viewer;

denoting means for denoting a part of an image display area of the displaying means;

parallax calculating means for calculating a parallax of the part of the image display area denoted by the denoting means; and

determining means for determining an amount of the horizontal shift in accordance with the parallax, the image shifting means shifting at least one of the right-eye and left-eye images by said amount determined by the determining means;

said image shifting means performing the horizontal shift on at least one of the left-eye and right-eye images to satisfy

space="preserve" listing-type="equation">1/L-2<

(tan θ

.sub.R +tan θ

.sub.L)/d<

1/L+2 (L≦

0.5)

space="preserve" listing-type="equation">0<

(tan θ

.sub.R +tan θ

.sub.L)/d<

1/L+2 (L>

0.5)

wherein L(m) is a distance from the right and left eyes of the viewer to a plane on which the virtual images are formed, θ

_R is an angle between a line of sight of the right eye of the viewer and a normal line to said plane, θ

_L is an angle between a line of sight of the left eye of the viewer and said normal line to said plane, and d(m) is a distance between the right and left eyes of the viewer.

33. A stereoscopic video display apparatus comprising:

a displaying means for displaying a right-eye image to be exclusively seen by a right eye of a viewer and a left-eye image to be exclusively seen by a left eye of the viewer, said right-eye and left-eye images composing a stereoscopic image, said displaying means comprising a right-eye image display device and a left-eye image display device;

an image shifting means for performing a horizontal shift on at least one of said right-eye image and left-eye image displayed on said displaying means such that a distance of convergence is maintained substantially constant on a time domain;

a right-eye magnifying lens for generating a virtual image of the right-eye image which can be seen by the right eye of the viewer; and

a left-eye magnifying lens for generating a virtual image of the left-eye image which can be seen by the left eye of the viewer;

said image shifting means performing the horizontal shift on at least one of the left-eye and right-eye images to satisfy

space="preserve" listing-type="equation">1/L-2<

(tan θ

.sub.R +tan θ

.sub.L)/d<

1/L+2 (L≦

0.5)

space="preserve" listing-type="equation">0<

(tan θ

.sub.R +tan θ

.sub.L)/d<

1/L+2 (L>

0.5)

wherein L(m) is a distance from the right and left eyes of the viewer to a plane on which the virtual images are formed, θ

_R is an angle between a line of sight of the right eye of the viewer and a normal line to said plane, θ

_L is an angle between a line of sight of the left eye of the viewer and said normal line to said plane, and d(m) is a distance between the right and left eyes of the viewer; and

the displaying means displaying a black stripe having a width substantially equal to an amount of the horizontal shift (i) at a right side of said at least one of the right-eye image and the left-eye image when the horizontal shift is leftward and (ii) at a left side of said at least one of the right-eye image and the left-eye image when the horizontal shift is rightward.