STEREO IMAGE DISPLAY SYSTEM, STEREO IMAGING APPARATUS AND STEREO DISPLAY APPARATUS

• US 20120154551A1
• Filed: 12/12/2011
• Published: 06/21/2012
• Est. Priority Date: 12/17/2010
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: INOUE, Chiaki
• Granted Patent: US 9,007,442 B2
• Time in Patent Office: Days
• US Class Current: 348/49
• CPC Class Codes: H04N 13/128 Adjusting depth or disparity
• CPC Class Codes: H04N 13/144 for flicker reduction
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence

Abstract

The stereo display apparatus displays parallax images to present a stereo image. The apparatus acquires the parallax images and information on a maximum pixel shift amount and a minimum pixel shift amount of the parallax images, calculates maximum and minimum relative parallax amounts corresponding to the maximum and minimum relative parallax amounts, by using the information on the maximum and minimum pixel shift amounts and a display condition, and determines whether or not at least one of the maximum and minimum relative parallax amounts exceeds a fusional limit criterion value. The apparatus determines whether or not a difference between the maximum and minimum relative parallax amounts exceeds a fusional limit range amount if the at least one of the maximum and minimum relative parallax amounts exceeds the fusional limit criterion value.

Claims

1. A stereo image display system comprising:

a stereo imaging apparatus configured to perform imaging to produce parallax images having a parallax therebetween; and

a stereo display apparatus configured to be capable of displaying the parallax images to present a stereo image,

wherein the stereo imaging apparatus comprising;

a corresponding point extraction part configured to extract corresponding points at each of plural portions in the parallax images;

a pixel shift amount acquisition part configured to acquire a pixel shift amount between the corresponding points at each of the plural portions, and configured to acquire information on a maximum pixel shift amount and a minimum pixel shift amount among the acquired pixel shift amounts; and

an output part configured to output the parallax images and the information on the maximum and minimum pixel shift amounts,

wherein the stereo display apparatus comprising;

an information acquisition part configured to acquire the parallax images and the information on the maximum and minimum pixel shift amounts;

a relative parallax amount calculation part configured to calculate (a) a maximum relative parallax amount corresponding to the maximum pixel shift amount and (b) a minimum relative parallax amount corresponding to the minimum pixel shift amount, by using the information on the maximum and minimum pixel shift amounts and a display condition; and

a fusional limit determination part configured to determine whether or not at least one of the maximum and minimum relative parallax amounts exceeds a fusional limit criterion value, and configured to determine whether or not a difference between the maximum and minimum relative parallax amounts exceeds a fusional limit range amount if the at least one of the maximum and minimum relative parallax amounts exceeds the fusional limit criterion value.

2. A stereo image display system according to claim 1, wherein the output part of the stereo imaging apparatus is configured to output information on the pixel shift amount between the corresponding points at each of the plural portions acquired by the pixel shift amount acquisition part.

3. A stereo image display system according to claim 1, wherein the stereo display apparatus further comprising:

an image processing part configured to execute an image process that performs offset control on the parallax images if the fusional limit determination part determines that the maximum and minimum relative parallax amounts exceed the fusional limit criterion value, and configured not to execute the image process if the fusional limit determination part determines that the maximum and minimum relative parallax amounts do not exceed the fusional limit criterion value.

4. A stereo image display system according to claim 1, wherein the stereo display apparatus further comprising:

an image processing part configured to execute a first image process that performs offset control on the parallax images if the fusional limit determination part determines that the maximum and minimum relative parallax amounts do not exceed the fusional limit criterion value, and configured to execute second image process that adds a blur component to the parallax images if the fusional limit determination part determines that the maximum and minimum relative parallax amounts exceed the fusional limit criterion value.

5. A stereo image display system according to claim 1, wherein the display condition is at least one of a number of display pixels, a screen size and a viewing distance of the stereo display apparatus, the viewing distance being a distance from the display apparatus to an observer.

6. A stereo image display system according to claim 1, further comprising:

a viewing distance detection part configured to detect a distance from the display apparatus to an observer.

7. A stereo image display system comprising:

a stereo imaging apparatus configured to perform imaging to produce parallax images having a parallax therebetween; and

a stereo display apparatus configured to be capable of displaying the parallax images to present a stereo image,

wherein the stereo imaging apparatus comprising;

a corresponding point extraction part configured to extract corresponding points at each of plural portions in the parallax images;

a pixel shift ratio acquisition part configured to calculate a pixel shift ratio between the corresponding points at each of the plural portions, and configured to acquire information on a maximum pixel shift ratio and a minimum pixel shift ratio among the calculated pixel shift ratios; and

an output part configured to output the parallax images and the information on the maximum and minimum pixel shift ratios, and

wherein the stereo display apparatus comprising;

an information acquisition part configured to acquire the parallax images and the information on the maximum and minimum pixel shift ratios;

a relative parallax amount calculation part configured to calculate (a) a maximum relative parallax amount corresponding to the maximum pixel shift ratio and (b) a minimum relative parallax amount corresponding to the minimum pixel shift ratio, by using the information on the maximum and minimum pixel shift ratios and a display condition; and

a fusional limit determination part configured to determine whether or not at least one of the maximum and minimum relative parallax amounts exceeds a fusional limit criterion value, and configured to determine whether or not a difference between the maximum and minimum relative parallax amounts exceeds a fusional limit range amount if the at least one of the maximum and minimum relative parallax amounts exceeds the fusional limit criterion value.

8. A stereo image display system according to claim 7, wherein the output part of the stereo imaging apparatus is configured to output information on the pixel shift ratios between the corresponding points at each of the plural portions calculated by the pixel shift ratio acquisition part.

9. A stereo image display system according to claim 7, wherein the stereo display apparatus further comprising:

an image processing part configured to execute an image process that performs offset control on the parallax images if the fusional limit determination part determines that the maximum and minimum relative parallax amounts exceed the fusional limit criterion value, and configured not to execute the image process if the fusional limit determination part determines that the maximum and minimum relative parallax amounts do not exceed the fusional limit criterion value.

10. A stereo image display system according to claim 7, wherein the stereo display apparatus further comprising:

an image processing part configured to execute a first image process that performs offset control on the parallax images if the fusional limit determination part determines that the maximum and minimum relative parallax amounts do not exceed the fusional limit criterion value, and configured to execute a second image process that adds a blur component to the parallax images if the fusional limit determination part determines that the maximum and minimum relative parallax amounts exceed the fusional limit criterion value.

11. A stereo image display system according to claim 7, wherein the display condition is at least one of a number of display pixels, a screen size and a viewing distance of the display apparatus, the viewing distance being a distance from the display apparatus to an observer.

12. A stereo image display system according to claim 7, further comprising:

a viewing distance detection part configured to detect a distance from the stereo display apparatus to an observer.

13. A stereo imaging apparatus configured to perform imaging to produce parallax images having a parallax therebetween, the apparatus comprising:

a corresponding point extraction part configured to extract corresponding points at each of plural portions in the parallax images;

a pixel shift amount acquisition part configured to acquire a pixel shift amount between the corresponding points at each of the plural portions, and configured to acquire information on a maximum pixel shift amount and a minimum pixel shift amount among the acquired pixel shift amounts; and

a recording part configured to record the parallax images and the information on the maximum and minimum pixel shift amounts.

14. A stereo display apparatus configured to display parallax images having a parallax therebetween to present a stereo image, the apparatus comprising:

an information acquisition part configured to acquire (a) the parallax images and (b) information on a maximum pixel shift amount and a minimum pixel shift amount of the parallax images;

a relative parallax amount calculation part configured to calculate (a) a maximum relative parallax amount corresponding to the maximum pixel shift amount and (b) a minimum relative parallax amount corresponding to the minimum pixel shift amount, by using the information on the maximum and minimum pixel shift amounts and a display condition; and

a fusional limit determination part configured to determine whether or not at least one of the maximum and minimum relative parallax amounts exceeds a fusional limit criterion value, and configured to determine whether or not a difference between the maximum and minimum relative parallax amounts exceeds a fusional limit range amount if the at least one of the maximum and minimum relative parallax amounts exceeds the fusional limit criterion value.

15. A computer-readable recording medium in which a computer program causing a computer to execute processing is stored, the computer program comprising:

a corresponding point extraction step of extracting corresponding points at each of plural portions in parallax images having a parallax therebetween;

a pixel shift amount acquisition step of acquiring a pixel shift amount between the corresponding points at each of the plural portions, and of acquiring information on a maximum pixel shift amount and a minimum pixel shift amount among the acquired pixel shift amounts; and

a recording step of recording the parallax images and the information on the maximum and minimum pixel shift amounts.

16. A computer-readable recording medium in which a computer program causing a computer to execute processing is stored, the computer program comprising:

an information acquisition step of acquiring (a) parallax images having a parallax therebetween and (b) information on a maximum pixel shift amount and a minimum pixel shift amount of the parallax images;

a relative parallax amount calculation step of calculating (a) a maximum relative parallax amount corresponding to the maximum pixel shift amount and (b) a minimum relative parallax amount corresponding to the minimum pixel shift amount, by using the information on the maximum and minimum pixel shift amounts and a display condition;

a first fusional limit determination step of determining whether or not at least one of the maximum and minimum relative parallax amounts exceeds a fusional limit criterion value; and

a second fusional limit determination step of determining whether or not a difference between the maximum and minimum relative parallax amounts exceeds a fusional limit range amount if the at least one of the maximum and minimum relative parallax amounts exceeds the fusional limit criterion value.

17. A stereo imaging apparatus configured to perform imaging to produce parallax images having a parallax therebetween, the apparatus comprising:

a corresponding point extraction part configured to extract corresponding points at each of plural portions in the parallax images;

a pixel shift ratio acquisition part configured to calculate a pixel shift ratio between the corresponding points at each of the plural portions, and configured to acquire information on a maximum pixel shift ratio and a minimum pixel shift ratio among the calculated pixel shift ratios; and

a recording part configured to record the parallax images and the information on the maximum and minimum pixel shift ratios.

18. A stereo display apparatus configured to display parallax images having a parallax therebetween to present a stereo image, the apparatus comprising:

an information acquisition part configured to acquire (a) the parallax images and (b) information on a maximum pixel shift ratio and a minimum pixel shift ratio of the parallax images;

a relative parallax amount calculation part configured to calculate (a) a maximum relative parallax amount corresponding to the maximum pixel shift ratio and (b) a minimum relative parallax amount corresponding to the minimum pixel shift ratio, by using the information on the maximum and minimum pixel shift ratios and a display condition; and

a fusional limit determination part configured to determine whether or not at least one of the maximum and minimum relative parallax amounts exceeds a fusional limit criterion value, and configured to determine whether or not a difference between the maximum and minimum relative parallax amounts exceeds a fusional limit range amount if the at least one of the maximum and minimum relative parallax amounts exceeds the fusional limit criterion value.

19. A computer-readable recording medium in which a computer program causing a computer to execute processing is stored, the computer program comprising:

a corresponding point extraction step of extracting corresponding points at each of plural portions in parallax images having a parallax therebetween;

a pixel shift ratio calculation step of calculating a pixel shift ratio between the corresponding points at each of the plural portions, and of acquiring information on a maximum pixel shift ratio and a minimum pixel shift ratio among the calculated pixel shift ratios; and

a recording step of recording the parallax images and the information on the maximum and minimum pixel shift ratios.

20. A computer-readable recording medium in which a computer program causing a computer to execute processing is stored, the computer program comprising:

an information acquisition step of acquiring (a) parallax images having a parallax therebetween and (b) information on a maximum pixel shift ratio and a minimum pixel shift ratio of the parallax images;

a relative parallax amount calculation step of calculating (a) a maximum relative parallax amount corresponding to the maximum pixel shift ratio and (b) a minimum relative parallax amount corresponding to the minimum pixel shift ratio, by using the information on the maximum and minimum pixel shift ratios and a display condition;

a first fusional limit determination step of determining whether or not at least one of the maximum and minimum relative parallax amounts exceeds a fusional limit criterion value; and

a second fusional limit determination step of determining whether or not a difference between the maximum and minimum relative parallax amounts exceeds a fusional limit range amount if the at least one of the maximum and minimum relative parallax amounts exceeds the fusional limit criterion value.