IMAGE PROCESSING APPARATUS AND IMAGE PROCESSING METHOD

• US 20110074818A1
• Filed: 09/24/2010
• Published: 03/31/2011
• Est. Priority Date: 09/25/2009
• Status: Abandoned Application

• Current Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Original Assignee: Fujifilm Corporation (Fujifilm Holdings Corporation)
• Inventors: MASUDA, Tomonori
• Application Number:
  US12/890,322
• Publication Number:
  US 20110074818A1
• Time in Patent Office: Days
• US Class Current: 345/634
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/20092 Interactive image processing based on input by user
• CPC Class Codes: G06T 7/593 from stereo images

Abstract

An image processing method including: inputting a plurality of images with a parallax between the images; by using one of the plurality of inputted images as a reference image, computing a parallax for each of pixels of the reference image on the basis of the plurality of images; extracting an unknown-parallax region for which a parallax cannot be computed; displaying the unknown-parallax region on a display device; receiving a user input of information on a parallax for the unknown-parallax region from a user; and setting the parallax for the unknown-parallax region on the basis of the input information on the parallax.

Claims

1. An image processing apparatus comprising:

an image input device configured to input a plurality of images with a parallax between the images;

a parallax computation device configured to set one of the plurality of inputted images as a reference image and compute a parallax for each of pixels of the reference image on the basis of the plurality of images;

a first extraction device configured to extract an unknown-parallax region for which a parallax cannot be computed by the parallax computation device;

a display control device configured to display the unknown-parallax region on a display device;

an input device configured to receive a user input of information on a parallax for the unknown-parallax region from a user; and

a parallax setting device configured to set the parallax for the unknown-parallax region on the basis of the input information on the parallax.

2. The image processing apparatus according to claim 1, wherein the input device includes:

a specification device configured to receive a user instruction to specify any one region within the plurality of images; and

an acquisition device configured to acquire a parallax computed by the parallax computation device for the specified region, and

the parallax setting device sets the parallax acquired by the acquisition device as the parallax for the unknown-parallax region.

3. The image processing apparatus according to claim 1, wherein

the input device includes:

a specification device configured to receive an user instruction to specify any two regions within the plurality of images;

an acquisition device configured to acquire parallaxes computed by the parallax computation device for the two specified region; and

an intermediate parallax computation device configured to compute a parallax intermediate between the two parallaxes acquired by the acquisition device, and

the parallax setting device sets the parallax computed by the intermediate parallax computation device as the parallax for the extracted unknown-parallax region.

4. The image processing apparatus according to claim 1, further comprising:

an acquisition device configured to receive a user instruction to specify any one region within the plurality of images and acquire a parallax computed by the parallax computation device for the specified region;

an intermediate parallax computation device configured to receive a user instruction to specify any two regions within the plurality of images, acquire parallaxes computed by the parallax computation device for the two specified regions, and compute a parallax intermediate between the two acquired parallaxes; and

a selection device configured to select from a first option of setting the parallax acquired by the acquisition device as the parallax for the unknown-parallax region by the parallax setting device and a second option of setting the parallax computed by the intermediate parallax computation device as the parallax for the unknown-parallax region by the parallax setting device.

5. The image processing apparatus according to claim 1, further comprising

a first dividing device configured to divide the unknown-parallax region into a plurality of regions, wherein

the input device receives a user input of information on the parallax for the unknown-parallax region for each of the divided regions.

6. The image processing apparatus according to claim 1, wherein

the display control device superimposes the unknown-parallax region on at least one of the plurality of images and displays the at least one image on the display device.

7. The image processing apparatus according to claim 1, further comprising

a second dividing device configured to divide the reference image into components within different predetermined distance ranges on the basis of the parallaxes for the pixels computed by the parallax computation device, wherein

the display control device superimposes a dividing line by which the reference image is divided on the reference image and displays the reference image.

8. The image processing apparatus according to claim 1, further comprising

a generating device configured to generate a parallax image of the reference image on the basis of the parallaxes for the pixels computed by the parallax computation device, wherein

the display control device superimposes the unknown-parallax region on the parallax image and displays the parallax image on the display device.

9. The image processing apparatus according to claim 8, further comprising

a second extraction device configured to extract a color contour from the reference image, wherein

the display control device superimposes the color contour on the parallax image and displays the parallax image on the display device.

10. The image processing apparatus according to claim 1, further comprising

a parallax-by-parallax image generating device configured to divide the reference image according to parallax on the basis of the parallaxes for the pixels computed by the parallax computation device and generate a plurality of parallax-by-parallax images, wherein

the display control device displays the parallax-by-parallax images in order of parallax on the display device, and

the input device receives a user input of information on the parallax for the unknown-parallax region in association with positions of the parallax-by-parallax images displayed in order of parallax.

11. The image processing apparatus according to claim 1, wherein

the input device receives an user input of a reference line with respect to the unknown-parallax region displayed on the display device which is information on the parallax for the unknown-parallax region, and

the parallax setting device includes:

a parallax approximate line generating device configured to generate a parallax approximate line on the basis of the reference line and

a parallax setting device configured to set the parallax for the unknown-parallax region on the basis of the parallax approximate line.

12. An image processing method comprising:

an image input step of inputting a plurality of images with a parallax between the images;

a parallax computation step of using one of the plurality of inputted images as a reference image and computing a parallax for each of pixels of the reference image on the basis of the plurality of images;

an extraction step of extracting an unknown-parallax region for which a parallax cannot be computed by the parallax computation step;

a display control step of displaying the unknown-parallax region on a display device;

an input step of receiving a user input of information on a parallax for the unknown-parallax region from a user; and

a parallax setting step of setting the parallax for the unknown-parallax region on the basis of the input information on the parallax.