IMAGE PROCESSING DEVICE, IMAGE PROCESSING METHOD, AND PROGRAM

• US 20130222656A1
• Filed: 02/15/2013
• Published: 08/29/2013
• Est. Priority Date: 02/28/2012
• Status: Active Grant

• Current Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Original Assignee: Canon Kabushiki Kaisha (Canon Inc.)
• Inventors: Kaneko, Chiaki
• Granted Patent: US 9,307,150 B2
• Time in Patent Office: Days
• US Class Current: 348/262
• CPC Class Codes: H04N 23/631 Graphical user interfaces [GUI] specially adapted for controlling image capture or setting capture parameters
• CPC Class Codes: H04N 23/90 Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
• CPC Class Codes: H04N 5/268 Signal distribution or switching

Abstract

In a case of a camera array, the arrangement of image capturing units and the arrangement of captured images that are displayed do not agree with each other depending on the orientation of the camera at the time of image capturing and it is hard to grasp the correspondence relationship between both. An image processing device for processing a plurality of images represented by captured image data obtained by a camera array image capturing device including a plurality of image capturing units includes a determining unit configured to determine, on the basis of a display angle of the images in a display region, an arrangement of each image in the display region corresponding to each of the plurality of image capturing units, and the arrangement of each image in the display region is determined based on the arrangement of the plurality of image capturing units.

Claims

1. An image processing device for processing a plurality of images represented by captured image data obtained by a camera array image capturing device including a plurality of image capturing units, the image processing device comprising:

a determining unit configured to determine, on the basis of a display angle of the images in a display region, an arrangement of each image in the display region corresponding to each of the plurality of image capturing units, wherein

the arrangement of each image in the display region is determined based on the arrangement of the plurality of image capturing units.

2. The image processing device according to claim 1, wherein

the display angle in the display region is determined based on an orientation of the image capturing device in a case that images of the captured image data are captured.

3. The image processing device according to claim 1, further comprising an operation unit configured to receive an input operation by a user, wherein

the display angle in the display region is determined based on inclination information of the image capturing device input via the operation unit.

4. The image processing device according to claim 1, wherein

a body of the image capturing device is provided with an acceleration sensor, and

the display angle in the display region is determined based on inclination information of the body relative to a vertical direction obtained by the acceleration sensor at the time of image capturing.

5. The image processing device according to claim 1, wherein

the arrangement of each image in the display region is determined so that a positional relationship of the each image is the same as a positional relationship of the plurality of image capturing units.

6. An image processing method for processing a plurality of images represented by captured image data obtained by a camera array image capturing device including a plurality of image capturing units, the image processing method comprising the step of:

determining, on the basis of a display angle of the images in a display region, an arrangement of each image in the display region corresponding to each of the plurality of image capturing units, wherein

the arrangement of each image in the display region is determined based on the arrangement of the plurality of image capturing units.

7. A program stored in a non-transitory computer readable storage medium for causing a computer to perform the image processing method according to claim 6.

8. An image processing device for processing a plurality of images represented by captured image data obtained by a camera array image capturing device including a plurality of image capturing units, the image processing device comprising:

a control unit configured to control a display of a plurality of captured images represented by the captured image data based on the arrangement of the plurality of image capturing units;

a selecting unit configured to select images to be combined from among the captured images; and

a generating unit configured to generate combined image data by combining images selected by the selecting unit.

9. The image processing device according to claim 8, further comprising a determining unit configured to determine, on the basis of a display angle of the images in a display region, an arrangement of each image in the display region corresponding to each of the plurality of image capturing units, wherein

the control unit controls a display of a plurality of images represented by the captured image data based on the arrangement determined by the determining unit.

10. The image processing device according to claim 9, further comprising an operation unit configured to receive an input operation by a user, wherein

the display angle in the display region is determined based on inclination information of the image capturing device input via the operation unit.

11. The image processing device according to claim 9, wherein

a body of the image capturing device is provided with an acceleration sensor, and

the display angle in the display region is determined based on of inclination information of the body relative to a vertical direction obtained by the acceleration sensor at the time of image capturing.

12. The image processing device according to claim 9, wherein

the arrangement of each image in the display region is determined based on the arrangement of the plurality of image capturing units.

13. The image processing device according to claim 9, wherein

the display angle in the display region is determined based on an orientation of the image capturing device in a case that images of the captured image data are captured.

14. The image processing device according to claim 9, wherein

the arrangement of each image in the display region is determined so that a positional relationship of each image is the same as a positional relationship of the plurality of image capturing units.

15. An image processing method for processing a plurality of images represented by captured image data obtained by a camera array image capturing device including a plurality of image capturing units, the image processing method comprising the steps of:

controlling a display of a plurality of captured images represented by the captured image data based on the arrangement of the plurality of image capturing units;

selecting images to be combined from among the captured images; and

generating combined image data by combining images selected at the selecting step.

16. A program stored in a non-transitory computer readable storage medium for causing a computer to perform the image processing method according to claim 15.