Image processing apparatus, image processing method, program therefor, and recording medium in which the program is recorded

• US 8,254,713 B2
• Filed: 11/10/2006
• Issued: 08/28/2012
• Est. Priority Date: 11/11/2005
• Status: Active Grant

• Current Assignee: Sony Semiconductor Solutions Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Yamaoka, Shigemitsu, Kamiya, Ryo
• Primary Examiner(s): Cunningham, Gregory F
• Application Number:
  US12/084,349
• Publication Number:
  US 20090041378A1
• Time in Patent Office: 2,118 Days
• Field of Search: 345/647, 348/36, 353/69, 353/70, 359/206.1, 359/662, 359/724, 359/725, 382/255, 382/275
• US Class Current: 382/255
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: H04N 23/62 Control of parameters via user interfaces
• CPC Class Codes: H04N 23/69 Control of means for changing angle of the field of view, e.g. optical zoom objectives or electronic zooming
• CPC Class Codes: H04N 23/698 for achieving an enlarged field of view, e.g. panoramic image capture
• CPC Class Codes: H04N 5/2628 Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation
• CPC Class Codes: H04N 7/18 Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Abstract

In an image processing apparatus that processes image data containing a distortion of an image pickup optical section, which is obtained by picking up an optical image from a subject through the image pickup optical section giving the distortion, a region selection mode setting section (13b) selectively sets a first region selection mode in which, from a field of view represented by the image data, a selected region is selected which indicates a partial region of the field of view by using an orthogonal coordinate system and a second region selection mode in which, from the field of view represented by the image data, the selected region is selected which indicates the partial region of the field of view by using a polar coordinate system. A distortion correction section (13a) corrects the distortion contained in the image data that corresponds to the selected region selected the first or second region selection mode selected in the region selection mode setting section (13b). A data output section (13d) outputs distortion-corrected data.

Claims

1. An image processing apparatus that processes image data containing a distortion of an image pickup optical section, which is obtained by picking up an optical image from a subject through the image pickup optical section giving the distortion, the image processing apparatus comprising:

a region selection mode setting section that selectively sets a first region selection mode in which, from a field of view represented by the image data a selected region is selected which indicates a partial region of the field of view by using an orthogonal coordinate system and a second region selection mode in which, from the field of view represented by the image data, the selected region is selected which indicates the partial region of the field of view by using a polar coordinate system; and

a data output section that outputs distortion-corrected data obtained by correcting the distortion in the image data that corresponds to the selected region selected in the first or second region selection mode which is set by the region selection mode setting section, wherein the region selection mode setting section switches from the first region setting mode to the second region setting mode according to whether or not the angle exceeds a first threshold value and switches from the second region selection mode to the first region selection mode according to whether or not the angle exceeds a second threshold value that is different from the first threshold value.

2. The image processing apparatus according to claim 1, further comprising a distortion correction section that corrects the distortion in the image data that corresponds to the selected region.

3. The image processing apparatus according to claim 2, wherein the distortion correction section corrects the distortion in only the image data that corresponds to the selected region.

4. The image processing apparatus according to claim 1, further comprising a control section that switches the selected region by changing coordinate values of the orthogonal coordinate system in a case where the selected region is switched in the first region selection mode or switches the selected region by changing an argument and/or a moving radius of the polar coordinate system in a case where the selected region is switched in the second region selection mode.

5. The image processing apparatus according to claim 1, further comprising an image pickup section that contains the image pickup optical section and an image pickup element which generates image data of an optical image that is made incident through the image pickup optical section.

6. The image processing apparatus according to claim 5, wherein the image pickup optical section is constituted by using a fish-eye lens.

7. The image processing apparatus according to claim 5, further comprising a direction detection sensor that detects a direction in which an optical image is made incident upon the image pickup optical section, wherein the region selection mode setting section selects either one of the first region selection mode and the second region selection mode based on a sensor signal from the direction detection sensor.

8. The image processing apparatus according to claim 7, wherein the region selection mode setting section selects either one of the first region selection mode and the second region selection mode in accordance with an angle with respect to a vertical direction that is determined on the basis of the sensor signal from the direction detection sensor.

9. The image processing apparatus according to claim 1, further comprising a detection sensor that detects contact with an object,

wherein the region selection mode setting section selects either one of the first region selection mode and the second region selection mode according to whether or not the contact with the object is detected on the basis of the sensor signal from the detection sensor.

10. The image processing apparatus according to claim 1, wherein the region selection mode setting section selects either one of the first region selection mode and the second region selection mode in accordance with a position at which the selected region is selected.

11. The image processing apparatus according to claim 1, further comprising an input section that generates input information including a selection instruction to select the selected region,

wherein the region selection mode setting section selects the selected region based on the selection instruction included in the input information.

12. The image processing apparatus according to claim 1, further comprising a storage apparatus that stores the image data containing the distortion due to the image pickup optical section,

wherein the image data read from the storage apparatus is processed.

13. The image processing apparatus according to claim 1, further comprising a display section that provides graphical user interface display,

wherein the region selection mode setting section switches the graphical user interface display between the first region selection mode and the second region selection mode.

14. An image processing method for processing image data containing a distortion of an image pickup optical section, which is obtained by picking up an optical image from a subject through the image pickup optical section giving the distortion, the method comprising:

a region selection mode setting step of selectively setting a first region selection mode in which, from a field of view represented by the image data, a selected region is selected which indicates a partial region of the field of view by using an orthogonal coordinate system and a second region selection mode in which, from the field of view represented by the image data, the selected region is selected which indicates the partial region of the field of view by using a polar coordinate system; and

a data output step of outputting distortion-corrected data obtained by correcting the distortion in the image data that corresponds to the selected region selected in the first or second region selection mode which is set in the region selection mode setting step, wherein the region selection mode setting section switches from the first region setting mode to the second region setting mode according to whether or not the angle exceeds a first threshold value and switches from the second region selection mode to the first region selection mode according to whether or not the angle exceeds a second threshold value that is different from the first threshold value.

15. A program stored in an electronic memory and automatically executed by a processor that causes a computer to perform image processing to process image data containing a distortion of an image pickup optical section, which is obtained by picking up an optical image from a subject through the image pickup optical section giving the distortion, the program comprising:

a region selection mode setting step of selectively setting a first region selection mode in which, from a field of view represented by the image data, a selected region is selected which indicates a partial region of the field of view by using an orthogonal coordinate system and a second region selection mode in which, from the field of view represented by the image data, the selected region is selected which indicates the partial region of the field of view by using a polar coordinate system; and

a data output step of outputting distortion-corrected data obtained by correcting the distortion in the image data that corresponds to the selected region selected in the first or second region selection mode which is set in the region selection mode setting step, wherein the region selection mode setting section switches from the first region setting mode to the second region setting mode according to whether or not the angle exceeds a first threshold value and switches from the second region selection mode to the first region selection mode according to whether or not the angle exceeds a second threshold value that is different from the first threshold value.

16. A non-transitory recording medium that records a program that is automatically executed by a processor and when executed performs image processing to process image data containing a distortion of an image pickup optical section, which is obtained by picking up an optical image from a subject through the image pickup optical section giving the distortion, the program comprising:

a region selection mode setting step of selectively setting a first region selection mode in which, from a field of view represented by the image data, a selected region is selected which indicates a partial region of the field of view by using an orthogonal coordinate system and a second region selection mode in which, from the field of view represented by the image data, the selected region is selected which indicates the partial region of the field of view by using a polar coordinate system; and

a data output step of outputting distortion-corrected data obtained by correcting the distortion in the image data that corresponds to the selected region selected in the first or second region selection mode which is set in the region selection mode setting step, wherein the region selection mode setting section switches from the first region setting mode to the second region setting mode according to whether or not the angle exceeds a first threshold value and switches from the second region selection mode to the first region selection mode according to whether or not the angle exceeds a second threshold value that is different from the first threshold value.