Image processing device and method, recording medium, and program

• US 20060140497A1
• Filed: 02/13/2004
• Published: 06/29/2006
• Est. Priority Date: 02/28/2003
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Sawao, Takashi, Kondo, Tetsujiro, Miyake, Toru, Fujiwara, Naoki, Ishibashi, Junichi, Nagano, Takahiro, Wada, Seiji
• Granted Patent: US 7,561,188 B2
• Time in Patent Office: Days
• US Class Current: 382/254
• CPC Class Codes: G06T 1/00 General purpose image data processing
• CPC Class Codes: G06T 7/12 Edge-based segmentation
• CPC Class Codes: G06T 7/66 of image moments or centre of gravity
• CPC Class Codes: G06T 7/74 involving reference images or patches
• CPC Class Codes: G06T 7/77 using statistical methods
• CPC Class Codes: G06V 10/443 by matching or filtering

Abstract

The present invention relates an image processing device and method, recording medium, and program. A simple-type angle detecting unit 901 simply detects the angle as continuity using correlation from an input image. A determining unit 902, based on the angle thus simply obtained, connects a switch 903 to a terminal 903a in the event the angle is closer to the horizontal direction or the vertical direction, and outputs the angle information simply detected to a regression-type angle detecting unit 904. The regression-type angle detecting unit 904 statistically detects and outputs the angle as continuity in a regression equation. On the other hand, in the event that the angle as continuity simply obtained is closer to 45 degrees, the determining unit 902 connects the switch 903 and a terminal 903b. At this time, a gradient-type angle detecting unit 905 detects and outputs the direction of continuity from the input image in a gradient equation. As a result, the angle as continuity may be detected more accurately.

Claims

1. An image processing device including:

first angle detecting means for detecting an angle -corresponding to the reference axis of continuity of image data in image data made up of a plurality of pixels acquired by real world light signals being cast upon a plurality of detecting elements each having spatio-temporal integration effects, of which a part of continuity of said real world light signals have been lost, using matching processing;

second angle detecting means for detecting said angle using statistical processing based on said image data within a predetermined region corresponding to the angle detected by said first angle detecting means; and

actual world estimating means for estimating said light signals by estimating said lost continuity of said real world light signals based on said angle detected by said second angle detecting means.

2. The image processing device according to claim 1, said first angle detecting means including:

pixel detecting means for detecting an image block centered on a plurality of pixels adjacent to the straight line of each angle on the basis of a pixel of interest within said image data; and

correlation detecting means for detecting correlation of image blocks detected by said pixel detecting means;

wherein the angle as to the reference axis of continuity of said image data is detected according to the value of correlation of said image blocks detected by said correlation detecting means.

3. The image processing device according to claim 1, said second angle detecting means further including:

a plurality of statistical processing means;

wherein said angle is detected using one statistical processing means of said plurality of statistical processing means according to the angle detected by said first angle detecting means.

4. The image processing device according to claim 3, one statistical processing means of said plurality of statistical processing means further including:

dynamic range detecting means for detecting a dynamic range, which is difference between the maximum value and the minimum value of the pixel values of the pixels within said predetermined region;

difference value detecting means for detecting the difference value between adjacent pixels in the direction according to activity within said predetermined region; and

statistical angle detecting means for statistically detecting an angle as to the reference axis of continuity of image data corresponding to said lost continuity of the real world light signals, according to said dynamic range and said difference value.

5. The image processing device according to claim 3, one statistical processing means of said plurality of statistical processing means including:

score detecting means for taking the number of pixels of which the correlation value as to the pixel value of the pixel of interest and another pixel within said predetermined region is equal to or greater than a threshold value as a score corresponding to said pixel of interest; and

statistical angle detecting means for statistically detecting an angle as to the reference axis of continuity of said image data by detecting a regression line based on the score of each pixel of interest detected by said score detecting means.

6. An image processing method including:

a first angle detecting step for detecting an angle corresponding to the reference axis of continuity of image data in image data made up of a plurality of pixels acquired by real world light signals being cast upon a plurality of detecting elements each having spatio-temporal integration effects, of which a part of continuity of said real world light signals have been lost, using matching processing;

a second angle detecting step for detecting said angle using statistical processing based on said image data within a predetermined region corresponding to the angle detected in said first angle detecting step; and

an actual world estimating step for estimating said light signals by estimating said lost continuity of said real world light signals based on said angle detected in said second angle detecting step.

7. A recording medium recording a program that can be read by a computer which executes processing including:

a first angle detecting step for detecting an angle corresponding to the reference axis of continuity of image data in image data made up of a plurality of pixels acquired by real world light signals being cast upon a plurality of detecting elements each having spatio-temporal integration effects, of which a part of continuity of said real world light signals have been lost, using matching processing;

a second angle detecting step for detecting said angle using statistical processing based on said image data within a predetermined region corresponding to the angle detected in said first angle detecting step; and

an actual world estimating step for estimating said light signals by estimating said lost continuity of said real world light signals based on said angle detected in said second angle detecting step.

8. A program that causes a computer to execute processing including:

a first angle detecting step for detecting an angle corresponding to the reference axis of continuity of image data in image data made up of a plurality of pixels acquired by real world light signals being cast upon a plurality of detecting elements each having spatio-temporal integration effects, of which a part of continuity of said real world light signals have been lost, using matching processing;

a second angle detecting step for detecting said angle using statistical processing based on said image data within a predetermined region corresponding to the angle detected in said first angle detecting step; and

an actual world estimating step for estimating said light signals by estimating said lost continuity of said real world light signals based on said angle detected in said second angle detecting step.