Removal of poisson false color noise in low-light images usng time-domain mean and variance measurements

• US 7,570,833 B2
• Filed: 01/20/2006
• Issued: 08/04/2009
• Est. Priority Date: 10/11/2005
• Status: Active Grant

• Current Assignee: NextChip Co., Ltd.
• Original Assignee: NextChip Co., Ltd.
• Inventors: Lee, Seong-Won
• Primary Examiner(s): Werner; Brian P
• Assistant Examiner(s): DRENNAN, BARRY T
• Application Number:
  US11/336,290
• Publication Number:
  US 20080144958A1
• Time in Patent Office: 1,292 Days
• Field of Search: None
• US Class Current: 382/260
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20032 Median filtering
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/20182 Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 5/20 using local operators
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51

Abstract

Disclosed are an image processing method capable of effectively removing noise contained in an image photographed in a low light environment by using statistical information, and a system thereof. There is provided an image processing method for an image consecutively inputted per frame unit, the method comprising: a step of segmenting the image into unit areas comprising a predetermined number of pixels; a first step of dividing each unit area into a low light region or a high light region by using the brightness of image data contained in said each unit area; a second step of outputting statistical information from image data contained in at least one unit area divided into the low light region, and detecting and removing Poisson and photon counting noise on the basis of the statistical information, the statistical information being the mean of the unit area; a third step of detecting a motion pixel from the image data; and a fourth step of detecting and removing false color noise from the image data on the basis of the detected motion pixel and the statistical information.

Claims

1. An image processing method for an image consecutively inputted per frame unit, the method comprising:

a step of capturing the image with a capturing device;

a step of segmenting the image into unit areas comprising a predetermined number of pixels;

a first step of dividing each unit area into a low light region or a high light region by using the brightness of image data contained in said each unit area;

a second step of outputting statistical information from image data contained in at least one unit area divided into the low light region, and detecting and removing Poisson and photon counting noise on the basis of the statistical information, the statistical information being the mean of the unit area;

a third step of detecting a motion pixel from the image data; and

a fourth step of detecting and removing false color noise from the image data on the basis of the detected motion pixel and the statistical information,

wherein the step of detecting and removing false color noise uses an area statistical value, the area statistical value determined as

|(x(i, j, t)−

x(i, j, t)²−

σ

²(i, j, t)|,

wherein said x(i, j, t) is a pixel value in coordinates (i, j) when time is t,

said x(i, j, t) is the mean of the unit area containing coordinates (i, j) when time is t, and

said σ

²(i, j, t) is the variance in coordinates (i, j) when time is t.

2. The method of claim 1, wherein the second to fourth steps are not performed with respect to image data contained in the unit area divided into the high light region.

3. The method of claim 1, wherein the second step comprises the steps of:

detecting whether a first pixel containing uncorrelated noise in the Poisson and photon counting noise exists in the unit area by using the statistical information and a threshold; and

removing the uncorrelated noise by applying a median filter to the first pixel.

4. The method of claim 3, wherein the step of detecting whether a first pixel containing uncorrelated noise in the Poisson and photon counting noise exists in the unit area by using the statistical information and a threshold detects that a pixel contained in the unit area is the first pixel, in the case the difference between a pixel value of the pixel and a median value of absolute deviation thereof is larger than the threshold.

5. The method of claim 4, wherein the median value of absolute deviation of the pixel is calculated as,

median value of absolute deviation=median{|x(i, j)−

x(i, j)||x(i, j) ∈

W},

wherein said x(i, j) is a pixel value in coordinates (i, j), and

the x(i, j) is the mean of unit area W containing coordinates (i, j).

6. The method of claim 3, wherein the second step further comprises the step of:

removing correlated noise in the Poisson and photon counting noise in the unit area by applying an adaptive low pass filter to a second pixel adjacent to the first pixel.

7. The method of claim 1, wherein the fourth step comprises the steps of:

determining first image data corresponding to a predetermined frame and determining image data corresponding to a frame inputted right after the predetermined frame as second image data;

outputting a first area statistical value for each pixel of the first image data;

outputting a second area statistical value for each pixel of the second image data;

comparing the first area statistical value and the second area statistical value for said each pixel and selecting a pixel value of image data corresponding to a smaller value; and

substituting a pixel value of the second image data with the selected pixel value.

8. A computer readable storage medium comprising computer-readable instructions which, when executed by a computer, perform a method for processing an image consecutively inputted per frame unit, the method comprising the acts of:

a step of segmenting the image into unit areas comprising a predetermined number of pixels;

a first step of dividing each unit area into a low light region or a high light region by using the brightness of image data contained in said each unit area;

a second step of outputting statistical information from image data contained in at least one unit area divided into the low light region, and detecting and removing Poisson and photon counting noise on the basis of the statistical information, the statistical information being the mean of the unit area;

a third step of detecting a motion pixel from the image data; and

a fourth step of detecting and removing false color noise from the image data on the basis of the detected motion pixel and the statistical information,

wherein the step of detecting and removing false color noise uses an area statistical value, the area statistical value determined as

|(x(i, j, t)−

x(i, j, t))²−

σ

²(i, j, t)|,

wherein said x(i, j, t) is a pixel value in coordinates (i, j) when time is t,

said x(i, j, t) is the mean of the unit area containing coordinates (i, j) when time is t, and

said σ

²(i, j, t) is the variance in coordinates (i, j) when time is t.

9. An image processing system for an image consecutively inputted per frame unit, the system comprising:

a computing device having a processor, a memory, and an executable application residing in the memory for processing an image consecutively inputted per frame unit, the executable application comprising;

a segment module segmenting the image into unit areas comprising a predetermined number of pixels and dividing each unit area into a low light region or a high light region by using the brightness of image data contained in said each unit area;

a spatial hybrid filter outputting statistical information from image data contained in at least one unit area divided into the low light region, and detecting and removing Poisson and photon counting noise on the basis of the statistical information, the statistical information being the mean of the unit area;

a motion detector detecting a motion pixel from the image data; and

a statistical domain temporal filter detecting and removing false color noise from the image data on the basis of the detected motion pixel and the statistical information,

wherein the statistical domain temporal filter uses an area statistical value, the area statistical value determined as

|(x(i, j, t)−

x(i, j, t))²−

σ

²(i, j, t)|,

wherein said x(i, j, t) is a pixel value in coordinates (i, j) when time is t,

said x(i, j, t) is the mean of the unit area containing coordinates (i, j) when time is t, and

said σ

²(i, j, t) is the variance in coordinates (i, j) when time is t.