Method of processing noise in image data, noise reduction unit, and imaging apparatus
First Claim
1. A method of processing noise in image data by an image processor having a signal-processing portion converting an image signal from an image sensor into a digital signal and outputting the converted signal as image data for each frame, the image data indicating sets of pixel values each having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns, the method comprising the steps of:
- extracting pixel values by accepting each frame of the image data delivered from the signal-processing portion in turn while shifting the image data at regular intervals of time in a direction of a time axis and extracting, in each frame, pixel values represented by the image data accepted for each frame;
deciding pixel value by comparing each pixel value extracted by the pixel values extracting step against a previously set first threshold value and making a decision as to whether the pixel value is less than the first threshold value;
finding autocorrelation coefficients of pixel values which are less than the first threshold value and which are possessed by pixels located at the same coordinate point defined by the sets of image data over plural ones of the frames accepted while being shifted at the regular intervals of time; and
deciding random noise in the image by making a decision as to whether the autocorrelation coefficients found in the autocorrelation coefficients finding step are less than a previously set second threshold value and determining that the image data has suffered from deterioration of image quality due to random noise when the autocorrelation coefficients are less than the second threshold value.
2 Assignments
0 Petitions
Accused Products
Abstract
A method of processing noise in image data by an image processor having a signal-processing portion converting an image signal from an image sensor into a digital signal and outputting the converted signal as image data for each frame, the image data indicating sets of pixel values each having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns is disclosed. The method includes the steps of: extracting pixel values; deciding pixel value; finding autocorrelation coefficients of pixel values which are less than a first threshold value; and deciding random noise in the image.
29 Citations
34 Claims
-
1. A method of processing noise in image data by an image processor having a signal-processing portion converting an image signal from an image sensor into a digital signal and outputting the converted signal as image data for each frame, the image data indicating sets of pixel values each having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns, the method comprising the steps of:
-
extracting pixel values by accepting each frame of the image data delivered from the signal-processing portion in turn while shifting the image data at regular intervals of time in a direction of a time axis and extracting, in each frame, pixel values represented by the image data accepted for each frame; deciding pixel value by comparing each pixel value extracted by the pixel values extracting step against a previously set first threshold value and making a decision as to whether the pixel value is less than the first threshold value; finding autocorrelation coefficients of pixel values which are less than the first threshold value and which are possessed by pixels located at the same coordinate point defined by the sets of image data over plural ones of the frames accepted while being shifted at the regular intervals of time; and deciding random noise in the image by making a decision as to whether the autocorrelation coefficients found in the autocorrelation coefficients finding step are less than a previously set second threshold value and determining that the image data has suffered from deterioration of image quality due to random noise when the autocorrelation coefficients are less than the second threshold value. - View Dependent Claims (2, 3, 4, 5, 6)
-
-
7. A method of processing noise in image data by an image processor having a signal-processing portion for converting an image signal from an image sensor into a digital signal and outputting the converted signal as image data for each frame, the image data indicating sets of pixel values each having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns, the method comprising the steps of:
-
extracting pixel values by accepting the sets of image data delivered from the signal-processing portion in turn for each frame while shifting the sets of image data at regular intervals of time in a direction of a time axis and extracting, in each frame, the pixel values represented by the image data accepted in each frame; deciding pixel values by comparing each pixel value extracted by the pixel values extracting step against a previously set first threshold value and making a decision as to whether the pixel value is less than the first threshold value; finding first autocorrelation coefficients of pixel values which are possessed by pixels located at the same coordinate point defined by the image data over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis; deciding random noise in the image by making a decision as to whether the autocorrelation coefficients found in the autocorrelation coefficients finding step are less than a previously set second threshold value and determining that the image data has suffered from deterioration of image quality due to random noise when the autocorrelation coefficients are less than the second threshold value; setting pixel values equal to or larger than the first threshold value as a second pixel value when the decision at the pixel values deciding step is that the pixel values of the pixels are equal to or larger than the first threshold value; finding second autocorrelation coefficients by extracting pixel values which are equal to or larger than of the second pixel value and which are possessed by pixels located at the same coordinate point over plural frames accepted while being shifted at the regular intervals of time in the direction of the time axis and finding the autocorrelation coefficients of the extracted pixel values; deciding autocorrelation coefficients by making a decision as to whether the autocorrelation coefficients found in the second autocorrelation coefficients finding step are less than a previously set third threshold value; selecting pixels possessing pixel values having autocorrelation coefficients less than the third threshold value as pixels of a short-distance view of the image when the decision made at the autocorrelation coefficients deciding step is that the autocorrelation coefficients are less than the third threshold value; and making a correction for camera shake regarding the pixels of the short-distance view selected in the short-distance view selecting step. - View Dependent Claims (8, 9, 10, 11, 12)
-
-
13. A noise reduction unit for processing noise in image data, comprising:
-
an image sensor; a signal-processing portion for converting an image signal from the image sensor into a digital signal and outputting the converted signal as sets of image data for each frame, each set of image data indicating a pixel value having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns; pixel value extraction means for accepting the sets of image data from the signal-processing portion in turn for each frame while shifting the sets of image data at regular intervals of time in a direction of a time axis and extracting, in each frame, the pixel values represented by the image data accepted in each frame; pixel value decision means for comparing each pixel value extracted by the pixel value extraction means against a previously set first threshold value and making a decision as to whether the pixel value is less than the first threshold value; autocorrelation coefficient calculation means for finding autocorrelation coefficients of the pixel values which are less than the first threshold value and which are possessed by the pixels located at the same coordinate point defined by the image data over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis; and random noise decision means for making a decision as to whether each autocorrelation coefficient found by the autocorrelation coefficient calculation means is less than a previously set second threshold value and determining that the image data has suffered from deterioration of image quality due to random noise when the decision is that the autocorrelation coefficient is less than the second threshold value. - View Dependent Claims (14, 15, 16, 17, 18)
-
-
19. A noise reduction unit for processing noise in image data, comprising:
-
an image sensor; a signal-processing portion for converting an image signal from the image sensor into a digital signal and outputting the converted signal as sets of image data for each frame, each set of image data indicating a pixel value having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns; pixel value extraction means for accepting the sets of image data delivered from the signal-processing portion in turn for each frame while shifting the image data at regular intervals of time in a direction of a time axis and extracting, in each frame, the pixel values represented by the image data accepted in each frame; pixel value decision means for comparing each pixel value extracted by the pixel value extraction means against a previously set first threshold value and making a decision as to whether the pixel value is less than the first threshold value; first autocorrelation coefficient calculation means for finding autocorrelation coefficients of pixel values which are less than the first threshold value and which are possessed by pixels located at the same coordinate point defined by the image data over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis; random noise decision means for making a decision as to whether the autocorrelation coefficients found by the first autocorrelation coefficient calculation means are less than a previously set second threshold value and, when the autocorrelation coefficients are judged to be less than the second threshold value, determining that the image data has suffered from deterioration of image quality due to random noise; pixel value setting means which, when the pixel value decision means has determined that the pixel values of the pixels are equal to or larger than the first threshold value, sets the pixel values equal to or larger than the first threshold value as a second threshold value; second autocorrelation coefficient calculation means for extracting pixel values which are equal to or larger than the second threshold value and which are possessed by pixels located at the same coordinate point over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis and finding autocorrelation coefficients of the extracted pixel values; autocorrelation coefficient decision means for making a decision as to whether the autocorrelation coefficients found by the second autocorrelation coefficient calculation means are less than a previously set third threshold value; short-distance view selection means for selecting pixels possessing pixel values having autocorrelation coefficients less than the third threshold value as pixels of a short-distance view of the image when the autocorrelation coefficients are judged to be less than the third threshold value by the autocorrelation coefficient decision means; and camera shake correction means for making a correction for camera shake of the pixels of the short-distance view of the image selected by the short-distance view selection means. - View Dependent Claims (20, 21, 22, 23, 24)
-
-
25. An imaging apparatus comprising:
-
an image sensor; an optical system for guiding incident light from a subject into the image sensor; a signal-processing portion for converting an image signal from the image sensor into a digital signal and outputting the converted signal as image data for each frame, the image data including pixel values each having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns; and a random noise decision/reduction processing portion which judges and/or reduces random noise generated by the image sensor; wherein the random noise decision/reduction processing portion has; pixel value extraction means for accepting the image data delivered from the signal-processing portion in turn for each frame while shifting the image data at regular intervals of time in a direction of a time axis and extracting, in each frame, the pixel value represented by the image data accepted in each frame; pixel value decision means for comparing each pixel value extracted by the pixel value extraction means against a previously set first threshold value and making a decision as to whether the pixel value is less than the first threshold value; first autocorrelation coefficient calculation means for finding autocorrelation coefficients of the pixel values which are less than the first threshold value and which are possessed by the pixels located at the same coordinate point defined by the image data over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis; and random noise decision means for making a decision as to whether the autocorrelation coefficients found by the first autocorrelation coefficient calculation means are less than a previously set second threshold value and, when the autocorrelation coefficients are judged to be less than the second threshold value, determining that the image data has suffered from deterioration of image quality due to random noise. - View Dependent Claims (26, 27, 28, 29, 30, 31)
-
-
32. A noise reduction unit for processing noise in image data, comprising:
-
an image sensor; a signal-processing portion for converting an image signal from the image sensor into a digital signal and outputting the converted signal as sets of image data for each frame, each set of image data indicating a pixel value having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns; a pixel value extraction section which accepts the sets of image data from the signal-processing portion in turn for each frame while shifting the sets of image data at regular intervals of time in a direction of a time axis and extracts, in each frame, the pixel values represented by the image data accepted in each frame; a pixel value decision section which compares each pixel value extracted by the pixel value extraction section against a previously set first threshold value and makes a decision as to whether the pixel value is less than the first threshold value; an autocorrelation coefficient calculation section which finds autocorrelation coefficients of the pixel values which are less than the first threshold value and which are possessed by the pixels located at the same coordinate point defined by the image data over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis; and a random noise decision section which makes a decision as to whether each autocorrelation coefficient found by the autocorrelation coefficient calculation section is less than a previously set second threshold value and determines that the image data has suffered from deterioration of image quality due to random noise when the decision is that the autocorrelation coefficient is less than the second threshold value.
-
-
33. A noise reduction unit for processing noise in image data, comprising:
-
an image sensor; a signal-processing portion for converting an image signal from the image sensor into a digital signal and outputting the converted signal as sets of image data for each frame, each set of image data indicating a pixel value having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns; a pixel value extraction section which accepts the sets of image data delivered from the signal-processing portion in turn for each frame while shifting the image data at regular intervals of time in a direction of a time axis and extracts, in each frame, the pixel values represented by the image data accepted in each frame; a pixel value decision section which compares each pixel value extracted by the pixel value extraction section against a previously set first threshold value and makes a decision as to whether the pixel value is less than the first threshold value; a first autocorrelation coefficient calculation section which finds autocorrelation coefficients of pixel values which are less than the first threshold value and which are possessed by pixels located at the same coordinate point defined by the image data over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis; a random noise decision section which makes a decision as to whether the autocorrelation coefficients found by the first autocorrelation coefficient calculation section are less than a previously set second threshold value and, when the autocorrelation coefficients are judged to be less than the second threshold value, determines that the image data has suffered from deterioration of image quality due to random noise; a pixel value setting section which, when the pixel value decision section has determined that the pixel values of the pixels are equal to or larger than the first threshold value, sets the pixel values equal to or larger than the first threshold value as a second threshold value; a second autocorrelation coefficient calculation section which extracts pixel values which are equal to or larger than the second threshold value and which are possessed by pixels located at the same coordinate point over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis and finding autocorrelation coefficients of the extracted pixel values; an autocorrelation coefficient decision section which makes a decision as to whether the autocorrelation coefficients found by the second autocorrelation coefficient calculation section are less than a previously set third threshold value; a short-distance view selection section which selects pixels possessing pixel values having autocorrelation coefficients less than the third threshold value as pixels of a short-distance view of the image when the autocorrelation coefficients are judged to be less than the third threshold value by the autocorrelation coefficient decision section; and a camera shake correction section which makes a correction for camera shake of the pixels of the short-distance view of the image selected by the short-distance view selection section.
-
-
34. An imaging apparatus comprising:
-
an image sensor; an optical system for guiding incident light from a subject into the image sensor; a signal-processing portion for converting an image signal from the image sensor into a digital signal and outputting the converted signal as image data for each frame, the image data including pixel values each having a brightness at a corresponding one of coordinate points arranged in directions of rows and columns; and a random noise decision/reduction processing portion which judges and/or reduces random noise generated by the image sensor; wherein the random noise decision/reduction processing portion has; a pixel value extraction section which accepts the image data delivered from the signal-processing portion in turn for each frame while shifting the image data at regular intervals of time in a direction of a time axis and extracts, in each frame, the pixel value represented by the image data accepted in each frame; a pixel value decision section which compares each pixel value extracted by the pixel value extraction section against a previously set first threshold value and makes a decision as to whether the pixel value is less than the first threshold value; a first autocorrelation coefficient calculation section which finds autocorrelation coefficients of the pixel values which are less than the first threshold value and which are possessed by the pixels located at the same coordinate point defined by the image data over plural ones of the frames accepted while being shifted at the regular intervals of time in the direction of the time axis; and a random noise decision section which makes a decision as to whether the autocorrelation coefficients found by the first autocorrelation coefficient calculation section are less than a previously set second threshold value and, when the autocorrelation coefficients are judged to be less than the second threshold value, determines that the image data has suffered from deterioration of image quality due to random noise.
-
Specification