Method and apparatus for motion compensated noise reduction

• US 10,282,831 B2
• Filed: 12/28/2015
• Issued: 05/07/2019
• Est. Priority Date: 12/28/2015
• Status: Active Grant

• Current Assignee: Novatek Microelectronics Corporation (Novatek Microelectronics Corp Limited)
• Original Assignee: Novatek Microelectronics Corporation (Novatek Microelectronics Corp Limited)
• Inventors: Chen, Chien-Chi, Lee, Tung-Hsin, Chen, Chieh-Cheng
• Primary Examiner(s): Patel, Jayanti K
• Assistant Examiner(s): Habib, Irfan
• Application Number:
  US14/981,821
• Publication Number:
  US 20170188038A1
• Time in Patent Office: 1,226 Days
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/20182 Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing

Abstract

An apparatus for motion compensated noise reduction for input images is provided. The motion estimation and motion compensation circuit performs a motion estimation operation and a motion compensation operation on a current image and a previous image to obtain a first patch. The block matching operation circuit performs a block matching operation on the current image and the previous image to obtain a second patch. The motion detection circuit performs a motion detection operation on a target patch according to the first patch and the second patch to output a set of third patches. The current image includes the target patch. The noise reduction circuit performs a noise reduction operation on the set of third patches according to a threshold curve, so as to generate the target patch that the noise is reduced. A method for motion compensated noise reduction for input images is also provided.

Claims

1. A method for motion compensated noise reduction for input images, comprising:

performing a motion estimation operation and a motion compensation operation on a current image and a previous image to obtain at least one first patch comprising at least one first block;

performing a block matching operation on the current image and the previous image to obtain at least one second patch comprising at least one second block;

performing a motion detection operation on a target patch according to the at least one first patch and the at least one second patch to output a set of third patches, wherein the current image comprises the target patch, comprising;

performing a similarity calculation on the target patch and the at least one first patch to obtain a motion value; and

performing a patch searching operation to determine a number of the at least one second patch that the set of third patches comprises based on the motion value; and

performing a noise reduction operation on the set of third patches in a frequency domain according to a threshold curve, so as to generate the target patch that the noise is reduced.

2. The method for motion compensated noise reduction according to claim 1, wherein the larger the motion value is, the more second patches are added into the set of third patches, and the smaller the motion value is, the less second patches are added into the set of third patches.

3. The method for motion compensated noise reduction according to claim 1, wherein the step of performing the noise reduction operation on the set of third patches according to the threshold curve comprises:

transforming the set of third patches in a spatial domain into the set of third patches in the frequency domain;

filtering the noise of the set of third patches in the frequency domain according to the threshold curve; and

transforming the set of third patches in the frequency domain into the set of third patches in the spatial domain.

4. The method for motion compensated noise reduction according to claim 3, wherein the step performing the noise reduction operation on the set of third patches according to the threshold curve further comprises:

determining a relationship of the threshold curve with respect to a threshold value and a frequency according to a preset value.

5. The method for motion compensated noise reduction according to claim 4, wherein the threshold curve is selected from one of an exponential curve, an oblique line and a straight line.

6. The method for motion compensated noise reduction according to claim 3, wherein the step of performing the noise reduction operation on the set of third patches according to the threshold curve further comprises:

performing a patch-wise estimation operation on the set of third patches to, so as to generate the target patch that the noise is reduced.

7. The method for motion compensated noise reduction according to claim 1, wherein the set of third patches comprises the target patch and the at least one first patch.

8. The method for motion compensated noise reduction according to claim 7, wherein the set of third patches further comprises the at least one second patch.

9. An apparatus for motion compensated noise reduction for input images, comprising:

a motion estimation and motion compensation circuit, configured to perform a motion estimation operation and a motion compensation operation on a current image and a previous image to obtain at least one first patch comprising at least one first block;

a block matching operation circuit, configured to perform a block matching operation on the current image and the previous image to obtain at least one second patch comprising at least one second block;

a motion detection circuit, coupled to the motion estimation and motion compensation circuit and the block matching operation circuit, and configured to perform a motion detection operation on a target patch according to the at least one first patch and the at least one second patch to output a set of third patches, wherein the current image comprises the target patch, wherein the motion detection circuit comprises;

a similarity calculation circuit, coupled to the motion estimation and motion compensation circuit, and configured to perform a similarity calculation on the target patch and the at least one first patch to obtain a motion value; and

a patch searching circuit, coupled to the block matching operation circuit and the similarity calculation circuit, and configured to perform a patch searching operation to determine a number of the at least one second patch that the set of third patches comprises based on the motion value; and

a noise reduction circuit, coupled to the motion detection circuit, and configured to perform a noise reduction operation on the set of third patches in a frequency domain according to a threshold curve, so as to generate the target patch that the noise is reduced.

10. The apparatus for motion compensated noise reduction according to claim 9, wherein the larger the motion value is, the more second patches are added into the set of third patches, and the smaller the motion value is, the less second patches are added into the set of third patches.

11. The apparatus for motion compensated noise reduction according to claim 9, wherein the noise reduction circuit comprises:

a first transforming circuit, coupled to the motion detection circuit, and configured to transform the set of third patches in a spatial domain into the set of third patches in the frequency domain;

a noise filtering circuit, coupled to the first transforming circuit, and configured to filter the noise of the set of third patches in the frequency domain according to the threshold curve; and

a second transforming circuit, coupled to the noise filtering circuit, and configured to transform the set of third patches in the frequency domain into the set of third patches in the spatial domain.

12. The apparatus for motion compensated noise reduction according to claim 11, wherein the noise reduction circuit further comprises:

a threshold determining circuit, coupled to the noise filtering circuit, and configured to determine a relationship of the threshold curve with respect to a threshold value and a frequency according to a preset value.

13. The apparatus for motion compensated noise reduction according to claim 12, wherein the threshold curve is selected from one of an exponential curve, an oblique line and a straight line.

14. The apparatus for motion compensated noise reduction according to claim 11, wherein the noise reduction circuit further comprises:

a patch-wise estimation circuit, coupled to the second transforming circuit, and configured to perform a patch-wise estimation operation on the set of third patches, so as to generate the target patch that the noise is reduced.

15. The apparatus for motion compensated noise reduction according to claim 9, wherein the set of third patches comprises the target patch and the at least one first patch.

16. The apparatus for motion compensated noise reduction according to claim 15, wherein the set of third patches further comprises the at least one second patch.