Volterra filters for enhancement of contours in images

• US 20030156762A1
• Filed: 10/15/2002
• Published: 08/21/2003
• Est. Priority Date: 10/15/2001
• Status: Active Grant

• Current Assignee: Jonas August
• Original Assignee: Jonas August
• Inventors: August, Jonas
• Granted Patent: US 7,085,426 B2
• Time in Patent Office: Days
• US Class Current: 382/260
• CPC Class Codes: G06T 2207/20076 Probabilistic image processing
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 2207/30004 Biomedical image processing
• CPC Class Codes: G06T 2207/30112 Baggage; Luggage; Suitcase
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06V 10/30 Noise filtering

Abstract

Enhancement of contours in images that are noisy or otherwise corrupted is important in medical imaging, scanning for weapons detection, and many other fields. Here, the Curve Indicator Random Field (CIRF) is used as a model of uncorrupted images of contours for constructing linear, quadratic and cubic Volterra filters involving a number of adjustable parameters.

Claims

1. A method of enhancing contours in a noisy image, said method comprising the steps of:

a) capturing said noisy image as a first distribution m of spatially distributed intensity values

b) transforming said intensity values of said first distribution m into a second distribution U of spatially distributed intensity values representing an enhanced image having enhanced contours therein, by using a transformation model, which defines a cubic filter, as follows;

U=a₀+a₃[Gm+G*m]+a₂[G(diag m)Gm+Gm·

G*m+G*(diag m)G*m]+a₁[G(diag m)G(diag m)Gm+G(diag m)Gm·

G*m+Gm·

G*(diag m)G*m+G*(diag m)G*(diag m)G*m],

where;

diag m is a diagonal operator comprising a matrix with said first distribution m along the diagonal of said matrix and zeroes elsewhere;

the operation “

·

”

indicates the taking of a componentwise product of two vectors, wherein in s·

v evaluated at location r is the product of the two numbers s(r) and v(r), where s and v are each functions of r, a₀, a₁, a₂, and a₃ are real-valued parameters controlling the relative importance of constant, linear, quadratic, and cubic terms, respectively, in said transformation model;

G=G(r₁, r₂) comprises a matrix of probabilities, each entry of which represents the probability that a contour passing through location r₁ passes through location r₂ in a forward direction along said contour; and

G*=G*(r₁, r₂) comprises a matrix of probabilities, each entry of which represents the probability that a contour passing through location r₁ passes through location r₂ in a backward direction along said contour.

2. A method as set forth in claim 1, wherein a₂=a₃=0, to thereby define a linear filter.

3. A method as set forth in claim 1, wherein a₃=0, to thereby define a quadratic filter.

4. A method as set forth in claim 1, and further comprising the step of:

c) transforming U(r) into an image I(s), wherein r represents more dimensions than s.

5. A method as set forth in claim 1, and further comprising the step of:

c) transforming U(r) into an image I(x,y,z) by integrating U or selecting maxima of U over at least one spatial dimension other than (x,y,z).

6. A method as set forth in claim 1, wherein U, μ

, ν

, C, f, and b are functions of (r₁,r₂), and wherein r₁ comprises the two-dimensional space (x,y) or the three-dimensional space (x,y,z), and wherein r₂ comprises at least one of local direction, curvature, torsion, blur scale, color, texture, contrast and other properties used to form a local description of a contour passing a point of said two-dimensional space (x,y) or said three-dimensional space (x,y,z), respectively.

7. A method as set forth in claim 4, and further comprising the step of:

d) displaying said image I(s).

8. A computer readable medium including computer instructions for carrying out a method of enhancing contours in a noisy image, said method comprising the steps of:

a) capturing said noisy image as a first distribution m of spatially distributed intensity values

b) transforming said intensity values of said first distribution m into a second distribution U of spatially distributed intensity values representing an enhanced image having enhanced contours therein, by using a transformation model, which defines a cubic filter, as follows;

U=a₀+a₁[Gm+G*m]+a₂[G(diag m)Gm+Gm·

G*m+G*(diag m)G*m]+a₃[G(diag m)G(diag m)Gm+G(diag m)Gm·

G*m+Gm·

G*(diag m)G*m+G*(diag m)G*(diag m)G*m],

where;

diag m is a diagonal operator comprising a matrix with said first distribution m along the diagonal of said matrix and zeroes elsewhere;

the operation “

·

”

indicates the taking of a componentwise product of two vectors, wherein in s·

v evaluated at location r is the product of the two numbers s(r) and v(r), where s and v are each functions of r, a₀, a₁, a₂, and a₃ are real-valued parameters controlling the relative importance of constant, linear, quadratic, and cubic terms, respectively, in said transformation model;

G=G(r₁, r₂) comprises a matrix of probabilities, each entry of which represents the probability that a contour passing through location r₁ passes through location r₂ in a forward direction along said contour; and

G*=G*(r₁, r₂) comprises a matrix of probabilities, each entry of which represents the probability that a contour passing through location r₁ passes through location r₂ in a backward direction along said contour.

9. A computer readable medium as set forth in claim 8, wherein a₂=a₃=0, to thereby define a linear filter.

10. A computer readable medium as set forth in claim 8, wherein a₃=0, to thereby define a quadratic filter.

11. A computer readable medium as set forth in claim 8, and further comprising the step of:

c) transforming U(r) into an image I(s), wherein r represents more dimensions than s.

12. A computer readable medium as set forth in claim 11, and further comprising the step of:

d) displaying said image I(s).

13. A system for enhancing contours in a noisy image, said system comprising:

a) a camera for capturing said noisy image as a first distribution m of spatially distributed intensity values

b) a computer for transforming said intensity values of said first distribution m into a second distribution U of spatially distributed intensity values representing an enhanced image having enhanced contours therein, by using a transformation model, which defines a cubic filter, as follows;

U=a₀+a₁[Gm+G*m]+a₂[G(diag m)Gm+Gm·

G*m+G*(diag m)G*m]+a₃[G(diag m)G(diag m)Gm+G(diag m)Gm·

G*m+Gm·

G*(diag m)G*m+G*(diag m)G*(diag m)G*m,

where;

diag m is a diagonal operator comprising a matrix with said first distribution m along the diagonal of said matrix and zeroes elsewhere;

the operation “

·

”

indicates the taking of a componentwise product of two vectors, wherein in s·

v evaluated at location r is the product of the two numbers s(r) and v(r), where s and v are each functions of r, a₀, a₁, a₂, and a₃ are real-valued parameters controlling the relative importance of constant, linear, quadratic, and cubic terms, respectively, in said transformation model;

G=G(r₁, r₂) comprises a matrix of probabilities, each entry of which represents the probability that a contour passing through location r₁ passes through location r₂ in a forward direction along said contour; and

G*=G*(r₁, r₂) comprises a matrix of probabilities, each entry of which represents the probability that a contour passing through location r₁ passes through location r₂ in a backward direction along said contour.

14. A system as set forth in claim 13, wherein a₂=a₃=0, to thereby define a linear filter.

15. A system as set forth in claim 13, wherein a₃=0, to thereby define a quadratic filter.

16. A system as set forth in claim 13, said system comprising:

c) a computer for transforming U(r) into an image I(s), wherein r represents more dimensions than s.

17. A system as set forth in claim 16, wherein U(r)=U(x,y,z,θ

,φ

), where θ and

φ

define a direction in three dimensions, and I(x,y,z) comprises either an integral of U over θ and

φ

or a selection of maxima of U over θ and

φ

.

18. A system as set forth in claim 13, and comprising:

c) a computer for transforming U(r) into a planar image I(x,y) by integrating U or selecting maxima of U over at least one spatial dimension other than (x,y).

19. A system as set forth in claim 13, wherein U(r)=U(x,y,θ

), and I(x,y) comprises either an integral of U over θ

or a selection of maxima of U over θ

.

20. A system as set forth in claim 16, said system further comprising:

d) a display for displaying said image I(s).