Medical viewing system and method for enhancing structures in noisy images

• US 20050002546A1
• Filed: 11/20/2002
• Published: 01/06/2005
• Est. Priority Date: 11/30/2001
• Status: Active Grant

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Lelong, Pierre, Florent, Raoul, Rongen, Peter Maria Johannes, Nosjean, Lucile
• Granted Patent: US 7,415,169 B2
• Time in Patent Office: Days
• US Class Current: 382/128
• CPC Class Codes: A61B 2017/22001 Angioplasty, e.g. PCTA
• CPC Class Codes: A61B 2090/376 using X-rays, e.g. fluoroscopy
• CPC Class Codes: A61B 6/12 Arrangements for detecting or locating foreign bodies
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: G06T 2207/10121 Fluoroscopy
• CPC Class Codes: G06T 2207/20182 Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 2207/30048 Heart; Cardiac
• CPC Class Codes: G06T 2207/30052 Implant; Prosthesis
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/33 using feature-based methods

Abstract

A viewing system and method for enhancing objects of interest represented on a moving background in a sequence of noisy images and for displaying the sequence of enhanced images, comprising extracting means (11) for extracting features related to an object of interest in images of the sequence; registering means (12) for registering the features related to the object of interest with respect to the image referential, yielding registered images (13); similarity detection means for determining the resemblance of the representations of a registered object of interest in succeeding images and weighing means for modulating the intensities of the pixels of said object of interest over the images of the sequence; temporal integrating means (14, 33b) for integrating the object of interest and the background over a number, or at least two, registered images (13) of the sequence; and display means (54) for displaying the processed images (15, 45) of the enhanced registered object of interest on faded background. Application: Medical Imaging. X-ray Fluoroscopic Imaging.

Claims

1. A viewing system for enhancing objects of interest represented on a moving background in a sequence of noisy images and for displaying the sequence of enhanced images, including acquisition means for acquiring the sequence of images and processing means for processing the images comprising extracting means (11) for extracting features related to an object of interest on a background in images of the sequence having an image referential, said processing means further comprising:

registering means (12), yielding registered images (13), for registering the features related to the object of interest with respect to the image referential, while not registering the background;

temporal integration means (14, 33b) for integrating both the object of interest and the background over at least two registered images (13) of the sequence; and

display means (54) for displaying the processed images (15, 45) of the enhanced registered object of interest on faded background.

2. The system of claim 1, having control means (58) for a user to activate, to control the duration or to stop the processing means at a selected stage in the sequence of images.

3. The system of one of claim 1, wherein the processing means further comprises:

similarity detection means for determining resemblance information in the representations of a registered object of interest in succeeding images; and

weighing means using said resemblance information for modulating the intensities of the pixels of said object of interest over the images of the sequence, during temporal integration by the temporal integration means.

4. The system of one of claim 1, wherein the processing means further comprises:

enhancement means (21) for spatially enhancing sharp details in the images issued from the temporal integration means (14), yielding images of edges (22) of the object of interest;

combination means for combining the registered images (13) yielded by the registration means (12) and the images of edges (22) yielded by the filtering means (21), yielding images (42) of the registered object of interest with enhanced edges to the display means (54).

5. The system of claim 4, further comprising a second registering means and a second temporal integrating means (33a) for integrating the registered object of interest with enhanced edges and the moving background over at least two images (43) of the sequence, yielding images (43) of the registered object of interest with enhanced edges and faded background to the display means (54).

6. The system of claim 4, further comprising inverse registration means (31a, 31b) to restitute the motion of the object of interest, yielding to the display means (54) images (41, 44) of the object of interest moving with respect to the image referential.

7. The system of claim 6, wherein the inverse registration means (31b) to restitute the motion of the object of interest is applied to the images (43) of the registered object of interest with enhanced edges and faded background yielded by the second temporal integration means (33a), yielding to the display means (54) images (44) of the object of interest having enhanced edges, moving with respect to the image referential, and with faded background.

8. The system of claim 6, wherein the inverse registration means (31a) is applied to the images (22) of enhanced edges yielded by the spatial filter (21), to restitute the original motion to said enhanced edges, the system further comprising:

combination means (32a) for combining the original images (10) and the images of edges (22) with original motion, yielding to the display means (54) images (41) of the original object of interest with enhanced edges.

9. The system of claim 1, wherein the registration means (12) further comprises zooming means for zooming a registered object of interest.

10. The viewing system of claim 1, for dynamically displaying a sequence of medical images of a medical intervention that comprises moving and/or positioning a tool called balloon (64, 74), in an artery (81), said balloon and artery being considered as objects of interest, and said balloon being carried by a support called monorail (60, 70), to which at least two localizing features called balloon-markers (61,62;

71,72) are attached and located in correspondence with the extremities of the balloon, wherein;

the extracting means (11) extracts the balloon-markers considered as features related to the objects of interest, which balloon-markers pertain neither to the balloon nor to the artery;

the registering means (12) registers the balloon-markers and the related balloon and artery in the images (13);

the processing means, comprising at least temporal integration means (14) and sharp detail enhancement means (21), yield images of enhanced balloon and artery; and

;

the display means dynamically displays the images during the medical intervention for the user to visualized images of the balloon during its positioning in the artery, at a specific location of a portion of the artery, with respect to the balloon-marker extracted location.

11. The system of claim 1, for dynamically displaying a sequence of images of an intervention, which comprises moving and/or positioning a tool called stent (75a, 75b) wrapped around a balloon (74a, 74b) in an artery (81), said balloon, stent and artery being considered as objects of interest, which stent and balloon are carried by the monorail (70) to which at least two localizing features called balloon-markers (71,72) are attached and located in correspondence with the extremities of the balloon, wherein:

the extracting means (11) extracts the balloon-markers considered as features related to the objects of interest, which balloon-markers pertain neither to the balloon nor to the stent and nor to the artery;

the registering means (12) registers the balloon-markers and the related balloon, stent and artery in the images (13);

the processing means, comprising at least temporal integration means (14) and sharp detail enhancement means (21), yield images of enhanced balloon, stent and artery; and

;

the display means dynamically displays the images during the medical intervention for the user to visualize images of the balloon during its positioning in the artery, at a specific location of a portion of the artery, with respect to the balloon-marker extracted location.

the display means dynamically displays the images during the medical intervention for the user to visualize images of the balloon with the stent during their positioning in the artery, at a specific location of a portion of the artery, with respect to the balloon-marker extracted location, and for the user to further visualize images of the stent deployment during a stage of balloon inflation with an inflation product without or with substantially few contrast agent.

12. The system of claim 10, comprising:

selecting means for selecting an image of the sequence called reference image, and at least a marker called reference marker in the reference image related to an object of interest; and

system wherein;

the registering means (12) uses the marker location information in the reference image and in a current image of the sequence, for registering the marker and the related object of interest of the current image by matching the marker of the current image to the reference marker of the reference image.

13. A computer executable image processing method to be used in a system as claimed in claim 1, for dynamically visualizing in real time an object moving on a background.

14. A computer program product comprising a set of instructions for carrying out an image processing method to be used in a system as claimed in claim 1.

15. A medical examination imaging apparatus having means for acquiring a sequence of medical images and having a viewing system for processing and for displaying said sequence of images according to claim 1.