Medical viewing system and method for enhancing structures in noisy images

• US 7,415,169 B2
• Filed: 11/20/2002
• Issued: 08/19/2008
• Est. Priority Date: 11/30/2001
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Florent, Raoul, Rongen, Peter Maria Johannes, Lelong, Pierre, Nosjean, Lucile
• Primary Examiner(s): Bella; Matthew C.
• Assistant Examiner(s): CHU, RANDOLPH I
• Application Number:
  US10/496,554
• Publication Number:
  US 20050002546A1
• Time in Patent Office: 2,099 Days
• Field of Search: 382/130, 382/284, 382/294, 382/287, 623/1.11, 606/7
• US Class Current: 382/294
• CPC Class Codes: A61B 2017/22001 Angioplasty, e.g. PCTA
• CPC Class Codes: A61B 2090/376 using X-rays, e.g. fluoroscopy
• CPC Class Codes: A61B 6/12 Arrangements for detecting or locating foreign bodies
• CPC Class Codes: A61B 90/36 Image-producing devices or illumination devices not otherwise provided for
• CPC Class Codes: G06T 2207/10121 Fluoroscopy
• CPC Class Codes: G06T 2207/20182 Noise reduction or smoothing in the temporal domain; Spatio-temporal filtering
• CPC Class Codes: G06T 2207/20192 Edge enhancement; Edge preservation
• CPC Class Codes: G06T 2207/30048 Heart; Cardiac
• CPC Class Codes: G06T 2207/30052 Implant; Prosthesis
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/70 Denoising; Smoothing
• CPC Class Codes: G06T 5/73 Deblurring; Sharpening
• CPC Class Codes: G06T 7/33 using feature-based methods

Abstract

A viewing system and method for enhancing objects of interest represented on a moving background in a sequence of noisy images and for displaying the sequence of enhanced images, comprising extracting means (11) for extracting features related to an object of interest in images of the sequence; registering means (12) for registering the features related to the object of interest with respect to the image referential, yielding registered images (13); similarity detection means for determining the resemblance of the representations of a registered object of interest in succeeding images and weighing means for modulating the intensities of the pixels of said object of interest over the images of the sequence; temporal integrating means (14, 33b) for integrating the object of interest and the background over a number, or at least two, registered images (13) of the sequence; and display means (54) for displaying the processed images (15, 45) of the enhanced registered object of interest on faded background. Application: Medical Imaging. X-ray Fluoroscopic Imaging.

Claims

1. A viewing system for enhancing objects of interest represented on a moving background in a sequence of noisy images and for displaying the sequence of enhanced images, including acquisition means for acquiring the sequence of images and processing means for processing the images comprising extracting means for extracting features related to an object of interest on a background in images of the sequence having an image referential, said processing means further comprising:

a first registering means, yielding registered images, for registering the features related to the object of interest with respect to the image referential, while not registering the background;

a first temporal integration means for integrating both the object of interest and the background over at least two registered images of the sequence;

a second registering means and a second temporal integrating means for integrating the registered object of interest with enhanced edges and the moving background over at least two images of the sequence, yielding images of the registered object of interest with enhanced edges and faded background to the display means and display means for displaying the processed images of the enhanced registered object of interest on faded background.

2. The system of claim 1, having control means for a user to activate the processing means, control duration of the processing means, or stop the processing means at a selected stage in the sequence of images.

3. The system of one of claim 1, wherein the processing means further comprises:

similarity detection means for determining resemblance information in one or more representations of a registered object of interest in succeeding images; and

weighing means using said resemblance information for modulating the intensities of the pixels of said object of interest over the images of the sequence, during temporal integration by the temporal integration means.

4. The system of one of claim 1, wherein the processing means further comprises:

enhancement means for spatially enhancing sharp details in the images issued from the temporal integration means (14), yielding images of edges of the object of interest;

combination means for combining the registered images yielded by the first and second registration means and the images of edges yielded by a filtering means, yielding images of the registered object of interest with enhanced edges to the display means.

5. The system of claim 4, further comprising inverse registration means to restitute the motion of the object of interest, yielding to the display means images of the object of interest moving with respect to the image referential.

6. The system of claim 5, wherein the inverse registration means to restitute the motion of the object of interest is applied to the images of the registered object of interest with enhanced edges and faded background yielded by the second temporal integration means, yielding to the display means images of the object of interest having enhanced edges, moving with respect to the image referential, and with faded background.

7. The system of claim 5, wherein the inverse registration means is applied to the images of enhanced edges yielded by the spatial filter, to restitute the original motion to said enhanced edges, the system further comprising:

combination means for combining the original images and the images of edges with original motion, yielding to the display means images of the original object of interest with enhanced edges.

8. The system of claim 1, wherein the first registration means further comprises zooming means for zooming a registered object of interest.

9. The viewing system of claim 1, for dynamically displaying a sequence of medical images of a medical intervention that comprises moving and/or positioning a tool called balloon, in an artery, said balloon and artery being considered as objects of interest, and said balloon being carried by a support called monorail, to which at least two localizing features called balloon-markers are attached and located in correspondence with the extremities of the balloon, wherein:

the extracting means extracts the balloon-markers considered as features related to the objects of interest, which balloon-markers pertain neither to the balloon nor to the artery;

the registering means registers the balloon-markers and the related balloon and artery in the images;

the processing means, comprising at least temporal integration means and sharp detail enhancement means, yield images of enhanced balloon and artery; and

;

the display means dynamically displays the images during the medical intervention for the user to visualized images of the balloon during its positioning in the artery, at a specific location of a portion of the artery, with respect to the balloon-marker extracted location.

10. The system of claim 1, for dynamically displaying a sequence of images of an intervention, which comprises moving and/or positioning a tool called stent wrapped around a balloon in an artery, said balloon, stent and artery being considered as objects of interest, which stent and balloon are carried by the monorail to which at least two localizing features called balloon-markers are attached and located in correspondence with the extremities of the balloon, wherein:

the extracting means extracts the balloon-markers considered as features related to the objects of interest, which balloon-markers pertain neither to the balloon nor to the stent and nor to the artery;

the registering means registers the balloon-markers and the related balloon, stent and artery in the images;

the processing means, comprising at least temporal integration means and sharp detail enhancement means, yield images of enhanced balloon, stent and artery; and

;

the display means dynamically displays the images during the medical intervention for the user to visualize images of the balloon during its positioning in the artery, at a specific location of a portion of the artery, with respect to the balloon-marker extracted location;

the display means dynamically displays the images during the medical intervention for the user to visualize images of the balloon with the stent during their positioning in the artery, at a specific location of a portion of the artery, with respect to the balloon-marker extracted location, and for the user to further visualize images of the stent deployment during a stage of balloon inflation with an inflation product without or with substantially few contrast agent.

11. The system of claim 9, comprising:

selecting means for selecting an image of the sequence called reference image, and at least a marker called reference marker in the reference image related to an object of interest; and

system wherein;

the first registering means uses the marker location information in the reference image and in a current image of the sequence, for registering the marker and the related object of interest of the current image by matching the marker of the current image to the reference marker of the reference image.

14. A medical examination imaging apparatus having means for acquiring a sequence of medical images and having a viewing system for processing and for displaying said sequence of images according to claim 1.

12. A computer executable image processing method, for enhancing objects of interest represented on a moving background in a sequence of noisy images, for displaying the sequence of enhanced images, for acquiring the sequence of images, for processing the images, and for extracting features related to an object of interest on a background in images of the sequence having an image referential, the method comprising acts of:

registering the features related to the object of interest with respect to the image referential, while not registering the background, yielding registered images;

temporally integrating both the object of interest and the background over at least two registered images of the sequence;

registering and temporally integrating the registered object of interest with enhanced edges and the moving background over at least two images of the sequence, yielding processed images of the registered object of interest with enhanced edges and faded background; and

displaying the processed images of the enhanced registered object of interest on faded background.

13. A computer readable medium having processor-executable instructions thereon which, when executed by a processor, direct the processor to carry out an image processing method for enhancing objects of interest represented on a moving background in a sequence of noisy images, for displaying the sequence of enhanced images, for acquiring the sequence of images, for processing the images, and for extracting features related to an abject of interest on a background in images of the sequence having an image referential, the processor-executable instructions comprising:

a portion for registering the features related to the object of interest with respect to the image referential, while not registering the background, yielding registered images;

a portion for temporally integrating both the object of interest and the background over at least two registered images of the sequence;

a portion for registering and temporally integrating the registered object of interest with enhanced edges and the moving background over at least two images of the sequence, yielding processed images of the registered object of interest with enhanced edges and faded background; and

a portion for providing the processed images of the enhanced registered object of interest on faded background to a display device for displaying.