Luminal background cleaning

• US 9,305,334 B2
• Filed: 06/21/2012
• Issued: 04/05/2016
• Est. Priority Date: 03/08/2007
• Status: Active Grant

• Current Assignee: Sync-Rx, Ltd. (Koninklijke Philips N.V.)
• Original Assignee: Sync-Rx, Ltd. (Koninklijke Philips N.V.)
• Inventors: Barzelay, Zohar, Cohen, Ran, Tolkowsky, David
• Primary Examiner(s): Liu, Li
• Application Number:
  US14/128,243
• Publication Number:
  US 20140140597A1
• Time in Patent Office: 1,384 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: A61B 6/481 involving the use of contrast agents
• CPC Class Codes: A61B 6/504 for diagnosis of blood vessels, e.g. by angiography
• CPC Class Codes: A61B 6/52 Devices using data or image processing specially adapted for radiation diagnosis
• CPC Class Codes: A61B 6/5235 combining images from the same or different ionising radiation imaging techniques, e.g. PET and CT
• CPC Class Codes: A61B 6/5258 involving detection or reduction of artifacts or noise
• CPC Class Codes: G06T 2207/10116 X-ray image
• CPC Class Codes: G06T 2207/20212 Image combination
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 5/00 Image enhancement or restoration
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 5/92 based on global image properties

Abstract

Apparatus and methods are described for use with an input angiogram image of a device inserted inside a portion of subject'"'"'s body, the angiogram image being acquired in the presence of contrast agent. At least one processor (11) includes background-image-generation functionality (13) configured to generate a background image in which a relative value is assigned to a first pixel with respect to a second pixel, at least partially based upon relative values of surroundings of the first pixel and the surroundings of the second pixel in the input image. Cleaned-image-generation functionality (14) generates a cleaned image in which visibility of the radiopaque portions of the device is increased relative to the input image, by dividing the input image by the background image. Output-generation functionality (15) drives a display (16) to display an output based upon the cleaned image. Other applications are also described.

Claims

1. Apparatus for use with at least one input angiogram image of a device inserted inside a portion of a body of a subject, the device including radiopaque portions thereof, the angiogram image being acquired in the presence of contrast agent within the body portion, the apparatus comprising:

a display; and

at least one processor configured;

to generate a background image in which a relative pixel value is assigned to a first pixel with respect to a second pixel, at least partially based upon relative pixel values of a patch of pixels that surround a first pixel of the input angiogram image that is disposed at the same location as the first pixel of the background image and a patch of pixels that surround a second pixel of the input angiogram image that is disposed at the same location as the second pixel of the background image;

to generate a cleaned image in which visibility of the radiopaque portions of the device is increased relative to the input angiogram image, by dividing the input angiogram image by the background image; and

to drive the display to display an output based upon the cleaned image.

2. The apparatus according to claim 1, wherein the processor is configured to generate the background image by:

in the background image, assigning pixel values to the first pixel and the second pixel that are more similar to one another, than the similarity of pixel values that are assigned to a third pixel and a fourth pixel,

based upon the patch of pixels that surround the first pixel of the input angiogram image and the patch of pixels that surround the second pixel of the input angiogram image having more similar pixel values to one another, than a similarity, to one another, of pixel values of a patch of pixels that surround a third pixel of the input angiogram image that is disposed at the same location as the third pixel of the background image and a patch of pixels that surround a fourth pixel of the input angiogram image that is disposed at the same location as the fourth pixel of the background image.

3. The apparatus according to claim 1, wherein the processor is further configured to generate the background image by assigning pixel values to the first and second pixels of the background image based upon pixel values of the first pixel and the second pixel of the input angiogram image.

4. The apparatus according to claim 1, wherein the processor is configured to drive the display to display the cleaned image.

5. The apparatus according to claim 1, wherein:

the input angiogram image of the device includes a plurality of input angiogram images of the device, and

the processor is configured to;

generate a plurality of cleaned images, the cleaned images corresponding to respective input angiogram images,

generate a stabilized image stream by image tracking the cleaned images with respect to each other, based upon locations of the radiopaque portions of the device in the cleaned images, and

drive the display to display the stabilized image stream.

6. The apparatus according to claim 1, wherein:

the input angiogram image of the device includes a plurality of input angiogram images of the device, and

the processor is configured to;

generate a plurality of cleaned images, the cleaned images corresponding to respective input angiogram images,

generate a stabilized image stream by image tracking the input images with respect to each other, based upon locations of the radiopaque portions of the device in the corresponding cleaned images, and

drive the display to display the stabilized image stream.

7. The apparatus according to claim 1, wherein:

the input angiogram image of the device includes a plurality of input angiogram images of the device, and

the processor is configured to;

generate a plurality of cleaned images, the cleaned images corresponding to respective input angiogram images,

generate an enhanced image frame by;

aligning the cleaned images with each other, based upon locations of the radiopaque portions of the device in the cleaned images, and

generating an averaged image frame based upon the aligned images, and

drive the display to display the enhanced image frame.

8. The apparatus according to claim 1, wherein:

the input angiogram image of the device includes a plurality of input angiogram images of the device, and

the processor is configured to;

generate a plurality of cleaned images, the cleaned images corresponding to respective input angiogram images,

generate an enhanced image frame by;

aligning the input images with each other, based upon locations of the radiopaque portions of the device in the corresponding cleaned images, and

generating an averaged image frame based upon the aligned images, and

drive the display to display the enhanced image frame.

9. The apparatus according to claim 1, wherein:

the portion of the subject'"'"'s body includes a lumen of the subject'"'"'s body,

the device includes an endoluminal data-acquisition device configured to acquire endoluminal data points while the device is at respective locations within the lumen, and

the processor is configured;

based upon locations of the radiopaque portions of the device in the cleaned image, to determine that a given one of the endoluminal data points corresponds to a given location within the lumen, and

to drive the display to display an output, in response to the determining.

10. The apparatus according to claim 1, wherein:

the portion of the subject'"'"'s body includes a lumen of the subject'"'"'s body,

the device includes an endoluminal device configured to be moved through the lumen, and

the processor is configured;

based upon locations of the radiopaque portions of the device in the cleaned image, to determine that the endoluminal device is at a given location within the lumen, and

in response to the determining that the endoluminal device is at the given location within the lumen, to drive the display to display an endoluminal image of the lumen corresponding to the location.

11. A method for use with at least one input angiogram image of a device inserted inside a portion of a body of a subject, the device including radiopaque portions thereof, the angiogram image being acquired in the presence of contrast agent within the body portion, the method comprising:

generating, with a processor, a background image in which a relative pixel value is assigned to a first pixel with respect to a second pixel, at least partially based upon relative pixel values of a patch of pixels that surround a first pixel of the input angiogram image that is disposed at the same location as the first pixel of the background image and a patch of pixels that surround a second pixel of the input angiogram image that is disposed at the same location as the second pixel of the background image;

generating, with the processor, a cleaned image in which visibility of the radiopaque portions of the device is increased relative to the input angiogram image, by dividing the input angiogram image by the background image; and

generating an output on a display, based upon the cleaned image.

12. The method according to claim 11, wherein generating the background image comprises:

in the background image, assigning pixel values to the first pixel and the second pixel that are more similar to one another, than the similarity of pixel values that are assigned to a third pixel and a fourth pixel,

based upon the patch of pixels that surround the first pixel of the input angiogram image and the patch of pixels that surround the second pixel of the input angiogram image having more similar pixel values to one another, than a similarity, to one another, of pixel values of a patch of pixels that surround a third pixel of the input angiogram image that is disposed at the same location as the third pixel of the background image and a patch of pixels that surround a fourth pixel of the input angiogram image that is disposed at the same location as the fourth pixel of the background image.

13. The method according to claim 11, wherein generating the background image further comprises assigning pixel values to the first and second pixels of the background image based upon pixel values of the first pixel and the second pixel of the input angiogram image.

14. The method according to claim 11, wherein generating the output comprises displaying the cleaned image.

15. The method according to claim 11,

wherein the input angiogram image of the device includes a plurality of input angiogram images of the device,

wherein generating the cleaned image comprises generating a plurality of cleaned images, the cleaned images corresponding to respective input angiogram images,

the method further comprising generating a stabilized image stream by image tracking the cleaned images with respect to each other, based upon locations of the radiopaque portions of the device in the cleaned images, and

wherein generating the output comprises displaying the stabilized image stream.

16. The method according to claim 11,

wherein the input angiogram image of the device includes a plurality of input angiogram images of the device,

wherein generating the cleaned image comprises generating a plurality of cleaned images, the cleaned images corresponding to respective input angiogram images,

the method further comprising generating a stabilized image stream by image tracking the input images with respect to each other, based upon locations of the radiopaque portions of the device in the corresponding cleaned images, and

wherein generating the output comprises displaying the stabilized image stream.

17. The method according to claim 11,

wherein the input angiogram image of the device includes a plurality of input angiogram images of the device,

wherein generating the cleaned image comprises generating a plurality of cleaned images, the cleaned images corresponding to respective input angiogram images,

the method further comprising generating an enhanced image frame by:

aligning the cleaned images with each other, based upon locations of the radiopaque portions of the device in the cleaned images, and

generating an averaged image frame based upon the aligned cleaned images, and

wherein generating the output comprises displaying the enhanced image frame.

18. The method according to claim 11,

wherein the input angiogram image of the device includes a plurality of input angiogram images of the device,

wherein generating the cleaned image comprises generating a plurality of cleaned images, the cleaned images corresponding to respective input angiogram images,

the method further comprising generating an enhanced image frame by:

aligning the input images with each other, based upon locations of the radiopaque portions of the device in the corresponding cleaned images, and

generating an averaged image frame based upon the aligned input images, and

wherein generating the output comprises displaying the enhanced image frame.

19. The method according to claim 11,

wherein the portion of the subject'"'"'s body includes a lumen of the subject'"'"'s body,

wherein the device includes an endoluminal data-acquisition device configured to acquire endoluminal data points while the device is at respective locations within the lumen,

the method further comprising, based upon locations of the radiopaque portions of the device in the cleaned image, determining that a given one of the endoluminal data points corresponds to a given location within the lumen, and

wherein generating the output comprises generating the output in response to the determining.

20. The method according to claim 11,

wherein the portion of the subject'"'"'s body includes a lumen of the subject'"'"'s body,

wherein the device includes an endoluminal device configured to be moved through the lumen,

the method further comprising, based upon locations of the radiopaque portions of the device in the cleaned image, determining that the endoluminal device is at a given location within the lumen, and

wherein generating the output comprises, in response to the determining that the endoluminal device is at the given location within the lumen, generating an endoluminal image of the lumen corresponding to the location.