Image super enhancement

• US 9,974,509 B2
• Filed: 09/08/2011
• Issued: 05/22/2018
• Est. Priority Date: 11/18/2008
• Status: Active Grant

• Current Assignee: Sync-Rx, Ltd. (Koninklijke Philips N.V.)
• Original Assignee: Sync-Rx, Ltd. (Koninklijke Philips N.V.)
• Inventors: Steinberg, Alexander, Philipp, Sagiv, Cohen, Ran, Tolkowsky, David
• Primary Examiner(s): Moher, Amanda Lauritzen
• Assistant Examiner(s): Gupta, Vani
• Application Number:
  US13/228,335
• Publication Number:
  US 20110319752A1
• Time in Patent Office: 2,448 Days
• Field of Search: 600407-480, 328128
• CPC Class Codes: A61B 2017/00252 for by-pass connections, i.e. connections from heart chamber to blood vessel or from blood vessel to blood vessel
• CPC Class Codes: A61B 2017/00694 with means correcting for movement of or for synchronisation with the body
• CPC Class Codes: A61B 2017/00703 correcting for movement of heart, e.g. ECG-triggered
• CPC Class Codes: A61B 2017/22044 with a pointed tip
• CPC Class Codes: A61B 2017/22094 for crossing total occlusions, i.e. piercing
• CPC Class Codes: A61B 2034/2065 Tracking using image or pattern recognition
• CPC Class Codes: A61B 2090/364 Correlation of different images or relation of image positions in respect to the body
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 6/12 Arrangements for detecting or locating foreign bodies
• CPC Class Codes: A61B 6/503 for diagnosis of the heart
• CPC Class Codes: A61B 6/504 for diagnosis of blood vessels, e.g. by angiography
• CPC Class Codes: A61B 6/5217 extracting a diagnostic or physiological parameter from medical diagnostic data
• CPC Class Codes: A61B 6/541 involving acquisition triggered by a physiological signal
• CPC Class Codes: A61B 8/0891 for diagnosis of blood vessels
• CPC Class Codes: A61F 2/82 Devices providing patency to, or preventing collapsing of, tubular structures of the body, e.g. stents stent-grafts for tubular structures of the body other than blood vessels A61F2/04; stent-grafts for blood vessels A61F2/07; instruments specially adapted for placement or removal of stents or stent-grafts A61F2/95; for closing wounds, or holding wounds closed A61B17/04 - A61B17/115; dilators A61M29/00
• CPC Class Codes: A61F 2/958 Inflatable balloons for placing stents or stent-grafts
• CPC Class Codes: A61F 2250/0098 radio-opaque, e.g. radio-opaque markers
• CPC Class Codes: G16H 50/30 for calculating health indices; for individual health risk assessment

Abstract

Apparatus and methods are provided for imaging a tool inside a portion of a subject'"'"'s body that undergoes motion. A plurality of image frames of the portion are acquired. An image frame in which the tool is enhanced is generated by (a) identifying radiopaque markers in the image frames, (b) identifying edge lines in a vicinity of the markers within the image frames, the edge lines corresponding to contours of the tool, (c) in response to the identifying of the edge lines, selecting a subset of the image frames that are based upon the acquired image frames, based upon a level of similarity between the edge lines in the selected image frames to one another, (d) aligning the contours in a plurality of the selected image frames, and (e) averaging the plurality of aligned frames to generate an averaged image frame. Other applications are also described.

Claims

1. A method for imaging a tool inside a portion of a body of a subject that undergoes motion, the tool having contours and the tool having one or more radiopaque markers coupled thereto, the method comprising:

acquiring a plurality of image frames of the portion of the subject'"'"'s body, wherein the tool comprises an endoluminal tool such that the plurality of image frames include the endoluminal tool within the portion of the subject'"'"'s body; and

using at least one computer processor, generating at least one image frame in which the tool is enhanced, by;

identifying edge lines that correspond to contours of the tool in the image frames;

in response to identifying the edge lines that correspond to contours of the tool;

determining similarities between the edge lines within the image frames to one another; and

selecting a subset of the image frames that are based upon the acquired image frames, at least partially based upon a level of similarity between the edge lines in the selected image frames to one another, the selecting comprising rejecting from being included in the subset, at least one image frame in which edge lines corresponding to the contours of the tool appear, wherein the at least one image frame that is rejected is one of the plurality of image frames including the endoluminal tool within the portion of the subject'"'"'s body;

aligning the contours in a plurality of the selected image frames, and

averaging the plurality of aligned frames to generate an averaged image frame, such that only image frames belonging to the subset of image frames are included in the averaged image frame; and

displaying the averaged image frame.

2. The method according to claim 1, wherein selecting the subset of image frames comprises selecting a subset of image frames based upon a level of similarity between shapes of the edge lines in the image frames.

3. The method according to claim 1, further comprising identifying one or more radiopaque markers that are coupled to the device within the image frames, wherein selecting the subset of image frames comprises selecting a subset of image frames based upon a level of alignment between the edge lines and the radiopaque markers in the image frames.

4. The method according to claim 1, wherein aligning the contours in the plurality of selected image frames comprises translating at least one image frame with respect to at least one other image frame of the selected image frames.

5. The method according to claim 1, wherein generating the at least one image frame in which the tool is enhanced comprises generating a plurality of image frames in which the tool is enhanced, and wherein displaying the averaged image frame comprises displaying, as an image stream, the plurality of image frames in which the tool is enhanced.

6. The method according to claim 1,

wherein the tool includes a stent and a device, the stent being configured to be inserted into the lumen while disposed on the device, and

wherein identifying edge lines that correspond to contours of the tool in the image frames comprises:

identifying radiopaque markers that are coupled to the device, and

identifying edge lines that correspond to contours of the stent by identifying curved edge lines, which are within a given distance of the radiopaque markers.

7. The method according to claim 6, wherein selecting the subset of image frames comprises selecting a subset of image frames based upon a level of similarity between shapes of the curved edge lines in the image frames.

8. The method according to claim 6, further comprising identifying first and second radiopaque markers that are coupled to the device within the image frames, and wherein selecting the subset of image frames comprises selecting a subset of image frames based upon a level of alignment between the edge lines and an imaginary line running from the first marker to the second marker in the image frames.

9. Apparatus for use with a tool configured to be placed inside a portion of a body of a subject that undergoes motion, the tool having contours and the tool having one or more radiopaque markers coupled thereto, the apparatus comprising:

an image-acquisition device configured to acquire a plurality of image frames of the portion of subject'"'"'s body, wherein the tool comprises an endoluminal tool such that the plurality of image frames include the endoluminal tool within the portion of the subject'"'"'s body;

a display; and

at least one computer processor configured to generate at least one image frame in which the tool lanced by;

receiving the plurality of image frames into the processor, identifying edge lines that correspond to contours of the tool, in response to identifying the edge lines that correspond to contours of the tool;

determining similarities between the edge lines within the image frames to one another, and

selecting a subset of the image frames that are based upon the acquired image frames, at least partially based upon a level of similarity between the edge lines in the selected image frames to one another, the selecting comprising rejecting from being included in the subset, at least one image frame in which edge lines corresponding to the contours of the tool appear, wherein the at least one image frame that is rejected is one of the plurality of image frames including the endoluminal tool within the portion of the subject'"'"'s body;

aligning the edge lines in a plurality of the selected image frames, and

generating an averaged image frame by averaging the plurality of aligned image frames, such that only image frames belonging to the subset of image frames are included in the averaged image frame; and

driving the display to display the averaged image frame.

10. The apparatus according to claim 9, wherein the processor is configured to select the subset of image frames based upon a level of similarity between shapes of the edge lines in the image frames.

11. The apparatus according to claim 9, wherein the processor is configured to identify one or more radiopaque markers that are coupled to the device within the image frames, and to select the subset of image frames based upon a level of alignment between the edge lines and the radiopaque markers in the image frames.

12. The apparatus according to claim 9, wherein the processor is configured to align the edge lines in the selected image frames by translating at least one image frame with respect to at least one other image frame of the selected image frames.

13. The apparatus according to claim 9, wherein the processor is configured to generate a plurality of image frames in which the tool is enhanced, and wherein the processor is configured to drive the display to display, as an image stream, the plurality of image frames in which the tool is enhanced.

14. The apparatus according to claim 9, wherein the tool includes a stent and a device, the stent being configured to be inserted into the lumen while disposed on the device, wherein the processor is configured to identify radiopaque markers that are coupled to the device, and wherein the processor is configured to identify the edge lines that correspond to contours of the stent at least partially by identifying curved edge lines, which are within a given distance from the radiopaque markers.

15. The apparatus according to claim 14, wherein the processor is configured to select the subset of image frames based upon a level of similarity between shapes of the curved edge lines in the image frames.

16. The apparatus according to claim 14, wherein the processor is configured to identify first and second radiopaque markers that are coupled to the device, and wherein the processor is configured to select the subset of image frames based upon a level of alignment between the edge lines and an imaginary line running from the first marker to the second marker in the image frames.

17. Apparatus for use with a tool configured to be placed inside a portion of a body of a subject that undergoes motion, the tool having contours and the tool having one or more radiopaque markers coupled thereto, and an image-acquisition device configured to acquire a plurality of image frames of the portion of the subject'"'"'s body, wherein the tool comprises an endoluminal tool such that the plurality of image frames include the endoluminal tool within the portion of the subject'"'"'s body, the apparatus comprising:

a display; and

at least one computer processor configured to generate at least one image frame in which the tool is enhanced by;

receiving the plurality of image frames into the processor,

identifying edge lines that correspond to contours of the tool,

in response to identifying the edge lines that correspond to contours of the tool;

determining similarities between the edge lines within the image frames to one another, and

selecting a subset of the image frames that are based upon the acquired image frames, at least partially based upon a level of similarity between the edge lines in the selected image frames to one another, the selecting comprising rejecting from being included in the subset, at least one image frame in which edge lines corresponding to the contours of the tool appear, wherein the at least one image frame that is rejected is one of the plurality of image frames including the endoluminal tool within the portion of the subject'"'"'s body;

aligning the edge lines in a plurality of the selected image frames, and

generating an averaged image frame by averaging the plurality of aligned image frames, such that only image frames belonging to the subset of image frames are included in the averaged image frame; and

driving the display to display the averaged image frame.