Forming and displaying a composite image

• US 9,216,065 B2
• Filed: 05/17/2010
• Issued: 12/22/2015
• Est. Priority Date: 03/08/2007
• Status: Active Grant

• Current Assignee: Sync-Rx, Ltd. (Koninklijke Philips N.V.)
• Original Assignee: Sync-Rx, Ltd. (Koninklijke Philips N.V.)
• Inventors: Cohen, Ran, Barzelay, Zohar, Klaiman, Eldad, Steinberg, Alexander
• Primary Examiner(s): Jung, Unsu
• Assistant Examiner(s): FISHER, MICHAEL NAPOLEON
• Application Number:
  US12/781,366
• Publication Number:
  US 20100222671A1
• Time in Patent Office: 2,045 Days
• Field of Search: 600/407, 600/416, 600/423, 600/425, 600/433, 600/437, 600/443, 600/466, 600/467, 382/128, 382/278, 382/285, 382/294
• US Class Current: 1/1
• CPC Class Codes: A61B 17/12036 partial occlusion
• CPC Class Codes: A61B 17/1204 temporary occlusion
• CPC Class Codes: A61B 17/12136 Balloons
• CPC Class Codes: A61B 18/02 by cooling, e.g. cryogenic techniques devices for cooling specific reflex points of the body within cell-life limits A61H39/06
• CPC Class Codes: A61B 18/1492 having a flexible, catheter-like structure, e.g. for heart ablation A61B18/1477 takes precedence
• CPC Class Codes: A61B 18/24 with a catheter A61B18/26, A61B18/28 take precedence
• CPC Class Codes: A61B 2017/00252 for by-pass connections, i.e. connections from heart chamber to blood vessel or from blood vessel to blood vessel
• CPC Class Codes: A61B 2017/00694 with means correcting for movement of or for synchronisation with the body
• CPC Class Codes: A61B 2017/00703 correcting for movement of heart, e.g. ECG-triggered
• CPC Class Codes: A61B 2017/1205 Introduction devices
• CPC Class Codes: A61B 2017/22044 with a pointed tip
• CPC Class Codes: A61B 2017/22094 for crossing total occlusions, i.e. piercing
• CPC Class Codes: A61B 2034/105 Modelling of the patient, e.g. for ligaments or bones
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2034/254 being adapted depending on the stage of the surgical procedure
• CPC Class Codes: A61B 2090/365 augmented reality, i.e. correlating a live optical image with another image
• CPC Class Codes: A61B 34/10 Computer-aided planning, simulation or modelling of surgical operations
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 5/0044 for the heart
• CPC Class Codes: A61B 5/7285 : for synchronising or triggering a physiological measurement or image acquisition with a physiological event or waveform, e.g. an ECG signal A61B6/5205, A61B6/541, A61B8/5207, A61B8/543 take precedence
• CPC Class Codes: A61B 5/7289 : Retrospective gating, i.e. associating measured signals or images with a physiological event after the actual measurement or image acquisition, e.g. by simultaneously recording an additional physiological signal during the measurement or image acquisition
• CPC Class Codes: A61B 6/12 : Arrangements for detecting or locating foreign bodies
• CPC Class Codes: A61B 6/469 : for selecting a region of interest [ROI]
• CPC Class Codes: A61B 6/481 : involving the use of contrast agents
• CPC Class Codes: A61B 6/501 : for diagnosis of the head, e.g. neuroimaging or craniography
• CPC Class Codes: A61B 6/503 : for diagnosis of the heart
• CPC Class Codes: A61B 6/504 : for diagnosis of blood vessels, e.g. by angiography
• CPC Class Codes: A61B 6/5217 : extracting a diagnostic or physiological parameter from medical diagnostic data
• CPC Class Codes: A61B 6/5247 : combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
• CPC Class Codes: A61B 6/541 : involving acquisition triggered by a physiological signal
• CPC Class Codes: A61B 8/0883 : for diagnosis of the heart
• CPC Class Codes: A61B 8/0891 : for diagnosis of blood vessels
• CPC Class Codes: A61B 8/543 : involving acquisition triggered by a physiological signal
• CPC Class Codes: A61F 2/958 : Inflatable balloons for placing stents or stent-grafts
• CPC Class Codes: G06T 11/60 : Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 2207/10121 : Fluoroscopy
• CPC Class Codes: G06T 2207/30048 : Heart; Cardiac
• CPC Class Codes: G06T 2207/30101 : Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 5/00 : Image enhancement or restoration
• CPC Class Codes: G06T 7/0012 : Biomedical image inspection
• CPC Class Codes: G06T 7/0014 : using an image reference approach
• CPC Class Codes: G06T 7/13 : Edge detection
• CPC Class Codes: G06T 7/246 : using feature-based methods, e.g. the tracking of corners or segments
• CPC Class Codes: G06T 7/62 : of area, perimeter, diameter or volume
• CPC Class Codes: G06V 2201/034 : of medical instruments
• CPC Class Codes: G06V 40/103 : Static body considered as a whole, e.g. static pedestrian or occupant recognition
• CPC Class Codes: G16H 50/30 : for calculating health indices; for individual health risk assessment

Abstract

Apparatus and methods are described including acquiring a plurality of image frames of a portion of a subject'"'"'s body. At least one of the image frames is designated as a baseline image frame, a shape of the portion in the first baseline image frame being designated as a baseline shape. A non-baseline-shape image frame is deformed, such that the shape of the portion becomes more similar to the baseline shape of the portion than when the portion in the non-baseline-shape image frame is not deformed. A composite image is formed that is of higher clarity with respect to anatomy of the portion, relative to each of the acquired image frames, by averaging at least the deformed non-baseline-shape image frame with the baseline image frame. The composite image is displayed on a display. Other applications are also described.

Claims

1. Apparatus for use with a portion of a subject'"'"'s body that assumes a plurality of different shapes, the apparatus comprising:

an image-acquisition device configured to acquire a plurality of image frames of the portion of the subject'"'"'s body;

a display; and

at least one computer processor, configured to;

receive the image frames,

designate at least one of the image frames as a first baseline image frame, a shape of the portion in the first baseline image frame being designated as a first baseline shape of the portion,

identify the portion within a first non-baseline-shape image frame of the plurality of image frames, the portion not being shaped in the first baseline shape within the first non-baseline-shape image frame,

deform the first non-baseline-shape image frame by deforming the shape of the portion in the first non-baseline-shape image frame, such that the shape of the portion becomes more similar to the first baseline shape of the portion than when the portion in the non-baseline-shape image frame is not deformed,

form at least a first composite image that is of higher clarity with respect to anatomy of the portion, relative to each of the acquired image frames, by averaging at least the deformed first non-baseline-shape image frame with the first baseline image frame, and

drive the display to display the first composite image.

2. The apparatus according to claim 1, wherein the processor is configured to:

designate at least one of the image frames as a second baseline image frame, a shape of the portion in the second baseline image frame being designated as a second baseline shape of the portion,

identify the portion within a second non-baseline-shape image frame of the plurality of image frames, the portion not being shaped in the second baseline shape within the second non-baseline-shape image frame,

deform the second non-baseline-shape image frame by deforming the shape of the portion in the second non-baseline-shape image frame, such that the shape of the portion becomes more similar to the second baseline shape of the portion than when the portion in the second non-baseline image frame is not deformed,

form a second composite image that is of higher clarity with respect to the anatomy of the portion, relative to each of the acquired image frames, by averaging the deformed second non-baseline-shape image frame with the second baseline image frame, and

drive the display to display the first and second composite images as an image stream.

3. The apparatus according to claim 1, wherein the portion of subject'"'"'s body includes a portion of the subject'"'"'s body that undergoes cyclic motion, wherein the apparatus is for use with a tool that is configured to be inserted into the portion of the subject'"'"'s body, and wherein the computer processor is further configured to:

determine an extent of movement of the tool with respect to the portion of the body that is due to the cyclic motion of the portion of the body; and

in response thereto, generate an output that is indicative of the determined extent of the movement of the tool with respect to the portion of the body.

4. A method for use with a portion of a subject'"'"'s body that assumes a plurality of different shapes, the method comprising:

using an image acquisition device, acquiring a plurality of image frames of the portion of the subject'"'"'s body;

using at least one computer processor, designating at least one of the image frames as a first baseline image frame, a shape of the portion in the first baseline image frame being designated as a first baseline shape of the portion;

using the processor, identifying the portion within a first non-baseline-shape image frame of the plurality of image frames, the portion not being shaped in the first baseline shape within the first non-baseline-shape image frame;

using the processor, deforming the first non-baseline-shape image frame by deforming the shape of the portion in the first non-baseline-shape image frame, such that the shape of the portion becomes more similar to the first baseline shape of the portion than when the portion in the non-baseline-shape image frame is not deformed;

using the processor, forming at least a first composite image that is of higher clarity with respect to anatomy of the portion, relative to each of the acquired image frames, by averaging at least the deformed first non-baseline-shape image frame with the first baseline image frame; and

using a display, displaying the first composite image.

5. The method according to claim 4,

further comprising:

using the processor, designating at least one of the image frames as a second baseline image frame, a shape of the portion in the second baseline image frame being designated as a second baseline shape of the portion;

using the processor, identifying the portion within a second non-baseline-shape image frame of the plurality of image frames, the portion not being shaped in the second baseline shape within the second non-baseline-shape image frame;

using the processor, deforming the second non-baseline-shape image frame by deforming the shape of the portion in the second non-baseline-shape image frame, such that the shape of the portion becomes more similar to the second baseline shape of the portion than when the portion in the second non-baseline image frame is not deformed; and

using the processor, forming a second composite image that is of higher clarity with respect to the anatomy of the portion, relative to each of the acquired image frames, by averaging the deformed second non-baseline-shape image frame with the second baseline image frame,

wherein displaying the output comprises displaying the first and second composite images as an image stream.

6. The method according to claim 4, wherein the portion of subject'"'"'s body includes a portion of the subject'"'"'s body that undergoes cyclic motion, wherein the method is for use with a tool that is configured to be inserted into the portion of the subject'"'"'s body, and wherein the method further comprises, using at least one computer processor:

determining an extent of movement of the tool with respect to the portion of the body that is due to the cyclic motion of the portion of the body; and

in response thereto, generating an output that is indicative of the determined extent of the movement of the tool with respect to the portion of the body.