MOTION-BASED IMAGE SEGMENTATION SYSTEMS AND METHODS

• US 20170330331A1
• Filed: 05/15/2017
• Published: 11/16/2017
• Est. Priority Date: 05/16/2016
• Status: Active Grant

• Current Assignee: ACIST Medical Systems Incorporated (Bracco SPA)
• Original Assignee: ACIST Medical Systems Incorporated (Bracco SPA)
• Inventors: Bhatt, Advit, Vlaanderen, Wouter, Suh, Jung Wook
• Granted Patent: US 10,489,919 B2
• Time in Patent Office: Days
• CPC Class Codes: A61B 5/02007 Evaluating blood vessel condition, e.g. elasticity, compliance
• CPC Class Codes: A61B 8/12 in body cavities or body tracts, e.g. by using catheters catheters per se A61M25/00
• CPC Class Codes: G06T 2207/10132 Ultrasound image
• CPC Class Codes: G06T 2207/20021 Dividing image into blocks, subimages or windows
• CPC Class Codes: G06T 2207/30101 Blood vessel; Artery; Vein; Vascular
• CPC Class Codes: G06T 7/174 involving the use of two or more images
• CPC Class Codes: G06T 7/215 Motion-based segmentation
• CPC Class Codes: G06T 7/223 using block-matching
• CPC Class Codes: G16H 20/00 ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
• CPC Class Codes: G16H 20/10 relating to drugs or medications, e.g. for ensuring correct administration to patients
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

Methods and systems are disclosed for segmenting an image. First and second frames of image data are generated at different times. A first portion of the first frame is compared to image data of the second frame, and a second portion of the second frame is selected based on the comparison. A displacement vector between the first portion and the second portion is calculated, where the displacement vector represents relative movement over time between the image data represented by the first portion and the image data represented by the second portion. An image is output with an indicator, and the location of the indicator on the image is determined by using the calculated displacement vector. The indicator can serve to distinguish between items in an imaging view.

Claims

1. A method of segmenting an image, the method comprising the steps of:

generating a first frame of image data representing a plurality of items in an imaging view at a first time;

generating a second frame of image data representing a plurality of items in an imaging view at a second time, the second time differing from the first time;

selecting a first portion of the first frame, the first portion having a first subset of the image data of the first frame;

comparing the selected first portion to image data of the second frame;

selecting a second portion of the second frame based on the comparison, the second portion having a second subset of the image data of the second frame;

calculating a first displacement vector representing relative movement between the first portion at the first time and the second portion at the second time; and

outputting on a display an image having an indicator, wherein the indicator is at a location on the image that is determined by using the calculated first displacement vector.

2. The method of claim 1, wherein the second portion is selected based on the comparison by determining that the second subset of image data corresponds to the first subset of image data to a greater degree than image data of any other portion of the second frame.

3. The method of claim 2, wherein comparing the selected first portion to image data of the second frame comprises calculating a matching error between the first subset of image data of the selected first portion and each of a plurality of portions having a subset of image data of the second frame.

4. The method of claim 3, wherein selecting the second portion of the second frame based on the comparison comprises selecting as the second portion one of the plurality of portions of the second frame that has the lowest calculated matching error with the selected first portion.

5. The method of claim 2, wherein comparing the selected first portion to image data of the second frame comprises comparing the selected first portion to image data of the second frame that is part of a search window of the second frame, the search window comprising a subset of all image data of the second frame.

6. The method of claim 5, wherein the search window is larger than the selected first and second portions, and wherein the second portion is selected based on the comparison by determining that the second subset of image data corresponds to the first subset of image data to a greater degree than image data at any other portion of the search window of the second frame.

7. The method of claim 5, wherein the search window comprises the subset of all image data of the second frame excluding image data of the second frame forming a perimeter of the second frame.

8. The method of claim 1, further comprising the steps of:

selecting a third portion of the first frame, the third portion having a third subset of the image data of the first frame, and wherein the third subset of the image data of the first frame differs from the first subset of the image data of the first frame;

comparing the selected third portion to image data of the second frame;

selecting a fourth portion of the second frame based on the comparison, the fourth portion having a fourth subset of the image data of the second frame;

calculating a second displacement vector representing relative movement between the third portion at the first time and the fourth portion at the second time; and

outputting on the display the image having the indicator, wherein the indicator is at the location on the image that is determined by using the calculated first and second displacement vectors.

9. The method of claim 8, wherein the fourth portion is selected based on the comparison by determining that the fourth subset of image data corresponds to the third subset of image data to a greater degree than image data of any other portion of the second frame.

10. The method of claim 9, wherein determining the location on the image by using the calculated first and second displacement vectors comprises comparing a length of the first displacement vector to a length of the second displacement vector.

11. The method of claim 10, further comprising the step of:

determining that the first subset of the image data of the first frame represents a different item in the image view than the third subset of the image data of the first frame based on the length of the first displacement vector differing from the length of the second displacement vector beyond a predetermined degree.

12. The method of claim 11, wherein the location on the image including the indicator comprises an interface between the different items in the imaging view.

13. The method of claim 1, wherein the first time corresponds to a first part of a cardiac cycle and the second time corresponds to a second part of the cardiac cycle that is different from the first part of the cardiac cycle.

14. The method of claim 13, wherein the first frame of image data and the second frame of image data are generated using an intravascular ultrasound imaging system, and wherein using the intravascular ultrasound imaging system comprises collecting cross-sectional image data using a catheter assembly that includes an intravascular imaging device having an imaging module for emitting and receiving energy.

15. The method of claim 1, further comprising the step of:

measuring a heart rate of a patient, wherein the first and second times are determined using the measured heart rate of the patient.

16. An imaging system comprising:

a catheter assembly including an intravascular imaging device having an imaging module configured to emit and receive energy at a first time to generate a first frame of image data and emit and receive energy at a second time that is different from the first time to generate a second frame of image data, wherein the image data represents a plurality of image elements;

a user interface including an image display region; and

an imaging engine in communication with the intravascular imaging device and the user interface and comprising at least one processor, the imaging engine being configured to;

select, using the at least one processor, a first portion of the first frame, the first portion having a first subset of the image data of the first frame;

compare, using the at least one processor, the selected first portion to image data of the second frame;

select, using the at least one processor, a second portion of the second frame based on the comparison, the second portion having a second subset of the image data of the second frame;

calculate, using the at least one processor, a first displacement vector representing relative movement between the first portion at the first time and the second portion at the second time; and

output on the image display region an image having an indicator, wherein the indicator is at a location on the image that is determined by using the calculated first displacement vector.

17. The system of claim 16, wherein the imaging engine is further configured to:

select, using the at least one processor, a third portion of the first frame, the third portion having a third subset of the image data of the first frame, and wherein the third subset of the image data of the first frame differs from the first subset of the image data of the first frame;

compare, using the at least one processor, the selected third portion to image data of the second frame;

select, using the at least one processor, a fourth portion of the second frame based on the comparison, the fourth portion having a fourth subset of the image data of the second frame;

calculate, using the at least one processor, a second displacement vector representing relative movement between the third portion at the first time and the fourth portion at the second time; and

output on the image display region the image having the indicator, wherein the indicator is at the location on the image that is determined by using the calculated first and second displacement vectors.

18. The system of claim 17, wherein the second portion is selected based on the comparison by determining that the second subset of image data corresponds to the first subset of image data to a greater degree than image data of any other portion of the second frame, and wherein the fourth portion is selected based on the comparison by determining that the fourth subset of image data corresponds to the third subset of image data to a greater degree than image data of any other portion of the second frame.

19. The system of claim 18, wherein determining the location on the image by using the calculated first and second displacement vectors comprises comparing a length of the first displacement vector to a length of the second displacement vector, and wherein the imaging engine is further configured to:

determine that the first subset of the image data of the first frame represents a different image element than the third subset of the image data of the first frame based on the length of the first displacement vector differing from the length of the second displacement vector beyond a predetermined degree.

20. A non-transitory computer-readable storage article having computer-executable instructions stored thereon to cause at least one programmable processor to:

select a first portion of a first frame of image data, the first frame of image data representing a plurality of image elements generated at a first time, the first portion having a first subset of the image data of the first frame;

compare the selected first portion to image data of a second frame of image data, the second frame of image data representing a plurality of image elements generated at a second time;

select a second portion of the second frame based on the comparison, the second portion having a second subset of the image data of the second frame;

calculate a first displacement vector representing relative movement between the first portion at the first time and the second portion at the second time;

select a third portion of the first frame of image data, the third portion having a third subset of the image data of the first frame, and wherein the third subset of the image data of the first frame differs from the first subset of the image data of the first frame;

compare the selected third portion to image data of the second frame;

select a fourth portion of the second frame based on the comparison, the fourth portion having a fourth subset of the image data of the second frame;

calculate a second displacement vector representing relative movement between the third portion at the first time and the fourth portion at the second time; and

position an indicator on an image at a location representing an interface between two different image elements, the location determined by comparing a length of the first displacement vector to a length of the second displacement vector.