Landmarks for ultrasound imaging

• US 9,295,449 B2
• Filed: 01/23/2013
• Issued: 03/29/2016
• Est. Priority Date: 01/23/2012
• Status: Active Grant

• Current Assignee: BK Medical Holding Company, Inc. (GE Healthcare Technologies, Inc.)
• Original Assignee: Ultrasonix Medical Corporation (GE Healthcare Technologies, Inc.)
• Inventors: Zhang, Bill, Zhuang, Bo, Pelissier, Laurent
• Primary Examiner(s): Leubecker, John P
• Assistant Examiner(s): TORRES DIAZ, ARNALDO
• Application Number:
  US13/748,432
• Publication Number:
  US 20130211243A1
• Time in Patent Office: 1,161 Days
• Field of Search: 600/424, 600/427, 600/407, 600/426, 600/111, 600/437, 600/440, 606/130
• US Class Current: 1/1
• CPC Class Codes: A61B 10/02 Instruments for taking cell samples or for biopsy A61B10/0038 and A61B10/0045 take precedence; needle locating or guiding means A61B17/3403; samplers for enzymology or microbiology C12M1/26; sampling or preparing biological specimens G01N33/48
• CPC Class Codes: A61B 10/0233 Pointed or sharp biopsy instruments
• CPC Class Codes: A61B 2017/3413 guided by ultrasound
• CPC Class Codes: A61B 2034/107 Visualisation of planned trajectories or target regions
• CPC Class Codes: A61B 2090/363 Use of fiducial points
• CPC Class Codes: A61B 2090/378 using ultrasound
• CPC Class Codes: A61B 34/25 User interfaces for surgical systems
• CPC Class Codes: A61B 8/0841 for locating instruments
• CPC Class Codes: A61B 8/14 Echo-tomography
• CPC Class Codes: A61B 8/4254 using sensors mounted on the probe
• CPC Class Codes: A61B 8/4263 using sensors not mounted on the probe, e.g. mounted on an external reference frame
• CPC Class Codes: A61B 8/463 characterised by displaying multiple images or images and diagnostic data on one display composite display in devices for short-range imaging with acoustic waves G01S7/52074
• CPC Class Codes: A61B 8/469 for selection of a region of interest
• CPC Class Codes: A61B 8/5292 using additional data, e.g. patient information, image labeling, acquisition parameters

Abstract

An ultrasound imaging system has a 3D location system and a data store for recording locations within a patient. Navigation to target locations is facilitated by providing graphical elements superposed on a 2-dimensional image. The size and/or color of the graphical elements are controlled in real time based on distance of the target location(s) from a current image plane. This provides intuitive visual feedback and can be achieved with low computational requirements.

Claims

1. An ultrasound imaging apparatus, comprising:

an ultrasound probe configured to transmit ultrasound signals and to receive ultrasound echo signals;

an ultrasound system configured to process the ultrasound echo signals to yield a two-dimensional ultrasound image representing an image plane within a subject;

a display connected to the ultrasound system and the display displays the ultrasound image;

a position-sensing system configured to monitor a position and orientation of the ultrasound probe in a coordinate system to yield probe position and orientation information;

a processor configured to;

process the probe position and orientation information to determine;

a display location in the ultrasound image corresponding to a perpendicular projection of a predetermined location onto the image plane and a distance between the predetermined location and the image plane within a slab of a thickness defined by a positive slab surface and a negative slab surface which are a positive and negative distance from the image plane respectively; and

superimpose on the ultrasound image a display location marking indicia at the display location, and the indicia having one or more appearance characteristics determined at least in part by the distance between the predetermined location and the image plane within the slab, and the one or more appearance characteristics include a hue which is a continuous function of three colors within the slab.

2. The apparatus according to claim 1, wherein the position sensing system comprises a fiducial sensor configured to be removeably applied to the subject at a predetermined fixed location relative to the subject, the position sensing system is configured to monitor a position and orientation of the fiducial sensor and to determine position and orientation of the predetermined location relative to the fiducial sensor and the processor is configured to use the fiducial sensor position and orientation in determining the display location and the distance between the predetermined location and the image plane.

3. The apparatus according to claim 2, further comprising a tool configured to be inserted into the subject,

wherein the position-sensing system is configured to monitor a position and orientation of the tool to yield tool position and orientation information and the processor is configured to process the tool position and orientation information to determine a position of a point on the tool relative to the image plane, and determine a relative location of the point to at least one recognizable point of an organ in the subject.

4. The apparatus according to claim 3, wherein the processor is configured to process the tool position and orientation information to determine a tool location in the ultrasound image corresponding to a perpendicular projection of the point on the tool onto the image plane and a distance between the point on the tool and the image plane, and to superimpose on the ultrasound image on the display, tool indicia located at the tool location having one or more appearance characteristics determined at least in part by the distance between the point on the tool and the image plane.

5. The apparatus according to claim 4, wherein the tool indicia and the location marking indicia are different in appearance.

6. The apparatus according to claim 3, wherein the processor is configured to determine from the orientation of the tool an intersection point at which the tool will intersect the image plane if inserted to the subject along a current trajectory and to superimpose on the ultrasound image, indicia indicating a location in the ultrasound image corresponding to the intersection point.

7. The apparatus according to claim 3, wherein the processor is configured to store information specifying the position of the point on the tool in response to a triggering event.

8. The apparatus according to claim 7, comprising a user interface wherein the triggering event comprises actuation of a control of the user interface.

9. The apparatus according to claim 7, wherein the tool comprises a biopsy device and the triggering event comprises operation of the biopsy device to acquire a biopsy sample.

10. The apparatus according to claim 1, wherein the processor is configured to suppress display of the location marking indicia when the distance between the predetermined location and the image plane exceeds the positive and negative surfaces defined by the slab.

11. The apparatus according to claim 10, wherein the distance of the positive and negative surfaces defined by the slab is adjustable by way of a user interface control.

12. The apparatus according to claim 1, wherein the continuous function of three colors includes:

a first color contribution which decreases linearly from a maximum to zero according to a distance between the positive slab surface and the image plane, and is zero between the image plane and the negative slab surface;

a second color contribution which increases linearly from zero to a maximum according to a distance from the positive surface or the negative surface to the image plane; and

a third color contribution which decreases linearly from a maximum to zero according to a distance between the negative slab surface and the image plan, and is zero between the image plane and the positive slab surface.

13. The apparatus according to claim 12 wherein the location marking indicia comprises an outline shape and a size of the outline shape is set based upon the distance between the predetermined location and the image plane.

14. The apparatus according to claim 1, wherein the one or more appearance characteristics comprise one or more of:

color, brightness, transparency, size, or shape.

15. The apparatus according to claim 1, wherein the processor is configured to:

process the probe position and orientation information to determine for each of one or more additional predetermined locations;

an additional display location in the ultrasound image corresponding to a perpendicular projection of the additional predetermined location onto the image plane and a distance between the additional predetermined location and the image plane, and the one or more additional predetermined locations are selected from one or more previously recorded locations; and

superimpose on the ultrasound image at the additional display location an additional location marking indicia having one or more appearance characteristics determined at least in part by the distance between the additional predetermined location and the image plane.

16. The apparatus according to claim 1, wherein the processor is configured to generate an array of additional locations which are located relative to the predetermined location and to store the locations of the array of additional locations as additional predetermined locations.

17. The apparatus according to claim 1, wherein the processor is configured to update the position and appearance of the location marking indicia in real time.

18. An apparatus for providing information regarding a relationship between a location of a selected point within a body of a patient and a location and orientation of an ultrasound probe, the apparatus comprising a processor,

wherein:

the processor is configured to receive first information indicating the location and orientation of the ultrasound probe;

the processor is configured to determine, based on the first information, second information indicating the location and orientation of a 2D region within the body of the patient scanned by the ultrasound probe;

the processor is configured to receive third information indicating the location of the selected point selected from a plurality of recorded points;

the processor is configured to determine, based the second and third information, fourth information indicating whether or not the selected point lies within the 2D region;

the processor is configured to set location and appearance of indicia on a display based on the fourth information, wherein the appearance of the indicia includes a hue which is a continuous function of three colors;

the processor is configured to determine, based on the second information and the third information, fifth information indicating a distance between the selected point and a point within the 2D region which is closest to the selected point; and

the processor is configured to control an appearance of the indicia based at least in part on the fifth information, wherein the continuous function of three colors is defined for a slab which includes a positive and negative distance from the location and the orientation of the 2D region.

19. The apparatus according to claim 18, wherein the plurality of recorded points include a category which identifies each recorded point by at least one of a biopsy sample location, a seed placement, a drug placement, or a fiducial feature.

20. The apparatus according to claim 19, wherein the selected point includes one or more points selected by category.

21. The apparatus according to claim 18, wherein the recorded points include a relative position from a recognizable point of an organ in the patient.

22. The apparatus according to claim 18, where the indicia includes a transparency indicative of the distance.

23. A method for providing information regarding a relationship between a location of a selected point within a body of a patient and a location and orientation of an ultrasound probe, the method comprising employing a processor to:

receive first information indicating the location and orientation of the ultrasound probe;

determine, based on the first information, second information indicating the location and orientation of a 2D region within the body of the patient scanned by the ultrasound probe;

receive third information indicating the location of the selected point selected from a plurality of recorded points;

determine, based the second and third information, fourth information indicating whether or not the selected point lies within the 2D region;

set location and appearance of indicia on a display based on the fourth information, wherein the appearance of the indicia includes a hue which is a continuous function of three colors;

determine, based on the second information and the third information, fifth information indicating a distance between the selected point and a point within the 2D region which is closest to the selected point; and

control an appearance of the indicia based at least in part on the fifth information, wherein the continuous function of three colors is defined for a slab which includes a positive and negative distance from the location and the orientation of the 2D region.