System and methods for enhanced imaging of objects within an image

• US 9,895,133 B2
• Filed: 09/08/2014
• Issued: 02/20/2018
• Est. Priority Date: 04/07/2010
• Status: Active Grant

• Current Assignee: FUJIFILM SonoSite, Inc. (Fujifilm Holdings Corporation)
• Original Assignee: FUJIFILM SonoSite, Inc. (Fujifilm Holdings Corporation)
• Inventors: Pagoulatos, Nikolaos, Ma, Qinglin, Lundberg, Andrew K., Hippe, Richard, Siedenburg, Clinton T.
• Primary Examiner(s): Shumate, Victoria P
• Assistant Examiner(s): DURANT, JONATHAN W
• Application Number:
  US14/480,468
• Publication Number:
  US 20150094565A1
• Time in Patent Office: 1,261 Days
• CPC Class Codes: A61B 34/20 Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
• CPC Class Codes: A61B 8/0841 for locating instruments
• CPC Class Codes: A61B 8/13 Tomography A61B8/10, A61B8/12 take precedence; tomography for radiation diagnosis A61B6/02
• CPC Class Codes: A61B 8/5246 combining images from the same or different imaging techniques, e.g. color Doppler and B-mode
• CPC Class Codes: G01S 15/8995 Combining images from different aspect angles, e.g. spatial compounding
• CPC Class Codes: G06T 2207/10132 Ultrasound image
• CPC Class Codes: G06T 2207/20221 Image fusion; Image merging
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction

Abstract

Systems and methods which implement a plurality of different imaging signatures in generating an image frame are shown. A first imaging signature may be configured for providing relatively high quality images with respect to subsurface regions of living tissue, for example, whereas a second imaging signature may be configured for providing relatively high quality images with respect to interventional instruments inserted into living tissue at a steep angle. Image sub-frames generated using each such different imaging signature are blended to form a frame of the final image providing a relatively high quality image of various objects within the volume being imaged.

Claims

1. An ultrasound imaging system comprising:

a processor configured to execute instructions to produce an ultrasound image including an image of an interventional instrument by;

establishing a first imaging signature having one or more imaging parameters including a first range of image steering angles used for imaging tissue;

establishing a second imaging signature having one or more imaging parameters including a second range of image steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first imaging signature;

generating at least one second subframe using image data resulting from the application of the second imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of a coverage area where visualization of the interventional instrument is enabled.

2. The system of claim 1, wherein the interventional instrument is selected from the group consisting of a needle, a catheter, a stent, and a percutaneous tool.

3. The system of claim 1, wherein the first range of steering angles of the first imaging signature is predetermined to provide imaging of the tissue at a desired quality, and wherein the second range of steering angles of the second imaging signature is determined to provide imaging of the interventional instrument at a desired quality.

4. The system of claim 1, wherein the second range of steering angles for the second imaging signature are more acute than the first range of steering angles of the first imaging signature.

5. The system of claim 4, wherein the first range of steering angles comprises a steering angle magnitude smaller than plus 20 degrees and greater than minus 20 degrees and wherein the second range of imaging signal steering angles comprises a steering angle magnitude greater than plus 20 degrees or smaller than minus 20 degrees.

6. The system of claim 1, wherein the processor-based system is further operable to detect the interventional instrument within the data provided using the second imaging signature.

7. A method of operating an ultrasound machine to produce an ultrasound image including an image of an interventional instrument, comprising:

establishing a first ultrasound imaging signature having one or more imaging parameters including a first range of imaging steering angles used for imaging tissue;

establishing a second ultrasound imaging signature having one or more imaging parameters including a second range of imaging steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first ultrasound imaging signature;

generating at least one second subframe using image data resulting from the application of the second ultrasound imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of a region of the final ultrasound image, the region including image data resulting from the application of the second ultrasound imaging signature.

8. A method of operating an ultrasound machine to produce an ultrasound image including an image of an interventional instrument, comprising:

establishing a first ultrasound imaging signature having one or more imaging parameters including a first range of imaging steering angles used for imaging tissue;

establishing a second ultrasound imaging signature having one or more imaging parameters including a second range of imaging steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first ultrasound imaging signature;

generating at least one second subframe using image data resulting from the application of the second ultrasound imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of a region of the final ultrasound image, the region including image data resulting from the application of the first and second ultrasound imaging signatures.

9. A method of operating an ultrasound machine to produce an ultrasound image including an image of an interventional instrument, comprising:

establishing a first ultrasound imaging signature having one or more imaging parameters including a first range of imaging steering angles used for imaging tissue;

establishing a second ultrasound imaging signature having one or more imaging parameters including a second range of imaging steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first ultrasound imaging signature;

generating at least one second subframe using image data resulting from the application of the second ultrasound imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of a region of the final ultrasound image, the region including image data resulting from the application of the first ultrasound imaging signature only.

10. A method of operating an ultrasound machine to produce an ultrasound image including an image of an interventional instrument, comprising:

establishing a first ultrasound imaging signature having one or more imaging parameters including a first range of imaging steering angles used for imaging tissue;

establishing a second ultrasound imaging signature having one or more imaging parameters including a second range of imaging steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first ultrasound imaging signature;

generating at least one second subframe using image data resulting from the application of the second ultrasound imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image representative of an area imaged with the second ultrasound imaging signature in the final ultrasound image.

12. The method of any of claims 7-11, wherein the portion of the second image frame has fewer pixels than the first image frame.

13. The method of any of claims 7-11, wherein the second range of imaging steering angles are more acute than the first range of imaging steering angles.

14. The method of any of claims 7-11, wherein the first range of imaging steering angles comprises a steering angle magnitude smaller than plus 20 degrees and greater than minus 20 degrees and wherein the second range of imaging steering angles comprises a steering angle magnitude greater than plus 20 degrees or smaller than minus 20 degrees.

15. The method of any of claims 7-11, wherein the plurality of the first subframes comprises a total first number of first subframes, wherein the at least one second subframe comprises a total second number of second subframes, wherein the second number is less than the first number and herein the second range of imaging steering angles are more acute than the first range of imaging steering angles.

16. The method of any of claims 7-11, further comprising producing a graphic on the final ultrasound image indicative of an end point of the interventional instrument.

17. The method of any of claims 7-11, further comprising displaying a boundary that indicates the coverage area in the final ultrasound image, wherein the coverage area comprises the image of the interventional instrument that is produced based on one or more of the parameters of the second ultrasound imaging signature, wherein part of the boundary comprises the graphic.

18. The method of any of claims 7-11, wherein the at least one second subframe comprises a plurality of second subframes and wherein generating the second image frame comprises spatially compounding the plurality of second subframes.

19. The method of any of claims 7-11, wherein the portion of the second image frame has fewer pixels than the first image frame.

11. A method of operating an ultrasound machine to produce an ultrasound image including an image of an interventional instrument, comprising:

establishing a first ultrasound imaging signature having one or more imaging parameters including a first range of imaging steering angles used for imaging tissue;

establishing a second ultrasound imaging signature having one or more imaging parameters including a second range of imaging steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first ultrasound imaging signature;

generating at least one second subframe using image data resulting from the application of the second ultrasound imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of the second range of image steering angles.

20. An ultrasound imaging system comprising:

a processor configured to execute instructions to produce an ultrasound image including an image of an interventional instrument by;

establishing a first imaging signature having one or more imaging parameters including a first range of image steering angles used for imaging tissue;

establishing a second imaging signature having one or more imaging parameters including a second range of image steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first imaging signature;

generating at least one second subframe using image data resulting from the application of the second imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of a region of the final ultrasound image, the region including image data resulting from the application of the second ultrasound imaging signature.

21. An ultrasound imaging system comprising:

a processor configured to execute instructions to produce an ultrasound image including an image of an interventional instrument by;

establishing a first imaging signature having one or more imaging parameters including a first range of image steering angles used for imaging tissue;

establishing a second imaging signature having one or more imaging parameters including a second range of image steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first imaging signature;

generating at least one second subframe using image data resulting from the application of the second imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of a region of the final ultrasound image, the region including image data resulting from the application of the first and second ultrasound imaging signatures.

22. An ultrasound imaging system comprising:

a processor configured to execute instructions to produce an ultrasound image including an image of an interventional instrument by;

establishing a first imaging signature having one or more imaging parameters including a first range of image steering angles used for imaging tissue;

establishing a second imaging signature having one or more imaging parameters including a second range of image steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first imaging signature;

generating at least one second subframe using image data resulting from the application of the second imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of a region of the final ultrasound image, the region including image data resulting from the application of the first ultrasound imaging signature only.

23. An ultrasound imaging system comprising:

a processor configured to execute instructions to produce an ultrasound image including an image of an interventional instrument by;

establishing a first imaging signature having one or more imaging parameters including a first range of image steering angles used for imaging tissue;

establishing a second imaging signature having one or more imaging parameters including a second range of image steering angles used for visualization of the interventional instrument;

generating a plurality of first subframes using image data resulting from the application of the first imaging signature;

generating at least one second subframe using image data resulting from the application of the second imaging signature;

spatially compounding the plurality of first subframes to generate a first image frame;

generating a second image frame using the at least one second subframe, wherein the second image frame includes an image of the interventional instrument;

blending pixels from the first image frame and a portion of the second image frame to form a final ultrasound image; and

producing a graphic on the final ultrasound image indicative of a region of the final ultrasound image representative of an attribute of the interventional instrument in the final ultrasound image.