METHOD AND SYSTEM FOR 3D ACQUISITION OF ULTRASOUND IMAGES

• US 20160113632A1
• Filed: 05/28/2014
• Published: 04/28/2016
• Est. Priority Date: 05/28/2013
• Status: Abandoned Application

• Current Assignee: CAScination AG, Universitã¤T Bern
• Original Assignee: CAScination AG, Universitã¤T Bern
• Inventors: RIBES, Delphine, PETERHANS, Matthias, WEBER, Stefan
• Application Number:
  US14/894,523
• Publication Number:
  US 20160113632A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: A61B 6/03 Computed tomography [CT] echo-tomography A61B8/14
• CPC Class Codes: A61B 8/0891 for diagnosis of blood vessels
• CPC Class Codes: A61B 8/14 Echo-tomography
• CPC Class Codes: A61B 8/4245 involving determining the position of the probe, e.g. with respect to an external reference frame or to the patient
• CPC Class Codes: A61B 8/4254 using sensors mounted on the probe
• CPC Class Codes: A61B 8/463 characterised by displaying multiple images or images and diagnostic data on one display composite display in devices for short-range imaging with acoustic waves G01S7/52074
• CPC Class Codes: A61B 8/466 adapted to display 3D data 3D imaging and stereoscopic displays in devices for short-range imaging with acoustic waves G01S15/8993 and G01S7/52068, respectively; 3D image rendering G06T15/00; manipulating 3D models for computer graphics G06T19/00
• CPC Class Codes: A61B 8/469 for selection of a region of interest
• CPC Class Codes: A61B 8/483 involving the acquisition of a 3D volume of data
• CPC Class Codes: A61B 8/5207 involving processing of raw data to produce diagnostic data, e.g. for generating an image reconstruction G06T11/00
• CPC Class Codes: A61B 8/5253 combining overlapping images, e.g. spatial compounding
• CPC Class Codes: A61B 8/5261 combining images from different diagnostic modalities, e.g. ultrasound and X-ray
• CPC Class Codes: A61B 8/5269 involving detection or reduction of artifacts for image enhancement algorithms G06T5/00
• CPC Class Codes: A61B 8/54 Control of the diagnostic device

Abstract

The invention relates to a Method for 3D ultrasound image acquisition as well as to a system for conducting the method. The proposed method checks whether the current ultrasound image (401, 402) has at least a pixel in the volume of interest (301), wherein in case the current image (401, 402) has no pixel in the volume of interest (301), the current image (401, 402) is discarded, wherein otherwise the current ultrasound image (401, 402) is segmented and compounded into said 3D model (403) to be generated which is displayed in real-time on the display (101) and particularly overlaid on the displayed pre-acquired image (305), wherein particularly in case a new current ultrasound image (401, 402) is compounded into the 3D model (403), the displayed 3D model (403) on the display (101) is updated. Further, a quality measure for the 3D model (403) to be generated is computed upon acquiring of ultrasound images (401, 402), wherein said acquiring of said ultrasound images (401, 402) is ended once said quality measure has reached a pre-defined level.

Claims

1. A Method for 3D ultrasound image acquisition and registration of a 3D model to a pre-acquired 3D image, comprising the steps of:

providing to pre-acquired 3D image (305) of an object (110),

displaying said pre-acquired image (305) on a display (101),

selecting a volume of interest (301) of the object (110) in said pre-acquired image (305),

when the spatial position of the volume of interest (301) is selected or adjusted as intended;

triggering the acquisition of ultrasound images (401, 402) in said volume of interest (301) in order to generate a 3D model (403) of said object (110) in said volume of interest (301), and

acquiring a plurality of ultrasound images (401, 402) for generating said 3D model (403) by means of said ultrasound probe (103) in the volume of interest (301) while moving the ultrasound probe (103) with respect to said object (110) along the volume of interest (301), and

checking if the current ultrasound image (401, 402) has at least a pixel in the volume of interest (301), wherein in case the current image (401, 402) has no pixel in the volume of interest (301), the current image (401, 402) is discarded, wherein otherwise the current ultrasound image (401, 402) is segmented and compounded into said 3D model (403) to be generated, and

determining a quality measure for the 3D model (403) to be generated upon said acquisition of said ultrasound images (401, 402), wherein said acquisition of said ultrasound images (401, 402) is ended once said quality measure is fulfilled or has reached a pre-defined level,

registering the generated 3D model (403) to the pre-acquired 3D image (305).

2. The method according to claim 1, wherein said provided pre-acquired 3D image is acquired in a first session, and wherein said plurality of ultrasound images are acquired in a separate second session that is conducted at a later time.

3. The method according to claim 1, wherein said provided pre-acquired 3D image is acquired by using an imaging method other than ultrasound.

4. The method according to claim 1, wherein said quality measure is a criterion based on patient-specific data from said pre-acquired 3D image.

5. The method according to claim 1, wherein particularly said quality measure is at least one of:

the number of single ultrasound images (401, 402) scanned within the volume of interest (301),

the density of the acquired ultrasound images (401, 402) within the volume of interest (301),

the number and/or distribution of image features, particularly the number of segmented anatomic structures in the volume of interest (301),

the time needed for scanning the ultrasound images (401, 402),

6. The method of claim 5, wherein said number and/or distribution is selected depending on the patient-specific anatomy in the volume of interest (301).

7. The method according to claim 1, wherein a user acquiring said plurality of ultrasound images is guided to move the ultrasound probe (103) to a location where image features are expected based on the pre-acquired 3D image, particularly so as to provide a sufficient dataset for registering the generated 3D model to the pre-acquired 3D image (305).

8. The method according to claim 1, characterized in that an initial registration is performed, particularly in order to correctly display the position of the volume of interest (301), the acquired current ultrasound image (401, 402), and/or the 3D model (403) with respect to the pre-acquired image (305) on the display (101), wherein the initial registration involves the steps of:

selecting a point in the coordinate system of the pre-acquired image (305), calculating an expected ultrasound image at this location, acquiring a corresponding ultrasound image (401, 402) of the object (110) with the ultrasound probe (103) being tracked in the room-fixed or patient-fixed coordinate system of the ultrasound probe (103), and determining a registration transform between said coordinate systems using the expected ultrasound image and the acquired ultrasound image (401, 402).

9. The method according to claim 1, characterized in that, the generated 3D model (403) is registered to the pre-acquired, particularly preoperatively acquired, 3D image (305), by matching at least one feature of the generated 3D model (403), whose coordinates in the room-fixed or patient-fixed coordinate system are acquired with help of tracking the ultrasound probe (103), with a corresponding feature of the pre-acquired 3D image (305), and particularly by determining a registration transform between the coordinate system of the pre-acquired 3D image (305) and the room-fixed or patient-fixed coordinate system of the ultrasound probe (103) using the coordinates of said at least one feature in the room-fixed or patient-fixed coordinate system and the coordinates of said corresponding feature in the coordinate system of the pre-acquired 3D image (305).

10. The method according to claim 1, wherein said triggering is performed by means of said ultrasound probe (103), particularly by means of a specific movement of or a defined gesture with the ultrasound probe (103) on the surface of the object (110).

11. The method according to claim 1, wherein the current image (401, 402) is displayed in real-time on said display (101), wherein particularly the current image is displayed two-dimensionally (402) on said display and/or three-dimensionally (401), wherein said three-dimensionally displayed current ultrasound image is particularly overlaid on the displayed pre-acquired image (305), or where the contents of the pre-acquired 3D image is particularly overlaid on the current two-dimensional image.

12. The method according to claim 1, wherein features of the 3D model that are used or will be used for registering the 3D model (403) to the pre-acquired 3D image (305) are displayed in real-time on said display (101).

13. The method according to claim 1, wherein the 3D model is displayed in real-time on the display (101) and particularly overlaid on the displayed pre-acquired image (305), wherein particularly in case a new current ultrasound image (401, 402) is compounded into the 3D model (403), the displayed 3D model (403) on the display (101) is updated.

14. The method according to claim 1, characterized in that an artefact detection is conducted for the non-discarded current ultrasound image (401, 402), wherein particularly in case an artefact is detected in the current ultrasound image this current ultrasound image is discarded, and wherein particularly an artefact probability is calculated based on patient-specific features of the pre-acquired 3D image.

15. The method according to claim 1, characterized in that said segmentation of the individual current ultrasound image (401, 402) is conducted using at least one algorithm providing segmentation of specific anatomic structures of the object in the volume of interest, particularly vessels, tumors, organ boundaries, bile ducts, and or other anatomy, wherein particularly said algorithm is selected depending on patient-specific features of the pre-acquired 3D image.

16. The method according to claim 1, characterized in that said segmentation of the individual current ultrasound image (401, 402) is conducted using a probabilistic assessment of image features, particularly such as organ boundaries, organ parenchyma, and/or vessel systems, wherein said probabilistic assessment uses patient-specific features of the pre-acquired 3D image.

17. The method according to claim 14, characterized in that said artefact detection and said segmentation is conducted in parallel, wherein particularly said artefact detection directly uses the individual content of the current ultrasound image (401, 402) or a detected content of said current ultrasound, and wherein particularly the respective algorithms iteratively interact with each other.

18. Method according to claim 1, characterized in that guiding information is displayed on said display (101) and/or acoustically provided to the user (100), particularly verbally, in order to assist and/or guide the user (100) concealing positioning and/or moving of the ultrasound probe (103), wherein particularly said guiding information is provided through feedback based on said pre-acquired 3D image and acquired features of the 3D model.

19. The method according to claim 1, characterized in that the ultrasound probe (103) is tracked by deriving the absolute spatial image coordinates using a coordinate measurement system based on an optical, electromechanical or mechanical measurement principle and/or by deriving relative image coordinates by analyzing the relative shift of image features in subsequent images.

20. The method according to claim 1, wherein after selecting a volume of interest (301) of the object (110) in said pre-acquired image (305) the spatial position of said volume of interest (301) with respect to said pre-acquired image (305) is adjusted by positioning an Ultrasound probe (103) with respect to the object (110) accordingly.

21. The method according to claim 1, wherein the current spatial position of said volume of interest (301) on said display (101) with respect to said pre-acquired image (305) is visualized, particularly in real-time.

22. The method according to claim 21, wherein the visualization of the volume of interest (301) is overlaid on the displayed pre-acquired image (305).

23. The method according to claim 21, wherein the visualization of the volume of interest (301) on said display (101) is updated using the current spatial position of said ultrasound probe (103), which current spatial position of the ultrasound probe (103) is particularly determined using a tracking system (102).

24. The method according to claim 18, characterized in that said guiding information comprises a virtual visualization of at least one or several cubical grids on said display (101), which grid or grids are displayed on the pre-acquired 3D image, wherein particularly specific colors represent defined tissue structures and/or anatomic structures.

25. The method according to claim 1, characterized in that particularly upon said segmentation, missing information in the current ultrasound image (401, 402) is interpolated using a-priori information about the object (110) or particularly patient-specific features from the pre-acquired 3D image.

26. The method according to claim 1, wherein upon said segmentation, missing information in the current ultrasound image (401, 402) is interpolated using cohort specific and/or statistical information about the distribution of vascular structures, geometric shapes of the anatomic structures of interest in the object, object parts or lesions, and/or other known anatomical structures.

27. The method according to claim 1, characterized in that the generated 3D model (403) is aligned with the pre-acquired 3D image (305) that is particularly based on an imaging method other than ultrasound and particularly based on a different coordinate system compared to the 3D model, so as to display the current level of progress of the 3D model generation, particularly with respect to previously acquired or dynamically refreshed information content, particularly with respect to parameters such as homogeneity and/or resolution.

28. The method according to claim 1, characterized in that the visualization of the 3D model (403) on the display (101) uses static or dynamic color mappings, particularly indicating anatomic structures currently detected and analyzed or indicating information dens and exp. feature in certain areas of the 3d image

29. The method according to claim 1, characterized in that the pre-acquired 3D image (305) is a computer tomography, or magnetic resonance image.

30. A system for 3D ultrasound image acquisition and registration of a 3D model to a pre-acquired 3D image, comprising:

an ultrasound probe (103) connected to a data processing system (105) which particularly comprises a control unit (107) for control of said ultrasound probe (103), a computer (106), and a display (101) connected to said computer (106) for displaying information, and

a tracking system (102) for tracking the spatial position of the ultrasound probe (103), the tracking system (102) comprising one or several position sensors (108) arranged on or in the ultrasound probe (103) for detecting the spatial position of the ultrasound probe (103), wherein

the data processing system (105) is designed to automatically check if a current ultrasound image (401, 402) of an object (110) acquired with the ultrasound probe (103) has at least a pixel in a pre-selected volume of interest (301) of a pre acquired 3D image of the object (110), wherein in case the current image (401, 402) has no pixel in the volume of interest (301), the data processing system (105) is designed to discard the current image (401, 402), wherein otherwise the data processing system (105) is designed to automatically segment the current ultrasound image (401, 402) and to compound it into a 3D model (403), and wherein the data processing system (105) is designed to determine a quality measure for the 3D model (403) to be generated, particularly upon acquisition of ultrasound images (401, 402) with the ultrasound probe (103), wherein the data processing system (105) is designed to end the acquisition of ultrasound images for the 3D model once said quality measure has reached a pre-defined level or dynamically defined level, wherein particularly said quality measure is at least one of the number of single ultrasound images (401, 402) scanned within the volume of interest (301), the density of the acquired ultrasound images (401, 402) within the volume of interest (301), the number and/or distribution of specific image features, particularly the number of segmented anatomic structures in the volume of interest (301) or particularly a patient-specific number of expected features; and

the time needed for the acquisition of the ultrasound images (401, 402).