Processing and displaying breast ultrasound information

• US 7,615,008 B2
• Filed: 11/23/2004
• Issued: 11/10/2009
• Est. Priority Date: 11/24/2000
• Status: Expired due to Term

• Current Assignee: U-System Inc. (General Electric Company)
• Original Assignee: U-System Inc. (General Electric Company)
• Inventors: Wang, Shih-Ping, Yu, Zengpin, Zhang, Wei, Chen, Jiayu, Reed, Michael E., Neff, Thomas P., Cupples, Tommy Earl
• Primary Examiner(s): Le; Long V
• Assistant Examiner(s): Cattungal; Sanjay
• Application Number:
  US10/997,293
• Publication Number:
  US 20050171430A1
• Time in Patent Office: 1,813 Days
• Field of Search: 600437-461, 382/128, 382/132, 382/284, 382/294
• US Class Current: 600/437
• CPC Class Codes: A61B 6/463 characterised by displaying multiple images or images and diagnostic data on one display
• CPC Class Codes: A61B 6/502 for diagnosis of breast, i.e. mammography
• CPC Class Codes: A61B 6/5247 combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
• CPC Class Codes: A61B 6/563 involving image data transmission via a network
• CPC Class Codes: A61B 8/0825 for diagnosis of the breast, e.g. mammography
• CPC Class Codes: A61B 8/13 Tomography A61B8/10, A61B8/12 take precedence; tomography for radiation diagnosis A61B6/02
• CPC Class Codes: A61B 8/406 using means for diagnosing suspended breasts
• CPC Class Codes: A61B 8/4281 characterised by sound-transmitting media or devices for coupling the transducer to the tissue
• CPC Class Codes: A61B 8/4405 Device being mounted on a trolley
• CPC Class Codes: A61B 8/462 characterised by constructional features of the display
• CPC Class Codes: A61B 8/463 characterised by displaying multiple images or images and diagnostic data on one display composite display in devices for short-range imaging with acoustic waves G01S7/52074
• CPC Class Codes: A61B 8/465 adapted to display user selection data, e.g. icons or menus
• CPC Class Codes: A61B 8/466 adapted to display 3D data 3D imaging and stereoscopic displays in devices for short-range imaging with acoustic waves G01S15/8993 and G01S7/52068, respectively; 3D image rendering G06T15/00; manipulating 3D models for computer graphics G06T19/00
• CPC Class Codes: A61B 8/467 characterised by special input means
• CPC Class Codes: A61B 8/5238 for combining image data of patient, e.g. merging several images from different acquisition modes into one image for image registration algorithms G06T7/30
• CPC Class Codes: A61B 8/565 involving data transmission via a network

Abstract

Displaying breast ultrasound information on an interactive user interface is described, the user interface being useful in adjunctive ultrasound mammography environments and/or ultrasound-only mammography environments. Bilateral comparison is facilitated by a pairwise display of thick-slice images corresponding to analogous slab-like subvolumes in the left and right breasts. Coronal thick-slice imaging and convenient navigation on and among coronal thick-slice images is described. In one preferred embodiment, a nipple marker is displayed the coronal thick-slice image representing a projection of a nipple location thereupon. A convenient breast icon is also displayed including a cursor position indicator variably disposed thereon in a manner that reflects a relative position between the cursor and the nipple marker. Preferably, the breast icon is configured to at least roughly resemble a clock face, the center of the clock face representing the nipple marker location. Bookmark-centric and CAD-marker-centric navigation within and among thick-slice images is also described.

Claims

1. A method for presenting breast ultrasound information, comprising:

generating a first thick-slice image representing a sonographic property within a first slab subvolume of a chestwardly compressed first breast of a patient by (i) imaging the chestwardly compressed first breast with an ultrasound imaging apparatus to thereby derive a first plurality of thin-slice images and (ii) computer-processing said first plurality of thin-slice images to thereby generate said first thick-slice image;

generating a second thick-slice image representing said sonographic property within a second slab subvolume of a chestwardly compressed second breast of the patient by (i) imaging the chestwardly compressed second breast to thereby derive a second plurality of thin-slice images and (ii) computer-processing said second plurality of thin-slice images to thereby generate said second thick-slice image, said first and second slab subvolumes occupying generally similar positions within the first and second breasts, respectively, said first and second slab subvolumes each being substantially parallel to a coronal plane of the patient; and

displaying said first and second thick-slice image adjacent each other for comparison of the first and second breasts relative to said sonographic property.

2. The method of claim 1, said first thick-slice image being a member of a first thick-slice image array corresponding to successive slab subvolumes within the first breast, said second thick-slice image being a member of a second thick-slice image array corresponding to successive slab subvolumes within the second breast, each slab subvolume within the second breast having at least a general positionwise association with a corresponding slab subvolume within the first breast, further comprising displaying a plurality of members of said first thick-slice image array as positionally paired with corresponding members of said second thick-slice image array.

3. The method of claim 2, wherein said successive slab subvolumes for each of said first and second breasts collectively occupy substantially all of the breast volume for that breast.

4. The method of claim 2, said sonographic property being associated with first and second breast volumes corresponding to said first and second breasts, respectively, further comprising:

receiving a plurality of bookmarks, each bookmark identifying a bookmark location within one of said first and second breast volumes;

receiving a bookmark navigation command; and

automatically displaying (i) a corresponding one of said thick-slice images associated with a next bookmark location, and (ii) a planar ultrasound image corresponding to said next bookmark location, said planar ultrasound image representing said sonographic property along a plane passing through said next bookmark location within its associated first or second breast volume.

5. The method of claim 2, said sonographic property being associated with first and second breast volumes corresponding to said first and second breasts, respectively, further comprising:

receiving a plurality of computer-aided detection (CAD) results, each CAD) result identifying a potentially suspicious location within one of said first and second breast volumes;

receiving a CAD navigation command; and

automatically displaying (i) a corresponding one of said thick-slice images associated with a next CAD result location, and (ii) a planar ultrasound image corresponding to said next CAD result location, said planar ultrasound image representing said sonographic property along a plane passing through said next CAD result location within its associated first or second breast volume.

6. The method of claim 1, further comprising displaying a nipple marker on each of said first and second thick-slice images representing a projection of an associated nipple location thereupon.

7. The method of claim 6, said sonographic property being acquired during volumetric ultrasound scans obtaining first and second breast volumes corresponding to said first and second breasts, respectively, wherein each nipple marker is positioned on its associated thick-slice image according to at least one of (i) a manually-entered nipple position provided with the associated volumetric ultrasound scan, (ii) a computer-derived nipple position automatically generated from the associated volumetric ultrasound scan, (iii) a computer-derived nipple position automatically generated based on manual placement of a physical nipple token for the associated volumetric ultrasound scan, and (iv) a viewer-determined position for the nipple marker.

8. The method of claim 6, said first thick-slice image being displayed to a viewer on a display monitor having an associated pointing device, further comprising:

displaying a cursor upon the first thick-slice image according to a viewer manipulation of said pointing device; and

displaying a breast icon near said first thick-slice image, said breast icon including a cursor position indicator variably disposed thereon in a manner that reflects a relative position between said cursor and said nipple marker on said first thick-slice image.

9. The method of claim 8, wherein said breast icon is configured to at least roughly resemble a clock face, said cursor position indicator being positioned relative to a center of the clock face in a manner that reflects said position of said cursor relative to said nipple marker.

10. The method of claim 1, said first thick-slice image being displayed to a viewer on a display monitor having an associated pointing device, further comprising:

displaying a cursor position upon the first thick-slice image according to a viewer manipulation of said pointing device, said cursor position being associated with a corresponding point within the first breast volume; and

displaying a planar ultrasound image corresponding to said cursor position, said planar ultrasound image representing said sonographic property along a plane passing through said corresponding point within the first breast volume.

11. The method of claim 10, further comprising modifying an orientation of said plane around said corresponding point according to subsequent viewer manipulations of an orienting device.

12. The method of claim 1, wherein said slab subvolumes within the first and second breasts occupy substantially all of the volume of the first and second breasts, respectively, and wherein said first and second thick-sliced images are enhanced according to at least one computer-aided detection (CAD) algorithm operating on said first and second breast volumes.

13. The method of claim 1 said sonographic property being measured throughout a first breast volume corresponding to said first breast, further comprising:

receiving computer-aided diagnosis (CAD) information associated with the first breast volume identifying potentially suspicious regions therein;

displaying a volume rendering of said first breast volume according to said sonographic property thereof; and

displaying a surface rendering of at least one of said potentially suspicious regions within said volume rendering.

14. A method for presenting breast ultrasound information, comprising;

generating a thick-slice image representing a sonographic property of a chestwardly compressed breast of a patient within a slab subvolume thereof by (i) imaging the chestwardly compressed breast with an ultrasound imaging apparatus to thereby derive a plurality of thin-slice images and (ii) computer-processing said plurality of thin-slice images to thereby generate said thick-slice image;

wherein said slab subvolume has a thickness between 2 mm and 20 mm, and

wherein said slab subvolume is substantially parallel to a coronal plane of the patient, further comprising;

generating a nipple marker on said thick-slice image representing a projection of a nipple location thereupon, said sonograghic property being associated with a scan of a breast volume;

wherein said nipple marker is positioned on the thick-slice image according to at least one of

(i) a manually-entered nipple position provided with the scan, (ii) a computer-derived nipple position automatically generated from the scan,

(ii) (iii) a computer-derived nipple position automatically generated based on manual placement of a physical nipple token for the scans, and

(iii) a viewer-determined position for the nipple marker; and

displaying said first thick-slice image and said nipple marker on a computerized display.

15. The method of claim 14, said thick-slice image being a member of a thick-slice image array corresponding to successive slab subvolumes within the breast substantially parallel to the coronal plane, further comprising simultaneously displaying a plurality of members of said thick-slice image array.

16. The method of claim 15, wherein said successive slab subvolumes collectively occupy substantially all of the breast volume.

17. The method of claim 15, each of said thick-slice images being displayed to a viewer on a display monitor having an associated pointing device, further comprising:

displaying a cursor upon a selected one of said thick-slice images according to a viewer manipulation of said pointing device; and

displaying a breast icon on said display monitor, said breast icon including a cursor position indicator variably disposed thereon in a manner that reflects a relative position between said cursor and said nipple marker on said selected thick-slice image.

18. The method of claim 17, wherein said breast icon is configured to at least roughly resemble a clock face, said cursor position indicator being positioned relative to a center of the clock face in a manner that reflects said position of said cursor relative to said nipple marker.

19. The method of claim 14, said thick-slice image being displayed to a viewer on a display monitor having an associated pointing device, further comprising:

displaying a cursor position upon the thick-slice image according to a viewer manipulation of said pointing device, said cursor position being associated with a corresponding point within the breast volume; and

displaying a planar ultrasound image corresponding to said cursor position, said planar ultrasound image representing said sonographic property along a plane passing through said corresponding point within the breast volume.

20. The method of claim 19, further comprising modifying an orientation of said plane around said corresponding point according to subsequent viewer manipulations of an orienting device.

21. The method of claim 14, wherein said slab subvolume occupies substantially all of the breast volume, and wherein said thick-slice image is enhanced according at least one computer-aided detection (CAD)) algorithm operating on said breast volume.

22. The method of claim 14, said sonographic property being measured throughout the breast volume, further comprising:

receiving computer-aided diagnosis (CAD) inlbrmation associated with the breast volume identifying potentially suspicious regions therein;

displaying a volume rendering of said breast volume according to said sonographic property thereof; and

displaying a surface rendering of at least one of said potentially suspicious regions within said volume rendering.

23. A method for presenting breast ultrasound information, comprising:

generating a thick-slice image representing a sonographic property of a chestwardly compressed breast of a patient within a slab subvolume thereof by (i) imaging the chestwardly compressed breast with an ultrasound imaging apparatus to thereby derive a plurality of thin-slice images each representing a thin slice of the breast and (ii) computer-processing said plurality of thin-slice images to thereby generate said thick-slice image, wherein said slab subvolume is substantially parallel to a coronal plane of the patient;

displaying said thick-slice image on a computerized display;

generating and displaying a nipple marker on said thick-slice image representing a projection of a nipple location thereupon;

generating and displaying a cursor upon the thick-slice image according to a viewer manipulation of a pointing device associated with said display monitor; and

generating and displaying a breast icon near said thick-slice image, said breast icon including a cursor position indicator variably disposed thereon in a manner that reflects a relative position between said cursor and said nipple marker on said thick-slice image.

24. The method of claim 23, wherein said breast icon is configured to at least roughly resemble a clock face, said cursor position indicator being positioned relative to a center of the clock face in a manner that reflects said position of said cursor relative to said nipple marker.

25. The method of claim 23, said sonographic property being associated with scans of a breast volume, wherein said nipple marker is positioned on said thick-slice image according to at least one of (i) a manually-entered nipple position provided with the scan, (ii) a computer-derived nipple position automatically generated from the scans, (iii) a computer-derived nipple positioul automatically generated based on manual placement of a physical nipple token for the scans, and (iv) a viewer-determined position for the nipple marker.

26. The method of claim 23, further comprising:

receiving a plurality of bookmarks, each bookmark identifying a bookmark location within said slab subvolume; and

receiving a bookmark navigation command and, responsive thereto;

(i) automatically changing the cursor position to a next bookmark location; and

(ii) automatically displaying a planar ultrasound image corresponding to said next bookmark location, said planar ultrasound image representing said sonographic property along a plane passing through said next bookmark location within the breast volume.

27. The method of claim 23, further comprising:

receiving a plurality of computer-aided detection (CAD) results, each CAD result identifying a potentially suspicious location within the slab subvolume; and

receiving a CAD navigation command and, responsive thereto;

(i) automatically changing the cursor position to a next CAD result location; and

(ii) automatically displaying a planar ultrasound image corresponding to said next CAD result location, said planar ultrasound image representing said sonographic property along a plane passing through said next CAD result location within the breast volume.

28. A method for presenting breast ultrasound information comprising:

compressing a patient'"'"'s breast chestwardly;

acquiring a plurality of thin-slice ultrasound images representing a three-dimensional volume of the patient'"'"'s chestwardly compressed breast by scanning the chestwardly compressed patient'"'"'s breast in an automated scanning process in a scanning direction with an ultrasound transducer that is long in a direction transverse to the scanning direction, wherein;

said thin-slice images conform to respective planes that are generally along the compression direction, and

each of said thin-slice imaacs represents a thin slice of the patient'"'"'s breast;

generating a plurality of two-dimensional coronal thick-slice images from the three-dimensional data volume, each coronal thick-slice image;

representing said sonographic property of the breast as chestwardly compressed within a slab subvolume thereof substantially parallel to a coronal plane of the patient, and

representing a thick-slice of the patient'"'"'s breast that is thicker than a slice represented by one of said thin-slice images; and

displaying said coronal thick-slice images on a user display.

29. The method of claim 28, further comprising:

generating a plurality of two-dimensional standard-plane thick-slice images from the three-dimensional data volume, said standard-plane thick-slice images representing said sonographic property of the breast within slab subvolumes thereof substantially parallel to a standard x-ray mammogram view plane;

concurrently displaying said standard-plane thick-slice images and said coronal thick-slice images on the user display.

30. The method of claim 29, wherein said standard x-ray mammogram view plane is the craniocaudal (CC) or the mediolateral oblique (MLO) view plane.

31. The method of claim 30, further comprising:

receiving an x-ray mammogram image of the breast corresponding to said standard x-ray mammogram view plane; and

concurrently displaying said x-ray mammogram image on said user display with said concurrent display of said standard-plane thick-slice images and said coronal thick-slice images.

32. The method of claim 31, each slab subvolume being defined between first and second planes substantially parallel to said coronal plane, each slab subvolume having a thickness as measured between said first and second planes between about 2 mm and 20 mm.

33. The method of claim 32, said thickness being between about 4 mm and 10 mm.

34. The method of claim 33, wherein all of said slab subvolumes have the same thickness.

35. The method of claim 34, wherein an average thickness of a first subset of said slab subvolumes located closer to a chest wall is less than an average thickness of a second subset of said slab subvolumes located farther from the chest wall, for detection of smaller structures nearer to the chest wall.

36. The method of claim 28, further comprising:

processing said three-dimensional data volume according to at least one computer-aided detection (CAD) algorithm to detect anatomical abnormalities in the breast;

associating said detected abnormalities with corresponding coronal thick-slice images based upon their relative position within the three-dimensional data volume; and

displaying annotations on said corresponding coronal thick-slice images according to type and location of detected anatomical abnormality.