System and method for navigating a tomosynthesis stack using synthesized image data

• US 9,805,507 B2
• Filed: 02/13/2013
• Issued: 10/31/2017
• Est. Priority Date: 02/13/2012
• Status: Active Grant

• Current Assignee: Hologic Incorporated
• Original Assignee: Hologic Incorporated
• Inventors: Chen, Jin-Long, Chui, Haili, Gkanatsios, Nikolaos, Kreeger, Kevin, Marshall, Julian, Mislan, David, Prazer, Mark A., Zhang, Xiangwei
• Primary Examiner(s): Dunphy, David F
• Application Number:
  US14/376,530
• Publication Number:
  US 20150052471A1
• Time in Patent Office: 1,721 Days
• CPC Class Codes: A61B 6/025 Tomosynthesis
• CPC Class Codes: A61B 6/466 adapted to display 3D data
• CPC Class Codes: A61B 6/502 for diagnosis of breast, i.e. mammography
• CPC Class Codes: G06F 3/04815 Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06T 19/003 Navigation within 3D models or images
• CPC Class Codes: G06T 2207/30068 Mammography; Breast
• CPC Class Codes: G06T 7/0012 Biomedical image inspection

Abstract

A system and method for displaying and navigating breast tissue is configured for or includes obtaining a plurality of 2D and/or 3D images of a patient'"'"'s breast; generating a synthesized 2D image of the breast from the obtained images; displaying the synthesized 2D image; receiving a user command, or otherwise detecting through a user interface, a user selection or other indication of an object or region in the synthesized 2D image; and displaying at least a portion of one or more images from the plurality, including a source image and/or most similar representation of the user selected or indicated object or region.

Claims

1. A method for processing, displaying and navigating breast tissue images, comprising:

obtaining a plurality of 2D and/or 3D images of a patient'"'"'s breast, wherein respective images of the obtained plurality of images contain one or more regions defined by X,Y coordinate locations that are common for multiple images of the plurality;

generating a synthesized 2D image of the patient'"'"'s breast by importing respective regions from the obtained plurality of images into a merged image, wherein an image from which a respective region is imported into the merged image comprises a source image for that region, wherein the imported regions are incorporated into the merged image at X,Y coordinate locations corresponding to X,Y coordinate locations of the respective regions in their source image, and wherein one of each said one or more common regions is imported from the plurality of images into the merged image based upon a comparison of one or more attributes of the common region in each image that contains the respective common image;

displaying the synthesized 2D image;

receiving a user command, or otherwise detecting through a user interface, a user selection or other indication of a region or of an object at least partially contained in said region in the displayed synthesized 2D image; and

displaying at least a portion of one or more source images of the user selected or indicated region or object.

2. The method of claim 1, wherein the plurality of 2D and/or 3D images of a patient'"'"'s breast comprises acquired or synthesized X,Y coordinate slices at differing z axis locations of the breast, the images having one or more corresponding X,Y coordinate locations.

3. The method of claim 1, wherein at least one of the one or more attributes is user selected.

4. The method of claim 1, further comprising generating an index map comprising identifying information of selected images of the plurality of 2D and/or 3D images that are source images of regions and/or objects displayed in the synthesized 2D image.

5. The method of claim 1, wherein the user selected or indicated object or region is automatically highlighted in the displayed synthesized 2D image and/or in the displayed at least portions of the one or more corresponding source images.

6. The method of claim 5, wherein the object or region is highlighted in response to a further received user command or to certain user activity detected through the user interface.

7. The method of claim 5, wherein the object or region is highlighted by a contour line representing a boundary of the highlighted object or region.

8. The method of claim 5, wherein the object or region is highlighted in a manner indicating that the highlighted object or region is or contains a specified type of tissue structure.

9. The method of claim 1, wherein the plurality of 2D and/or 3D images is selected from a group consisting of tomosynthesis projection images, tomosynthesis reconstruction slices, mammography images, contrast enhanced mammography images, synthesized 2D images, and combinations thereof.

10. A method for processing, displaying and navigating breast tissue images, comprising:

obtaining a plurality of tomosynthesis images comprising volumetric image data of a patient'"'"'s breast;

generating a synthesized 2D image of the patient'"'"'s breast by importing one or more objects and/or regions from the tomosynthesis images into a merged image, wherein respective tomosynthesis images of the plurality contain one or more regions defined by X,Y coordinate locations that are common for multiple tomosynthesis images of the plurality;

displaying the synthesized 2D image;

receiving a user command, or otherwise detecting through a user interface, a user selection or other indication of an object or region in the synthesized 2D image; and

displaying at least a portion of one or more tomosynthesis images from the plurality, including a source image of the user selected or indicated object or region, wherein

(i) an image from which a respective object and/or region is imported into the merged image comprises a source image for that object or region,

(ii) the imported objects and/or regions are incorporated into the merged image at X,Y coordinate locations corresponding to X,Y coordinate locations of the respective objects and/or regions in their source image, and

(iii) one of each said one or more common regions is imported from the plurality of tomosynthesis images into the merged image based upon a comparison of one or more attributes of the common region in each tomosynthesis image that contains the respective common image.

11. The method of claim 10, further comprising generating an index map, the index map comprising identifying information of selected tomosynthesis images of the plurality that are source images or that otherwise contain a most similar representation of regions and/or objects in the synthesized 2D image.

12. A method for processing, displaying and navigating breast tissue images, comprising:

obtaining a plurality of 2D and/or 3D images of a patient'"'"'s breast, wherein respective images of the obtained plurality of images contain one or more regions defined by X,Y coordinate locations that are common for multiple images of the plurality;

generating a synthesized 2D image of the patient'"'"'s breast by importing respective regions from the obtained plurality of images into a merged image, wherein an image from which a respective region is imported into the merged image comprises a source image for that region, the imported regions are incorporated into the merged image at X,Y coordinate locations corresponding to X,Y coordinate locations of the respective regions in their source image, and wherein one of each said one or more common regions is imported from the plurality of images into the merged image based upon a comparison of one or more attributes of the common region in each image that contains the respective common image;

displaying the synthesized 2D image;

detecting through a user interface a location of a user movable input device in the displayed synthesized 2D image; and

concurrently displaying a respective source image of a tissue structure or region that corresponds to a given location of a user movable input device in the displayed synthesized 2D image.