Image processing device, image processing method, and pathological diagnosis assistance system using same

• US 11,238,268 B2
• Filed: 05/24/2018
• Issued: 02/01/2022
• Est. Priority Date: 07/05/2017
• Status: Active Grant

• Current Assignee: Konica Minolta Inc.
• Original Assignee: Konica Minolta Inc.
• Inventors: Kazayama, Yuki
• Primary Examiner(s): Le, Vu
• Assistant Examiner(s): Gebreslassie, Winta
• Application Number:
  US16/615,311
• Publication Number:
  US 20200134286A1
• Time in Patent Office: 1,349 Days
• Field of Search: 382133
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10056 Microscopic image
• CPC Class Codes: G06T 2207/20081 Training; Learning
• CPC Class Codes: G06T 2207/20224 Image subtraction
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 2207/30068 Mammography; Breast
• CPC Class Codes: G06T 5/60 using machine learning, e.g. neural networks
• CPC Class Codes: G06T 5/75 Unsharp masking
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06V 20/695 Preprocessing, e.g. image segmentation

Abstract

An image processing device and an image processing method capable of clarifying a specific region, especially a stained region of the cell nucleus, by correcting in consideration of overlap of staining, thereby making discrimination easy, and a pathological diagnosis assistance system using the same are provided. A pathological stained image is decomposed into dye concentration images of respective dyes, dye information on the respective staining dyes are correlated, and the respective dye concentration images are corrected to emphasize a specific region.

Claims

1. An image processing device which emphasizes a specific region in a pathological stained image, comprising:

a dye concentration image generating module which decomposes the pathological stained image into dye concentration images of respective staining dyes; and

a dye concentration image correcting module which performs image processing for emphasizing the specific region by using each of the dye concentration images,

wherein the dye concentration image correcting module corrects each of the dye concentration images by amplifying information on a dye which stains the specific region or eliminating information on a dye which stains a region other than the specific region, the amplifying or eliminating is performed in consideration of overlap of staining.

2. The image processing device according to claim 1,

wherein the dye concentration image generating module generates each of the dye concentration images by a color deconvolution method based on a dye base.

3. The image processing device according to claim 1,

wherein the dye concentration image generating module decomposes into the plurality of dye concentration images at least including:

a first staining dye concentration image based on a first staining dye which stains the specific region in the pathological stained image; and

a second staining dye concentration image based on a second staining dye which stains a non-specific region in the pathological stained image.

4. The image processing device according to claim 3,

wherein the dye concentration image correcting module performs, on the second staining dye concentration image, a subtracting process of a product of a dye concentration of the first staining dye concentration image in the same position and a predetermined correction coefficient, thereby correcting the second staining dye concentration image.

5. The image processing device according to claim 3,

wherein the dye concentration image correcting module performs, on the first staining dye concentration image, an adding process of a product of a dye concentration of the first staining dye concentration image, a dye concentration of the second staining dye concentration image in the same position, and a predetermined correction coefficient, thereby correcting the first staining dye concentration image.

6. The image processing device according to claim 3,

wherein the dye concentration image correcting module performs, on the second staining dye concentration image, an adding process of a product of a dye concentration of the first staining dye concentration image in the same position and a predetermined correction coefficient, thereby correcting the second staining dye concentration image.

7. The image processing device according to claim 3,

wherein the dye concentration image correcting module performs, on the first staining dye concentration image, a subtracting process of a product of a dye concentration of the first staining dye concentration image, a dye concentration of the second staining dye concentration image in the same position, and a predetermined correction coefficient, thereby correcting the first staining dye concentration image.

8. The image processing device according to claim 4,

wherein the predetermined correction coefficient is an optimum value obtained through a learning process by machine learning.

9. The image processing device according to claim 1, further comprising:

a pathological stained image regenerating module which generates a corrected pathological stained image based on each of the dye concentration images corrected by the dye concentration image correcting module.

10. The image processing device according to claim 9, further comprising:

a specific region extracting module which extracts the specific region based on color information specific to a staining dye which stains the specific region from the corrected pathological stained image generated by the pathological stained image regenerating module.

11. A pathological diagnosis assistance system comprising:

a specimen staining part which stains a specimen to be diagnosed;

an imager which captures a pathological stained image of the stained specimen; and

the image processing device according to claim 1.

20. The image processing device according to claim 2,

wherein the dye concentration image generating module decomposes into the plurality of dye concentration images at least including:

a first staining dye concentration image based on a first staining dye which stains the specific region in the pathological stained image; and

a second staining dye concentration image based on a second staining dye which stains a non-specific region in the pathological stained image.

12. An image processing method of emphasizing a specific region in a pathological stained image, comprising:

decomposing the pathological stained image into dye concentration images of respective staining dyes; and

performing image processing for emphasizing the specific region by using each of the dye concentration images,

wherein the performing corrects each of the dye concentration images by amplifying information on a dye which stains the specific region or eliminating information on a dye which stains a region other than the specific region, the amplifying or eliminating is performed in consideration of overlap of staining.

13. The image processing method according to claim 12,

wherein the decomposing generates each of the dye concentration images by a color deconvolution method based on a dye base.

14. The image processing method according to claim 12,

wherein the decomposing decomposes into the plurality of dye concentration images at least including:

a first staining dye concentration image based on a first staining dye which stains the specific region in the pathological stained image; and

a second staining dye concentration image based on a second staining dye which stains a non-specific region in the pathological stained image.

15. The image processing method according to claim 14,

wherein the performing performs, on the second staining dye concentration image, a subtracting process of a product of a dye concentration of the first staining dye concentration image in the same position and a predetermined correction coefficient, thereby correcting the second staining dye concentration image.

16. The image processing method according to claim 14,

wherein the performing performs, on the first staining dye concentration image, an adding process of a product of a dye concentration of the first staining dye concentration image, a dye concentration of the second staining dye concentration image in the same position, and a predetermined correction coefficient, thereby correcting the first staining dye concentration image.

17. The image processing method according to claim 14,

wherein the performing performs, on the second staining dye concentration image, an adding process of a product of a dye concentration of the first staining dye concentration image in the same position and a predetermined correction coefficient, thereby correcting the second staining dye concentration image.

18. The image processing method according to claim 14,

wherein the performing performs, on the first staining dye concentration image, a subtracting process of a product of a dye concentration of the first staining dye concentration image, a dye concentration of the second staining dye concentration image in the same position, and a predetermined correction coefficient, thereby correcting the first staining dye concentration image.

19. The image processing method according to claim 15,

wherein the predetermined correction coefficient is an optimum value obtained through a learning process by machine learning.