Interactive analytics of digital histology slides

• US 8,934,718 B2
• Filed: 08/01/2012
• Issued: 01/13/2015
• Est. Priority Date: 08/02/2011
• Status: Active Grant

• Current Assignee: NEC Corporation
• Original Assignee: NEC Laboratories America Inc (NEC Corporation)
• Inventors: Cosatto, Eric, Malon, Christopher, Graf, Hans P.
• Primary Examiner(s): Allison, Andrae S
• Application Number:
  US13/564,418
• Publication Number:
  US 20130034301A1
• Time in Patent Office: 895 Days
• Field of Search: None
• US Class Current: 382/190
• CPC Class Codes: G06V 10/95 structured as a network, e.g. client-server architectures

Abstract

Methods and systems for interactive image analysis include receiving a selection of a region of an image and a request for analysis of the selection at an interface layer, transferring the selection and the request to an interpretation layer for analysis, dividing the selected region of the image into a plurality of sub-sections optimized for parallel computation to provide an analysis result that minimizes perceptible delay between receiving the request and receipt of results, analyzing the sub-sections using one or more execution nodes using a copy of the image stored in a shared memory, and providing combined analysis results to the interface layer for display.

Claims

1. A method for interactive image analysis, comprising:

receiving a selection of a region of an image and a request for analysis of the selection at an interface layer;

transferring the selection and the request to an interpretation layer for analysis;

dividing the selected region of the image into a plurality of sub-sections optimized for parallel computation to provide an analysis result that minimizes perceptible delay between receiving the request and receipt of results;

analyzing the sub-sections using one or more execution nodes, each including one or more processors, using a copy of the image stored in a shared memory; and

providing combined analysis results to the interface layer for display;

wherein dividing the selected region of the image comprises;

determining sub-section size constraints;

forming an initial rectangular grid; and

iteratively conforming grid elements to the selection.

2. The method of claim 1, further comprising transferring predictive image data transfers to the interface layer that include portions of the image not requested by the user.

3. The method of claim 1, wherein the selection is a freeform selection by a user.

4. The method of claim 1, further comprising combining analysis results for each sub-section to provide combined analysis results.

5. The method of claim 1, further comprising pre-processing the image to produce intermediate results based on a determination of one or more likely regions of interest.

6. The method of claim 5, wherein analyzing the sub-sections includes performing further analysis on the intermediate results based on the selection.

7. The method of claim 1, wherein determining sub-section size constraints comprises determining a minimum width and height based on the request for analysis.

8. The method of claim 1, wherein determining sub-section size constraints comprises determining a maximum width and height based on available system resources.

9. The method of claim 1, wherein iteratively conforming grid elements to the selection includes resizing grid elements in accordance with the determined size constraints.

10. A system for interactive image analysis, comprising:

an interpretation layer configured to receive a selection of an image and a request for analysis of the selection from an interface layer, the interpretation layer comprising;

a shared memory configured to store full images and analysis results;

an execution controller configured to divide the selected region of the image into a plurality of sub-sections optimized for parallel computation to provide an analysis result that minimizes perceptible delay between receiving the request and receipt of results; and

one or more execution nodes, each including one or more processors, configured to receive one or more portions of the selection and to perform the requested analysis on said portions of the selection retrieved from the shared memory;

wherein the execution controller is further configured to determine sub-section size constraints, form an initial rectangular grid, and iteratively conform grid elements to the selection to divide the selected region of the image.

11. The system of claim 10, wherein the interpretation layer is further configured to transfer predictive image data transfers to the interface layer that include portions of the image not requested by the user.

12. The system of claim 10, wherein the selection is a freeform selection by a user.

13. The system of claim 10, wherein the execution controller is further configured to combine analysis results for each sub-section to provide combined analysis results.

14. The system of claim 10, wherein the execution controller is further configured to initiate pre-processing the image at the one or more execution nodes to produce intermediate results based on a determination of one or more likely regions of interest.

15. The system of claim 14, wherein the one or more execution nodes are further configured to perform further analysis on the intermediate results based on the selection.

16. The system of claim 10, wherein the execution controller is further configured to determine a minimum width and height based on the request for analysis to determine sub-section size constraints.

17. The system of claim 10, wherein the execution controller is further configured to determine a maximum width and height based on available system resources to determine sub-section size constraints.

18. The system of claim 10, wherein the wherein the execution controller is further configured to resize grid elements in accordance with the determined size constraints to conform grid elements to the selection.