Graphical user interface for analysis of red blood cells

• US 10,089,518 B2
• Filed: 05/02/2014
• Issued: 10/02/2018
• Est. Priority Date: 05/08/2013
• Status: Active Grant

• Current Assignee: Cellavision AB
• Original Assignee: Cellavision AB
• Inventors: Bengtsson, Hans-Inge, Palm, Lisbeth, Erikson, Mats, Strahlen, Kent, Almers, Martin, Kapferer, Anna, Nilson, Mattias, Klein, Benny, Carlsson, Gert-Ola
• Primary Examiner(s): Chu, Randolph I
• Application Number:
  US14/888,772
• Publication Number:
  US 20160078276A1
• Time in Patent Office: 1,614 Days
• Field of Search: None
• CPC Class Codes: G06F 18/40 Software arrangements specially adapted for pattern recognition, e.g. user interfaces or toolboxes therefor
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 2200/24 involving graphical user interfaces [GUIs]
• CPC Class Codes: G06T 2207/10004 Still image; Photographic image
• CPC Class Codes: G06T 7/10 Segmentation; Edge detection motion-based segmentation G06T7/215
• CPC Class Codes: G06V 10/945 User interactive design; Environments; Toolboxes
• CPC Class Codes: G06V 20/69 Microscopic objects, e.g. biological cells or cellular parts
• CPC Class Codes: G06V 20/698 Matching; Classification

Abstract

Methods and systems for generating a graphical user interface for analysis of red blood cells. The method generates a first view of the graphical user interface by highlighting red blood cells in an image that are classified into at least one group indicated by a user input. The method also generates a second view by extracting individual red blood cells being classified into the at least one group indicated by the user input from the image of red blood cells and displaying them group-wise.

Claims

1. A method for displaying red blood cells in a graphical user interface for analysis of red blood cells, comprising:

receiving, by a receiving device, an image depicting a sample of red blood cells;

receiving, by the receiving device, red blood cell data comprising, for each red blood cell in the image,

a segmentation and a position of the red blood cell in the image, and

a classification of the red blood cell into at least one group with respect to at least one property of red blood cells;

receiving, by a user input component, a first user input indicating at least one group into which the red blood cells in the image have been classified;

generating, with a processing unit, a first view of the graphical user interface by;

finding all red blood cells in the red blood cell data which are classified into the at least one group indicated by the first user input,

highlighting only the found red blood cells in the image, and

displaying the image with highlighted red blood cells in the first view;

generating, with the processing unit, a second view that is different from the first view of the graphical user interface by, for each of the at least one group indicated by the first user input;

finding all red blood cells in the red blood cell data that are classified into the at least one group,

extracting each of the red blood cells that are classified into the at least one group from the image by extracting image data from the image falling within the segmentation of each of the red blood cells that are classified into the at least one group, and

displaying the extracted red blood cells in a sub-view of the second view that corresponds to the at least one group.

2. The method of claim 1, wherein the first user input indicates a property of red blood cells, thereby indicating all groups being associated with that property.

3. The method of claim 1, further comprising:

receiving, via a user input component, a second user input indicating a selected group of the at least one group indicated by the first user input; and

in response thereto, updating the image displayed in the sub-view of the first view to only highlight red blood cells of the selected group.

4. The method of claim 1, further comprising:

receiving, via a user input component, a third user input indicating one or more selected red blood cells; and

in response thereto, updating the image displayed in the sub-view of the first view to only highlight the selected one or more red blood cells.

5. The method of claim 1, comprising:

receiving, via a user input component, a third user input indicating a selected red blood cell; and

finding, in the red blood cell data, the position of the selected red blood cell, extracting image data from the image corresponding to an area that includes the selected red blood cell, increasing the magnification level of the extracted image data, and displaying it in a second sub-view of the second view.

6. The method of claim 1, comprising

receiving a fourth user input, via a user input component, indicating a red blood cell in the second view, and for that red blood cell:

updating the classification in the red blood cell data from a first group indicated by the first user input to a second group indicated by the first user input,

updating the second view to display the extracted red blood cell in the sub-view corresponding to the second group instead of in the sub-view corresponding to the first group.

7. The method of claim 1, wherein the step of highlighting the found red blood cells in the image comprises

for each red blood cell which is not classified into the at least one group indicated by the first user input, decreasing the contrast of the image in a portion inside the segmentation of the red blood cell relative to a background of the image, wherein the background of the image is formed of those parts of the image where no red blood cells are depicted.

8. The method of claim 7, wherein the step of decreasing the contrast of the image in a portion inside the segmentation of the red blood cell comprises:

setting the intensity of the image in the portion inside the segmentation of the red blood cell to a combination of an original intensity of the image in the portion inside the segmentation of the red blood cell and an intensity of the background of the image.

9. The method of claim 1, wherein the red blood cell data further comprises, for each red blood cell in the image, a confidence of the classification of the red blood cell into the at least one group, and wherein the step of generating a second view of the graphical user interface further comprises, for each of the at least one group indicated by the first user input, sorting the extracted red blood cells with respect to the confidence of the classification of the red blood cells into the group.

10. The method of claim 1, wherein the step of receiving an image depicting a sample of red blood cells comprises receiving a plurality of images, the union of which depicts the sample of red blood cells, wherein the red blood cell data further comprises, for each red blood cell in the images, an identification of an image of the plurality of images in which the red blood cell is depicted, and wherein the step of displaying the image with highlighted red blood cells comprises displaying the union of the plurality of images with highlighted red blood cells.

11. The method of claim 1, further comprising

including in a sub-view of the second view corresponding to a third group a graphical marking of the extracted red blood cells that also ore classified into a fourth group, wherein the third and the fourth groups are associated with different properties of red blood cells.

14. A non-transitory computer-readable medium comprising computer code instructions adapted to carry out the method of claim 1 when executed in a device having processing capabilities.

12. An apparatus for displaying red blood cells in a graphical user interface for analysis of red blood cells, comprising:

a receiving component configured to receive an image depicting a sample of red blood cells, and red blood cell data comprising, for each red blood cell in the image,

a segmentation and a position of the red blood cell in the image, and

a classification of the red blood cell into at least one group with respect to at least one property of red blood cells;

a user input component configured to receive a first user input indicating at least one group into which the red blood cells in the image have been classified;

a processing unit configured to generate a first view of the graphical user interface by;

finding all red blood cells in the red blood cell data which are classified into the at least one group indicated by the first user input,

highlighting only the found red blood cells in the image, and

displaying the image with highlighted red blood cells in the first view;

the processing unit being further configured to generate a second view that is different from the first view of the graphical user interface by, for each of the at least one group indicated by the first user input;

finding all red blood cells in the red blood cell data that are classified into that group,

extracting each of the red blood cells that are classified into that group from the image by extracting image data from the image falling within the segmentation of each of the red blood cells that are classified into that group, and

displaying the extracted red blood cells in a sub-view of the second view that corresponds to that group.

13. A graphical user interface for analysis of red blood cells, comprising:

a receiving interface configured to receive an image depicting a sample of red blood cells, and red blood cell data comprising, for each red blood cell in the image,

a segmentation and a position of the red blood cell in the image, and

a classification of the red blood cell into at least one group with respect to at least one property of red blood cells,

a user input interface configured to receive a first user input indicating at least one group into which the red blood cells in the image have been classified;

a first view which has been generated by;

finding all red blood cells in the red blood cell data which are classified into the at least one group indicated by the first user input,

highlighting only the found red blood cells in the image, and

displaying the image with highlighted red blood cells in the first view;

a second view that is different from the first view which has been generated by, for each of the at least one group indicated by the first user input;

finding all red blood cells in the red blood cell data that are classified into that group,

extracting each of the red blood cells that are classified into that group from the image by extracting image data from the image falling within the segmentation of each of the red blood cells that are classified into that group, and

displaying the extracted red blood cells in a sub-view of the second view that corresponds to that group.

15. A system for displaying red blood cells in a graphical user interface for analysis of red blood cells, comprising:

a depicting device arranged to depict a sample of red blood cells;

a display; and

an apparatus for generating a graphical user interface according to claim 13, the apparatus being connected to the depicting device and the display, wherein the apparatus is arranged to receive an image depicting a sample of red blood cells from the depicting device and to display the graphical user interface on the display.