ANALYSIS DEVICE, ANALYSIS METHOD, ANALYSIS PROGRAM AND DISPLAY DEVICE

• US 20190236778A1
• Filed: 06/30/2016
• Published: 08/01/2019
• Est. Priority Date: 06/30/2016
• Status: Active Grant

• Current Assignee: University of Tokyo
• Original Assignee: Nikon Corporation
• Inventors: SAIGO, Takuro, FURUTA, Shinichi, TAKEI, Shunsuke, YAMASHITA, Masafumi, YAMASAKI, Shoko
• Granted Patent: US 11,645,859 B2
• Time in Patent Office: Days
• CPC Class Codes: C12M 1/34 Measuring or testing with condition measuring or sensing means, e.g. colony counters
• CPC Class Codes: G01N 33/48 Biological material, e.g. blood, urine G01N33/02, G01N33/26, G01N33/44, G01N33/46 take precedence; Haemocytometers counting blood corpuscules distributed over a surface by scanning the surface G06M11/02
• CPC Class Codes: G06T 2207/10056 Microscopic image
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 2207/30072 Microarray; Biochip, DNA array; Well plate
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/0016 involving temporal comparison
• CPC Class Codes: G06T 7/73 using feature-based methods
• CPC Class Codes: G06V 10/44 Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
• CPC Class Codes: G06V 20/69 Microscopic objects, e.g. biological cells or cellular parts
• CPC Class Codes: G06V 20/695 Preprocessing, e.g. image segmentation
• CPC Class Codes: G06V 20/698 Matching; Classification

Abstract

An analysis device configured to analyze a correlation between feature values in a cell in response to a stimulus includes: a cell-image acquiring unit configured to acquire a plurality of cell images in which the cell that is stimulated is captured; a feature value calculating unit configured to calculate a feature value for constituent elements that form the cell, based on the plurality of cell images acquired by the cell-image acquiring unit; a correlation calculating unit configured to use the feature value calculated by the feature value calculating unit and to calculate correlations between the constituent elements; a correlation selecting unit configured to select a first correlation from the correlations calculated by the correlation calculating unit; and an image selecting unit configured to select a first cell image from the plurality of cell images that are captured, based on the first correlation that is selected.

Claims

1-30. -30. (canceled)

31. An image selecting apparatus comprising:

a correlation selecting unit configured to select a desired correlation among a plurality of correlations between constituent elements calculated from a change in a feature value concerning constituent elements that form a cell, and

an image selecting unit configured to select an image, which includes a constituent element corresponding to the desired correlation, based on the selected desired correlation.

32. The image selecting apparatus according to claim 31, wherein the change in the feature value concerning the constituent element is calculated from an image in which a cell is captured.

33. The image selecting apparatus according to claim 32, wherein the change in the feature value concerning the constituent element is calculated from a plurality of images in which a cell is captured.

34. The image selecting apparatus according to claim 33, wherein the image selecting apparatus associates the change in the feature value concerning the constituent element and the plurality of images, and displays an image corresponding to a change in a feature value concerning the selected constituent element.

35. The image selecting apparatus according to claim 33, wherein the image selecting apparatus associates a value of the feature value concerning the constituent element and the image in which the cell is captured, and displays an image corresponding to the value of the feature value.

36. The image selecting apparatus according to claim 31, wherein the image selecting unit selects the image based on information of the image within the plurality of images.

37. The image selecting apparatus according to claim 36, wherein the information of the image includes at least one piece of information on a number of cells in the image, a shape of the cell, abnormality of the cell, presence or absence of abnormality, contrast, a number of the constituent element, a shape of the constituent element and a difference between a focal position.

38. The image selecting apparatus according to claim 36, wherein the image selecting apparatus calculates the change in the feature value concerning the constituent element of the cell from the image selected by the image selecting unit.

39. The image selecting apparatus according to claim 34, wherein the image selecting unit selects an image different from the selected image from the plurality of images based on the selected image selected by the image selecting unit.

40. The image selecting apparatus according to claim 39, wherein the image selecting apparatus selects the image different from the selected image through machine learning using the selected image.

41. The image selecting apparatus according to claim 31, wherein the change in the feature value concerning the constituent element is based on a value of the feature value at a first time and a value of the feature value at a second time, and the image selecting unit selects a first cell image, which is obtained at the first time, and a second cell image which is obtained at the second time.

42. The image selecting apparatus according to claim 41, wherein the image selecting unit selects an image of which shape resembles the first cell image and the second cell image.

43. The image selecting apparatus according to claim 42, wherein the image selecting unit displays the first cell image and the second cell image.

44. The image selecting apparatus according to claim 43, wherein, a value of the feature value at the first time and the image in which the cell is captured are associated with each other and a value of the feature value at the second time and the image in which the cell is captured are associated with each other, and the image selecting apparatus displays the selected first cell image corresponding to the value of the feature value at the first time and the selected second cell image corresponding to the value of the feature value at the second time.

45. The image selecting apparatus according to claim 32, wherein the change in the feature value concerning the constituent element include at least one of a change in luminosity, dispersion of luminosity, a change in area, a change of position, and a change in the number, within the image in which the cell is captured.

46. The image selecting apparatus according to claim 31, wherein the constituent element of the cell includes a first constituent element and a second constituent element, and

the desired correlation is a correlation between a change in a feature value concerning the first constituent element and a change in a feature value concerning the second constituent element.

47. The image selecting apparatus according to claim 46, wherein the correlation selecting unit selects the desired correlation by selecting the first constituent element and the second constituent element.

48. The image selecting apparatus according to claim 46, wherein the correlation selecting unit selects the first correlation by selecting a feature value concerning the first constituent element and a feature value concerning the second constituent element.

49. The image selecting apparatus according to claim 31, wherein the cell is a biological cell or fixed cell.

50. The image selecting apparatus according to claim 31, wherein the constituent element includes at least one of a gene, protein, and an organelle.

51. The image selecting apparatus according to claim 32, wherein the image selecting apparatus changes the selected desired correlation based on the selected image selected by the image selecting unit.

52. The image selecting apparatus according to claim 51, wherein the image selecting apparatus changes the selected desired correlation to a correlation different from the desired correlation based on the selected image selected by the image selecting unit.

53. The image selecting apparatus according to claim 52, wherein the image selecting apparatus calculates the different correlation by using an image different from the image used for calculating the desired correlation.

54. The image selecting apparatus according to claim 31, wherein the change in the feature value occurs due to a stimulus applied to the cell.

55. The image selecting apparatus according to claim 31, comprising a controller configured to display the image selected by the image selecting unit as a display image.

56. An image selecting method, comprising the steps of:

selecting a desired correlation among a plurality of correlations between constituent elements calculated from a change in a feature value concerning constituent elements that form a cell, and

selecting an image, which includes a constituent element corresponding to the desired correlation, based on the selected desired correlation.

57. An image selecting program, the program comprising the steps of:

selecting a desired correlation among a plurality of correlations between constituent elements calculated from a change in a feature value concerning constituent elements that form a cell, and

selecting an image, which includes a constituent element corresponding to the desired correlation, based on the selected desired correlation.

58. A display apparatus comprising:

a correlation selecting unit configured to select a desired correlation among a plurality of correlations between constituent elements calculated from a change in a feature value concerning constituent elements that form a cell,

an image selecting unit configured to select an image, which includes a constituent element corresponding to the desired correlation, based on the selected desired correlation, and

a display unit configured to display the selected image.

59. A calculating apparatus comprising:

a correlation calculating unit configured to calculate a plurality of correlations between constituent elements from a change in a feature value concerning a constituent elements that form a cell, and

a calculating unit configured to associate the correlation calculated by the correlation calculating unit and a cell image used for calculating the correlation.