Display control and image processing of a cell image

• US 10,311,581 B2
• Filed: 02/28/2012
• Issued: 06/04/2019
• Est. Priority Date: 02/28/2011
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Hayakawa, Tomohiro, Kunihiro, Takeshi, Matsui, Eriko
• Primary Examiner(s): Cobb, Michael J
• Application Number:
  US13/984,672
• Publication Number:
  US 20130321459A1
• Time in Patent Office: 2,653 Days
• Field of Search: 345629, 382106, 382107, 382128, 382131, 382133, 702 21
• CPC Class Codes: G01B 11/00 Measuring arrangements characterised by the use of optical techniques
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 7/0016 involving temporal comparison
• CPC Class Codes: G06T 7/215 Motion-based segmentation

Abstract

Apparatus and methods for display control and image processing that enable easy and noninvasive observation of an object are described. Display control of a cell image may include generating a motion amount for subregions of the cell image and displaying the motion amount superimposed on the cell image. Image processing of a cell image may include generating a motion amount for subregions of a cell image and evaluating a state of propagation of the motion of the cells.

Claims

1. An image processing apparatus comprising:

a processor configured to;

generate a motion amount absolute value for each subregion of a plurality of non-overlapping subregions for a first image and a second image of a plurality of images, wherein the first image and the second image are images of cells and individual subregions of the plurality of subregions include a portion of the cells, and wherein generating a motion amount absolute value comprises detecting a motion vector for each subregion and determining a magnitude of the motion vector;

identify a first one or more subregions of the plurality of subregions in the first image as having a first motion amount absolute value by analyzing a distribution of the motion amount absolute values for the first image and a second one or more subregions of the plurality of subregions in the second image as having the first motion amount absolute value;

identify a third one or more subregions of the plurality of subregions in the first image as having a second motion amount absolute value by analyzing the distribution of the motion amount absolute values for the first image and a fourth one or more subregions of the plurality of subregions in the second image as having the second motion amount absolute value, wherein the first motion amount absolute value is different than the second motion amount absolute value;

determine a temporal change of a feature of a region having the first motion amount absolute value by comparing the first one or more subregions of the plurality of subregions in the first image to the second one or more subregions of the plurality of subregions in the second image;

determine a temporal change of a feature of a region having the second motion amount absolute value by comparing the third one or more subregions of the plurality of subregions in the first image to the fourth one or more subregions of the plurality of subregions in the second image; and

evaluate a state of propagation of pulsation among at least a portion of the cells based, at least in part, on the temporal change of the feature of the region having the first motion amount absolute value and/or the temporal change of the feature of the region having the second motion amount absolute value.

2. The image processing apparatus according to claim 1, further comprising a display configured to display an image of a comparison result of the state of propagation of pulsation among at least a portion of the cells with a case where it is certain that the motion of the cells is normal.

3. The image processing apparatus according to claim 1, wherein determining the temporal change of a feature of a region having the first motion amount absolute value further comprises comparing a size of the first one or more subregions of the plurality of subregions in the first image to a size of the second one or more subregions of the plurality of subregions in the second image.

4. The image processing apparatus according to claim 1, wherein determining the temporal change of a feature of a region having the first motion amount absolute value further comprises comparing a shape of the first one or more subregions of the plurality of subregions in the first image to a shape of the second one or more subregions of the plurality of subregions in the second image.

5. The image processing apparatus according to claim 1, wherein determining the temporal change of a feature of a region having the first motion amount absolute value further comprises comparing a position of the first one or more subregions of the plurality of subregions in the first image to a position of the second one or more subregions of the plurality of subregions in the second image.

6. The image processing apparatus according to claim 1, wherein the processor is configured to evaluate a state of propagation of pulsation by quantitatively evaluating a change of the state of propagation of pulsation among at least a portion of the cells by obtaining a difference of the temporal change of the feature of the region having the first motion amount absolute value and/or the temporal change of the feature of the region having the second motion amount absolute value with the case where it is certain that the motion of the cells is normal, and by evaluating the difference.

7. The image processing apparatus according to claim 6, wherein the processor is configured to evaluate a state of propagation of pulsation by evaluating a change of a motionless region that does not have motion in the first image and the second image.

8. The image processing apparatus according to claim 6, wherein the processor is configured to evaluate a state of propagation of pulsation by evaluating a change of a speed of displacement of the region having the first motion amount absolute value and/or the region having the second motion amount absolute value.

9. The image processing apparatus according to claim 6, wherein the processor is configured to evaluate a state of propagation of pulsation by evaluating a change of a locus of a center of gravity of the region having the first motion amount absolute value and/or the region having the second motion amount absolute value.

10. The image processing apparatus according to claim 6, wherein the processor is configured to evaluate a state of propagation of pulsation by evaluating a histogram regarding a speed and a direction of motion of the cells in the first image and the second image.

11. An image processing method of an image processing apparatus, the method comprising the steps of:

generating a motion amount absolute value for each subregion of a plurality of non-overlapping subregions for a first image and a second image of a plurality of images, wherein the first image and the second image are images of cells and individual subregions of the plurality of subregions include a portion of the cells, and wherein generating a motion amount absolute value comprises detecting a motion vector for each subregion and determining a magnitude of the motion vector;

identifying a first one or more subregions of the plurality of subregions in the first image as having a first motion amount absolute value by analyzing a distribution of the motion amount absolute values for the first image and a second one or more subregions of the plurality of subregions in the second image as having the first motion amount absolute value;

identifying a third one or more subregions of the plurality of subregions in the first image as having a second motion amount absolute value by analyzing the distribution of the motion amount absolute values for the first image and a fourth one or more subregions of the plurality of subregions in the second image as having the second motion amount absolute value, wherein the first motion amount absolute value is different than the second motion amount absolute value;

determining a temporal change of a feature of a region having the first motion amount absolute value by comparing the first one or more subregions of the plurality of subregions in the first image to the second one or more subregions of the plurality of subregions in the second image;

determining a temporal change of a feature of a region having the second motion amount absolute value by comparing the third one or more subregions of the plurality of subregions in the first image to the fourth one or more subregions of the plurality of subregions in the second image; and

evaluating a state of propagation of pulsation among at least a portion of the cells based, at least in part, on the temporal change of the feature of the region having the first motion amount absolute value and/or the temporal change of the feature of the region having the second motion amount absolute value.

12. A non-transitory computer-readable storage medium having stored thereon instructions which, when executed by a processor, implement a method comprising:

generating a motion amount absolute value for each subregion of a plurality of non-overlapping subregions for a first image and a second image of a plurality of images, wherein the first image and the second image are images of cells and individual subregions of the plurality of subregions include a portion of the cells, and wherein generating a motion amount absolute value comprises detecting a motion vector for each subregion and determining a magnitude of the motion vector;

identifying a first one or more subregions of the plurality of subregions in the first image as having a first motion amount absolute value by analyzing a distribution of the motion amount absolute values for the first image and a second one or more subregions of the plurality of subregions in the second image as having the first motion amount absolute value;

identifying a third one or more subregions of the plurality of subregions in the first image as having a second motion amount absolute value by analyzing the distribution of the motion amount absolute values for the first image and a fourth one or more subregions of the plurality of subregions in the second image as having the second motion amount absolute value, wherein the first motion amount absolute value is different than the second motion amount absolute value;

determining a temporal change of a feature of a region having the first motion amount absolute value by comparing the first one or more subregions of the plurality of subregions in the first image to the second one or more subregions of the plurality of subregions in the second image;

determining a temporal change of a feature of a region having the second motion absolute value by comparing the third one or more subregions of the plurality of subregions in the first image to the fourth one or more subregions of the plurality of subregions in the second image; and

evaluating a state of propagation of pulsation among at least a portion of the cells based, at least in part, on the temporal change of the feature of the region having the first motion amount absolute value and/or the temporal change of the feature of the region having the second motion amount absolute value.