Image Recognition and Analysis System and Software

• US 20080166037A1
• Filed: 01/07/2008
• Published: 07/10/2008
• Est. Priority Date: 01/08/2007
• Status: Active Grant

• Current Assignee: Pollack Laboratories, Inc.
• Original Assignee: Pollack Laboratories, Inc.
• Inventors: Darnell, Branson J., Pollack, Michael J., DiDomizio, Richard A., Mandrachia, Steven J., Reichl, Gary
• Granted Patent: US 8,254,657 B2
• Time in Patent Office: Days
• US Class Current: 382/133
• CPC Class Codes: G01N 15/0227 using imaging; using holography
• CPC Class Codes: G01N 15/1433 using image recognition
• CPC Class Codes: G01N 2015/0092 Monitoring flocculation or agglomeration
• CPC Class Codes: G01N 2015/025 Methods for single or grouped particles
• CPC Class Codes: G01N 2015/1497 Particle shape
• CPC Class Codes: G01N 21/8507 Probe photometers, i.e. with optical measuring part dipped into fluid sample
• CPC Class Codes: G06T 2207/10016 Video; Image sequence
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 2207/30108 Industrial image inspection
• CPC Class Codes: G06T 7/0002 Inspection of images, e.g. flaw detection

Abstract

A method of analyzing bubbles, cells, cell viability, or other particles or agglomerates in a process liquid contained in a vessel is provided. Images of bubbles, cells or other particles in the liquid are obtained in-situ with a vision probe extending through a wall of the vessel. The images are analyzed with image recognition software. The software measures at lease one of bubble, cell or particle size, mean diameter, surface area, flow rate, flow pattern, population distribution, viability, agglomerates or clumping, color change, viscosity, Sauter mean, ratio of surface area of bubbles relative to volume of bubbles, gas hold-up ratio of gas volume to volume of liquid, or interfacial area. The software distinguishes valid or viable bubbles, cells or particles that should be included in an analysis from invalid or non-viable bubbles, cells or particles that should not be included. The software can be configured to provide an analysis of the valid bubbles, cells or particles that fall within pre-set size and shape or viability parameters.

Claims

1. A method of analyzing bubbles, cells or other particles in a process liquid contained in a vessel, comprising the steps of:

obtaining images of the bubbles, cells or other particles in the liquid in-situ with a vision probe extending into the vessel; and

analyzing the images with image recognition software;

said analyzing step including measuring at lease one of bubble, cell or particle size, mean diameter, surface area, flow rate, flow pattern, population distribution, viability, agglomerates or clumping, color change, viscosity, Sauter mean, ratio of surface area of bubbles relative to volume of bubbles, gas hold-up ratio of gas volume to volume of liquid, and interfacial area.

2. A method according to claim 1, wherein said analyzing step includes identifying valid or viable bubbles, cells or particles from invalid or non-viable bubbles, cells, or other particles appearing in the images.

3. A method according to claim 2, wherein said identifying step includes distinguishing the invalid bubbles, cells or particles that appear in the images and that are stuck to the vision probe relative to the valid bubbles, cells or particles that are freely flowing in the process liquid.

4. A method according to claim 3, wherein said distinguishing step is accomplished by determining which bubbles, cells or particles appear in the same location in each of the images.

5. A method according to claim 4, wherein said images include at least about 100 frames of images.

6. A method according to claim 4, wherein a binary image is generated for each image, and wherein each binary image has a background with spots located thereon corresponding to the bubbles, cells or particles appearing in the images.

7. A method according to claim 6, wherein the spots that appear in the binary images that are of a size less than a pre-determined number of pixels are deleted from the binary images.

8. A method according to claim 7, wherein binary images having annular or unfilled spots are filled in such that the spots in the binary images are solid.

9. A method according to claim 7, wherein any spots in the binary images contacting a border of the images are identified as invalid bubbles, cells or particles.

10. A method according to claim 9, wherein data including the location, size and shape of each spot corresponding to one of the valid bubbles, cells or particles is generated.

11. A method according to claim 10, wherein a report presenting the data is generated relative to the data corresponding to spots of a pre-determined shape and size.

12. A method according to claim 1, further comprising the steps of:

releasing gas in the form of bubbles from a sparger in the process liquid within the vessel; and

agitating the process liquid with an agitator within the vessel.

13. A method according to claim 12, wherein said analyzing step is performed in substantially real time, and further comprising the step of controlling a process condition in the vessel based on said analyzing step.

14. A method according to claim 13, wherein said step of controlling includes adjusting a flow rate of gas through the sparger, adjusting a rate of rotation of the agitator, adjusting temperature, or adjusting turbidity.

15. A method according to claim 12, wherein said step of obtaining images includes projecting light from the vision probe into the vessel to illuminate the gas bubbles and recording the images of illuminated bubbles with a camera mounted on the vision probe.

16. A method according to claim 15, wherein said step of projecting light includes emitting or reflecting light directionally from behind the gas bubbles relative to the camera to produce back lit images.

17. A method according to claim 16, wherein said step of obtaining images only occurs at preset intervals of time, and wherein light is only projected from the vision probe during the pre-set intervals.

18. A method according to claim 16, wherein the vision probe is flexible, and further comprising the step of re-positioning the vision probe within the vessel during an on-going process to observe a different region of the process fluid within the vessel.

19. A method according to claim 18, wherein said step of re-positioning the vision probe includes articulating the probe via a ball joint.

20. A system for analyzing bubbles, cells or particles in a process liquid, comprising:

a vessel containing a process liquid having gas bubbles, cells or particles therein;

a vision probe extending within an interior of said vessel and including a camera for recording digital images of the process liquid and gas bubbles, cells or particles flowing therein; and

a computer processor having image recognition software, said camera being interconnected to said processor for transferring said images in substantially real time to said processor for analysis by said software in substantially real time;

at lease one of bubble, cell or particle size, mean diameter, surface area, flow rate, flow pattern, population distribution, viability, agglomerates or clumping, color change, viscosity, Sauter mean, ratio of surface area of bubbles relative to volume of bubbles, gas hold-up ratio of gas volume to volume of liquid, or interfacial area being measurable by said software.

21. A system according to claim 20, further comprising a sparger extending within said sealed vessel for releasing gas in the form of bubbles directly into the process liquid.

22. A system according to claim 21, further comprising an agitator located with the vessel.

23. A system according to claim 22, wherein said software automatically causes adjustments to a flow rate of gas through the sparger or a rate of rotation of the agitator based on analysis of the images.

24. A system according to claim 23, wherein said probe includes non-contact optical sensors selected from the group consisting of a temperature sensor, a pressure sensor, and chemical analysis sensor.