Method for estimating a quantity of a blood component in a fluid canister

• US 9,824,441 B2
• Filed: 04/15/2015
• Issued: 11/21/2017
• Est. Priority Date: 04/15/2014
• Status: Active Grant

• Current Assignee: Gauss Surgical, Inc. (Stryker Corporation)
• Original Assignee: Gauss Surgical, Inc. (Stryker Corporation)
• Inventors: Satish, Siddarth, Miller, Kevin J., Madison, Christopher, Hosford, Andrew T., De, Titas, Zandifar, Ali, Lindquist, Eric, Aragon, Juan Carlos
• Primary Examiner(s): Lee, Jonathan S
• Application Number:
  US14/687,842
• Publication Number:
  US 20150294460A1
• Time in Patent Office: 951 Days
• CPC Class Codes: A61B 2010/0006 involving a colour change
• CPC Class Codes: G01N 21/274 Calibration, base line adjustment, drift correction
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/30024 Cell structures in vitro; Tissue sections in vitro
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06T 7/90 Determination of colour characteristics
• CPC Class Codes: G06V 10/56 relating to colour

Abstract

A system and method for assessing the concentration of a fluid component within a container, the method comprising: receiving data associated with an image of the canister; from the image, detecting a color grid comprising color elements coupled to the canister,; selecting a region of the image corresponding to a portion of the canister; determining a match between a detected color of the region and a shade in the set of colors associated with the color grid captured in the image; based upon a position of a color element corresponding to the shade in the color grid, retrieving a concentration of the blood component associated with the shade of color.

Claims

1. A method for assessing concentration of a fluid component within a container, comprising:

at a computing system in communication with an image acquisition device, receiving data associated with an image of the container generated by the image acquisition device;

detecting a color grid in the image, the color grid comprising an array of color elements, wherein each color element of the color grid is associated with at least one of a set of colors;

generating an adjusted image by adjusting a color setting in the image to align a color characteristic of a first color in the set of colors to a true color characteristic of the first color; and

determining a concentration of the fluid component based on a region of the adjusted image associated with the container.

2. The method of claim 1, wherein detecting the color grid comprises detecting corner features of the color grid.

3. The method of claim 2, wherein detecting the color grid further comprises:

fitting a homography between canonical space and an image space associated with the image; and

with the homography, transforming each of a set of regions associated with a color element of the color grid from canonical space to the image space.

4. The method of claim 1, further comprising at the computing system, determining the true color characteristic based upon a position of the first color in the color grid in the image.

5. The method of claim 4, wherein the true color characteristic is determined from a reference dataset of the color grid, and wherein generating the adjusted image comprises adjusting at least one component color setting of the image to align the color characteristic of the first color to the first true color characteristic of the first color.

6. The method of claim 5, further comprising generating a fit parameter derived from alignment of the color characteristic to the true color characteristic;

and providing an indication of suitability of the image, based upon the fit parameter.

7. The method of claim 1, wherein determining the concentration of the fluid component comprises determining the concentration from a set of color parameters derived from the region of the adjusted image.

8. The method of claim 7, wherein determining the concentration from the set of color parameters comprises transforming at least one color component into a concentration representative of the region of the adjusted image.

9. The method of claim 8, further comprising determining an amount of the fluid component within the container, the amount derived from the concentration multiplied by the volume of fluid within the container.

10. A method for assessing concentration of a fluid component received at a fluid receiver, the method implemented at a computer system and comprising:

receiving data associated with an image of the fluid receiver;

detecting a color grid in the image, the color grid comprising an array of color elements in proximity to the fluid receiver, wherein each color element of the color grid is associated with at least one of a set of colors;

generating an adjusted image by adjusting a color setting in the image to align a color characteristic of a first color in the set of colors to a true color characteristic of the first color; and

determining a concentration of the fluid component based on a region of the adjusted image associated with the container.

11. The method of claim 10, wherein receiving data associated with an image of the fluid receiver comprises receiving data associated with the image of at least one of:

a canister, a test strip, an absorbent pad, a surgical textile, a sponge, a fluid receiving bag, a drape, a cell salvage system, and a drain device.

12. The method of claim 11, wherein detecting the color grid comprises:

detecting a positional feature of the color grid;

determining an identifier of the fluid receiver upon decoding information from the color grid; and

retrieving a template of the color grid in canonical space upon reception of the identifier.

13. The method of claim 12, further comprising:

determining the true color characteristic of the first color in the set of colors captured in the image, based upon a position of the first color in the color grid in the image, wherein the true color characteristic is determined from a reference dataset of the color grid, and wherein generating the adjusted image comprises adjusting at least one of a red component color setting, a green component color setting, and a blue component color setting of the image to align the color characteristic of the first color to the first true color characteristic of the first color.

14. The method of claim 10, wherein determining the concentration of the fluid component based on the region of the adjusted image comprises at least one of 1) associating a color value of the region of the adjusted image with a color element of the color grid, wherein the color element of the color grid is associated with a predetermined concentration of the fluid component;

and

     2) generating a set of color parameters from the region of the adjusted image, and determining the concentration of the fluid component based upon a parametric model that receives the set of color parameters as inputs.

15. The method of claim 14, further comprising removing noise from the region of the adjusted image based upon an algorithm configured remove any pixels from the region whose color value is significantly different from a median color value of pixels of the region.

16. The method of claim 11, wherein determining the concentration of the fluid component from the region of the adjusted image comprises determining the concentration from a set of color parameters derived from the region of the adjusted image, the set of color parameters including a red component, a green component, and a blue component.

17. The method of claim 16, wherein determining a concentration of the fluid component from the region comprises determining the concentration of a bodily fluid component derived from at least one of:

urine, saline, ascites, bile, irrigant saliva, gastric fluid, mucus, pleural fluid, interstitial fluid, and fecal matter.

18. A system for assessing an amount of a fluid component, the system comprising:

a fluid receiver and a color grid comprising an array of color elements in proximity to the fluid receiver, wherein each color element of the color grid is associated with at least one of a set of colors;

an image acquisition device configured to capture an image of the fluid receiver and the color grid within a window of view; and

a computing system in communication with the image acquisition device and comprising;

a first module configured to detect the color grid within the image;

a second module configured to determine a first true color characteristic of a first color in the set of colors captured in the image, based upon a position of the first color in the color grid in the image;

a third module configured to generate an adjusted image by adjusting a color setting of the image to align a first color characteristic of the first color to the first true color characteristic of the first color;

a fourth module configured to determine a concentration of the fluid component from a region of the adjusted image corresponding to a portion of the fluid receiver; and

a fifth module configured to generate an analysis indicative of the amount of the fluid component at the fluid receiver, based upon the concentration of the fluid component and a volume of fluid received at the fluid receiver.

19. The system of claim 18, wherein the image acquisition device comprises a display configured to render fluid component amount information, derived from the analysis.

20. The system of claim 19, wherein the fluid receiver comprises a canister configured to receive fluid including a blood component, wherein the color grid is integrated with a quick response code including the array of color elements, and wherein the computing system is configured to decode an identifier of the canister from the quick response code.

21. The system of claim 18, wherein the fourth module of the computing system is configured to determine a hemoglobin concentration associated with the region, upon processing a red color component, a green color component, and a blue color component of the region with a parametric model, and wherein the fifth module of the computing system is configured to determine a hemoglobin mass associated with the volume of fluid received at the fluid receiver.