Smartphone-based apparatus and method

• US 9,787,815 B2
• Filed: 07/21/2015
• Issued: 10/10/2017
• Est. Priority Date: 01/21/2013
• Status: Active Grant

• Current Assignee: Cornell University
• Original Assignee: Cornell University
• Inventors: Erickson, David, Lee, Seoho, O'Dell, Dakota, Mehta, Saurabh, Oncescu, Vlad-Victor, Mancuso, Matthew
• Primary Examiner(s): Wendell, Andrew
• Application Number:
  US14/804,386
• Publication Number:
  US 20160080548A1
• Time in Patent Office: 812 Days
• CPC Class Codes: G01N 2021/7759 Dipstick; Test strip
• CPC Class Codes: G01N 21/78 producing a change of colour
• CPC Class Codes: G01N 21/80 Indicating pH value
• CPC Class Codes: G01N 21/8483 Investigating reagent band test-element handling not specific to a test method G01N33/4875; analytical elements specific to chemical analysis of biological material G01N33/52; autometer with reagent band G01N35/04
• CPC Class Codes: G01N 2201/0221 Portable; cableless; compact; hand-held
• CPC Class Codes: G01N 2201/062 LED's
• CPC Class Codes: G01N 2201/127 Calibration; base line adjustment; drift compensation
• CPC Class Codes: G01N 33/48785 Electrical and electronic details of measuring devices for physical analysis of liquid biological material not specific to a particular test method, e.g. user interface or power supply
• CPC Class Codes: H04M 1/72409 by interfacing with external accessories hands-free H04M1/60

Abstract

A method for obtaining a point-of-collection, selected quantitative indicia of an analyte on a test strip using a smartphone involves imaging a test strip on which a colorimetric reaction of a target sample has occurred due to test strip illumination by the smartphone. The smartphone includes a smartphone app and a smartphone accessory that provides an external environment-independent/internal light-free, imaging environment independent of the smartphone platform being used. The result can then be presented quantitatively or turned into a more consumer-friendly measurement (positive, negative, above average, etc.), displayed to the user, stored for later use, and communicated to a location where practitioners can provide additional review. Additionally, social media integration can allow for device results to be broadcast to specific audiences, to compare healthy living with others, to compete in health based games, create mappings, and other applications.

Claims

1. A method performed by an imaging system for obtaining a point-of-collection, selected qualitative and/or quantitative indicia of an analyte on a test platform, comprising:

providing a modular assay test platform (e.g., test strip) having at least one test region and a control region;

providing an analyte to be tested on the at least one test region;

providing an imaging system to implement the steps of;

obtaining an image of the at least one test region containing the analyte and the control region;

selecting an array of pixels in the image of the at least one test region containing the analyte and the control region;

determining a Red-Green-Blue-Alpha color value for each of the arrays of pixels;

extracting a test image region for analysis;

converting the Red-Green-Blue-Alpha array to an alternate color space as determined by the specific test including at least one of Hue-Saturation-Luminosity, Hue-Saturation-Value, and greyscale;

determining one of a median, mean, maximum, minimum, or other statistical measure of the color or intensity value for various regions of the test platform containing test and control areas and creating a one dimensional array containing these values;

determining a low-frequency variation in color or intensity value over the array and,

performing illumination correction and background subtraction;

detecting a peak or valley in the adjusted array corresponding to the test and control regions to be measured;

determining a depth, width, height (for example, based on intensity or color maxima/minima), and/or area (for example, based on integrated color or intensity) of these peaks or valleys which correspond to detection or control regions of the test platform; and

determining a qualitative presence of the selected indicia of the analyte by the number of peaks or valleys present, and/or a quantitative value of the selected indicia of the analyte by quantitative comparison of two or more peaks or valleys.

2. The method of claim 1, wherein the assay test platform is sensitive to at least one of a chemical colorimetric reaction, an enzymatic colorimetric reaction, and a gold nanoparticle colorimetric reaction, including a lateral flow type immunoassay.

3. The method of claim 1, wherein the assay test platform is a disposable lateral flow immunochromatographic test strip.

4. The method of claim 1, comprising obtaining the image of the at least one test region containing the analyte and the control region using the imaging system, wherein the imaging system includes a light source and an image detector.

5. The method of claim 4, further comprising displaying the determined selected indicia of the analyte on a smartphone.

6. The method of claim 4, wherein the imaging system further comprises a smartphone accessory that includes:

a housing that can be removeably attached to a smartphone in a manner that at least optically couples the smartphone accessory to a resident smartphone camera;

a lens that allows for adjustment of the focal length of the smartphone camera to enable imaging of the test platform in a compact device,

wherein the housing is opaque such that the smartphone accessory is substantially externally light-tight when the test platform is disposed therein,

further wherein the housing includes at least one of a designed-in optical pathway and a light diffuser in the housing for providing diffuse illumination of a surface of the test platform disposed therein from an internal light source resident in the housing or an external light source resident in the smartphone to which the smartphone accessory can be attached.

7. The method of claim 6, wherein the light source is one of an internal smartphone flash source and an external light-emitting diode source.

8. The method of claim 4, further comprising at least one of time stamping and location stamping the determined selected quantitative indicia of the analyte and storing the determined value for future access.

9. The method of claim 8, comprising storing the time and/or location data in at least one of a readable file in a smartphone, an external readable file, and in a Cloud file.

10. The method of claim 8, further comprising determining a temporal and/or a location trend of a plurality of the determined selected quantitative indicia of the analyte.

11. The method of claim 4, further comprising correlating the determined selected quantitative indicia of the analyte to a related selected metric and displaying a value of the related selected metric on a smartphone.

12. The method of claim 1, wherein the analyte is one of sweat, saliva, blood, tears, urine, and other bodily fluids.

13. The method of claim 6, wherein obtaining the image of the test region or regions containing the analyte and the control region or regions further comprises illuminating a surface of the test platform that is illuminated by the light source with diffused light from the light source.

14. The method of claim 1, wherein the step of obtaining the image of the test region or regions containing the analyte and the control region or regions comprises illuminating a surface of the modular, colorimetric test platform.

15. The method of claim 4, wherein the imaging system comprises a brand-independent or operating-system-independent smartphone.

16. The method of claim 1, wherein obtaining an image of the at least one test region comprises obtaining multiple images denoting changes in the indicia over time, which can be used to provide an improved estimate of the initial concentration of the analyte.

17. The method of claim 1, wherein obtaining an image of the at least one test region comprises obtaining multiple images denoting changes in the indicia over time, which can be used to serve as a method for detecting an error with the test.

18. A portable, modular, point-of-collection, colorimetric-based diagnostic system, comprising:

a smartphone including an image detector;

a smartphone accessory comprising;

a housing that can be removeably attached to the smartphone in a manner that at least optically couples the smartphone accessory to a resident smartphone camera;

a lens that allows for adjustment of the focal length of the smartphone camera to enable imaging of the test strip in a compact device,

wherein the housing is opaque such that the smartphone accessory is substantially externally light-tight when a test strip is disposed therein,

further wherein the housing includes at least one of a designed-in optical pathway and a light diffuser in the housing for providing diffuse illumination of a surface of the test strip disposed therein from an internal light source resident in the housing or an external light source resident in the smartphone to which the smartphone accessory can be attached; and

an executable application resident in the smartphone that, in operation, performs the following steps;

obtaining an image of the at least one test region containing the analyte and the control region;

selecting an array of pixels in the image of the at least one test region containing the analyte and the control region;

determining a Red-Green-Blue-Alpha color value for each of the arrays of pixels;

extracting a test image region for analysis;

converting the Red-Green-Blue-Alpha array to an alternate color space as determined by the specific test including but not limited to Hue-Saturation-Luminosity, Hue-Saturation-Value, or greyscale;

determining a median color or intensity value for the pixels in each row, and creating at least a one dimensional array containing these values;

determining a low-frequency variation in color value over the array and performing illumination correction and background subtraction;

detecting a peaks or valley in the adjusted array corresponding to the test and control lines to be measured;

determining a depth or height (intensity maxima/minima) and/or area (integrated intensity) of these peaks which correspond to detection lines of the test strip; and

determining a qualitative presence of the selected indicia of the analyte by the number of peaks present, and/or a quantitative value of the selected indicia of the analyte by quantitative comparison of two or more peaks.

19. The system of claim 18, wherein the light source is an internal flash source of the smartphone.

20. The system of claim 18, wherein the light source is an light-emitting diode disposed in the smartphone accessory, further comprising a battery in the smartphone accessory to power the light-emitting diode.

21. The system of claim 18, wherein the system is smartphone platform-independent.

22. The system of claim 18, wherein the smartphone accessory is an unpowered component.

23. The system of claim 18, further comprising a colorimetric reactive test strip that is removeably disposable in the smartphone accessory.

24. The system of claim 23, wherein the colorimetric reactive test strip includes at least one test region and a control region.

25. The system of claim 23, wherein the colorimetric reactive test region is at least one of chemically colorimetric reactive, enzymatically colorimetric reaction, and gold nanoparticle colorimetrically reactive, including a lateral flow type immunoassay.

26. The system of claim 18, wherein the light diffuser is disposed on the at least a portion of a surface of the test strip is such a manner to provide diffuse illumination to a surface of the test strip.