High throughput lens-free three-dimensional tracking of sperm

• US 9,588,037 B2
• Filed: 07/12/2013
• Issued: 03/07/2017
• Est. Priority Date: 07/13/2012
• Status: Active Grant

• Current Assignee: Regents of the University of California (University of California)
• Original Assignee: Regents of the University of California (University of California)
• Inventors: Ozcan, Aydogan, Su, Ting-Wei
• Primary Examiner(s): Heidemann, Jason
• Assistant Examiner(s): SHIN, BRIAN D
• Application Number:
  US14/412,984
• Publication Number:
  US 20150204773A1
• Time in Patent Office: 1,334 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G01B 11/00 Measuring arrangements characterised by the use of optical techniques
• CPC Class Codes: G01B 11/24 for measuring contours or curvatures
• CPC Class Codes: G01N 15/1433 using image recognition
• CPC Class Codes: G01N 2015/1006 for cytology
• CPC Class Codes: G01N 2015/1027 Determining speed or velocity of a particle
• CPC Class Codes: G03H 1/0443 Digital holography, i.e. recording holograms with digital recording means holobject computation G03H1/0866
• CPC Class Codes: G03H 1/0465 Particular recording light; Beam shape or geometry G03H1/06 takes precedence
• CPC Class Codes: G03H 1/0866 Digital holographic imaging, i.e. synthesizing holobjects from holograms
• CPC Class Codes: G03H 2001/0033 in hologrammetry for measuring or analysing
• CPC Class Codes: G03H 2001/0447 In-line recording arrangement
• CPC Class Codes: G03H 2210/30 3D object
• CPC Class Codes: G03H 2222/34 Multiple light sources
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 2200/04 involving 3D image data
• CPC Class Codes: G06T 2207/30004 Biomedical image processing

Abstract

A system for three dimensional imaging of motile objects includes an image sensor and a sample holder disposed adjacent to the image sensor. A first illumination source is provided and has a first wavelength and positioned relative to the sample holder at a first location to illuminate the sample. A second illumination source is also provided having a second wavelength, different from the first wavelength, and positioned relative to the sample holder at a second location, different from the first location, to illuminate the sample. The first and second illumination sources are configured to simultaneously, or alternatively, sequentially illuminate the sample contained within the sample holder. Three dimensional positions of the motile objects in each frame are obtained based on digitally reconstructed projection images of the mobile objects obtained from the first and second illumination sources. This positional data is connected for each frame to obtain 3D trajectories of motile objects.

Claims

1. A system for three dimensional imaging of motile objects contained within a sample comprising:

an image sensor;

a sample holder configured to hold the sample, the sample holder disposed adjacent to the image sensor;

a first illumination source having a first wavelength and positioned relative to the sample holder at a first location to illuminate the sample;

a second illumination source having a second wavelength, different from the first wavelength, and positioned relative to the sample holder at a second location, different from the first location, to illuminate the sample, and wherein both the first illumination source and the second illumination source illuminate the sample from the same side of the sample holder;

at least one digital processor configured to receive a plurality of image frames generated by the image sensor; and

wherein the first illumination source and the second illumination source are configured to simultaneously illuminate the sample contained within the sample holder over a period of time and wherein the at least one digital processor receives the plurality of image frames and identifies holographic projections and microscopic images of the motile objects from the first illumination source and the second illumination source and reconstructs a three dimensional trajectory of the motile objects observed over the period of time based on the acquired holographic projections and classifies the three dimensional trajectory of the motile objects into one or more types of trajectories.

2. The system of claim 1, wherein the motile objects comprise sperms.

3. The system of claim 1, wherein the first illumination source and the second illumination source comprise, respectively, a first LED and a second LED.

4. The system of claim 3, wherein the first and second LEDs are, respectively, butt-coupled to optical fibers.

5. The system of claim 1, further comprising a programmable power relay configured to cycle the image sensor between an ON state and an OFF state to maintain the sample holder at a regulated temperature between 36-37°

C.

6. The system of claim 1, further comprising a heat sink in thermal contact with the image sensor.

7. The system of claim 1, wherein the first location of the first illumination source is angled relative to the second location of the second illumination source.

8. The system of claim 7, wherein the angle between the first location and the second location is within the range of 20°

to 60°

.

9. The system of claim 1, wherein the sample holder has a depth of field within the range of 0.01 mm to 5.0 mm.

10. The system of claim 1, wherein the at least one digital processor comprises a computer processor.

11. The system of claim 1, wherein the at least one digital processor further reconstructs microscopic images of the stationary objects.

12. A method for three dimensional tracking of motile objects contained within a sample comprising:

simultaneously illuminating a sample holder containing the motile objects with a first illumination source and a second illumination source wherein the first illumination source and the second illumination source are located at different positions from one another and emit light at the same or different wavelengths, and wherein both the first illumination source and the second illumination source illuminate the motile objects from the same side of the sample holder;

obtaining a plurality of image frames over time of the motile objects with an image sensor disposed adjacent to the sample holder while the sample holder is illuminated;

digitally reconstructing a projection image of the motile objects in each frame based on illumination originating from the first illumination source;

digitally reconstructing a projection image of the motile objects in each frame based on illumination originating from the second illumination source;

identifying the x, y, and z positions of the motile objects in each frame based on the digitally reconstructed projection images of the motile objects obtained from the first and second illumination sources;

connecting the x, y, and z positions of the motile objects over a plurality of frames to form a three-dimensional track of the motile objects within the sample; and

automatically classifying, by at least one processor, the three-dimensional tracks of the sperm into one of a plurality of categories.

13. The method of claim 12, wherein the motile objects comprise sperm.

14. The method of claim 13, wherein the sperm comprises human sperm or equine sperm.

15. The method of claim 12, wherein the categories comprise:

typical, helical, ribbon, hyper-ribbon, hyper-activated, and hyper-helical.

16. The method of claim 15, wherein the ribbon category comprises one of a chiral ribbon, helical ribbon, or twisted ribbon.

17. The method of claim 12, wherein each image frame was divided into a plurality of regions-of-interest.

18. A method for three dimensional tracking of motile objects contained within a sample comprising:

sequentially illuminating a sample holder containing the motile objects with a first illumination source and a second illumination source wherein the first illumination source and the second illumination source are located at different positions from one another and emit light at the same or different wavelengths, and wherein both the first illumination source and the second illumination source illuminate the motile objects from the same side of the sample holder;

obtaining a plurality of image frames over time of the motile objects with an image sensor disposed adjacent to the sample holder while the sample holder is illuminated;

digitally reconstructing a projection image of the motile objects in each frame based on illumination originating from the first illumination source;

digitally reconstructing a projection image of the motile objects in each frame based on illumination originating from the second illumination source;

identifying the x, y, and z positions of the motile objects in each frame based on the digitally reconstructed projection images of the motile objects obtained from the first and second illumination sources;

connecting the x, y, and z positions of the motile objects over a plurality of frames to form a three-dimensional track of the motile objects within the sample; and

automatically classifying, by at least one processor, the three-dimensional tracks of the sperm into one of a plurality of categories.

19. The method of claim 18, wherein the motile objects comprise sperm.

20. The method of claim 19, wherein the sperm comprises human sperm.

21. The method of claim 19, wherein the sperm comprises equine sperm.

22. The method of claim 18, wherein the categories comprise:

typical, helical, ribbon, hyper-ribbon, hyper-activated, and hyper-helical.

23. The method of claim 22, wherein the ribbon category comprises one of a chiral ribbon, helical ribbon, or twisted ribbon.

24. The method of claim 18, wherein each image frame was divided into a plurality of regions-of-interest.