Fast auto-focus in imaging

• US 10,462,351 B2
• Filed: 10/03/2017
• Issued: 10/29/2019
• Est. Priority Date: 02/01/2011
• Status: Active Grant

• Current Assignee: Roche Diagnostics Hematology Inc (Roche Holding AG)
• Original Assignee: Roche Diagnostics Hematology Inc (Roche Holding AG)
• Inventors: Zahniser, Michael
• Primary Examiner(s): Walker, Jared
• Application Number:
  US15/723,788
• Publication Number:
  US 20180027173A1
• Time in Patent Office: 756 Days
• Field of Search: 348 80
• CPC Class Codes: G02B 21/244 using image analysis techniques
• CPC Class Codes: G06T 2207/10148 Varying focus

Abstract

The disclosure relates to methods and systems for automatically focusing multiple images of one or more objects on a substrate. The methods include obtaining, by a processor, a representative focal distance for a first location on the substrate based on a set of focal distances at known locations on the substrate. The methods also include acquiring, by an image acquisition device, a set of at least two images of the first location. The images are each acquired using a different focal distance at an offset from the representative focal distance. The methods further include estimating, by a processor, an ideal focal distance corresponding to the first location based on comparing a quality of focus for each of the images, and storing the estimated ideal focal distance and the first location in the set of focal distances at known locations.

Claims

1. A method for automatically focusing multiple images of one or more objects on a substrate, the method comprising:

a) obtaining, by one or more processing devices, a representative focal distance for a first location on the substrate based on a set of focal distances at known locations on the substrate;

b) acquiring, by an image acquisition device, a set of at least two images of the first location based on the representative focal distance, wherein the set of images comprises at least a first image that is acquired under illumination of a first color, and at least a second image that is acquired under illumination of a second color that is different from the first color, and wherein each of one or more images under a particular color is acquired using a focal distance at a corresponding offset from the representative focal distance;

c) estimating, by the one or more processing devices, an ideal focal distance based on the acquired set of images; and

d) storing the estimated ideal focal distance and the first location in the set of focal distances at known locations.

2. The method of claim 1, wherein at least two images are acquired under illumination by each color.

3. The method of claim 1, wherein estimating the ideal focal distance corresponding to the first location further comprises:

calculating a focal distance offset for each of the different colors;

determining an average focal distance offset based on the focal distance offsets calculated for the different colors; and

estimating the ideal focal distance corresponding to the first location based on the average focal distance offset.

4. The method of claim 1, wherein the representative focal distance is estimated as a weighted average of at least two focal distances from the set of focal distances at known locations, wherein a weight for a given focal distance is calculated based on a distance of the corresponding location from the first location.

5. The method of claim 3, wherein calculating the focal distance offset for a given color comprises comparing a quality of focus for each of the images of the given color.

6. The method of claim 5 wherein comparing the quality of focus further comprises calculating, for each image, a focus score by quantifying differences between neighboring pixels.

7. The method of claim 6, wherein the focus score comprises a Brenner score.

8. The method of claim 6, wherein calculating the focal distance offset for the given color comprises fitting a curve to logarithms of focus scores as a function of focal distance.

9. The method of claim 8, wherein an equation for the curve is selected based on the number of images acquired for each color.

10. The method of claim 1, wherein the first and second colors are selected from a group consisting of red, yellow, green, and blue.

11. A system comprising:

an image acquisition device configured to acquire a set of at least two images of the first location based on a representative focal distance, wherein the set of images comprises at least a first image that is acquired under illumination of a first color, and at least a second image that is acquired under illumination of a second color that is different from the first color, and wherein each of one or more images under each a particular color is acquired using a focal distance at a corresponding offset from the representative focal distance; and

one or more processing devices, connected to the image acquisition device, the one or more processing devices configured to;

obtain the representative focal distance for a first location on the substrate based on a set of focal distances at known locations on the substrate,

estimate an ideal focal distance based on the acquired set of images, and

store the estimated ideal focal distance and the first location in the set of focal distances at known locations.

12. The system of claim 11, wherein at least two images are acquired under illumination by each color.

13. The system of claim 11, wherein estimating the ideal focal distance corresponding to the first location further comprises:

calculating a focal distance offset for each of the different colors;

determining an average focal distance offset based on the focal distance offsets calculated for the different colors; and

estimating the ideal focal distance corresponding to the first location based on the average focal distance offset.

14. The system of claim 11, wherein the representative focal distance is estimated as a weighted average of at least two focal distances from the set of focal distances at known locations, wherein a weight for a given focal distance is calculated based on a distance of the corresponding location from the first location.

15. The system of claim 13, wherein calculating the focal distance offset for a given color comprises comparing a quality of focus for each of the images of the given color.

16. The system of claim 15, wherein comparing the quality of focus further comprises calculating, for each image, a focus score by quantifying differences between neighboring pixels.

17. The system of claim 16, wherein the focus score comprises a Brenner score.

18. The system of claim 16, wherein calculating the focal distance offset for the given color comprises fitting a curve to logarithms of focus scores as a function of focal distance.

19. The system of claim 18, wherein an equation for the curve is selected based on the number of images acquired for each color.

20. The system of claim 11, wherein the first and second colors are selected from a group consisting of red, yellow, green, and blue.

21. A non-transitory computer readable storage device, having encoded thereon computer readable instructions that causes one or more processing devices to execute operations comprising:

obtaining a representative focal distance for a first location on the substrate based on a set of focal distances at known locations on the substrate;

obtaining a set of at least two images of the first location based on the representative focal distance, wherein the set of images comprises at least a first image that is acquired under illumination of a first color, and at least a second image that is acquired under illumination of a second color that is different from the first color, and wherein each of one or more images under a particular color is acquired using a focal distance at a corresponding offset from the representative focal distance;

estimating an ideal focal distance based on the acquired set of images; and

storing the estimated ideal focal distance and the first location in the set of focal distances at known locations.

22. The computer readable storage device of claim 21, wherein at least two images are acquired under illumination by each color.

23. The computer readable storage device of claim 21, wherein estimating the ideal focal distance corresponding to the first location further comprises:

calculating a focal distance offset for each of the different colors;

determining an average focal distance offset based on the focal distance offsets calculated for the different colors; and

estimating the ideal focal distance corresponding to the first location based on the average focal distance offset.

24. The computer readable storage device of claim 21, wherein the representative focal distance is estimated as a weighted average of at least two focal distances from the set of focal distances at known locations, wherein a weight for a given focal distance is calculated based on a distance of the corresponding location from the first location.

25. The computer readable storage device of claim 23, wherein calculating the focal distance offset for a given color comprises comparing a quality of focus for each of the images of the given color.

26. The computer readable storage device of claim 25, wherein comparing the quality of focus further comprises calculating, for each image, a focus score by quantifying differences between neighboring pixels.

27. The computer readable storage device of claim 26, wherein the focus score comprises a Brenner score.

28. The computer readable storage device of claim 26, wherein calculating the focal distance offset for the given color comprises fitting a curve to logarithms of focus scores as a function of focal distance.

29. The computer readable storage device of claim 28, wherein an equation for the curve is selected based on the number of images acquired for each color.

30. The computer readable storage device of claim 21, wherein the first and second colors are selected from a group consisting of red, yellow, green, and blue.