Automated microscopic image acquisition compositing, and display

• US 7,305,109 B1
• Filed: 02/01/2006
• Issued: 12/04/2007
• Est. Priority Date: 11/14/2000
• Status: Expired due to Term

• Current Assignee: United States Department Of Health And Human Services (Government of the United States of America)
• Original Assignee: The United States of America As Represented By The Secretary of Agriculture
• Inventors: Lee, Tommy, Taylor, Roger, Gagnon, MariBeth, Kujawski, Edward, Lange, James V., Collins, Carlyn, Draut, Richard
• Primary Examiner(s): Dang; Duy M.
• Application Number:
  US11/345,863
• Time in Patent Office: 671 Days
• Field of Search: 382/128, 382/233, 382/305, 382/232, 382/240, 382/248
• US Class Current: 382/128
• CPC Class Codes: G01N 15/1433 using image recognition
• CPC Class Codes: G06T 2207/10024 Color image
• CPC Class Codes: G06T 2207/10056 Microscopic image
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 5/50 using two or more images, e.g. averaging or subtraction
• CPC Class Codes: G06T 7/33 using feature-based methods

Abstract

An automated microscope and computer system captures a set of images for a capture area in a plurality of focal planes. The images can then be integrated into composite images for browsing to simulate viewing an item, such as a biological sample, under a microscope. A corrective filter can be constructed from the images to avoid an effect called “tiling.” Before capture, variable focal plane error can be avoided by collecting z locations for a set of points in the capture area. During image browsing, entire composite images can be loaded into memory in compressed form. Compressed image portions can be pre-decompressed to avoid delay as a browsing user navigates throughout the composite images. Pre-decompression can be done by a thread separate from the thread performing navigation operations.

Claims

1. A computer-implemented method of browsing a composite image representing an item viewed under a microscope, wherein the composite image comprises a set of composite image portions, the method comprising:

decompressing the composite image portions of the composite image for a browsing area currently being browsed at a computer;

displaying at least portions of the decompressed images; and

decompressing composite image portions of the composite image that are outside the browsing area currently being browsed and likely to be next displayed during navigation of the composite image.

2. The method of claim 1 wherein the item is a biological sample.

3. The method of claim 1 further comprising:

loading into memory at least one complete composite image for a focal plane in compressed form.

4. The method of claim 1 further comprising:

loading into memory complete composite images for plural focal planes in compressed form.

5. The method of claim 1 wherein the composite image portions likely to be next displayed are composite image portions adjacent to and in a same focal plane as composite image portions currently being displayed.

6. The method of claim 1 wherein the composite image portions likely to be next displayed are composite image portions adjacent to composite image portions currently being displayed and in a different focal plane.

7. The method of claim 1 wherein

displaying is performed by a first thread;

and

decompressing images likely to be next displayed is performed by a second thread.

8. The method of claim 1 further comprising:

in preparation for displaying at least portions of the decompressed images, loading the decompressed images directly into video memory;

tracking which images are loaded into video memory;

tracking when images loaded into video memory were last used; and

keeping images in video memory until display of an image requires discarding an image, wherein the least recently used image is discarded.

9. A computer-readable medium comprising computer-executable instructions for performing the method of claim 1.

10. A browsing system for displaying composite images comprising a set of compressed images forming portions of the composite images, the system comprising:

variables for tracking the current browsing area;

a composite image manager for providing access to the portions of the composite images;

a decompression cache manager for tracking pre-decompressed images;

a decompressed image store for storing decompressed versions of the portions of the composite images;

a video memory cache manager for tracking which of the decompressed versions of the portions of the composite images are currently loaded in video memory.

11. The browsing system of claim 10 wherein the composite image manager maintains a store of composite images for a plurality of focal planes.

12. The browsing system of claim 10 wherein the composite image manager maintains in memory a store of at least one complete composite image in compressed form.

13. The browsing system of claim 10 wherein the composite image manager maintains in memory a store of a plurality of complete composite images for a plurality of focal planes in compressed form.

14. The browsing system of claim 10 wherein the decompression cache manager prioritizes decompression according to the following, ordered priority:

image portions for the current browsing area;

image portions in a same focal plane and adjacent to the current browsing area; and

image portions in a different focal plane and adjacent to the current browsing area.

15. A browsing system for displaying composite images comprising a set of compressed images forming portions of the composite images, the system comprising:

means for tracking the current browsing area;

means for providing access to the portions of the composite images;

means for tracking pre-decompressed images;

means for storing decompressed versions of the portions of the composite images;

means for tracking which of the decompressed versions of the portions of the composite images are currently loaded in video memory.