Method and apparatus for internet, intranet, and local viewing of virtual microscope slides

• US 7,149,332 B2
• Filed: 01/05/2004
• Issued: 12/12/2006
• Est. Priority Date: 08/23/1996
• Status: Expired due to Fees

• Current Assignee: Evident Scientific Incorporated (Evident Corporation)
• Original Assignee: Bacus Laboratories Incorporated (Olympus Corporation)
• Inventors: Bacus, James W., Bacus, James V.
• Primary Examiner(s): Johns, Andrew W.
• Assistant Examiner(s): Edwards, Patrick L.
• Application Number:
  US10/752,072
• Publication Number:
  US 20040141637A1
• Time in Patent Office: 1,072 Days
• Field of Search: 382/128, 382/129, 382/133, 382/134, 348/79, 348/80, 348/211.3, 359/363, 359/368, 359/369, 359/381, 345/744, 600/168, 709/203, 709/219, 725/82
• US Class Current: 382/128
• CPC Class Codes: G01N 1/312 for samples mounted on planar substrates
• CPC Class Codes: G01N 15/1468 with spatial resolution of the texture or inner structure of the particle
• CPC Class Codes: G02B 21/0004 specially adapted for specific applications
• CPC Class Codes: G02B 21/367 providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
• CPC Class Codes: G06T 3/4038 Image mosaicing, e.g. composing plane images from plane sub-images
• CPC Class Codes: G06T 7/0012 Biomedical image inspection
• CPC Class Codes: G06V 20/69 Microscopic objects, e.g. biological cells or cellular parts
• CPC Class Codes: G16H 10/40 for data related to laboratory analysis, e.g. patient specimen analysis
• CPC Class Codes: G16H 30/20 for handling medical images, e.g. DICOM, HL7 or PACS
• CPC Class Codes: G16H 40/63 for local operation
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 80/00 ICT specially adapted for facilitating communication between medical practitioners or patients, e.g. for collaborative diagnosis, therapy or health monitoring

Abstract

A method of and apparatus for viewing microscopic images include transmitting tiled microscopic images from a server to a client. The client assembles the tiled images into a seamless virtual slide or specimen image and provides tools for manipulating image magnification and viewpoint. The method and apparatus also provides a virtual multi-headed microscope function which allows scattered viewers to simultaneously view and interact with a coherent magnified microscopic image.

Claims

1. A method for viewing a specimen on a microscope slide of a specimen at a plurality of magnifications at a remote location from data transmitted over a common communication channel, the method comprising:

storing digitized data of a magnified image of the specimen with a server at a transmitting station;

sending a request from a remote location to the server for the digitized data for the specimen;

transmitting over a common communication channel the data structure having the digitized data to the remote location;

displaying from the received transmitted data on a viewer at the remote location a low magnification image of the specimen or a substantial portion thereof;

selecting a location on the displayed low magnification image for viewing at a higher magnification; and

displaying the higher magnification image of the selected location to the viewer.

2. A method in accordance with claim 1 comprising:

using coordinate information for the selected location and the transmitted data to retrieve and to display the higher magnification image for the selected point on the viewer.

3. A method for viewing a virtual microscope slide in accordance with claim 1 comprising:

transmitting the data in packets over an Internet/Intranet common communication channel.

4. A method in accordance with claim 1 comprising:

displaying images of the selected location at each of multiple higher magnifications; and

changing between the respective higher magnification images for the selected location.

5. A method in accordance with claim 4 comprising:

scrolling into view and displaying the location with adjacent images at a higher magnification.

6. A method in accordance with claim 1 comprising:

transmitting the data as a data structure to the remote location.

7. A method in accordance with claim 6 comprising:

using a browser at the remote location to assist in viewing and manipulating the images stored in the data structure and transmitted to the remote location.

8. A method in accordance with claim 7 comprising:

storing a plurality of virtual microscope slide on the server at the transmitting station.

9. A method in accordance with claim 8 wherein the transmitted data comprises:

sets of digital images with X, Y information organized to reconstruct and spatially align physically contiguous images at low magnification.

10. A method in accordance with claim 9 wherein the sets of digital images are tiles.

11. A method in accordance with claim 9 wherein the displayed higher magnification image of the selected location is a composite image of sets of digital images.

12. A method in accordance with claim 1 comprising:

placing a marker on the displayed low magnification image to indicate the selected location being viewed at the higher magnification.

13. A method in accordance with claim 1 comprising:

doing a quantitative analysis of the displayed higher magnification image of a histological specimen.

14. A method in accordance with claim 1 comprising:

reviewing a simultaneous display of both the low magnification and high magnification images to analyze cells forming part of an architectural feature for cancer or another disease.

15. A method in accordance with claim 1 providing programs for and doing a quantitative analysis of selected portions of the specimens being displayed.

16. A method in accordance with claim 1 wherein the location to be viewed at higher magnification comprises:

a segment selected on the low magnification image by the viewer for capture and storage as digitized data stored with the server.

17. A method in accordance with claim 16 comprising:

using a marker to draw an outline about the segment on the low magnification image to capture the segment at higher magnification.

18. A method in accordance with claim 1 comprising:

providing a plurality remote locations with viewers seeing the same image being displayed;

marking the same selected location on the low magnification view at each remote location; and

displaying the same selected high magnification image at each remote location thereby providing a multi-head microscope.

19. A method in accordance with claim 1 comprising:

navigating along an architectural feature being displayed on a low magnification image of the specimen and selecting successive locations during this navigation for display as higher magnification images.

20. A method in accordance with claim 1 using several different browsers, viewers and computers to access the digitized data at the transmitting station for transmission to the remote location.

21. A method in accordance with claim 1 comprising:

storing images in multiple storage for access with a computer running a server program; and

slide specimen images having been stored on different storage means including a portable disk storage medium.

22. A method of viewing magnified digitized images of microscope slide specimens stored in an organized collection of virtual microscope slides and transmitted over a common communication channel to a remote viewer, the method comprising:

providing a server at a transmitting station and storing a collection of organized virtual microscope slides having data for magnified, digitized images of their respective specimens;

accessing the transmitting station from a remote location and requesting transmission of image data for a specified virtual microscope slide;

transmitting image data for the specified virtual microscope slide over the common communication channel to the remote location;

displaying from the transmitted data a digitized image at low magnification of at least a portion of the specimens;

selecting a location on the digitized image of the specimen for viewing at a higher magnification; and

displaying a digitized image at the higher magnification image for the selected location at the remote location.

23. A method in accordance with claim 22 comprising:

using a browser software program with the data at the remote location to view the respective images.

24. A method in accordance with claim 22 providing a program that organizes virtual microscope slides for the data structures into a tree structured, folder presentation for selection of a specific virtual microscope slide for viewing.

25. A method in accordance with claim 22 providing multiple users on the common communication channel to see each others displayed magnified image of the selected microscope slide specimen.

26. A method in accordance with claim 25 comprising:

using an interactive painter on a magnified view to indicate the location of the higher magnification being seen at the respective remote locations.

27. A method in accordance with claim 25 comprising:

providing voice communication for discussion between the respective viewers of the magnified, digitized images of the specimen.

28. A method in accordance with claim 22 wherein the transmitting of the data structure comprises:

transmitting an active, dynamic control program allowing the viewer to interact and manipulate the viewed images at multiple magnifications at the remote location.

29. A method in accordance with claim 22 comprising:

providing a thin client browser at the remote location for interaction with the server.

30. A method in accordance with claim 22 comprising:

storing the viewed images locally in a cache; and

retrieving and displaying stored images locally at the remote location.

31. A method in accordance with claim 22 comprising:

sending an image request for an image at a specified magnification and at a specified location on the specimen; and

retrieving the specified images from the server and transmitting it to the remote location for viewing an image at the location and at the specified magnification.

32. A method in accordance with claim 22 comprising:

displaying to the viewer at the remote location an overall, low magnification image of the specimen or a substantial portion thereof, the overall, low magnification image being digitally reduced in size.

33. A method in accordance with claim 22 comprising:

providing a file structure for data structures at the transmitting station;

transmitting to the remote station and displaying thereat a list of image names and header text for file folders;

interactively selecting a file folder and displaying its contained images;

selecting a specific image file image and requesting from the server an image of the specimen; and

displaying the requested image at the remote location.