Analytical imaging system and process

• US 6,078,681 A
• Filed: 03/18/1996
• Issued: 06/20/2000
• Est. Priority Date: 03/18/1996
• Status: Expired due to Fees

• Current Assignee: Marine Biological Laboratory
• Original Assignee: Marine Biological Laboratory
• Inventors: Silver, Robert B.
• Primary Examiner(s): Bella, Matthew C.
• Application Number:
  US08/618,246
• Time in Patent Office: 1,555 Days
• Field of Search: 356/417, 356/426, 356/435, 382/284, 382/133, 382/128, 250/461.2, 348/46, 348/47, 348/79, 348/218, 348/135
• US Class Current: 382/133
• CPC Class Codes: G01N 2021/6417 Spectrofluorimetric devices
• CPC Class Codes: G01N 21/6428 Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" in vivo A61B5/00; immunoassay G01N33/53
• CPC Class Codes: G01N 21/6458 Fluorescence microscopy fluorescence microscopes per se G02B21/0076 and G02B21/16
• CPC Class Codes: G02B 21/32 Micromanipulators structurally combined with microscopes

Abstract

An image system captures and records optical and photon images of an activity, such as cellular phenomena. The images are simultaneously recorded on videotape and displayed. Image data is processed and stored for later analysis and for comparison to new data.

Claims

1. A method for analyzing a specimen during an activity, the method comprising:

recording visual images of the specimen to provide a spatial and temporal recording of the specimen during the activity;

recording photon images representing emissions of a first photon from the specimen during the activity so that the visual images and the photon images are obtained simultaneously; and

displaying simultaneously the spatial and temporal recording of the specimen and the photon images so that a user can visually see visual images of the actual activity and images of photons.

2. The method of claim 1, wherein the displaying includes displaying the visual images and photon images adjacent one another.

3. The method of claim 1, wherein the displaving includes displaying the visual images and the photon images in a superimposed manner.

4. The method of claim 1, wherein the recording includes recording the images as signals, the method further comprising a step of processing the recorded signals to determine correlations between the visual images and the photon images.

5. The method of claim 1, further comprising, simultaneously with the recording, recording space and time varying signals representing emissions of a second photon from the specimen during the activity.

6. The method of claim 1, further comprising, simultaneously with the recording, recording space and time varying signals representative of thermal emissions from the specimen during the activity.

7. The method of claim 1, wherein the recorded photon mages represent calcium ions.

8. The method of claim 1, wherein the recording and displaying are performed in real time.

9. The method of claim 1, further comprising filtering recorded data to visually display selected data.

10. The method of claim 1, further comprising storing the recorded images in a database.

11. The method of claim 10, further comprising comparing an image received in real-time to images stored in the database to determine if one or more of the previously stored images has a correlation with the currently received image.

12. The method of claim 1, wherein recording visual images is performed with a camera that captures a differential interference contract image.

13. The method of claim 1, further comprising making an audio recording of observations made of the images and recording the audio with the images so that the audio is heard while the images are played back.

14. The method of claim 1, wherein the method is performed to record a change in calcium ions during mitosis.

15. An apparatus for capturing images of a specimen during an activity of a specimen comprising:

a first receiver that receives visual images of the specimen during the activity and provides a spatial and temporal visual recording of the specimen during the activity;

a second receiver that receives space and time varying signals representing emissions of predetermined photons from the specimen during the activity simultaneously with the first receiver, the first and second receivers obtaining the images simultaneously; and

a display that displays the spatial and temporal recording of the specimen and the signals representative of emissions of predetermined photons at the same time so that a user can visually see the activity and the photon emissions at the same time.

16. The apparatus of claim 15, wherein the display displays the visual images and the photon images in a superimposed manner.

17. The apparatus of claim 15, wherein the display isplays the visual images and the photon images adjacent one another.

18. The apparatus of claim 15, further comprising a microscope and a beam splitter for receiving images from the microscope, the beam splitter providing first and second signals to the respective first and second recorders.

19. The apparatus of claim 18, further comprising a processor that correlates the visual images and the photon emission signals.

20. The apparatus of claim 15, further comprising a third receiver that simultaneously receives and records space and time varying signals representative of emissions of a second predetermined photon from the specimen during the activity.

21. The apparatus of claim 15, further comprising a thermal detector receiving and recording space and time varying signals representative of thermal emissions from the specimen during the activity, the thermal detector receiving at the same time as the first and second recorders.

22. The apparatus of claim 15, wherein the photon signals are photons of calcium ions.

23. The apparatus of claim 15, further comprising means for visually coding the emission signals to represent their elapsed time from initial emission.

24. The apparatus of claim 15, further comprising means for filtering recorded data to visually display selected data.

25. The invention of claim 15, further comprising a storage device that stores previously received images, and a processor for comparing the stored previously received images with images received in real time.

26. The apparatus of claim 15, wherein the first receiver includes a video camera and a video cassette recorder.

27. The apparatus of claim 15, wherein the second receiver includes a photon counting camera.

28. The apparatus of claim 15, further comprising a stage for holding the specimen and a manipulator for manipulating the stage.

29. The apparatus of claim 15, wherein the first receiver takes a differential interference contrast image.

30. The apparatus of claim 15, further comprising an audio recording system for recording observational comments with the images so that the audio is heard while the images are played back.

31. The apparatus of claim 15, further comprising an image processor for receiving the images and for generating a representation that appears three-dimensional.

32. An apparatus comprising:

a microscope for imaging a cellular activity;

a beam splitter for dividing the image taken by the microscope between two outputs;

a video camera for receiving one output from the beam splitter;

a photon counting camera for receiving another output from the beam splitter;

a first video recorder for recording visual images received by the first video camera by which a user can see the activity;

a second video recorder for recording images from the photon counting camera; and

an image processing system for forming a composite video recording of the outputs of the video camera and the photon counting camera superimposed on one another.

33. The apparatus of claim 32, further comprising a time code synchronizer that synchronizes the first and second video recorders with each other.