Computer microscope apparatus and method for superimposing an electronically-produced image from the computer memory upon the image in the microscope's field of view

• US 4,202,037 A
• Filed: 04/12/1978
• Issued: 05/06/1980
• Est. Priority Date: 04/22/1977
• Status: Expired due to Term

• Current Assignee: Edmund M. Glaser, Hendrik Van Der Loos
• Original Assignee: Edmund M. Glaser, Hendrik Van Der Loos
• Inventors: Van der Loos, Hendrik, Glaser, Edmund M.
• Primary Examiner(s): Wise, Edward J.
• Application Number:
  US05/895,709
• Time in Patent Office: 755 Days
• Field of Search: 364/413, 364/518, 364/525, 364/559, 356/39, 250/201, 250/202, 128/2 A
• US Class Current: 345/632
• CPC Class Codes: G02B 21/00 Microscopes
• CPC Class Codes: G02B 21/367 providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
• CPC Class Codes: G06F 3/033 Pointing devices displaced or positioned by the user , e.g. mice, trackballs, pens or joysticks; Accessories therefor digitisers characterised by the transducing means G06F3/041
• CPC Class Codes: G06T 17/00 Three dimensional [3D] modelling, e.g. data description of 3D objects

Abstract

A computer is coupled to a suitable light microscope in a closed-loop feedback system which facilitates total intervention by the operator. A graphics display electronically produces an image having two components: one, an image of the data stored in the computer'"'"'s memory; and two, a set of programmed procedures and instructions available to the operator for manipulating the microscope via the computer. The graphics display is juxtaposed to, and optically aligned with, a beam splitter incorporated in the microscope. As a result, the electronically-produced image of the graphics display is superimposed pictorially upon the optical image of a preparation carried on the slide mounted in the microscope'"'"'s stage. Suitable means are provided to facilitate operator control and intervention. In one embodiment, this means comprises a graphics tablet, interfaced with the computer, and provided with a hand-held stylus. Using the stylus, the operator may selectively exercise command functions, enter selected data from the preparation, and retrieve data previously stored in the computer'"'"'s memory, while simultaneously looking into the oculars of the microscope. In response to operator commands, the stage of the microscope is servo controlled by the computer in any desired coordinate system. In addition, a sensor is connected between the microscope and the computer for maintaining the constant magnification ratio that facilitates a continuous superposition of the graphics display image upon the preparation image. As a result, the computer microscope of the present invention constitutes a valuable research tool having flexibility and maximum utility at a relatively modest investment.

Claims

1. A computer microscope, comprising

computer means including memory means for storing data,

graphics display means connected to the computer means for electronically producing an image which includes

selected data from the computer memory means, and

a set of programmed procedures and instructions available to the operator,

microscope means for viewing a preparation therein and including optical beam splitter means juxtaposed to the graphics display means and optically aligned therewith,

thereby providing a pictorial superposition of the electronically-produced image of the graphics display means upon the image of the preparation in the microscope means, and

manually-manipulatable means interfaced with the computer means and selectively activated by the operator while continuing to view the pictorial superposition in the microscope means,

whereby the operator may control the microscope means via the computer means, and whereby the operator may selectively enter into the computer memory means additional data derived from the preparation, without requiring a diversion of the operator'"'"'s eyes away from the field of view in the microscope means.

2. The computer microscope of claim 1, wherein the manually-manipulatable means interfaced with the computer means comprises

a graphics tablet having a hand-held stylus.

3. The computer microscope of claim 2, wherein

the stylus is provided with a switch selectively activated by the operator.

4. The computer microscope of claim 2, further including

a foot switch interfaced with the computer and selectively activated by the operator.

5. The computer microscope of claim 1, wherein the manually-manipulatable means interfaced with the computer means comprises

a hand-held light pen associated with the graphics display means.

6. The computer microscope of claim 1, wherein

the microscope means has a stage which is servo controlled by the computer means in any desired coordinate system.

7. The computer microscope of claim 6, wherein

the stage is controlled in an X-Y-Z Cartesian coordinate system.

8. The computer microscope of claim 6, wherein

the stage is controlled in a polar coordinate axis system.

9. The computer microscope of claim 1, further including

sensor means connected between the microscope means and the computer means,

whereby a constant magnification ratio is maintained for facilitating a continuous pictorial super-position of the electronically-produced image of the graphics display means upon the image of the preparation in the microscope means.

10. The computer microscope of claim 1, wherein the electronically produced image of the graphics display means, which is superimposed upon the image of the preparation, comprises

a central circular imaging area, wherein the image of the selected data is presented, and

an annular system-control area, concentrically surrounding the central area, and remaining constant despite changes in the images presented in the central area.

11. The computer microscope of claim 10, wherein the system-control area comprises

a manipulation area for controlling the movement of the microscope via the computer,

a keyboard area including an alphanumeric display, and

a command area for data entry and retrieval.

12. The computer microscope of claim 10, wherein

the imaging area and the system-control area are displayed in contrasting colors.

13. The computer microscope of claim 1, wherein the

graphics display means is disposed in abutting relationship with the beam splitter means.

14. The computer microscope of claim 13, wherein the graphics display means comprises

a small diameter cathode ray tube.

15. The computer microscope of claim 14, wherein

an adapting lens is disposed between the cathode ray tube and the beam splitter means.

16. The computer microscope of claim 13, further including

a slaved graphics display connected to the computer means in parallel with the graphics display means.

17. The computer microscope of claim 13, wherein

the microscope means comprises a dissecting microscope.

18. A computer microscope, comprising

microscope means for viewing a preparation on a stage therein,

computer means including a memory means for storing data,

graphics display means connected to the computer means for electronically producing an image which includes

selected data from the computer memory means, and

a set of programmed procedures and instructions available to the operator,

optical beam splitter means incorporated in the microscope means and physically juxtaposed to the graphics display means and optically aligned therewith,

thereby providing a pictorial superposition of the electronically-produced image of the graphics display means upon the image of the preparation in the microscope means,

means for controlling the stage of the microscope means, via the computer means, in a reference coordinate system,

sensor means connected between the microscope means and the computer means, whereby a constant magnification ratio is maintained for facilitating a continuous pictorial superposition of the electronically-produced image of the graphics display means upon the image of the preparation, and

graphics tablet means interfaced with the computer

means and including a hand-held stylus selectively activated by the operator while continuing to view the pictorial superposition in the microscope means,

whereby the operator may control the microscope means via the computer means, and whereby the operator may selectively enter into the computer memory means additional data derived from the preparation, without requiring a diversion of the operator'"'"'s eyes away from the field of view in the microscope means.

19. In a computer microscope, the combination of

computer means including memory means for storing data,

microscope means including ocular means for viewing an object,

means connected between the computer means and the microscope means for simultaneously superimposing upon the object'"'"'s image a pictorial image of selected data from the memory means together with system commands, and

further means selectively activated by the operator, while continuing to view the superimposed pictorial image, for controlling the microscope means via the computer means, retrieving other data from the memory means, or entering new data derived from the object into the memory means, whereby the operator has control and flexibility and the facility for total intervention, without requiring a diversion of the operator'"'"'s eyes away from the ocular means.

20. The method of making a computerized microscopic analysis which comprises the steps of

providing a microscope for viewing an object therein,

providing a computer having a memory,

producing an image which includes

selected data from the computer memory, and

system commands,

optically superimposing said last-named produced image upon the image of the object visible in the microscope'"'"'s field of view,

providing an operator interface with the computer

viewing the pictorial superposition of images, and without a diversion of the operator'"'"'s eyes away from the microscope'"'"'s field of view, simultaneously and selectively controlling the microscope via the computer,

retrieving data from the computer memory, and entering into the computer memory new data derived from the object.

21. The method of claim 20, further including the step of

taking a measurement by bringing the stylus to the particular point to be examined,

thereby avoiding any requirement for the particular point to be brought exactly to the optical axis.

22. The method of claim 20, further including the steps of

providing a graphics tablet having a stylus, and

viewing the location of the tip of the stylus with respect to the object, while automatically maintaining superposition.

23. In a computerized microscope, a superimposed pictorial display viewed by the operator directly in the microscope, said superimposed pictorial display comprising

a first area for presenting a visual image of an object in the microscope in its superimposed relationship to an electronically-produced image of data retrieved from the computer'"'"'s memory, and a second area for providing system control, said second system-control area remaining constant despite pictorial changes in the first area.

24. The superimposed pictorial display of claim 23, wherein

said first area comprises a central circular area, and wherein

said second system-control area comprises an annular area concentrically surrounding the central area.

25. The superimposed pictorial display of claim 24, wherein

said annular system-control area comprises

a manipulation area for controlling the movement of the microscope via the computer,

a keyboard area including alphanumerics, and

a command area including specific commands for data entry and retrieval.

26. The superimposed pictorial display of claim 25, wherein

said manipulation area comprises a first annular band radially of the central circular area, and

said keyboard area and said command area are formed in a second annular band radially of said first annular band, said second annular band being segmented diametrically.

27. In a computerized microscope, a superimposed pictorial display viewed by the operator directly in the microscope, said superimposed pictorial display comprising

a first area for presenting a visual image of an object in the microscope in its superimposed relationship to an electronically-produced image of data retrieved from the computer'"'"'s memory, and

a second area, adjacent to the first area and remaining constant despite pictorial changes therein, and including

a manipulation area for controlling the movement of the microscope via the computer, and

at least one command area for data entry and retrieval.

28. The superimposed pictorial display of claim 27, further including, in combination,

a graphics tablet having a hand-held stylus, selectively interfaced with the computer, and adapted to be activated by the operator.

29. The superimposed pictorial display of claim 27, further including, in combination,

a graphics display interfaced with the computer, and

a hand-held light pen, associated with the graphics display, and adapted to be activated by the operator.