Technique for creating an ophthalmic augmented reality environment
First Claim
1. A method for implementing an ophthalmic augmented reality environment for overlaying at least one of previously stored photographic and angiographic images onto a real-time ophthalmic image, comprising the steps of:
- acquiring a real-time image of the eye;
registering landmarks of said acquired real-time image of the eye with at least one of said at least one previously stored photographic and angiographic images; and
displaying said at least one of said at least one previously stored photographic and angiographic images overlayed over said real-time image.
2 Assignments
0 Petitions
Accused Products
Abstract
An ophthalmic augmented reality environment is developed in order to allow for (a) more precise laser treatment for ophthalmic diseases, (b) teaching, (c) telemedicine, and (d) real-time image measurement, analysis, and comparison. A preferred embodiment of the system is designed around a standard slit-lamp biomicroscope. The microscope is interfaced to a CCD camera, and the image is sent to a video capture board. A single computer workstation coordinates image capture, registration, and display. The captured image is registered with previously stored, montaged photographic and/or angiographic data, with superposition facilitated by fundus-landmark-based fast registration algorithms. The computer then drives a high intensity, VGA resolution video display with adjustable brightness and contrast attached to one of the oculars of the slit-lamp biomicroscope.
-
Citations
35 Claims
-
1. A method for implementing an ophthalmic augmented reality environment for overlaying at least one of previously stored photographic and angiographic images onto a real-time ophthalmic image, comprising the steps of:
-
acquiring a real-time image of the eye; registering landmarks of said acquired real-time image of the eye with at least one of said at least one previously stored photographic and angiographic images; and displaying said at least one of said at least one previously stored photographic and angiographic images overlayed over said real-time image. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12)
-
-
13. A method of generating a seamless photomontage of photographic images of the eye, comprising the steps of:
-
acquiring multiple, partially overlapping photographic images of the eye; matching two eye images together by finding a maximum partial Hausdorff distance fraction over at least one of translation, rotation, and scale of sets of points of said two eye images which are in an overlap region of said two eye images; and weighting pixels in eye images to be included in said photomontage with a convex weighting such that pixels near the center of said photomontage have greater weight than pixels around the periphery of said photomontage. - View Dependent Claims (14)
-
-
15. A method of providing laser guided image therapy using an ophthalmic augmented reality environment for overlaying at least one of previously stored photographic and angiographic images onto a real-time ophthalmic image, comprising the steps of:
-
acquiring a real-time image of the eye; registering landmarks of said acquired real-time image of the eye with at least one of said at least one previously stored photographic and angiographic images; displaying an augmented reality image including said at least one of said at least one previously stored photographic and angiographic images overlayed over said real-time image; and guiding a laser during laser therapy of the eye using said augmented reality image.
-
-
16. A method for real-time measurement and analysis of ophthalmic images, comprising the steps of:
-
acquiring and capturing a real-time ophthalmic image; displaying the captured real-time ophthalmic image to an observer; drawing on the real-time image with an interactive pointer device to create a drawn image; registering said captured real-time ophthalmic image with said drawn image; and displaying said drawn image registered with, and overlayed on, said real-time ophthalmic image. - View Dependent Claims (17, 18)
-
-
19. A system which implements an ophthalmic augmented reality environment for overlaying at least one of previously stored photographic and angiographic images onto a real-time ophthalmic image, comprising:
-
an eye imaging device which acquires a real-time image of the eye for presentation to an examiner; an image capturing device which captures said real-time image of the eye; a processing device which registers landmarks of said captured real-time image of the eye with at least one of said at least one previously stored photographic and angiographic images; and an image adder which overlays said at least one of said at least one previously stored photographic and angiographic images over said captured real-time image for presentation to the examiner. - View Dependent Claims (20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31)
-
-
32. A laser guided image therapy system which implements an ophthalmic augmented reality environment for overlaying at least one of previously stored photographic and angiographic images onto a real-time ophthalmic image, comprising:
-
an eye imaging device which acquires a real-time image of the eye for presentation to an examiner; an image capturing device which captures said real-time image of the eye; a processing device which registers landmarks of said captured real-time image of the eye with at least one of said at least one previously stored photographic and angiographic images; an image adder which overlays said at least one of said at least one previously stored photographic and angiographic images over said captured real-time image for presentation to the examiner as an augmented reality image; and a laser system controlled in response to said augmented reality image.
-
-
33. A system for real-time measurement and analysis of ophthalmic images, comprising:
-
an eye imaging device which acquires a real-time image of the eye for presentation to an examiner; an image capturing device which captures said real-time image of the eye; an interactive pointer device which permits the examiner to draw on the real-time image to create a drawn image; a processing device which registers landmarks of said captured real-time image of the eye with said drawn image; an image adder which overlays said drawn image registered with, and overlayed on, said captured real-time image for presentation to the examiner. - View Dependent Claims (34, 35)
-
Specification