Apparatus and Method for Augmenting Sight

• US 20080247620A1
• Filed: 04/02/2008
• Published: 10/09/2008
• Est. Priority Date: 04/02/2007
• Status: Active Grant

• Current Assignee: Gentex Corporation
• Original Assignee: eSight Corporation (Gentex Corporation)
• Inventors: Hilkes, Robert G., Lewis, Conrad W., Mathers, Daniel R., Munger, Rejean J.Y.B., Colbeck, Roger P.
• Granted Patent: US 8,135,227 B2
• Time in Patent Office: Days
• US Class Current: 382/128
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G02C 2202/10 Optical elements and systems for visual disorders other than refractive errors, low vision
• CPC Class Codes: G06Q 50/22 Social work or social welfare, e.g. community support activities or counselling services
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.

Claims

1. A method of augmenting sight in an individual, the method comprising the steps of:

obtaining an image of a scene viewed by the individual using a camera carried by the individual;

transmitting the obtained image to a processor carried by the individual;

selecting an image modification to be applied to the image by the processor;

operating, by the processor, upon the image to create a modified image in response to the selected image modification; and

displaying the modified image on a display device carried by the individual.

2. The method of claim 1 wherein the image modification is magnification.

3. The method of claim 1 wherein the image modification is a remapping of the image to avoid visual defects in the individual.

4. The method of claim 1 wherein the image modification is a remapping of the colors within the image.

5. The method of claim 1 wherein the image modification is edge enhancement.

6. The method of claim 1 wherein the image modification is at least one of brightness and contrast intensity enhancement.

7. The method of claim 1 wherein the image is modified substantially in real time.

8. The method of claim 1 wherein the modification to the image is alternatively applied and removed.

9. An apparatus for augmenting sight in an individual comprising:

a camera, carried by the individual, for obtaining an image of a scene viewed by the individual;

a display carried by the individual;

an image modification input device carried by the individual; and

a processor, carried by the individual, the processor in communication with the camera, image modification input device and display, the processor for modifying the image obtained by the camera, in response to the instructions provided by the individual using the image modification input device, and for displaying the modified image on the display carried by the individual.

10. The apparatus of claim 9 wherein the display comprises a pair of eyeglass frames.

11. The apparatus of claim 10 wherein the camera is attached to the pair of eyeglass frames.

12. The apparatus of claim 9 further comprising a second camera and a second display in communication with the processor, the second camera providing a second image for the processor to modify and display.

13. A method for improving the visual acuity of a patient with retinal defects comprising the steps of:

determining the locations of retinal damage in an eye of the patient;

obtaining an image of a scene viewed by the patient; and

mapping the image to a display in such a way to avoid the locations of retinal damage when the display is viewed by the patient.

14. The method of claim 13 wherein the step of obtaining the image uses a camera attached to eyeglass frames worn by the patient.

15. The method of claim 13 wherein the display replaces a lens of the eyeglass frames worn by the patient.

16. The method of claim 13 wherein the locations of retinal damage are determined by a health professional.

17. The method of claim 13 further comprising the step of modifying the image according to instructions issued by the patient.

18. The method of claim 17 wherein the instructions are verbal.

19. The method of claim 17 wherein the instructions are selected from a set of instructions comprising magnify, edge enhance, remap color, remap visual field, contrast enhance and brightness enhance the image.

20. An apparatus for improving the visual acuity of a patient with retinal damage, the apparatus comprising:

a camera, carried by the patient, for obtaining an image of a scene viewed by the patient;

a display, carried by the patient;

a memory for storing locations of retinal damage in an eye of the patient; and

a processor, in communication with the camera, display and memory, for mapping the obtained image to the display in such a way to avoid the locations of retinal damage when the display is viewed by the patient.

21. The apparatus of claim 20 wherein the camera is a video source selected from the group comprising a camera, a television, and a computer.

22. An apparatus for augmenting sight in an individual comprising:

an image capture device, carried by the individual, for obtaining an image of a scene viewed by the individual;

a display carried by the individual;

an image modification input device carried by the individual; and

a pupil tracking device mounted to observe the directional of movement of a users pupil; and

a processor, carried by the individual, the processor in communication with the image capture device, image modification input device and display, the processor for modifying the image obtained by the image capture device, in response to the instructions provided by the individual using the image modification input device, and for displaying the modified image on the display carried by the individual.

23. A method for providing remuneration to a clinician utilizing a user-selected image enhancement system comprising a camera, a personal display, an image modification input device, and a processor, wherein the processor modifies the image obtained by the camera, in response to the instructions provided by the user using the image modification input device, and displays the modified image on the display, the method comprising the steps of:

one or more of synthesizing, reviewing, modifying or approving the user-selected image enhancement; and

upon the approval of the user-selected image enhancement, compensating the clinician.

24. The method of claim 23 wherein the clinician is remote from the system and the compensation occurs through electronic funds transfer.