Apparatus and Method for Augmenting Sight

• US 20130329190A1
• Filed: 07/22/2013
• Published: 12/12/2013
• Est. Priority Date: 04/02/2007
• Status: Abandoned Application

• Current Assignee: eSight Corporation
• Original Assignee: eSight Corporation
• Inventors: Mathers, Daniel R., Hilkes, Robert G., Munger, Rejean J.Y.B., Colbeck, Roger P., Lewis, Conrad W.
• Application Number:
  US13/947,376
• Publication Number:
  US 20130329190A1
• Time in Patent Office: Days
• US Class Current: 351/246
• CPC Class Codes: G02B 2027/0112 comprising device for genereting colour display
• CPC Class Codes: G02B 2027/0118 comprising devices for improving the contrast of the display / brillance control visibility
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02C 11/10 Electronic devices other than hearing aids
• CPC Class Codes: G02C 2202/10 Optical elements and systems for visual disorders other than refractive errors, low vision
• CPC Class Codes: G06Q 50/22 Social work or social welfare, e.g. community support activities or counselling services
• CPC Class Codes: G06T 19/006 Mixed reality object pose determination, tracking or camera calibration for mixed reality G06T7/00
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted
• CPC Class Codes: G16H 20/30 relating to physical therapies or activities, e.g. physiotherapy, acupressure or exercising
• CPC Class Codes: G16H 30/40 for processing medical images, e.g. editing

Abstract

A method of augmenting sight in an individual. The method comprises obtaining an image of a scene using a camera carried by the individual; transmitting the obtained image to a processor carried by the individual; selecting an image modification to be applied to the image by the processor; operating upon the image to create a modified image using either analog or digital imaging techniques, and displaying the modified image on a display device worn by the individual. The invention also relates to an apparatus augmenting sight in an individual. The apparatus comprises a camera, carried by the individual, for obtaining an image of a scene viewed by the individual; a display carried by the individual; an image modification input device carried by the individual; and a processor, carried by the individual. The processor modifies the image and displays the modified image on the display carried by the individual.

Claims

1. A method of improving the visual function of a patient comprising the steps of:

determining a vision issue relating to the patient'"'"'s vision, the vision issue being external to a physical eyeball of the patient;

obtaining image data relating to a predetermined portion of a visual field of view of the patient;

modifying substantially in real time a predetermined portion of the image data with an electronic processor to generate modified image data in dependence upon a characteristic of the vision issue; and

displaying the modified image data to the patient.

2. The method of claim 1 wherein,

the vision issue relates to at least one of:

a missing portion of the patient'"'"'s visual field of view;

an eye tracking issue of the patient;

reduced mental focus of the patient; and

peripheral distractions.

3. The method according to claim 1 wherein,

the image displayed to the patient is generated digitally using a digital imaging device attached to at least one of a head mounted device and an eyeglass frame of the patient.

4. The method according to claim 1 wherein,

determining the vision issue relating to the patient'"'"'s vision comprises at least one of:

determining at least a characteristic of the patient'"'"'s physical visual system;

determining at least a characteristic of the patient'"'"'s mental visual processing system; and

assessing at least a predetermined vision characteristic of the patient by a health professional.

5. The method according to claim 1 wherein,

modifying the image data with the electronic processor comprises applying at least one algorithm of a plurality of algorithms to the image data with at least one of a microprocessor and an electronic circuit wherein the at least one algorithm and algorithm data relating to the at least one algorithm are established in dependence upon the determined vision issue of the patient.

6. The method according to claim 1 wherein,

modifying a predetermined portion of the image data comprises at least one of:

adjusting the magnification;

enhancing the contrast;

enhancing edges;

converting to grey scale;

converting to grey scale and thresholding the resulting grey scale image data;

remapping the colours;

enhancing text;

adjusting the brightness; and

inverting the predetermined portion of the image data.

7. The method according to claim 1 wherein,

modifying a predetermined portion of the image data comprises at least one of:

remapping the predetermined portion of the image data to a second predetermined portion of the image data;

relocating text within the predetermined portion of the image data to a second predetermined portion of the image data;

deleting the predetermined portion of the image data; and

superimposing the predetermined portion of the image data onto a second predetermined portion of the image data.

8. A device for improving the visual function of a patient comprising:

a digital image device to provide image data relating to a predetermined portion of a field of view of the patient;

an electronic processor for receiving a predetermined portion of the image data and modifying it substantially in real time to generate modified image data in dependence upon a determined vision issue relating to the patient'"'"'s vision, the vision issue being external to a physical eyeball of the patient; and

a display for displaying the modified image data to the patient.

9. The device of claim 8 wherein,

the vision issue relates to at least one of:

a missing portion of the patient'"'"'s visual field of view;

an eye tracking issue of the patient;

reduced mental focus of the patient; and

peripheral distractions.

10. The device according to claim 8 wherein,

the digital image device is attached to at least one of a head mounted device and an eyeglass frame of the patient.

11. The device according to claim 8 wherein,

determining the vision issue relating to the patient'"'"'s vision comprises at least one of:

determining at least a characteristic of the patient'"'"'s physical visual system;

determining at least a characteristic of the patient'"'"'s mental visual processing system; and

assessing at least a predetermined vision characteristic of the patient by a health professional.

12. The device according to claim 8 wherein,

the electronic processor comprises at least one of a microprocessor and an electronic circuit applying at least one algorithm of a plurality of algorithms to the image data wherein the at least one algorithm and algorithm data relating to the at least one algorithm are established in dependence upon the determined vision issue of the patient.

13. The device according to claim 8 wherein,

the electronic processor in generating the modified image data at least one of:

adjusts the magnification;

enhances the contrast;

enhances edges;

converts to grey scale;

converts to grey scale and thresholds the resulting grey scale image data;

remaps the colours;

enhances text;

adjusts the brightness; and

inverts the predetermined portion of the image data.

14. The method according to claim 8 wherein,

the electronic processor in generating the modified image data at least one of:

remaps the predetermined portion of the image data to a second predetermined portion of the image data;

relocates text within the predetermined portion of the image data to a second predetermined portion of the image data;

deletes the predetermined portion of the image data; and

superimposes the predetermined portion of the image data onto a second predetermined portion of the image data.

15. A non-transitory tangible computer readable medium encoding a computer program for execution by the microprocessor, the computer program comprising the steps of:

receiving image data relating to a predetermined portion of a field of view of the patient;

receiving a predetermined portion of the image data and modifying it substantially in real time to generate modified image data in dependence upon a determined vision issue relating to the patient'"'"'s vision, the vision issue being external to a physical eyeball of the patient; and

providing the modified image data to a display for presentation to the patient.

16. The non-transitory tangible computer readable medium encoding a computer program for execution by the microprocessor according to claim 15 wherein,

the vision issue relates to at least one of:

a missing portion of the patient'"'"'s visual field of view;

an eye tracking issue of the patient;

reduced mental focus of the patient; and

peripheral distractions.

17. The non-transitory tangible computer readable medium encoding a computer program for execution by the microprocessor according to claim 15 wherein,

receiving image data relating to a predetermined portion of a field of view of the patient comprises filtering data provided by a digital imaging device attached to at least one of a head mounted device and an eyeglass frame of the patient.

18. The non-transitory tangible computer readable medium encoding a computer program for execution by the microprocessor according to claim 15 wherein,

the vision issue relating to the patient'"'"'s vision comprises at least one of:

at least a determined characteristic of the patient'"'"'s physical visual system;

at least a determined characteristic of the patient'"'"'s mental visual processing system; and

at least a predetermined vision characteristic of the patient determined by a health professional.

19. The non-transitory tangible computer readable medium encoding a computer program for execution by the microprocessor according to claim 15 wherein,

modifying substantially in real time a predetermined portion of the image data to generate modified image data comprises applying at least one algorithm of a plurality of algorithms to the image data wherein the at least one algorithm is determined in dependence upon the determined visual dysfunction of the patient.

20. The non-transitory tangible computer readable medium encoding a computer program for execution by the microprocessor according to claim 15 further comprising,

retrieving algorithm data from a memory associated with the microprocessor, the algorithm data relating to at least one of:

remapping the predetermined portion of the image data to a second predetermined portion of the image data;

relocating text within the predetermined portion of the image data to a second predetermined portion of the image data;

deleting the predetermined portion of the image data; and

superimposing the predetermined portion of the image data onto a second predetermined portion of the image data.