Apparatus and Method for Enhancing Human Visual Performance in a Head Worn Video System

• US 20130335543A1
• Filed: 06/13/2013
• Published: 12/19/2013
• Est. Priority Date: 06/13/2012
• Status: Active Grant

• Current Assignee: eSight Corporation
• Original Assignee: eSight Corporation
• Inventors: Hilkes, Robert, Jones, Frank, Rankin, Kevin
• Granted Patent: US 9,516,283 B2
• Time in Patent Office: Days
• US Class Current: 348/62
• CPC Class Codes: A61F 9/08 Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
• CPC Class Codes: A61H 2201/1604 Head
• CPC Class Codes: A61H 2201/165 Wearable interfaces
• CPC Class Codes: A61H 2201/5007 computer controlled
• CPC Class Codes: A61H 2201/501 connected to external computer devices or networks
• CPC Class Codes: A61H 2201/5092 Optical sensor
• CPC Class Codes: A61H 2201/5097 wireless
• CPC Class Codes: A61H 3/061 with electronic detecting or guiding means
• CPC Class Codes: G02B 2027/011 comprising device for correcting geometrical aberrations, distortion
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G02B 3/12 Fluid-filled or evacuated lenses
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: G06T 11/00 2D [Two Dimensional] image generation
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted
• CPC Class Codes: H04N 13/178 Metadata, e.g. disparity information
• CPC Class Codes: H04N 13/332 Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
• CPC Class Codes: H04N 7/185 : from a mobile camera, e.g. for remote control

Abstract

Visual impairment, or vision impairment, refers to the vision loss of an individual to such a degree as to require additional support for one or more aspects of their life. Such a significant limitation of visual capability may result from disease, trauma, congenital, and/or degenerative conditions that cannot be corrected by conventional means, such as refractive correction, such as eyeglasses or contact lenses, medication, or surgery. According to embodiments of the invention a method of augmenting a user'"'"'s sight is provided comprising obtaining an image of a scene using a camera carried by the individual, transmitting the obtained image to a processor, selecting an algorithm of a plurality of spectral, spatial, and temporal image modification algorithms to be applied to the image by the processor, modifying the image using the algorithm substantially in real time, and displaying the modified image on a display device worn by the individual.

Claims

1. A method comprising:

processing image data relating to an image with a microprocessor to separate the image data into at least two image data files of a plurality of image data files, each image data file relating to a predetermined portion of the image;

processing the image data within each image data file with the microprocessor to generate processed image data;

inserting into a header of each image data file data relating to an effect to be automatically applied to the image data by a display presenting the processed image data to the user when the data relating to the effect is present; and

transmitting to the display the image data file for display to the user.

2. The method according to claim 1 wherein

each predetermined portion of the image is determined in dependence upon at least one of:

a characteristic of a display upon which the image data will be displayed to a user;

a characteristic of the image sensor which captures the image data to be presented to the user; and

a characteristic of vision of a user to whom the image data will be displayed.

3. The method according to claim 1 wherein,

processing the image data to generate processed image data comprising processing the image data in dependence upon at least one of:

a characteristic of a region of a display associated with the image data file upon which the processed image data will be displayed to a user; and

a characteristic of vision of a user relating to that portion of the user'"'"'s vision to which the image data file relates.

4. The method according to claim 1 wherein;

adding data relating to an effect comprises adding data relating to at least one of a spectral shift and a spatial shift to be applied to the image file data by the display.

5. The method according to claim 1 wherein,

the predetermined portions of the image are distinguishable in that the regions of the display on which they are displayed have different physical characteristics.

6. The method according to claim 1 wherein,

the predetermined portions of the image are differentiated by different effective pixel characteristics which are applied to a display comprising an array of uniform display pixels.

7. A device comprising:

a digital camera for capturing an image relating to a field of view of a wearer of the device;

a microprocessor for executing an application stored within a memory associated with the microprocessor to process data received from the digital camera;

a display for displaying the data processed by the microprocessor comprising a plurality of pixels; and

a combining lens comprising a plurality of faces, a first face for receiving the output of the display, a second face disposed proximate an eye of the wearer through which the output of the display is coupled to the wearer'"'"'s eye, a third face disposed opposite the second face through which the viewer views the field of view.

8. The device according to claim 7 wherein,

the display comprises a plurality of regions, each region characterised by at least one of:

a different weighting of a plurality of groups of the pixels, each pixel in the group sharing a common characteristic;

a different spectral profile of the pixels;

a different physical layout of pixels; and

a different dimension of the pixels.

9. The device according to claim 7 further comprising;

a second combining lens, wherein the first and second combining lenses are disposed on either side of the wearer'"'"'s eye.

10. The device according to claim 9 further comprising;

a second display for displaying the data processed by the microprocessor comprising a plurality of pixels, the first and second displays presenting different portions of the field of view to the wearer.

11. The device according to claim 7 further comprising;

a liquid lens disposed within the optical path from the display to the wearer'"'"'s eye, wherein the liquid lens provides an electrically controlled variation in the optical properties of the path between the display and the wearer'"'"'s eye.

12. The device according to claim 11 wherein,

the liquid lens is disposed between at least one of the display and the combining lens and the combining lens and the wearer'"'"'s eye.

13. The device according to claim 7 wherein,

an image data file generated by the microprocessor containing processed image content comprises data relating to an effect for automatic execution by the display when the effect data is present, the effect being at least one of a spectral shift and a spatial shift to be applied to the processed image content without generation or transmission of additional data to the display.

14. A method of augmenting sight comprising:

providing a head mounted device comprising;

a digital camera for capturing an image relating to a field of view of a wearer of the head mounted device;

a display for displaying processed image data relating to the image and comprising a plurality of pixels; and

a combining lens for overlaying the output of the display with a predetermined portion of the field of view of the wearer; and

providing a controller comprising at least a microprocessor and a memory, the controller for receiving image data from the camera and generating processed image data according to a predetermined file format and providing the processed image data to the display.

15. The method according to claim 14 wherein,

the controller is at least one of a dedicated controller associated with the head mounted device and a portable electronic device associated with a wearer of the head mounted device executing a software application relating to the head mounted device.

16. The method according to claim 14 wherein,

the predetermined file format comprises at least image data relating to the image and effect data relating to an effect for automatic execution by the display when the effect data is present, the effect being at least one of a spectral shift and a spatial shift to be applied to the processed image content without generation or transmission of additional data to the display.

17. The method according to claim 14 wherein,

generating the processed image data is performed in dependence upon at least one of:

a characteristic of a region of the display upon which the processed image data will be displayed to a user; and

a characteristic of vision of a user relating to that portion of the user'"'"'s vision to which the image data relates.

18. The method according to claim 14 wherein,

the display comprises a plurality of regions, each region characterised by at least one of:

a different weighting of a plurality of groups of the pixels, each pixel in the group sharing a common characteristic;

a different spectral profile of the pixels;

a different temporal rate at which that region is updated;

a different physical layout of pixels; and

a different dimension of the pixels.

19. The method according to claim 14 wherein,

the processed image data is stored within a plurality of data files, each data file relating to a predetermined portion of the image and a predetermined region of a plurality of regions of the display.

20. The method according to claim 19 wherein,

each region of the plurality of regions is characterised by at least one of:

having different physical characteristics to other regions; and

being differentiated by different effective pixel characteristics which are applied to a display comprising an array of uniform display pixels.