Low vision video magnifier

• US 20050162512A1
• Filed: 03/28/2003
• Published: 07/28/2005
• Est. Priority Date: 03/28/2002
• Status: Abandoned Application

• Current Assignee: Technologies Humanware Inc. (EssilorLuxottica SA)
• Original Assignee: Technologies Humanware Inc. (EssilorLuxottica SA)
• Inventors: Seakins, Paul John
• Application Number:
  US10/509,554
• Publication Number:
  US 20050162512A1
• Time in Patent Office: Days
• US Class Current: 348/62
• CPC Class Codes: G09B 21/00 Teaching, or communicating with, the blind, deaf or mute audible presentation of material to be studied G09B5/04; devices or methods for replacing direct visual or auditory perception by another kind of perception A61F9/08, A61F11/04; audible indication of meter readings or of colour G01D7/12; watches for blind persons G04B25/02; speech analysis, speech recognition G10L; sound-recording or reproducing, per se G11B

Abstract

A low-vision viewer magnifies the face-up source material in the visual field of a camera and displays the magnified image on a VDU or other display means. In a static mode, the camera captures and stores a high-resolution image of the source material. This high-resolution image can be manipulated and subsequently displayed on the VDU. In a live mode, the camera captures a low resolution image of the source material or a high resolution image of a section of the source material to provide a high frame rate for full motion video. In the live capture mode, the low-vision user can move their view around the source material and zoom in on a desired section of interest. The same camera is used in either static or live modes.

Claims

1. A low vision viewing apparatus that displays an image of an object, said apparatus comprising:

a camera, including a lens to define an image plane and an electronic image sensor located at the image plane for capturing a visual field providing an output set of pixels representative of said visual field depending on input as to specific pixels or ranges thereof;

a display means configured to provide a representation of a window of interest;

an electronic processing means controlled by a program, connected intermediate of said display means and said camera, which defines said visual field as a set of pixels and a subset of said set of pixels as said window-of-interest; and

a steering means to select said subset of pixels on said visual field which constitutes the window-of-interest,

wherein said processing means selectively acquiring said subset of said set of pixels from said camera depending on user input from said steering means and pre-programmed instructions.

2. A low vision viewing apparatus according to claim 1 wherein:

said electronic processing means includes storage means; and

said electronic processing means controlled by said program that causes said processing means to apply digital magnification to said stored set of pixels to a desired magnification level selected by said low-vision user, said electronic processing means displaying a magnified image of said visual field image on said display means.

3. A low vision viewing apparatus according to claim 2 wherein said electronic image sensor is a high-resolution image sensor that captures a high-resolution image.

4. A low vision viewing apparatus according to claim 1 wherein said electronic image sensor is a low-resolution image sensor that captures a plurality of low-resolution images by moving a low-resolution image sensor by sub-pixel amounts and combining said low-resolution images to create a high-resolution image.

5. A low vision viewing apparatus according to claim 1 wherein said electronic image sensor consists of a plurality of low-resolution image sensors that are optically “

butted”

together to create a single high-resolution image sensor and captures a high-resolution image.

6. A low vision viewing apparatus according to claim 1 wherein said electronic image sensor is a low-resolution image sensor that is moved within said image plane of said lens to capture a plurality of low-resolution images, and combining said low-resolution images to create a high-resolution image.

7. A low vision viewing apparatus according to claim 3 wherein said electronic processing means moves said window-of-interest on said electronic image sensor by reading said subset of pixels from said electronic image sensor and displaying said window-of-interest on said display means.

8. A low vision viewing apparatus according to claim 3 wherein said electronic processing means moves said electronic image sensor within said image plane of said lens and displays said window-of-interest on said display means.

9. A low vision viewing apparatus according to claim 3 wherein said electronic processing means moves said electronic image sensor within said image plane of said lens and displays said high resolution image on said display means.

10. A low vision viewing apparatus according to claim 7 wherein said low-vision user controls the location of said window-of-interest or said electronic image sensor by a device selected from the group consisting of a trackball, a joystick, a set of buttons, a mouse, a touch screen, or a touch tablet.

11. A low vision viewing apparatus according to claim 1 wherein said electronic processing means subsamples said window-of-interest by reading said subset of pixels as defined by a previously defined regular pattern and displays a compressed image on said display means.

12. A low vision viewing apparatus according to claim 3 wherein said electronic processing means subsamples said high-resolution image by reading said set of pixels as defined by a previously defined regular pattern and displays said compressed image on said display means.

13. A low vision viewing apparatus according to claim 12 wherein said program controls said processing means to apply digital magnification to said high-resolution compressed image to a desired magnification level selected by said low-vision user and displays the digitally magnified image on said display means.

14. A low vision viewing apparatus according to claim 7 wherein said program controls said processing means to apply digital magnification to said window-of-interest to a desired magnification level selected by said low-vision user and displays the digitally magnified image on said display means.

15. A low vision viewing apparatus according to claim 11 wherein said program controls said processing means to apply digital magnification to window-of-interest compressed image to a desired magnification level selected by said low-vision user and displays the digitally magnified image on said display means.

16. A low vision viewing apparatus according to claim 12 wherein said program controls said processing means to select said high-resolution compressed image based on said desired level of magnification selected by said low-vision user, and displays selected image on said display means.

17. A low vision viewing apparatus according to claim 7 wherein said program controls said processing means to select said window-of-interest based on said desired level of magnification selected by said low-vision user, and displays selected image on said display means.

18. A low vision viewing apparatus according to claim 11 wherein said program controls said processing means to select said window-of-interest compressed image based on said desired level of magnification selected by said low-vision user, and displays selected image on said display means.

19. A low vision viewing apparatus according to claim 13 wherein said program controls said processing means to select said desired magnification level for each letter so that text in said visual field and said window-of-interest is magnified to a preselected size on said display means.

20. A low vision viewing apparatus according to claim 13 wherein said program controls said processing means to select said desired magnification level for each letter so that the text in said visual field and said window-of-interest is reduced to a preselected size on said display means.

21. A low vision viewing apparatus according to claim 13 wherein said digital magnification is implemented using two dimensional scaling by a form of interpolation selected from the group consisting of linear interpolation, nearest-neighbour interpolation, or cubic spline interpolation.

22. A low vision viewing apparatus according to claim 12 wherein said program controls said processing means to automatically adjust the brightness and contrast of said high-resolution compressed image on said display means.

23. A low vision viewing apparatus according to claim 7 wherein said program controls said processing means to automatically adjust the brightness and contrast of said window-of-interest on said display means.

24. A low vision viewing apparatus according to claim 11 wherein said program controls said processing means to automatically adjust the brightness and contrast of said window-of-interest compressed image on said display.

25. A low vision viewing apparatus according to claim 2 wherein said electronic processing and storage means successively adjusts the focus of said lens and captures an image at different focus points, analyzes said different focused images to extract the image sections of each different focus image which are the sharpest, and combines said image sections to yield a high-resolution image with extended depth of focus.

26. A low vision viewing apparatus according to claim 3 wherein said program controls said processing means to implement pixel level binarisation on said stored high-resolution image based on a uniform pixel threshold level.

27. A low vision viewing apparatus according to claim 3 wherein said program controls said processing means to implement pixel level binarisation based on a pixel threshold level which varies over said high-resolution image to provide optimum binarisation in the presence of brightness variations.

28. A low vision viewing apparatus according to claim 3 wherein said program controls said processing means to use page segmentation to identify the location of letters and a reading order for said letters in said stored high-resolution text and display said letters on said display means in a predefined pattern.

29. A low vision viewing apparatus according to claim 28 wherein said program controls said processing means to arrange said letters into words and displays said words on said display means in a predetermined sequence wherein each said word replaces the previous said word after a predetermined time period.

30. A low vision viewing apparatus according to claim 28 wherein said program controls said processing means to arrange words on said display means in a predetermined sequence, wherein said words are displayed from one side of said display means to the opposite side of said display means.

31. A low vision viewing apparatus according to claim 28 wherein said program controls said processing means to separate said letters by displaying said letters with a predetermined space between each said letter.

32. A low vision viewing apparatus according to claim 28 wherein said program uses a device to determine the section of said stored high-resolution image text displayed on said display means by a device from the group consisting of a trackball, a joystick, a set of buttons, a mouse, a touch screen, or a touch tablet.

33. A low vision viewing apparatus according to claim 3 wherein said program automatically moves through said stored high-resolution image text, said movement based on said reading order of said text on said display means.

34. A low vision viewing apparatus that magnifies and displays an image of an object on a display means, said apparatus incorporating a controller for electronically processing said image, said electronic processing modes including:

a live video capture and image display of said magnified image; and

a static image capture and image display of said magnified image.

35. A low vision viewing apparatus according to claim 34 wherein said static image capture mode allows a user to adjust the magnification of said static image on said display means.

36. A low vision viewing apparatus according to claim 34 claims 34 or 35 wherein said static image capture mode allows the user to navigate said static image on said display means.

37. A low vision viewing apparatus according to claim 34 wherein said static image capture mode analyzes text present in said static image and provides for the display of said text on said display means in a plurality of predetermined formats.

38. A low vision viewing apparatus according to claim 34 wherein said static image capture mode analyzes the reading order of said text, and facilitates the user to navigate around said static image on said display means by using a controller to determine the section of said static image to be displayed on said display means.

39. A low vision viewing apparatus according to claim 34 wherein said static image capture mode analyzes the reading order of said text and allows automatic movement of the section of said static image visible on said display means, using a controller to determine the speed and direction of said automatic movement.

40. (canceled)