Methods and apparatus for vision enhancement

• US 10,146,304 B2
• Filed: 11/10/2015
• Issued: 12/04/2018
• Est. Priority Date: 11/10/2014
• Status: Active Grant

• Current Assignee: IrisVision, Inc.
• Original Assignee: IrisVision, Inc.
• Inventors: Werblin, Frank S., Massof, Robert, Boger, Yuval S.
• Primary Examiner(s): Rao, Andy
• Assistant Examiner(s): Jiang, Zaihan
• Application Number:
  US14/937,373
• Publication Number:
  US 20160156850A1
• Time in Patent Office: 1,120 Days
• Field of Search: 348 63
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/014 comprising information/image processing systems
• CPC Class Codes: G02B 27/017 Head mounted
• CPC Class Codes: G06F 2203/04805 Virtual magnifying lens, i.e. window or frame movable on top of displayed information to enlarge it for better reading or selection
• CPC Class Codes: G06F 3/013 Eye tracking input arrangements G06F3/015 takes precedence
• CPC Class Codes: H04N 5/772 the recording apparatus and the television camera being placed in the same enclosure

Abstract

A system and methods for the enhancement of a user'"'"'s vision using a head-mounted and user-controllable device including a magnification bubble having variable attributes wherein a portion of the scene is magnified within the complete scene, wherein the user is able to modify, in real-time, how the images are processed including the attributes of the magnification bubble.

Claims

1. A portable vision-enhancement system wearable by a user, comprising:

a memory including a stored program;

a camera mounted on the user aimed to view a scene in front of the user and operable to obtain input video images of the scene;

a processor programmed to execute the stored program to transform the input video images of the scene into a stream of output video images of the scene that include a magnification bubble that overlays and enlarges a user-selected portion of the output video images of the scene within the context of the scene;

wherein the magnification bubble has variable attributes where the processor is programmed to vary attributes of the magnification bubble including at least one of the position of the magnification bubble, the size of the magnification bubble, the shape of the magnification bubble, and the magnification power of the magnification bubble, in the scene in the stream of output video images in response to an input signal; and

a user screen disposed to be viewed by the user that displays the output video images.

2. The portable vision-enhancement system of claim 1,

further comprising a pair of goggles and an electronic device attached to the goggles, where said camera, the processor, and the screen are components of the electronic device where the electronic device is removably attached to the goggles.

3. The portable vision-enhancement system of claim 2, where the electronic device is a smartphone.

4. The portable vision-enhancement system of claim 1, where the magnification bubble has a circular shape.

5. The portable vision-enhancement system of claim 1, where the magnification bubble has a non-circular shape.

6. The portable vision-enhancement system of claim 1, further including an eye tracking device to determine the gaze direction of the user, and where the processor is further programmed to position the magnification bubble within the scene as a function of the gaze direction.

7. The portable vision-enhancement system of claim 1, wherein said magnification bubble includes a first area having a first magnifying power and a second area contiguous to and surrounding the first area having a lower magnifying power.

8. A clinician setup comprising:

a clinician monitor; and

a clinician controller, where the clinician monitor and the clinician controller are each configured to communicate with the portable vision-enhancement system of claim 1 such that the clinician monitor mirrors what is displayed on the user screen and the clinician controller provides access to the stored program, such that a clinician can view the contents of the user screen and, through the clinician controller, modify parameters of the stored program such that the clinician controls how the processor executes the stored program to transform the stream of input video images into a stream of output images that includes a magnification bubble that overlays and enlarges a selected portion of the output video images of the scene within the context of the scene.

18. The portable vision-enhancement system of claim 1 wherein the processor is programmed to vary at least two of the attributes of the magnification bubble.

19. The portable vision-enhancement system of claim 1 wherein the processor is programmed to vary at least three of the attributes of the magnification bubble.

20. The portable vision-enhancement system of claim 1 wherein the processor is programmed to vary at least four of the attributes of the magnification bubble.

9. A method for enhancing vision for a user having a head and a gaze using a system including a camera, a processor, and a screen, the method comprising:

receiving a stream of video images from the camera of a scene in front of the user;

processing the received stream of video images into a stream of output video images of the scene wherein the processed output video images include a magnification bubble that overlays and enlarges a user-selected area of the scene within the context of the scene wherein the magnification bubble has variable attributes that the processor is programmed to vary including at least one of the position of the magnification bubble, the size of the magnification bubble, the shape of the magnification bubble, and the magnification power of the magnification bubble;

sending a signal to vary one or more of the attributes of the magnification bubble; and

displaying the stream of output video images on the screen.

10. The method of claim 9, wherein the magnification bubble has variable attributes, one of which attributes is the position of the magnification bubble and where the processor is programmed to vary the position of the magnification bubble in the stream of output video images as a function of the movement of the head or gaze of the user.

11. The method of claim 9, wherein one of the variable attributes of the magnification bubble is the power of magnification of the magnification bubble wherein said the processor is programmed to vary the power of magnification of at least a portion of the magnification bubble in response to an input signal.

12. The method of claim 9, wherein one of the variable attributes of said magnification bubble is the shape of the magnification bubble wherein the processor is programmed to vary the shape of the magnification bubble in response to an input signal.

13. The method of claim 9, where the magnification bubble has a circular shape.

14. The method of claim 9, where the magnification bubble has a non-circular shape.

15. The method of claim 9 wherein one of the variable attributes of the magnification bubble is its size of the magnification bubble and where the processor is programmed to vary the size of the magnification bubble in the stream of output video images in response to an input signal.

16. The method of claim 9, further comprising:

determining the gaze direction of the user, and where the processor is further programmed to position the magnification bubble as a function of user gaze direction.

17. The method of claim 9, where the magnification bubble includes a first area having a first magnifying power and a second area surrounding the first area and having a variable magnifying power that is lower than the magnifying power of the first area.