System to compensate for visual impairment

• US 10,062,353 B2
• Filed: 06/27/2016
• Issued: 08/28/2018
• Est. Priority Date: 06/27/2016
• Status: Active Grant

• Current Assignee: Intel Corporation
• Original Assignee: Intel Corporation
• Inventors: Yeung, Fai, Wei, John, Yener, Murat
• Primary Examiner(s): Wills, Diane
• Application Number:
  US15/193,428
• Publication Number:
  US 20170372673A1
• Time in Patent Office: 792 Days
• CPC Class Codes: G06T 5/80 Geometric correction
• CPC Class Codes: G09G 2320/0261 in the context of movement of objects on the screen or movement of the observer relative to the screen
• CPC Class Codes: G09G 2340/06 Colour space transformation
• CPC Class Codes: G09G 2340/14 Solving problems related to the presentation of information to be displayed
• CPC Class Codes: G09G 2380/08 Biomedical applications
• CPC Class Codes: G09G 3/001 using specific devices not provided for in groups G09G3/02 - G09G3/36, e.g. using an intermediate record carrier such as a film slide; Projection systems; Display of non-alphanumerical information, solely or in combination with alphanumerical information, e.g. digital display on projected diapositive as background slide projectors per se G03B23/00 = 42 HP
• CPC Class Codes: G09G 5/005 Adapting incoming signals to the display format of the display terminal

Abstract

This disclosure is directed to a system to compensate for visual impairment. The system may comprise, for example, a frame wearable by a user to which is mounted at least sensing circuitry and display circuitry. The sensing circuitry may sense at least visible data and depth data. Control circuitry may then cause the display circuitry to visibly present the depth to the user based on the visible data and depth data. For example, the display circuitry may present visible indicia indicating depth to appear superimposed on the field of view to indicate different depths in the field of view, or may alter the appearance of objects in the field of view based on the depth of each object. The system may also be capable of sensing a particular trigger event, and in response may initiate sensing and presentation for a peripheral field of view of the user.

Claims

1. A system to compensate for visual impairment, comprising:

a frame wearable by a user;

sensing circuitry mounted to the frame, wherein the sensing circuitry is to at least sense visible data and depth data in a field of view of the user;

display circuitry mounted to the frame;

control circuitry to cause the display circuitry to present a visible representation of depth in the field of view based on the visible data and the depth data;

wherein;

the visible representation of depth comprises at least a change in a color hue of the object from a default color hue of the object to an altered color hue; and

the altered color hue is correlated by the control circuitry to a distance of the object from the user.

2. The system of claim 1, wherein the sensing circuitry comprises at least one camera to sense the visible data and at least one infrared emitter and detector pair to sense the depth data.

3. The system of claim 2, wherein the depth of object sensed in the field of view is determined utilizing a time-of-flight calculation based on detected reflection of emitted IR signals.

4. The system of claim 1, wherein the display circuitry comprises at least one transparent or semi-transparent lens mounted in the frame, the visible representation of depth in the field of view being presented on the at least one lens to visibly convey depth to the user.

5. The system of claim 1, wherein the visible representation of depth further comprises visible indicia of depth presented by the display circuitry so as to appear superimposed on the field of view.

6. The system of claim 1, wherein the control circuitry is to cause the sensing circuitry to initiate sensing for a peripheral field of view based on a sensed trigger event.

7. The system of claim 6, further comprising user interface circuitry to at least sense said trigger event based on at least one of a position, orientation, velocity, or acceleration.

8. The system of claim 7, wherein the control circuitry is to cause the display circuitry to present a peripheral field of view to the user based on sensing the trigger event.

9. The system of claim 1, wherein in presenting a visible representation of depth the control circuitry is to cause the display circuitry to present the visible data modified to include the visible representation of depth superimposed on the visible data.

10. The system of claim 1, wherein the control circuitry is to cause the display circuitry to present the visible representation of depth only for depths greater than a certain distance from the user.

11. A method for providing compensation for visual impairment, comprising:

capturing visual data within a field of view of a user utilizing sensing circuitry mounted to a frame wearable by the user;

capturing depth data utilizing the sensing circuitry;

presenting a visible representation of depth in the field of view based on the visible data and the depth data utilizing display circuitry mounted to the frame, the visible representation of depth comprising at least a change in a color hue of the object from a default color hue of the object to an altered color hue; and

wherein the altered color hue is correlated by the control circuitry to a distance of the object from the user.

12. The method of claim 11, wherein the visible representation of depth further comprises visible indicia of depth presented by the display circuitry so as to appear superimposed on the field of view.

13. The method of claim 11, further comprising causing the sensing circuitry to initiate sensing for a peripheral field of view based on sensing a trigger event wherein the visible representation of depth comprises modifications to the appearance of objects in the field of view to visibly represent depth.

14. The method of claim 13, further comprising:

sensing the trigger event based on at least one of a position, orientation, velocity or acceleration.

15. The method of claim 13, further comprising:

causing the display circuitry to present a peripheral field of view to the user based on sensing the trigger event.

16. The method of claim 11, wherein presenting a visible representation of depth further comprises causing the display circuitry to present the visible data modified to include the visible representation of depth superimposed on the visible data.

17. The method of claim 11, further comprising:

causing the display circuitry to present the visible representation of depth only for depths greater than a certain distance from the user.

18. At least one non-transitory machine-readable storage medium having stored thereon, individually or in combination, instructions for providing compensation for visual impairment that, when executed by one or more processors, cause the one or more processors to:

sense visual data within a field of view of a user utilizing sensing circuitry mounted to a frame wearable by the user;

sense depth data utilizing the sensing circuitry;

present a visible representation of depth in the field of view based on the visible data and the depth data utilizing display circuitry mounted to the frame, the visible representation of depth comprising at least a change in a color hue of the object from a default color hue of the object to an altered color hue;

wherein the altered color hue is correlated by the control circuitry to a distance of the object from the user.

19. The non-transitory storage medium of claim 18, wherein the visible representation of depth further comprises visible indicia of depth presented by the display circuitry so as to appear superimposed on the field of view.

20. The non-transitory storage medium of claim 18, wherein said instructions when executed further cause the sensing circuitry to initiate sensing for a peripheral field of view based on sensing a trigger event.

21. The non-transitory storage medium of claim 20, further comprising instructions that, when executed by one or more processors, cause the one or more processors to:

sense the trigger event based on at least one of a position, orientation, velocity or acceleration.

22. The non-transitory storage medium of claim 20, further comprising instructions that, when executed by one or more processors, cause the one or more processors to:

cause the display circuitry to present a peripheral field of view to the user based on sensing a trigger event.

23. The non-transitory storage medium of claim 18, wherein the instructions to present a visible representation of depth comprise instructions to cause the display circuitry to present the visible data modified to include the visible representation of depth superimposed on the visible data.

24. The non-transitory storage medium of claim 18, further comprising instructions that, when executed by one or more processors, cause the one or more processors to:

causing the display circuitry to present the visible representation of depth only for depths greater than a certain distance from the user.