Cognitive situation-aware vision deficiency remediation

• US 10,565,872 B2
• Filed: 12/04/2017
• Issued: 02/18/2020
• Est. Priority Date: 12/04/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chan, Yuk L., Clevenger, Lawrence A., Loiseau, Alain, Naphade, Deepti M.
• Primary Examiner(s): Haile, Benyam
• Application Number:
  US15/830,204
• Publication Number:
  US 20190172347A1
• Time in Patent Office: 806 Days
• CPC Class Codes: B60Q 9/008 for anti-collision purposes
• CPC Class Codes: B60W 50/14 Means for informing the driver, warning the driver or prompting a driver intervention
• CPC Class Codes: G06V 20/58 Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads
• CPC Class Codes: G06V 20/584 of vehicle lights or traffic lights
• CPC Class Codes: G08G 1/005 including pedestrian guidance indicator
• CPC Class Codes: G08G 1/0967 Systems involving transmission of highway information, e.g. weather, speed limits transmission of navigation instructions to the vehicle G08G1/0968
• CPC Class Codes: G08G 1/16 Anti-collision systems road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08
• CPC Class Codes: G08G 1/164 Centralised systems, e.g. external to vehicles
• CPC Class Codes: G08G 1/165 for passive traffic, e.g. including static obstacles, trees
• CPC Class Codes: G08G 1/167 Driving aids for lane monitoring, lane changing, e.g. blind spot detection
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted
• CPC Class Codes: G09B 21/04 Devices for conversing with the deaf-blind

Abstract

Embodiments include methods, systems, and computer program products for remediating a vision deficiency. Aspects include receiving a user device signal indicating a vision deficiency hazard on a roadway and a user device location. Aspects also include sending a user warning signal to the user device.

Claims

1. A computer implemented method for remediating a vision deficiency of a user, the method comprising:

receiving a signal from a user device, the signal indicating a vision deficiency hazard and a user device location;

performing an analysis of relative object movement in relation to a user associated with the user device and an object moving relative to the user; and

sending a user warning signal to the user device based on the vision deficiency hazard exceeding a first predetermined threshold level of importance and the analysis of relative object movement, the warning signal comprising a visual signal providing an overlay image, wherein the overlay image comprises an object annotation and an enhanced overlay based on a determination that an importance level of the vision deficiency hazard exceeds a second predetermined threshold level of importance and that the object is obscured by a nearby object of similar color, the enhanced overlay comprising a flashing boundary around the object and the object annotation comprising a label of a characteristic of the object, wherein the object annotation is obtained from a third party system and the label is determined using contextual information about the object gathered by sensors associated with the third party system.

2. The method of claim 1, wherein the vision deficiency hazard includes the object moving relative to the user and the method further comprises identifying the object based at least in part upon the user device signal.

3. The method of claim 1, wherein the user warning signal comprises an audible signal.

4. The method of claim 1 further comprising sending a vision deficiency hazard warning warning to a moving object, wherein the moving object comprises a vehicle.

5. The method of claim 4, wherein the moving object warning comprises an audible signal.

6. The method of claim 1 further comprising registering a vision deficiency hazard characteristic.

7. The method of claim 1 further comprising updating a location of the vision deficiency hazard.

19. The method of claim 1, wherein the third party system comprises a social networking system.

20. The method of claim 1, wherein the third party system comprises a merchant system.

8. A processing system for remediating a vision deficiency of a user, comprising:

a processor in communication with one or more types of memory, the processor configured to perform a method comprising;

receiving a signal from a user device, the signal indicating a vision deficiency hazard on a roadway and a user device location;

performing an analysis of relative object movement in relation to a user associated with the user device and an object moving relative to the user; and

sending a user warning signal to the user device based on the vision deficiency hazard exceeding a first predetermined threshold level of importance and the analysis of relative object movement, the warning signal comprising a visual signal providing an overlay image, wherein the overlay image comprises an object annotation and an enhanced overlay based on a determination that an importance level of the vision deficiency hazard exceeds a second predetermined threshold level of importance and that the object is obscured by a nearby object of similar color, the enhanced overlay comprising a flashing boundary around the object and the object annotation comprising a label of a characteristic of the object, wherein the object annotation is obtained from a third party system and the label is determined using contextual information about the object gathered by sensors associated with the third party system.

9. The processing system of claim 8, wherein the vision deficiency hazard includes the object moving relative to the user and the method further comprises identifying the object based at least in part upon the user device signal.

10. The processing system of claim 9, wherein the method further comprises sending a moving object warning to a moving object.

11. The processing system of claim 8, wherein the user warning signal comprises an audible signal.

12. The processing system of claim 8, wherein the method further comprises registering a vision deficiency hazard characteristic.

13. The processing system of claim 8, wherein the method further comprises updating a location of the vision deficiency hazard.

14. The processing system of claim 8, wherein the method further comprises sending the signal to a cloud-based server.

15. A computer program product for remediating a vision deficiency of a user, the computer program product comprising:

a non-transitory computer readable storage medium readable by a processing circuit and storing program instructions for execution by the processing circuit for performing a method comprising;

receiving a signal from a user device, the signal indicating a vision deficiency hazard on a roadway and a user device location;

performing an analysis of relative object movement in relation to a user associated with the user device and an object moving relative to the user, and

sending a user warning signal to the user device based on the vision deficiency hazard exceeding a first predetermined threshold level of importance and the analysis of relative object movement, the warning signal comprising a visual signal providing an overlay image, wherein the overlay image comprises an object annotation and an enhanced overlay based on a determination that an importance level of the vision deficiency hazard exceeds a second predetermined threshold level of importance and that the object is obscured by a nearby object of similar color, the enhanced overlay comprising a flashing boundary around the object and the object annotation comprising a label of a characteristic of the object, wherein the object annotation is obtained from a third party system and the label is determined using contextual information about the object gathered by sensors associated with the third party system.

16. The computer program product of claim 15, wherein the user warning signal comprises an audible signal.

17. The computer program product of claim 15, wherein the vision deficiency hazard includes the object moving relative to the user and the method further comprises identifying the object based at least in part upon the user device signal.

18. The computer program product of claim 15, wherein a software is provided as a service in a cloud environment.