Cognitive situation-aware vision deficiency remediation

• US 10,377,304 B2
• Filed: 12/04/2017
• Issued: 08/13/2019
• Est. Priority Date: 12/04/2017
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Chan, Yuk L., Clevenger, Lawrence A., Loiseau, Alain, Naphade, Deepti M.
• Primary Examiner(s): McNally, Kerri L
• Application Number:
  US15/830,211
• Publication Number:
  US 20190168668A1
• Time in Patent Office: 617 Days
• Field of Search: 340905
• CPC Class Codes: B60Q 9/00 Arrangement or adaptation of signal devices not provided for in one of main groups B60Q1/00 - B60Q7/00 , e.g. haptic signalling
• CPC Class Codes: G06T 11/001 Texturing; Colouring; Generation of texture or colour inpainting G06T5/77
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G08G 1/0967 Systems involving transmission of highway information, e.g. weather, speed limits transmission of navigation instructions to the vehicle G08G1/0968
• CPC Class Codes: G08G 1/164 Centralised systems, e.g. external to vehicles

Abstract

Embodiments include methods, systems, and computer program products for remediating a color vision deficiency. Aspects include receiving a user profile. Aspects also include identifying an object type for each of the plurality of objects. Aspects also include generating an image overlay for the location based at least in part upon the user profile and the object type.

Claims

1. A computer-implemented method for remediating a vision deficiency, the method comprising:

receiving, by a processor, location image data for a location comprising one or more images of a plurality of objects at the location;

receiving, by the processor, a user profile comprising a type of color vision deficiency, a severity of vision deficiency and user-specific object importance information, wherein the user profile is generated during a learning phase in which a user is presented with a series of questions to determine what the user can and cannot see;

identifying, by the processor, an object type for each of the plurality of objects;

assigning an importance level to each of the plurality of objects at the location based at least in part upon a context and the user-specific object importance information; and

generating an image overlay for the location based at least in part upon the user profile, the object type and the importance level.

2. The computer-implemented method of claim 1 further comprising identifying an object color for each of the plurality of objects.

3. The computer-implemented method of claim 1, wherein the importance level is based at least in part upon the object type.

4. The computer-implemented method of claim 1, wherein the context comprises a location classification, a user activity, or a user preference.

5. The computer-implemented method of claim 1, wherein the image overlay comprises an enhanced overlay for an object having the importance level above a threshold importance.

6. The computer-implemented method of claim 5, wherein the enhanced overlay comprises a flashing color.

7. The computer-implemented method of claim 1, wherein the image overlay comprises a color replacement for the object.

8. The computer-implemented method of claim 1 further comprising displaying the image overlay on a windshield or an eyeglass lens.

9. The computer-implemented method of claim 1 further comprising displaying the image overlay on a portable display.

10. A processing system for remediating a vision deficiency, comprising:

a processor in communication with one or more types of memory, the processor configured to;

receive location image data for a location comprising one or more images of a plurality of objects at the location;

receive a user profile comprising a type of color vision deficiency, a severity of vision deficiency and user-specific object importance information, wherein the user profile is generated during a learning phase in which a user is presented with a series of questions to determine what the user can and cannot see;

identify an object type for each of the plurality of objects;

assign an importance level to each of the plurality of objects at the location based at least in part upon a context and the user-specific object importance information; and

generate an image overlay for the location based at least in part upon the user profile, the object type and the importance level.

11. The processing system of claim 10, wherein the processor is configured to identify an object color for each of the plurality of objects.

12. The processing system of claim 10, wherein the importance level is based at least in part upon the object type.

13. A computer program product for remediating a vision deficiency, the computer program product comprising:

a computer readable storage medium readable by a processing circuit and storing program instructions for execution by the processing circuit for performing a method comprising;

receiving location image data for a location comprising one or more images of a plurality of objects at the location;

receiving a user profile comprising a type of color vision deficiency, a severity of vision deficiency and user-specific object importance information, wherein the user profile is generated during a learning phase in which a user is presented with a series of questions to determine what the user can and cannot see;

identifying an object type for each of the plurality of objects;

assigning an importance level to each of the plurality of objects at the location based at least in part upon a context and the user-specific object importance information; and

generating an image overlay for the location based at least in part upon the user profile, the object type and the importance level.

14. The computer program product of claim 13, wherein the method further comprises identifying an object color for each of the plurality of objects.

15. The computer program product of claim 13, wherein the importance level is based at least in part upon the object type.