INTELLIGENT GLASSES FOR THE VISUALLY IMPAIRED

• US 20150227778A1
• Filed: 02/07/2014
• Published: 08/13/2015
• Est. Priority Date: 02/07/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Cervantes, Humberto Orozco
• Granted Patent: US 9,488,833 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G02B 2027/0138 comprising image capture systems, e.g. camera
• CPC Class Codes: G02B 2027/0178 Eyeglass type eyeglass details G02C
• CPC Class Codes: G02B 27/0101 characterised by optical features G02B27/0172 takes precedence
• CPC Class Codes: G02B 27/0172 characterised by optical features
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06T 7/70 Determining position or orientation of objects or cameras camera calibration G06T7/80
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays
• CPC Class Codes: G09B 21/006 using audible presentation of the information
• CPC Class Codes: G09B 21/008 using visual presentation of the information for the partially sighted
• CPC Class Codes: G09B 5/125 the stations being mobile
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 23/57 Mechanical or electrical details of cameras or camera modules specially adapted for being embedded in other devices

Abstract

An embodiment of the present invention is a method for communicating navigation information on a physical environment to a user. The method comprises receiving, by one or more computer processors, at least one digital image of a physical environment of a user that is captured by one or more digital video devices and converting the at least one digital image into a three-dimensional image. Furthermore, the method includes analyzing the three-dimensional image using object analysis to generate output data where the output data corresponds to the physical environment. Additionally, the method includes determining a device associated with the user and formatting the output data for use with the device

Claims

1. A method for communicating navigation information on a physical environment to a user, the method comprising:

receiving, by one or more computer processors, at least one digital image of a physical environment of the user captured by one or more digital video devices;

converting, by one or more computer processors, the at least one digital image into a three-dimensional image;

analyzing, by one or more computer processors, the three-dimensional image using object analysis to generate output data, wherein the output data corresponds to the physical environment;

determining, by one or more computer processors, a device associated with the user; and

formatting, by one or more computer processors, the output data for use with the device.

2. The method of claim 1, further comprising:

receiving, by one or more computer processors, a request to identify an object in the physical environment; and

retrieving, by one or more computer processors, a name of the object in the physical environment from a database, the database containing the at least one digital image associated with the name of the object.

3. The method of claim 1, wherein analyzing, by one or more computer processors, the three-dimensional image using object analysis to generate output data, wherein the output data corresponds to the physical environment, further comprises:

determining, by one or more computer processors, an estimated distance to at least one object, based, at least in part, on a focal point of the user; and

determining, by one or more computer processors, output data, based, at least in part, on the estimated distance to the at least one object.

4. The method of claim 1, further comprising:

transmitting, by one or more computer processors, the output data to the device associated with the user.

5. The method of claim 1, wherein the device associated with the user includes at least one of:

an electrical stimulation pad, an audio device, and an electrical stimulation device with a touch sensitive surface accessible to the user.

6. The method of claim 5, wherein the electrical stimulation pad includes at least a matrix of electrodes embedded in a plastic pad attached to a user, the matrix of electrodes capable of varying intensity and shock pattern.

7. The method of claim 1, wherein formatting, by one or more computer processors, the output data for use with the device further comprises:

determining, by one or more computer processors, a level of intensity associated with each object in the physical environment, the level corresponding to an estimated distance between the user and the object.

8. A computer program product for communicating navigation information on a physical environment to a user, the computer program product comprising:

one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions comprising;

program instructions to receive at least one digital image of a physical environment of the user captured by one or more digital video devices;

program instructions to convert the at least one digital image into a three-dimensional image;

program instructions to analyze the three-dimensional image using object analysis to generate output data, wherein the output data corresponds to the physical environment;

program instructions to determine a device associated with the user; and

program instructions to format the output data for use with the device.

9. The computer program product of claim 8, further comprising:

program instructions to receive a request to identify an object in the physical environment; and

program instructions to retrieve a name of the object in the physical environment from a database, the database containing the at least one digital image associated with the name of the object.

10. The computer program product of claim 8, wherein the program instructions to analyze the three-dimensional image using object analysis to generate output data, wherein the output data corresponds to the physical environment, further comprise:

program instructions to determine an estimated distance to at least one object, based, at least in part, on a focal point of the user; and

program instructions to determine output data, based, at least in part, on the estimated distance to the at least one object.

11. The computer program product of claim 8, further comprising:

program instructions to transmit the output data to the device associated with the user.

12. The computer program product of claim 8, wherein the device associated with the user includes at least one of:

an electrical stimulation pad, an audio device, and an electrical stimulation device with a touch sensitive surface accessible to the user.

13. The computer program product of claim 12, wherein the electrical stimulation pad includes at least a matrix of electrodes embedded in a plastic pad attached to a user, the matrix of electrodes capable of varying intensity and shock pattern.

14. The computer program product of claim 8, wherein the program instruction to format the output data for use with the device further comprise:

program instructions to determine a level of intensity associated with each object in the physical environment, the level corresponding to an estimated distance between the user and the object.

15. A computer system for communicating navigation information on a physical environment to a user, the system comprising:

one or more computer processors;

one or more computer readable storage media;

program instructions stored on at least one of the one or more computer readable storage media for execution by at least one of the one or more computer processors, the program instructions comprising;

program instructions to receive at least one digital image of a physical environment of the user captured by one or more digital video devices;

program instructions to convert the at least one digital image into a three-dimensional image;

program instructions to analyze the three-dimensional image using object analysis to generate output data, wherein the output data corresponds to the physical environment;

program instructions to determine a device associated with the user; and

program instructions to format the output data for use with the device.

16. The computer system of claim 15, further comprising:

program instructions to receive a request to identify an object in the physical environment; and

program instructions to retrieve a name of the object in the physical environment from a database, the database containing the at least one digital image associated with the name of the object.

17. The computer system of claim 15, wherein the program instructions to analyze the three-dimensional image using object analysis to generate output data, wherein the output data corresponds to the physical environment, further comprise:

program instructions to determine an estimated distance to at least one object, based, at least in part, on a focal point of the user; and

program instructions to determine output data, based, at least in part, on the estimated distance to the at least one object.

18. The computer system of claim 15, further comprising:

program instructions to transmit the output data to the device associated with the user.

19. The computer system of claim 15, wherein the device associated with the user includes at least one of:

an electrical stimulation pad, an audio device, and an electrical stimulation device with a touch sensitive surface accessible to the user.

20. The computer system of claim 15, wherein the program instruction to format the output data for use with the device further comprises:

program instructions to determine a level of intensity associated with each object in the physical environment, the level corresponding to an estimated distance between the user and the object.