ASSISTING A VISION-IMPAIRED USER WITH NAVIGATION BASED ON A 3D CAPTURED IMAGE STREAM

• US 20080170118A1
• Filed: 01/12/2007
• Published: 07/17/2008
• Est. Priority Date: 01/12/2007
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Goldman, Steven D., Sessa, Anthony J., Arnold, Kenneth C., Paolini, Michael A., Albertson, Jacob C.
• Granted Patent: US 8,588,464 B2
• Time in Patent Office: Days
• US Class Current: 348/46
• CPC Class Codes: A61H 2003/063 with tactile perception
• CPC Class Codes: A61H 2003/065 in the form of braille
• CPC Class Codes: A61H 3/061 with electronic detecting or guiding means
• CPC Class Codes: G01C 21/3804 Creation or updating of map data

Abstract

An object-enabled navigation system assists a vision-impaired user in navigating an environment. The system captures 3D movement of a moving object within the environment, wherein the three-dimensional movement is determined using at least one image capture device aimed at the moving object. The system predicts a mobile path of the visually-impaired user. The system determines whether the movement of the moving object will intersect with the mobile path of the vision-impaired user and informs the vision-impaired user whether the movement of the moving object will intersect the mobile path of the vision-impaired user.

Claims

1. A computer-implemented method for assisting a user with information about an environment relative to the user, comprising:

capturing a three-dimensional movement of a moving object within the environment, wherein the three-dimensional movement is determined using at least one image capture device aimed at the moving object;

predicting a mobile path of the user;

determining whether the movement of the moving object will intersect with the mobile path of the user; and

informing the user whether the movement of the moving object will intersect the mobile path of the user.

2. The computer-implemented method according to claim 1, further comprising:

capturing a three-dimensional location of a stationary object within the environment, wherein the three-dimensional location is determined using at least one image capture device aimed at the stationary object;

determining whether the three-dimensional location of the stationary object will intersect with the mobile path of the user; and

informing the user whether the stationary object will intersect the mobile path of the user.

3. The computer-implemented method according to claim 1, further comprising:

identifying a three-dimensional object properties stream using the captured three-dimensional movement of the moving object;

identifying a particular type of object representing the three-dimensional object properties stream by comparing the identified three-dimensional object properties steam with a plurality of object definitions for the environment; and

in response to identifying the particular type of object from among the plurality of object definitions, informing the user of the type of moving object detected within the environment.

4. The computer-implemented method according to claim 3, wherein identifying a particular type of object further comprises identifying at least one of a shape of the moving object, a name of the moving object, and a surface characteristic of the moving object.

5. The computer-implemented method according to claim 1, wherein capturing a three-dimensional movement of a moving object further comprises capturing the three-dimensional movement using a stereoscopic video capture device to identify and track a particular three-dimensional movement.

6. The computer-implemented method according to claim 1, wherein capturing a three-dimensional movement of the moving object further comprises capturing the three-dimensional movement using at least one stereoscopic video capture device and at least one sensor enabled device to detect a distance to the moving object in the three-dimensional movement.

7. The computer-implemented method according to claim 1, wherein informing the user whether the movement of the moving object will intersect the mobile path of the user further comprises:

generating a feedback pattern for output to a feedback device detected by the user to warn the user of the moving object.

8. The computer-implemented method according to claim 1, wherein informing the user whether the movement of the moving object will intersect the mobile path of the user further comprises:

generating a feedback pattern for output to a feedback device detected by the user to direct the user to adjust a current path to avoid the moving object.

9. The computer-implemented method according to claim 1, wherein informing the user whether the movement of the moving object will intersect the mobile path of the user further comprises:

generating a tactile feedback pattern for output to a tactile feedback device detected by the user to enable the user to virtually detect the three-dimensional surface of the moving object.

10. A system for assisting a user with information about an environment relative to the user, comprising:

an object processing system for capturing a three-dimensional movement of a moving object within the environment, wherein the three-dimensional movement is determined using at least one image capture device aimed at the moving object, predicting a mobile path of the user, and determining whether the movement of the moving object will intersect with the mobile path of the user; and

a navigation system for receiving from the object processing system the determination whether the movement of the moving object will intersect with the mobile path of the user and controlling outputs for informing the user whether the movement of the moving object will intersect the mobile path of the user.

11. The system according to claim 10, wherein,

said object processing system further comprises:

means for capturing a three-dimensional location of a stationary object within the environment, wherein the three-dimensional location is determined using at least one image capture device aimed at the stationary object; and

means for determining whether the three-dimensional location of the stationary object will intersect with the mobile path of the user; and

said navigation system further comprises means for informing the user whether the stationary object will intersect the mobile path of the user.

12. The system according to claim 10, wherein,

said object processing system further comprises:

means for identifying a three-dimensional object properties stream using the captured three-dimensional movement of the moving object; and

means for identifying a particular type of object representing the three-dimensional object properties stream by comparing the identified three-dimensional object properties steam with a plurality of object definitions for the environment; and

said navigation system further comprises means, in response to receiving an identifier from said object processing system of the particular type of object from among the plurality of object definitions, for informing the user of the type of moving object detected within the environment.

14. The system according to claim 10, wherein said object processing system for capturing a three-dimensional movement of a moving object further comprises means for capturing the three-dimensional movement using a stereoscopic video capture device to identify and track a particular three-dimensional movement.

15. The system according to claim 10, wherein said object processing system for capturing a three-dimensional movement of the moving object further comprises means for capturing the three-dimensional movement using at least one stereoscopic video capture device and at least one sensor enabled device to detect a distance to the moving object in the three-dimensional movement.

16. The system according to claim 10, wherein said navigation system for informing the user whether the movement of the moving object will intersect the mobile path of the user further comprises means for generating a feedback pattern for output to a feedback device detected by the user to warn the user of the moving object.

17. The system according to claim 10, wherein said navigation system for informing the user whether the movement of the moving object will intersect the mobile path of the user further comprises means for generating a feedback pattern for output to a feedback device detected by the user to direct the user to adjust a current path to avoid the moving object.

18. The system according to claim 10, wherein said navigation system for informing the user whether the movement of the moving object will intersect the mobile path of the user further comprises means for generating a tactile feedback pattern for output to a tactile feedback device detected by the user to enable the user to virtually detect the three-dimensional surface of the moving object.

19. A program product comprising a storage-type computer-usable medium including a computer-readable program for assisting a user with information about an environment relative to the user, wherein the computer-readable program when executed on a computer causes the computer to:

capture a three-dimensional movement of a moving object within the environment, wherein the three-dimensional movement is determined using at least one image capture device aimed at the moving object;

predict a mobile path of the user;

determine whether the movement of the moving object will intersect with the mobile path of the user; and

inform the user whether the movement of the moving object will intersect the mobile path of the user.

20. The program product according to claim 19, wherein said computer-readable program is transmitted over a network.