Obstacle avoidance using mobile devices

• US 9,872,811 B2
• Filed: 09/01/2016
• Issued: 01/23/2018
• Est. Priority Date: 09/06/2013
• Status: Active Grant

• Current Assignee: AT&T Mobility II LLC (AT&T, Inc.)
• Original Assignee: AT&T Mobility II LLC (AT&T, Inc.)
• Inventors: Yu, Loc
• Primary Examiner(s): Atala, Jamie
• Assistant Examiner(s): NGUYEN, KATHLEEN V
• Application Number:
  US15/254,049
• Publication Number:
  US 20170027804A1
• Time in Patent Office: 509 Days
• Field of Search: 348 62
• CPC Class Codes: A45B 1/02 Walking sticks with rollers for carrying parcels or the like
• CPC Class Codes: A45B 2009/002 Accessories
• CPC Class Codes: A45B 3/00 Sticks combined with other objects
• CPC Class Codes: A45B 9/00 Details
• CPC Class Codes: A45B 9/04 Ferrules or tips for crutches A61H3/0288
• CPC Class Codes: A61F 9/08 Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
• CPC Class Codes: A61H 2003/063 with tactile perception
• CPC Class Codes: A61H 3/061 with electronic detecting or guiding means
• CPC Class Codes: A61H 3/068 Sticks for blind persons
• CPC Class Codes: G08B 21/02 Alarms for ensuring the safety of persons
• CPC Class Codes: G09B 21/001 Teaching or communicating with blind persons G09B21/02 - G09B21/06 take precedence
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays

Abstract

Methods, systems, and products estimate distances to aid a visually impaired user of a mobile device. As the user carries the mobile device, a camera in the mobile device captures images of a walking cane. The images of the walking cane are analyzed to infer a distance between a tip of the walking cane and the mobile device. The distance may then be used by navigational tools to aid the visually impaired user.

Claims

1. A method, comprising:

pairing a visually impaired walking cane to a mobile device;

receiving, by the mobile device, an orientation angle sent from the visually impaired walking cane;

querying, by the mobile device, an electronic database for an identifier associated with the visually impaired walking cane, the electronic database electronically associating the cane identifier to parameters associated with the visually impaired walking cane;

retrieving, by the mobile device, a length associated with the visually impaired walking cane in the electronic database that is electronically associated to the cane identifier; and

inferring, by the mobile device, a distance to an obstacle based on the orientation angle of the visually impaired walking cane and the length identified in the electronic database;

wherein the distance to the obstacle aids a visually impaired user.

2. The method of claim 1, further comprising determining a location associated with a tip of the visually impaired walking cane based on the orientation angle.

3. The method of claim 1, further comprising generating a warning of the obstacle.

4. The method of claim 1, further comprising receiving the cane identifier during the pairing, the cane identifier uniquely identifying the visually impaired walking cane.

5. The method of claim 1, further comprising determining a location associated with the visually impaired walking cane.

6. The method of claim 1, further comprising retrieving global positioning system information associated with the visually impaired walking cane.

7. The method of claim 1, further comprising receiving a location associated with the mobile device.

8. A system, comprising:

a processor; and

a memory device, the memory device storing instructions, the instructions when executed causing the processor to perform operations, the operations comprising;

receiving an identifier sent from a visually impaired walking cane to a mobile device;

querying an electronic database for the identifier, the electronic database electronically associating the identifier to lengths of the visually impaired walking cane;

retrieving a length of the lengths of the visually impaired walking cane in the electronic database that is electronically associated to the cane identifier;

receiving an orientation angle associated with the visually impaired walking cane; and

determining a distance to the obstacle based on the orientation angle and on the length of the visually impaired walking cane;

wherein the distance aids a user of the visually impaired walking cane.

9. The system of claim 8, wherein the operations further comprise determining a location associated with the visually impaired walking cane.

10. The system of claim 8, wherein the operations further comprise generating a warning of the obstacle.

11. The system of claim 8, wherein the operations further comprise pairing the mobile device to the visually impaired walking cane.

12. The system of claim 8, wherein the operations further comprise retrieving global positioning system information associated with the visually impaired walking cane.

13. The system of claim 8, wherein the operations further comprise determining a location associated with the visually impaired walking cane.

14. The system of claim 8, wherein the operations further comprise receiving a location associated with the mobile device.

15. A memory device storing instructions that when executed cause a processor to perform operations, the operations comprising:

receiving global positioning system information sent from a mobile device;

receiving an identifier associated with a visually impaired walking cane;

querying a parameter database for the identifier associated with the visually impaired walking cane, the parameter database electronically associating the identifier to a length of the visually impaired walking cane;

querying a locational database for the global positioning system information, the locational database electronically associating locations associated with obstacles and the global positioning system information;

retrieving a location of the locations in the electronic database that is electronically associated with the global positioning system information, the location associated with an obstacle of the obstacles specified by the global positioning system information;

receiving an orientation angle associated with the visually impaired walking cane; and

determining a distance from the visually impaired walking cane to the obstacle based on the orientation angle and on the length of the visually impaired walking cane;

wherein the distance aids a user of the visually impaired walking cane.

16. The memory device of claim 15, wherein the operations further comprise determining the location associated with a tip of the visually impaired walking cane.

17. The memory device of claim 15, wherein the operations further comprise generating a warning of the obstacle.

18. The memory device of claim 15, wherein the operations further comprise determining the identifier during a pairing with the visually impaired walking cane.

19. The memory device of claim 15, wherein the operations further comprise identifying an arm length associated with the user of the visually impaired walking cane.

20. The memory device of claim 15, wherein the operations further comprise inferring the distance from a tip of the visually impaired walking cane to the obstacle.