Obstacle avoidance using mobile devices

• US 9,460,635 B2
• Filed: 09/06/2013
• Issued: 10/04/2016
• Est. Priority Date: 09/06/2013
• Status: Active Grant

• Current Assignee: AT&T Mobility II LLC (AT&T, Inc.)
• Original Assignee: AT&T Mobility II LLC (AT&T, Inc.)
• Inventors: Yu, Loc
• Primary Examiner(s): Prince, Jessica M
• Assistant Examiner(s): NGUYEN, KATHLEEN V
• Application Number:
  US14/019,567
• Publication Number:
  US 20150070479A1
• Time in Patent Office: 1,124 Days
• Field of Search: 348/62
• US Class Current: 1/1
• CPC Class Codes: A45B 1/02 Walking sticks with rollers for carrying parcels or the like
• CPC Class Codes: A45B 2009/002 Accessories
• CPC Class Codes: A45B 3/00 Sticks combined with other objects
• CPC Class Codes: A45B 9/00 Details
• CPC Class Codes: A45B 9/04 Ferrules or tips for crutches A61H3/0288
• CPC Class Codes: A61F 9/08 Devices or methods enabling eye-patients to replace direct visual perception by another kind of perception
• CPC Class Codes: A61H 2003/063 with tactile perception
• CPC Class Codes: A61H 3/061 with electronic detecting or guiding means
• CPC Class Codes: A61H 3/068 Sticks for blind persons
• CPC Class Codes: G08B 21/02 Alarms for ensuring the safety of persons
• CPC Class Codes: G09B 21/001 Teaching or communicating with blind persons G09B21/02 - G09B21/06 take precedence
• CPC Class Codes: G09B 21/003 using tactile presentation of the information, e.g. Braille displays

Abstract

Methods, systems, and products estimate distances to aid a visually impaired user of a mobile device. As the user carries the mobile device, a camera in the mobile device captures images of a walking cane. The images of the walking cane are analyzed to infer a distance between a tip of the walking cane and the mobile device. The distance may then used by navigational tools to aid the visually impaired user.

Claims

1. A method, comprising:

pairing a walking cane to a mobile smart phone;

receiving, by the mobile smart phone, a cane identifier during the pairing, the cane identifier uniquely identifying the walking cane;

querying, by the mobile smart phone, an electronic database for the cane identifier, the electronic database having electronic associations between parameters and cane identifiers including the cane identifier received during the pairing;

retrieving, by the mobile smart phone, a length of the walking cane from the electronic database, the length electronically associated with the cane identifier;

retrieving, by the mobile smart phone, an arm length from the electronic database, the arm length electronically associated with the cane identifier and describing a length of an arm of a visually impaired user of the mobile smart phone;

receiving, by the mobile smart phone, a command sent from the walking cane, the command instructing the mobile smart phone to activate a camera;

storing, by the mobile smart phone, an image of a tip of the walking cane;

receiving, by the mobile smart phone, an orientation angle associated with the walking cane; and

inferring, by the mobile smart phone, a distance from the tip of the walking cane to the mobile smart phone, the distance based on information in the image, the orientation angle, the length of the walking cane, and the arm length,

wherein the distance is used to aid the visually impaired user of the mobile smart phone.

2. The method of claim 1, further comprising:

calculating a first maximum for the distance from the tip of the walking cane to the mobile smart phone, the first maximum distance as twice the length of the walking cane; and

calculating a second maximum for the distance as a sum of the length of the walking cane and the arm length of the visually impaired user.

3. The method of claim 1, further comprising storing an association between the image of the tip of the walking cane and the orientation angle of the walking cane.

4. The method of claim 1, further comprising storing a database of images that associates different images of the tip of the walking cane to corresponding distances from the tip of the walking cane to the mobile smart phone.

5. The method of claim 4, further comprising comparing the image of the tip of the walking cane to images associated with the database of images.

6. The method of claim 5, further comprising selecting a matching image in the database of images that matches the image of the tip of the walking cane.

7. The method of claim 6, further comprising retrieving a corresponding distance that is associated with the matching image in the database of images.

8. The method of claim 7, further comprising using the corresponding distance associated with the matching image as the distance from the tip of the walking cane to the mobile smart phone.

9. A system, comprising:

a processor; and

a memory device, the memory device storing instructions, the instructions when executed causing the processor to perform operations, the operations comprising;

pairing a walking cane with a mobile smart phone;

receiving a cane identifier during the pairing, the cane identifier uniquely identifying the walking cane;

querying an electronic database for the cane identifier, the electronic database having electronic associations between parameters and cane identifiers including the cane identifier received during the pairing;

retrieving a length of the walking cane from the electronic database, the length electronically associated with the cane identifier;

retrieving an arm length from the electronic database, the arm length electronically associated with the cane identifier and describing a length of an arm of a visually impaired user of the mobile smart phone;

receiving a command sent from the walking cane, the command instructing the mobile smart phone to activate a camera;

storing an image of a tip of the walking cane in response to the command;

receiving an orientation angle associated with the walking cane; and

inferring a distance from the tip of the walking cane to the mobile smart phone based on information in the image, the orientation angle, the length of the walking cane, and the arm length of the walking cane,

wherein the distance is used to aid the visually impaired user of the mobile smart phone.

10. The system of claim 9, wherein the operations further comprise:

calculating a first maximum for the distance from the tip of the walking cane to the mobile smart phone, the first maximum distance as twice the length of the walking cane; and

calculating a second maximum for the distance as a sum of the length of the walking cane and the arm length of the visually impaired user.

11. The system of claim 9, further comprising storing an association between the image of the tip of the walking cane and the orientation angle of the walking cane.

12. The system of claim 9, wherein the operations further comprise storing a database of images that associates different images of the tip of the walking cane to corresponding distances from the tip of the walking cane to the mobile smart phone.

13. The system of claim 12, wherein the operations further comprise comparing the image of the tip of the walking cane to a database of images.

14. The system of claim 13, wherein the operations further comprise selecting a matching image in the database of images that matches the image of the tip of the walking cane captured by the camera.

15. The system of claim 14, wherein the operations further comprise retrieving a corresponding distance that is associated with the matching image in the database of images.

16. The system of claim 15, wherein the operations further comprise using the corresponding distance associated with the matching image as the distance from the tip of the walking cane to the mobile smart phone.

17. A memory device storing instructions that when execute cause a processor to perform operations, the operations comprising:

pairing a walking cane with a mobile smart phone;

receiving a cane identifier during the pairing, the cane identifier uniquely identifying the walking cane;

querying an electronic database for the cane identifier, the electronic database having electronic associations between parameters and cane identifiers including the cane identifier received during the pairing;

retrieving a length of the walking cane from the electronic database, the length electronically associated with the cane identifier;

retrieving an arm length from the electronic database, the arm length electronically associated with the cane identifier and describing a length of an arm of a visually impaired user of the mobile smart phone;

receiving a command sent from the walking cane, the command instructing the mobile smart phone to activate a camera;

storing an image of a tip of the walking cane in response to the command;

receiving an orientation angle associated with the walking cane; and

inferring a distance from the tip of the walking cane to the mobile smart phone based on information in the image, the orientation angle, the length of the walking cane, and the arm length of the walking cane,

wherein the distance is used to aid the visually impaired user of the mobile smart phone.