Human assisted techniques for providing local maps and location-specific annotated data

• US 8,938,355 B2
• Filed: 01/12/2010
• Issued: 01/20/2015
• Est. Priority Date: 03/13/2009
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Das, Saumitra Mohan, Hardie, Edward Thomas Lingham
• Primary Examiner(s): Danneman, Paul
• Application Number:
  US12/686,267
• Publication Number:
  US 20100235091A1
• Time in Patent Office: 1,834 Days
• Field of Search: None
• US Class Current: 701/408
• CPC Class Codes: G01C 21/3602 Input other than that of destination using image analysis, e.g. detection of road signs, lanes, buildings, real preceding vehicles using a camera
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal
• CPC Class Codes: H04W 4/02 Services making use of location information
• CPC Class Codes: H04W 4/024 Guidance services

Abstract

Methods and apparatuses are provided that may be implemented in various electronic devices to allow for location, navigation, and/or other like information and/or services to be provided to a user based, at least in part, on audio input information corresponding one or more environmental features which are near by the user of the portable electronic device.

Claims

1. A method comprising:

with a portable electronic device;

obtaining one or more electronic signals representing audio input information, wherein the audio input information corresponds to at least one environmental feature at or near by a location of said portable electronic device and includes an ambient auditory environmental recording in which a user captures sounds in their surrounding environment;

obtaining one or more electronic signals representing local map information, said local map information being based, at least in part, on said audio input information;

obtaining one or more electronic signals representing location and/or navigation information based, at least in part, on said local map information and said audio input information; and

determining a current position of the portable electronic device based on the one or more electronic signals representing location and/or navigation information.

2. The method as recited in claim 1, further comprising, with the portable electronic device, obtaining image input information from a camera in the portable electronic device, wherein the image input information corresponds to the at least one environmental feature.

3. The method as recited in claim 1, wherein said audio input information comprises recorded audio information, and wherein obtaining said one or more electronic signals representing said audio input information further comprises:

determining textual metadata based, at least in part, on said recorded audio information; and

generating said one or more electronic signals representing said audio input information based at least in part on said textual metadata.

4. The method as recited in claim 3, wherein generating said one or more electronic signals representing said audio input information based at least in part on said textual metadata comprises

transmitting one or more electronic signals representing at least a portion of said textual metadata via a communication network;

and

receiving at least a portion of said one or more electronic signals representing said audio input information based at least in part on said textual metadata via said communication network.

5. The method as recited in claim 1, wherein obtaining said one or more electronic signals representing said audio input information comprises:

transmitting one or more electronic signals representing at least one of recorded audio information via a communication network; and

receiving at least a portion of said one or more electronic signals representing said local map information via said communication network.

6. The method as recited in claim 1, wherein obtaining said one or more electronic signals representing said local map information comprises receiving at least a portion of said one or more electronic signals representing said local map information via a communication network.

7. The method as recited in claim 1, wherein obtaining said one or more electronic signals representing said location and/or navigation information comprises receiving at least a portion of said one or more electronic signals representing said location and/or navigation information via a communication network.

8. The method as recited in claim 1, wherein obtaining said one or more electronic signals representing local map information comprises:

obtaining said one or more electronic signals representing local map information based, at least in part, on estimated location information associated with said portable electronic device.

9. The article of claim 1, wherein the audio input information includes a human voice based audio information.

10. An apparatus comprising:

means for obtaining audio input information, wherein the audio input information corresponds to at least one environmental feature at or near by a location of said portable electronic device and includes an ambient auditory environmental recording in which a user captures sounds in their surrounding environment;

means for obtaining local map information, said local map information being based, at least in part, on said audio input information;

means for obtaining location and/or navigation information based, at least in part, on said local map information and on said audio input information; and

means for determining a current position of the portable electronic device based on the obtained location and/or navigation information.

11. The apparatus as recited in claim 10, further comprising:

means for recording image information corresponding to the at least one environmental feature.

12. The apparatus as recited in claim 10, further comprising:

means for determining textual metadata based, at least in part, on recorded audio information; and

means for generating said audio input information based at least in part on said textual metadata.

13. The apparatus as recited in claim 12, further comprising:

means for transmitting at least a portion of said textual metadata via a communication network; and

means for receiving at least a portion of said audio input information based at least in part on said textual metadata via said communication network.

14. The apparatus as recited in claim 10, further comprising:

means for transmitting at least the audio input information via a communication network; and

means for receiving at least a portion of said local map information via said communication network.

15. The apparatus as recited in claim 10, further comprising:

means for receiving at least a portion of said local map information via a communication network.

16. The apparatus as recited in claim 10, further comprising:

means for receiving at least a portion of said location and/or navigation information via a communication network.

17. The article of claim 10, wherein the audio input information includes a human voice based audio information.

18. A portable electronic device comprising:

memory;

at least one user interface mechanism coupled to said memory; and

at least one processing unit coupled to said memory and said user interface mechanism and programmed with instructions to;

obtain audio input information corresponding to at least one environmental feature at or near by a location of said portable electronic device and including an ambient auditory environmental recording in which a user captures sounds in their surrounding environment;

obtain local map information, said local map information being based, at least in part, on said audio input information;

obtain location and/or navigation information based, at least in part, on said local map information and on said audio input information; and

initiate presentation of a current position of the portable electronic device based on at least a portion of said location and/or navigation information, wherein the current position of the portable device is presented via said user interface mechanism.

19. The portable electronic device as recited in claim 18, further comprising:

a camera coupled to at least one of said memory and/or said at least one processing unit, said at least one processing unit being further programmed with said instructions to initiate said camera to record image information corresponding to the at least one environmental feature.

20. The portable electronic device as recited in claim 18, wherein said audio input information comprises recorded audio information, and wherein said at least one processing unit being further programmed with said instructions to:

determine textual metadata based, at least in part, on said recorded audio information; and

generate said audio input information based at least in part on said textual metadata.

21. The portable electronic device as recited in claim 20, further comprising:

a network interface coupled to at least one of said memory and/or said at least one processing unit;

wherein said at least one processing unit is further programmed with said instructions to initiate said network interface to transmit at least a portion of said textual metadata via a communication network; and

wherein said network interface receives at least a portion of said audio input information based at least in part on said textual metadata via said communication network.

22. The portable electronic device as recited in claim 18, further comprising:

a network interface coupled to at least one of said memory and/or said at least one processing unit;

wherein said at least one processing unit is further programmed with said instructions to initiate said network interface to transmit the audio input information via a communication network; and

wherein said network interface receives at least a portion of said local map information via said communication network.

23. The portable electronic device as recited in claim 18, further comprising:

a network interface coupled to at least one of said memory and/or said at least one processing unit, said network interface to receive at least a portion of said local map information via a communication network.

24. The portable electronic device as recited in claim 18, further comprising:

a network interface coupled to at least one of said memory and/or said at least one processing unit, said network interface to receive at least a portion of said location and/or navigation information via a communication network.

25. The portable electronic device as recited in claim 18, wherein said portable electronic device comprises a mobile station.

26. The article of claim 18, wherein the audio input information includes a human voice based audio information.

27. An article comprising:

a computer readable medium having computer implementable instructions stored thereon that in response to being executed by one or more processing units in a portable electronic device enable the electronic device to;

obtain audio input information corresponding to at least one environmental feature at or near by a location of said portable electronic device and including an ambient auditory environmental recording in which a user captures sounds in their surrounding environment;

obtain local map information, said local map information being based, at least in part, on said audio input information;

obtain location and/or navigation information based, at least in part, on said local map information; and

determine a current position of the portable device based on the one or more electronic signals representing location and/or navigation information.

28. The article as recited in claim 27, wherein the computer implementable instructions in response to being executed by the one or more processing units in the portable electronic device further enable the portable electronic device to record image information corresponding to the at least one environmental feature.

29. The article as recited in claim 27, wherein the computer implementable instructions in response to being executed by the one or more processing units in the portable electronic device further enable the portable electronic device to:

determine textual metadata based, at least in part, on recorded audio information; and

generate said audio input information based at least in part on said textual metadata.

30. The article as recited in claim 29, wherein the computer implementable instructions in response to being executed by the one or more processing units in the portable electronic device further enable the portable electronic device to:

initiate transmission of at least a portion of said textual metadata via a communication network; and

access at least a portion of said audio input information based at least in part on said textual metadata obtained via said communication network.

31. The article as recited in claim 27, wherein the computer implementable instructions in response to being executed by the one or more processing units in the portable electronic device further enable the portable electronic device to:

initiate transmission of recorded audio information via a communication network; and

access at least a portion of said local map information obtained via said communication network.

32. The article as recited in claim 27, wherein the computer implementable instructions in response to being executed by the one or more processing units in the portable electronic device further enable the portable electronic device to:

access at least a portion of said local map information obtained via a communication network.

33. The article as recited in claim 27, wherein the computer implementable instructions in response to being executed by the one or more processing units in the portable electronic device further enable the portable electronic device to:

access at least a portion of said location and/or navigation information obtained via a communication network.

34. The article as recited in claim 27, wherein the computer implementable instructions in response to being executed by the one or more processing units in the portable electronic device further enable the portable electronic device to:

initiate presentation of the current position of the portable electronic device based on at least a portion of said location and/or navigation information, wherein the current position of the portable device is presented via at least one user interface mechanism.

35. The article of claim 27, wherein the audio input information includes a human voice based audio information.

36. A method for displaying the position of a portable electronic device, comprising:

receiving audio input information with the portable electronic device, wherein the audio input information corresponds to at least one environmental feature adjacent to the portable electronic device and includes an ambient auditory environmental recording in which a user captures sounds in their surrounding environment;

provisioning an initial map based on the audio input information;

providing a relative position of the portable electronic device in reference to the initial map based on the audio input information;

transforming the relative position into a position within a global coordinate system; and

displaying the position of the portable electronic device.

37. The method of claim 36 wherein the audio input information includes a human voice based audio information.