Navigational soundscaping

• US 8,996,296 B2
• Filed: 12/15/2011
• Issued: 03/31/2015
• Est. Priority Date: 12/15/2011
• Status: Active Grant

• Current Assignee: Qualcomm, Inc.
• Original Assignee: Qualcomm, Inc.
• Inventors: Xiang, Pei
• Primary Examiner(s): Nguyen, John Q
• Assistant Examiner(s): KERRIGAN, MICHAEL V
• Application Number:
  US13/327,544
• Publication Number:
  US 20130158856A1
• Time in Patent Office: 1,202 Days
• US Class Current: 701/408
• CPC Class Codes: G01C 21/26 specially adapted for navigation in a road network
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: G01C 21/3679 Retrieval, searching and output of POI information, e.g. hotels, restaurants, shops, filling stations, parking facilities G01C21/3611 takes precedence
• CPC Class Codes: H04R 2499/13 Acoustic transducers and sound field adaptation in vehicles
• CPC Class Codes: H04R 5/023 in a chair, pillow
• CPC Class Codes: H04S 2400/11 Positioning of individual sound objects, e.g. moving airplane, within a sound field H04S2420/13 takes precedence
• CPC Class Codes: H04S 2420/01 Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
• CPC Class Codes: H04S 7/302 Electronic adaptation of stereophonic sound system to listener position or orientation H04S7/301 takes precedence

Abstract

A navigational system generates audio cues that are perceived in a three-dimensional space, allowing users to aurally perceive the locations of mapped objects such as landmarks. The audio cues can be produced alone, or in some applications, produced in conjunction with a visual navigational map display to improve the overall efficacy of the system. The audio navigation system includes a positioning system to determine the location of a user, a memory to store hierarchically-organized information about one or more objects, and a processor to render an audio signal based on the hierarchically-organized information. The audio signal is rendered into an audio space corresponding to the user, so as to allow user perception of the location of at least one of the objects relative to the location of the user. The objects may be landmarks in the vicinity of the user.

Claims

1. An apparatus comprising:

a positioning system configured to determine a first location;

a memory configured to store hierarchically-organized information associated with one or more landmarks, wherein the hierarchically-organized information is organized by a plurality of categories and a plurality of sub-categories, wherein a first audio icon of the hierarchically-organized information corresponds to a first audio sound concatenated with a second audio sound, wherein the first audio sound is associated with a first category of the plurality of categories, and wherein the second audio sound is associated with a first sub-category of the plurality of sub-categories; and

a processor configured to generate a first audio signal based on the first audio icon and the first location to enable user perception of a first landmark location of a first landmark relative to the first location, the first audio icon associated with the first landmark.

2. The apparatus of claim 1, wherein the hierarchically-organized information includes an audio icon associated with each of the one or more landmarks.

3. The apparatus of claim 1, wherein the memory is further configured to store an audio source library of audio icons corresponding to the one or more landmarks, the audio source library of audio icons including the first audio icon.

4. The apparatus of claim 1, wherein the processor is further configured to:

determine whether the first landmark is user-designated; and

modify the first audio icon by substituting user-defined audio content for default audio content corresponding to the first landmark when the first landmark is user designated.

5. The apparatus of claim 1, further comprising one or more transducers configured to produce an auditory sound into an audio space based on the first audio signal.

6. The apparatus of claim 1, wherein the first audio signal enables user perception of a distance between the first location and the first landmark location and a direction of the first landmark location relative to the first location, and wherein the first location is a location of a user.

7. The apparatus of claim 1, wherein the processor is further configured to generate a second audio signal based on a second audio icon and the first location, the second audio icon associated with a second landmark at a second landmark location, wherein a user perceives the first landmark location to be closer to the user than the second landmark location based on the first audio signal and the second audio signal.

8. The apparatus of claim 1, further comprising a user interface configured to enable a user to modify the first audio icon.

9. The apparatus of claim 8, wherein the user interface is further configured to enable the user to assign an importance level to the first audio icon.

10. The apparatus of claim 8, wherein the user interface is further configured to enable the user to modify the first audio icon based on one or more user-selected sound effects corresponding to the first audio icon, and wherein the one or more user-selected sound effects include a chorus sound effect, a phaser sound effect, or a combination thereof.

11. The apparatus of claim 8, wherein the user interface is further configured to enable the user to associate the first audio icon with a user configured audio icon.

12. The apparatus of claim 1, wherein the processor is configured to synthesize audio content of the first audio icon.

13. The apparatus of claim 1, wherein the categories are associated with types of landmarks, and wherein the sub-categories are associated with sub-types of the types of landmarks.

14. The apparatus of claim 1, wherein the first category corresponds to a restaurant, and wherein the first sub-category corresponds to a type of restaurant.

15. The apparatus of claim 14, wherein the first audio sound is a fork-and-knife sound, and wherein the second audio sound includes music associated with the type of restaurant corresponding to the first sub-category.

16. The apparatus of claim 15, wherein the first sub-category corresponds to a Chinese restaurant, and wherein the music includes pentatonic music.

17. The apparatus of claim 15, wherein the first sub-category corresponds to a Persian restaurant.

18. A method of presenting audio information to a user, the method comprising:

determining a first location via a positioning system;

retrieving, from a memory, hierarchically-organized information associated with a first landmark based on the first location, wherein the hierarchically-organized information is organized by a plurality of categories, wherein at least one category of the plurality of categories includes a plurality of sub-categories, wherein a first audio icon of the hierarchically-organized information corresponds to a first audio sound concatenated with a second audio sound, wherein the first audio sound is associated with a first category of the plurality of categories, and wherein the second audio sound is associated with a first sub-category of the plurality of sub-categories; and

initiating, at a processor, an output of a first auditory sound based on the first audio icon and the first location via one or more transducers, wherein the first auditory sound enables user perception of a first landmark location of the first landmark relative to the first location.

19. The method of claim 18, wherein the hierarchically-organized information includes a plurality of audio icons associated with a plurality of landmarks.

20. The method of claim 18, further comprising providing an audio source library of a plurality of audio icons.

21. The method of claim 20, further comprising mapping a plurality of landmarks to the plurality of audio icons via a lookup table.

22. The method of claim 21, further comprising initiating an output of a second auditory sound based on the first location and a second audio icon associated with a second landmark, wherein the second auditory sound enables user perception of a distance between the first location and a second landmark location of the second landmark and direction to the second landmark location relative to the first location, and wherein the first location is a user location.

23. The method of claim 22, wherein the second auditory sound is perceived by the user as more distant than the first auditory sound when a first distance between the first location and the first landmark location is less than a second distance between the first location and the second landmark location.

24. The method of claim 18, further comprising receiving user input.

25. The method of claim 24, wherein the user input indicates a custom action based on weather conditions.

26. The method of claim 24, further comprising modifying the first audio icon based on one or more sound effects indicated by the user input.

27. The method of claim 24, wherein the user input includes user-defined audio content, and wherein the first audio icon is associated with the user-defined audio content.

28. The method of claim 18, wherein a second audio icon associated with a second landmark corresponds to an audio sound associated with at least one of a second category associated with the second landmark, a second sub-category associated with the second landmark, or a combination thereof.

29. An apparatus comprising:

means for determining a first location;

means for retrieving hierarchically-organized information associated with a first landmark based on the first location, wherein the hierarchically-organized information is organized by a plurality of categories, wherein at least one category includes a plurality of sub-categories, wherein a first audio icon of the hierarchically-organized information corresponds to a first audio sound concatenated with a second audio sound, wherein the first audio sound is associated with a first category of the plurality of categories, and wherein the second audio sound is associated with a first sub-category of the plurality of sub-categories; and

means for producing a first auditory sound based on the first audio sound, the second audio sound, and the first location, wherein the first auditory sound enables user perception of a first landmark location of the first landmark relative to the first location.

30. The apparatus of claim 29, wherein the hierarchically-organized information includes a plurality of audio icons associated with a plurality of landmarks.

31. The apparatus of claim 29, wherein the hierarchically-organized information is stored in an audio source library that includes a plurality of audio icons.

32. The apparatus of claim 31, wherein a plurality of landmarks is mapped to the plurality of audio icons via a lookup table.

33. The apparatus of claim 29, wherein the first auditory sound enables user perception of a distance between the first location and the first landmark location and a direction to the first landmark location relative to the first location, and wherein the first location is a user location.

34. The apparatus of claim 29, wherein the first auditory sound is perceived by the user as sounding more distant than a second auditory sound produced based on a second audio icon associated with a second landmark.

35. The apparatus of claim 29, further comprising means for enabling a user to modify the first audio icon.

36. The apparatus of claim 35, wherein the first audio icon is modified based on user input, and wherein the user input indicates a custom action based on a time of day.

37. The apparatus of claim 35, wherein the first audio icon is modified based on one or more sound effects indicated by user input.

38. The apparatus of claim 37, wherein the one or more sound effects include a reverb characteristic.

39. The apparatus of claim 29, further comprising means for synthesizing the hierarchically-organized information based on the first location.

40. A non-transitory computer-readable medium including instructions that, when executed by a processor, cause the processor to:

determine a first location via a positioning system;

retrieve hierarchically-organized information associated with a landmark based on the first location, wherein the hierarchically-organized information is organized by a plurality of categories, wherein at least one category includes a first sub-category and a second sub-category, and wherein a first audio icon of the hierarchically-organized information associated with the first sub-category and a second audio icon of the hierarchically-organized information associated with the second sub-category correspond to different versions of a particular audio sound; and

initiate an output of an auditory sound based on the first audio icon and the first location, wherein the auditory sound enables user perception of a landmark location of the landmark relative to the first location.

41. The non-transitory computer-readable medium of claim 40, wherein the hierarchically-organized information includes a plurality of audio icons associated with a plurality of landmarks.

42. The non-transitory computer-readable medium of claim 40, further comprising instructions that, when executed by the processor, cause the processor to synthesize the hierarchically-organized information based on the first location.

43. The non-transitory computer-readable medium of claim 40, wherein the at least one category corresponds to a bank, and wherein the first sub-category and the second sub-category correspond to types of a bank.

44. The non-transitory computer-readable medium of claim 43, wherein the particular audio sound is a sound of one or more coins dropping.

45. The non-transitory computer-readable medium of claim 44, wherein the first sub-category corresponds to an automatic teller machine, wherein the second sub-category corresponds to a bank branch office, wherein the first audio icon corresponds to a sound of a first number of coins dropping, wherein the second audio icon corresponds to a sound of a second number of coins dropping, and wherein the second number exceeds the first number.