Geo-coded spatialized audio in vehicles

• US 8,422,693 B1
• Filed: 09/29/2004
• Issued: 04/16/2013
• Est. Priority Date: 09/29/2003
• Status: Expired due to Fees

• Current Assignee: General Motors Corporation (Motors Liquidation Co. GUC Trust)
• Original Assignee: General Motors Corporation (Motors Liquidation Co. GUC Trust), HRL Laboratories LLC (The Boeing Co.)
• Inventors: Daily, Michael J., Martin, Kevin, Lu, Henry, O'Neal, Michael
• Primary Examiner(s): Lee, Ping
• Application Number:
  US10/954,986
• Time in Patent Office: 3,121 Days
• Field of Search: 381 77- 82, 381/86, 381/110, 700/94, 340/988, 340/996, 340/995.24, 701/211
• US Class Current: 381/86
• CPC Class Codes: G01C 21/3629 Guidance using speech or audio output, e.g. text-to-speech text to speech systems per se G10L13/00
• CPC Class Codes: H04R 5/02 Spatial or constructional arrangements of loudspeakers

Abstract

A three dimensional audio playback system in which the audio clips are determined by location. The audio playback system being located within a vehicle to aid in navigation or for entertainment or informational or safety purposes.

Claims

1. An audio system comprising:

a position sensor providing current position location information;

a database for storing a plurality of data records wherein each data item is associated with at least location information and audibly playable information;

means for querying said database to find one or more data records matching search criteria, the search criteria including at least position information associated with the current position location information;

an audio processing unit for retrieving the audibly playable information associated with one or more data records found in said database, said audio processing unit generating a spatialized audio cue for at least selected ones of said one or more data records in said database as a function of at least the current position location information provided by said position sensor and the position information associated with the stored data record, the current position information being updated during the generation of said spatialized audio cue and the audio processing unit changing spatialization of the spatialized audio cue in response to changes of the current position information as said spatialized audio cue is generated; and

audio components for audibly reproducing said spatialized audio cue.

2. The audio system of claim 1 further including:

an apparatus for recognizing commands issued by a user of the system, the commands being recognized including at least “

yes” and

“

no”

for controlling the delivery of additional audio cues based upon additional data items fetched from said database in response to recognizing a command issued by said user.

3. The audio system of claim 2 wherein the apparatus for recognizing commands includes a speech recognition apparatus.

4. The audio system of claim 1 wherein the position sensor is a global position system (GPS) receiver.

5. The audio system of claim 1 wherein the data items stored in said database correspond to physical landmarks and include information regarding the nature of the landmark.

6. The audio system of claim 1 wherein the means for querying the database includes means for making both “

pull” and

“

push”

queries, wherein the “

push”

queries are generated in response to predetermined search criteria, the search criteria including at least a requirement that the current position location information and the location information associated with data items in said database bear a predetermined positional relationship with respect to one another and wherein the “

pull”

queries are generated in response to a search query initiated by a user of the audio system.

7. The audio system of claim 6 wherein the predetermined positional relationship comprises a predetermined range requirement.

8. The audio system of claim 6 wherein the predetermined search criteria and the predetermined positional relationship are stored as user preference data in or associated with said database.

9. The audio system of claim 8 wherein the data items stored in said database correspond to physical landmarks and include information regarding a nature of the landmark and information regarding a playback length of the audibly playable information for at least selected ones of said data items.

10. The audio system of claim 1 wherein the audio components include at least four speakers, two of said at least four speakers being disposed to the right and left and forwardly of a user of said audio system and wherein another two of said at least four speakers are disposed to the right and left and rearwardly of said user.

11. The audio system of claim 10 further including:

an apparatus for recognizing commands issued by said user of the system for controlling the delivery of additional audio cues based upon additional data items fetched from said database in response to recognizing a command issued by said user.

12. The audio system of claim 11 wherein the apparatus for recognizing commands includes a speech recognition apparatus and a user'"'"'s head position tracking apparatus.

13. The audio system of claim 12 wherein the user'"'"'s head position tracking apparatus includes a device worn on the user'"'"'s head which provides information to a laser system regarding a position of the user'"'"'s head when the user utters a spoken command.

14. The audio system of claim 12 wherein the user'"'"'s head position tracking apparatus is responsive to head gestures of the user for decoding at least certain head gestures as commands issued to the audio system.

15. A method for enabling location based audio playback comprising:

storing a plurality of audio clips and associated location information;

receiving real-time position data of a vehicle, including vehicular orientation data;

selecting a subset of said plurality of audio clips based on at least said real-time position data; and

providing spatialized audio in said vehicle for an audio clip in said subset of said plurality of audio clips through the analysis of said real-time position data of a vehicle, including said vehicular orientation data, relative to the location information associated with said audio clip, the spatialized audio having a perceived orientation within said vehicle which coincides with the location information associated with the audio clip and the perceived orientation of the spatialized audio changing in response to changes of said real-time position data while the spatialized audio for said audio clip is being provided in said vehicle.

16. The method of claim 15 further comprising:

providing a user interface;

choosing via the user interface a category of audio clips; and

selecting a subset of said plurality of audio clips based on at least said real-time position data and said category of audio clips.

17. The method of claim 16 wherein selecting the subset of said plurality of audio clips occurs automatically, in at least one mode of operation, as a user drives or steers the vehicle.

18. The method of claim 17 wherein selecting the subset of said plurality of audio clips occurs in response to a user-generated request.

19. A method for providing audio information in a vehicle regarding external landmarks comprising:

receiving an information signal, said information signal comprising at least a current orientation of the vehicle, said information signal being updated as the vehicle moves relative to said external landmarks;

producing a spatialized audio signal based on said information signal, wherein said spatialized audio is produced having a spatial orientation within said vehicle which spatially coincides with an associated landmark; and

wherein the spatial orientation of the spatialized audio signal relative to the associated landmark is updated in response to updates of the information signal while the spatialized audio based on said information signal is being produced within said vehicle.

20. The method according to claim 19 wherein said information signal further comprises current position information of the vehicle.

21. The method according to claim 20 further comprising:

receiving real-time position information; and

determining a pre-defined region relative to the current position of the vehicle, wherein the spatialized audio signal is produced only when the landmark is in a pre-determined area.

22. The method according to claim 19 wherein said spatialized audio is produced in said vehicle from at least four speakers, two of said at least four speakers being disposed to the right and left and forwardly of a user in said vehicle and wherein another two of said at least four speakers are disposed to the right and left and rearwardly of said user.

23. The method according to claim 19 further including recognizing commands issued by a user in said vehicle for controlling the delivery of specialized audio information based in response to recognizing a command issued by said user.

24. The method according to claim 23 wherein recognizing commands includes both user speech recognition and user head position tracking.

25. The method according to claim 24 wherein user head position tracking includes providing a device worn on the user'"'"'s head which provides information to a laser system regarding a position of the user'"'"'s head when the user utters a spoken command.

26. The method according to claim 25 wherein user head position tracking includes detecting user head gestures for decoding at least certain head gestures as commands issued by the user in said vehicle for controlling the delivery of specialized audio information to the user.

27. A method for providing audio information in a vehicle regarding external landmarks comprising:

determining a current location of the vehicle;

retrieving from a database information regarding landmarks located in a vicinity of said vehicle based at least in part on the current location of the vehicle; and

producing a spatialized audio signal based on the information regarding landmarks retrieved from said database as the vehicle approaches a retrieved landmark, wherein spatialized audio is produced in said vehicle using said spatialized audio signal, the spatialized audio being spatially oriented in a real time fashion relative to a position of the retrieved landmark located externally of the vehicle (i) as the vehicle approaches said retrieved landmark and (ii) while said spatialized audio signal is being produced in said vehicle.

28. The method of claim 27 wherein retrieving information regarding landmarks is further based on predetermined search criteria.

29. The method of claim 27 wherein retrieving information regarding landmarks is further based on user-supplied search criteria.