Sound library and method

• US 9,253,560 B2
• Filed: 09/15/2009
• Issued: 02/02/2016
• Est. Priority Date: 09/16/2008
• Status: Active Grant

• Current Assignee: Staton Techiya, LLC
• Original Assignee: Personics Holdings, Inc.
• Inventors: Goldstein, Steven, Keady, John P., Hoshizaki, Gary, Boillot, Marc
• Primary Examiner(s): Chin, Vivian
• Assistant Examiner(s): Jerez Lora, William A
• Application Number:
  US12/560,074
• Publication Number:
  US 20100142715A1
• Time in Patent Office: 2,331 Days
• Field of Search: 381/56, 381/380, 381/14, 381/26, 381/58, 709/203, 340/952, 455/67.7, 455/73, 455/95
• US Class Current: 1/1
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/686 using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
• CPC Class Codes: G06F 16/687 using geographical or spatial information, e.g. location
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06T 17/05 Geographic models
• CPC Class Codes: G10L 15/22 Procedures used during a speech recognition process, e.g. man-machine dialogue
• CPC Class Codes: G10L 2015/223 Execution procedure of a spoken command
• CPC Class Codes: G10L 25/51 for comparison or discrimination
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 2020/10546 specifically adapted for audio data
• CPC Class Codes: H04M 1/6066 including a wireless connection
• CPC Class Codes: H04M 1/72454 according to context-related or environment-related conditions
• CPC Class Codes: H04M 1/72457 according to geographic location
• CPC Class Codes: H04M 2250/10 including a GPS signal receiver
• CPC Class Codes: H04M 2250/12 including a sensor for measuring a physical value, e.g. temperature or motion telephones including GPS signal receivers H04M2250/10
• CPC Class Codes: H04R 1/083 Special constructions of mouthpieces
• CPC Class Codes: H04R 1/1083 Reduction of ambient noise active noise reduction per se G10K11/175; protective devices for the ear, e.g. providing acoustic protection A61F11/06
• CPC Class Codes: H04R 2499/11 Transducers incorporated or for use in hand-held devices, e.g. mobile phones, PDA's, camera's
• CPC Class Codes: H04R 29/00 Monitoring arrangements; Testing arrangements for hearing aids H04R25/30; detection of loudspeaker connection H04R5/04; sound-field adaptation dependent on speaker detection H04S7/308

Abstract

At least one exemplary embodiment is directed to a website configured to collect sound signatures from around the world and beyond. A communication device automatically stores acoustic information received by a microphone of the communication device. The acoustic information is analyzed for a trigger event. The trigger event stores the acoustic information, attaches metadata, creates a Gaussian Mixture Model, and measures sound pressure level. The communication device automatically sends the sound signature to a database when a communication path is opened to communication device. Each sound signature has associated metadata including a time stamp and geocode. Automatically collecting sounds using a communication device adapted for the process enables a database that captures sounds globally on a continuous basis.

Claims

1. A method of collecting acoustic information comprising the steps of:

collecting acoustic data by a microphone communicatively coupled to a mobile device;

presenting visual information on a map on the mobile device;

associating sounds within the acoustic data with the visual information on the map, where associating includes analyzing the sounds for a sound signature;

tagging the sound signature with metadata;

sending the sound signature and metadata to an acoustic database; and

accessing at least audio from the acoustic database when a cursor is placed over a specific location on the map corresponding to captured ambient sounds from a geographic location.

2. The method of claim 1, further comprising audibly presenting the audio from the acoustic database when placing the cursor over the specific location on the map corresponding to the geographic location and representative of the captured ambient sound collected at the specific location.

3. The method of claim 1, further comprising searching for audio content in the map related to the sound signature responsive to a trigger event related to the visual information where the searching includes downloading or streaming media to the mobile device for analysis of the audio content.

4. The method of claim 1, where the map comprises a picture and text and where the metadata includes time information and location information when the acoustic data was collected.

5. The method of claim 1, further comprising searching the acoustic database for acoustic information related to a topic, and providing information posted with the location information corresponding to the map related to the topic including time information, wherein acoustic information can be retrieved corresponding to the location information and for different selected times of the day.

6. The method of claim 1, further comprising:

storing the acoustic data as an audio record of a user'"'"'s day;

uploading events in the audio record determined in the user'"'"'s day; and

sharing the audio record of events for social networking.

7. The method of claim 1, further comprising storing the acoustic data as an audio segment and linking discussion topics on the audio segment across social websites.

8. The method of claim 1, wherein the step of collecting comprises automatically and continuously capturing acoustic data responsive to the trigger event by the microphone communicatively coupled to the mobile device and wherein the step of presenting comprises presenting a topic associated with the acoustic data and the map.

9. The method of claim 8, further comprising:

searching for content in the map related to the sounds responsive to voice activation of spoken words.

10. The method of claim 8, further comprising searching an acoustic database for acoustic information related to the topic, and providing information posted to the map by other users related to the topic.

11. The method of claim 8, further comprising linking topics on the map across social websites including an overlay of geocoded and time stamped sounds on the maps representative of the captured ambient sounds form the geographical locations.

12. The method of claim 8, further comprising tagging and cataloging captured acoustic data with the metadata comprising location and user experience information.

13. The method of claim 8, where the trigger event is one of a location event, a sound signature detection event, or a voice activation event.

14. The method of claim 3, where the trigger event is a sound signature detection event and where the sound signature is a Gaussian Mixture Model of the sound signature captured.

15. The method of claim 8, where the trigger event is a voice activation event.

16. The method of claim 1, further comprising the step of creating a real-time three-dimensional acoustic map that is produced or updated using searchable sound content including real-time acoustically mapped information from a geographical location.

17. The method of claim 1, further comprising:

identifying sound information in the acoustic signals relevant to a user experience in the environment;

tagging the sound information and associating the sound information with the user experience by including location, time, trigger event and a topic associated with the collecting to produce tagged sound data;

indexing and cataloging the tagged sound data for creating searchable sound content according to the location, time, trigger event and topic enabling retrieval of an audio experience for at least the location and time.

18. The method of claim 17, wherein the trigger event comprises one or more of acceleration and velocity, temperature, atmospheric measurement, wind speed, moisture levels, odor, chemical compounds, biological information, a sonic sound signature, a sonic signature based on a Gaussian Mixture Model analysis, average sound pressure level above a predetermined threshold over a predetermined time period, or a delta change in sound pressure level above a predetermined amount.

19. The method of claim 17, wherein the trigger event comprises one or more of detection of movement, a time of day, GPS information, or a sound pressure level, or a predetermined time period.

20. An electronic device configured to collect acoustic information, comprising:

at least one or more processors; and

a non-transitory computer readable medium communicatively coupled to the at least one or more processors, the execution of the instruction by the at least one or more processors causing the at least one or more processors to perform operations comprising;

collecting acoustic data by a microphone communicatively coupled to a mobile device or the electronic device;

presenting visual information on a map on the mobile device or the electronic device;

associating sounds within the acoustic data with the visual information on the map, wherein associating includes analyzing the sounds for a sound signature;

tagging the sound signature with metadata;

sending the sound signature and metadata to an acoustic database; and

accessing information from an acoustic database causing an audio output associated with a geographic location when a cursor is placed over a specific location on the map corresponding to ambient sound from the geographic location.