Systems and Methods for Sound Recognition

• US 20100211693A1
• Filed: 05/04/2010
• Published: 08/19/2010
• Est. Priority Date: 05/04/2010
• Status: Active Grant

• Current Assignee: Aaron Steven Master, Benjamin John Levitt, Jun Huang, Keyvan Mohajer, Timothy P. Stonehocker
• Original Assignee: SoundHound Incorporated
• Inventors: Huang, Jun, Levitt, Benjamin John, Master, Aaron Steven, Stonehocker, Timothy P., Mohajer, Keyvan
• Granted Patent: US 9,280,598 B2
• Time in Patent Office: Days
• US Class Current: 709/238
• CPC Class Codes: G06F 16/634 Query by example, e.g. query by humming
• CPC Class Codes: G06F 16/68 Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G10L 25/51 for comparison or discrimination

Abstract

Systems and methods for recognizing sounds are provided herein. User input relating to one or more sounds is received from a computing device. Instructions, which are stored in memory, are executed by a processor to discriminate the one or more sounds, extract music features from the one or more sounds, analyze the music features using one or more databases, and obtain information regarding the music features based on the analysis. Further, information regarding the music features of the one or more sounds may be transmitted to display on the computing device.

Claims

1. A method for recognizing one or more sounds, comprising:

receiving user input from the computing device, the user input providing a search query comprising the one or more sounds;

executing instructions stored in memory, wherein execution of the instructions by a processor;

discriminates the one or more sounds,

extracts music features from the one or more sounds,

analyzes the music features using one or more databases, and

obtains information regarding the music features based on the analysis; and

in response to the search query, transmitting for display information regarding the music features of the one or more sounds to the computing device.

2. The method of claim 1, wherein executing instructions stored in memory, wherein execution of the instructions by a processor discriminates the one or more sounds further comprises executing instructions stored in memory, wherein execution of the instructions by a processor classifies the one or more sounds of the search query as a singing or humming sound, recorded music, or speech.

3. The method of claim 1, wherein the one or more sounds includes a song, a song clip, a song snippet, a singing or humming sound, voice, spoken words or any combination thereof.

4. The method of claim 1, further comprising utilizing load balancing routers to distribute workload to one or more computing resources.

5. The method of claim 1, wherein information regarding the music features of the one or more sounds comprises a song title, a name of an artist, an artist'"'"'s biographical information, identification of similar artists, a link to download a song, a link to download a video related to the song, or any combination thereof.

6. The method of claim 1, further comprising executing instructions stored in memory, wherein execution of the instructions by a processor separates music features from background noise by noise cancellation.

7. The method of claim 1, further comprising:

executing instructions stored in memory, wherein execution of the instructions by a processor determines whether the music features of the one or more sounds are already included in a local music database of the computing device; and

transmitting to display a flag on the display of the computing device, the flag depicting the determination of whether the music features of the one or more sounds are already included in a local music database of the computing device.

8. The method of claim 1, further comprising:

executing instructions stored in memory, wherein execution of the instructions by a processor provides relevant content relating to the music features; and

transmitting to display a premium row on the display of the computing device, the premium row depicting the relevant content relating to the music features.

9. A method for recognizing one or more sounds, comprising:

receiving user input from the computing device, the user input providing a search query comprising the one or more sounds;

executing instructions stored in memory, wherein execution of the instructions by a processor;

discriminates the one or more sounds by classifying and routing the one or more sounds to one of three sound recognition applications for processing based on sound type, the three sound recognition applications comprising a first sound recognition application for singing or humming sounds, a second sound recognition application for recorded music, and a third sound recognition application for speech,

extracts music features from the one or more sounds,

analyzing and searching the music features using one of three databases for searching based on sound type, the three databases comprising a first database for singing or humming sounds, a second database for recorded music, and a third database for speech, and

obtains information regarding the music features based on the analysis, searching and extraction; and

in response to the search query, transmitting for display information regarding the music features of the one or more sounds to the display of the computing device.

10. A computer readable storage medium having embodied thereon a program, the program being executable by a processor to perform a method for recognizing one or more sounds, the method comprising:

receiving user input from the computing device, the user input providing a search query comprising the one or more sounds;

discriminating the one or more sounds;

extracting music features from the one or more sounds;

analyzing the music features using one or more databases;

obtaining information regarding the music features based on the analysis;

and

in response to the search query, transmitting for display information regarding the music features of the one or more sounds to the computing device.

11. The computer readable storage medium of claim 10, wherein discriminating the one or more sounds further comprises classifying the one or more sounds of the search query as a singing or humming sound, recorded music, or speech.

12. The computer readable storage medium of claim 10, wherein the one or more sounds includes a song, a song clip, a song snippet, a humming sound, voice, or any combination thereof.

13. The computer readable storage medium of claim 10, wherein the method further comprises utilizing load balancing routers to distribute workload to one or more computing resources.

14. The computer readable storage medium of claim 10, wherein information regarding the music features of the one or more sounds comprises a song title, a name of an artist, an artist'"'"'s biographical information, identification of similar artists, a link to download a song, a link to download a video related to the song, or any combination thereof.

15. The computer readable storage medium of claim 10, wherein the method further comprises executing instructions stored in memory, wherein execution of the instructions by a processor separates music features from background noise by noise cancellation.

16. The computer readable storage medium of claim 10, wherein the method further comprises:

executing instructions stored in memory, wherein execution of the instructions by a processor determines whether the music features of the one or more sounds are already included in a local music database of the computing device; and

transmitting to display a flag on the display of the computing device, the flag depicting the determination of whether the music features of the one or more sounds are already included in a local music database of the computing device.

17. The computer readable storage medium of claim 10, wherein the method further comprises executing instructions stored in memory, wherein execution of the instructions by a processor provides relevant content relating to the music features;

and

transmitting to display a premium row on the display of the computing device, the premium row depicting the relevant content relating to the music features.

18. A system for recognizing one or more sounds, comprising:

a computing device having a display;

one or more databases coupled to the computing device;

a server having a music processor, the server being coupled to the computing device and the one or more databases, the processor configured to execute instructions stored in memory to;

receive user input from the computing device, the user input providing a search query comprising the one or more sounds,

discriminate the one or more sounds,

extract music features from the one or more sounds,

analyze the music features using the one or more databases, and

obtain information regarding the music features based on the analysis; and

in response to the search query, transmit for display information regarding the music features of the one or more sounds to the display of the computing device.

19. The system of claim 18, wherein the processor is further configured to classify the one or more sounds of the search query as a singing or humming sound, recorded music, or speech.

20. The system of claim 18, wherein the one or more sounds includes a song, a song clip, a song snippet, a humming sound, voice, or any combination thereof.

21. The system of claim 18, wherein the processor is further configured to utilize load balancing routers to distribute workload to one or more computing resources.

22. The system of claim 18, wherein information regarding the music features of the one or more sounds comprises a song title, a name of an artist, an artist'"'"'s biographical information, identification of similar artists, a link to download or purchase a song, a link to download or purchase a video related to the song, or any combination thereof.

23. The system of claim 18, wherein the processor is further configured to execute instructions stored in memory to separate music features from background noise by noise cancellation.

24. The system of claim 18, wherein the processor is further configured to execute instructions stored in memory to determine whether the music features of the one or more sounds are already included in a local music database of the computing device, and the method further comprises transmitting to display a flag on the display of the computing device, the flag depicting the determination of whether the music features of the one or more sounds are already included in a local music database of the computing device.

25. The system of claim 18, wherein the processor is further configured to execute instructions stored in memory to provide relevant content relating to the music features;

and the method further comprises transmitting to display a premium row on the display of the computing device, the premium row depicting the relevant content relating to the music features.

26. A system for recognizing one or more sounds, comprising:

a computing device having a display;

three databases coupled to a server,

the server having a music processor, the music processor having three sound recognition applications coupled to the three databases, the server being coupled to the computing device and the three databases, the processor configured to execute instructions stored in memory to;

receive user input from the computing device, the user input providing a search query comprising the one or more sounds,

discriminates the one or more sounds by classifying and routing the one or more sounds to one of the three sound recognition applications for processing based on sound type, the three sound recognition applications comprising a first sound recognition application for singing or humming sounds, a second sound recognition application for recorded music, and a third sound recognition application for speech,

extract music features from the one or more sounds,

analyze and search the music features using one of the three databases for searching based on sound type, the three databases comprising a first database for singing or humming sounds, a second database for recorded music, and a third database for speech, and

obtain information regarding the music features based on the analysis, searching and extraction; and

in response to the search query transmitting for display information regarding the music features of the one or more sounds to the display of the computing device.

27. An audio discriminator, comprising:

a classifier of one or more sounds received by user input, the user input providing a search query comprising the one or more sounds, the user input received through a unified search interface provided by a computing device.

28. The audio discriminator of claim 27, wherein the classifier of the one or more sounds comprises a classifier of the one or more sounds classifies sounds based on one of three sound types, the three sound types comprising humming or singing sounds, recorded music and speech.

29. The audio discriminator of claim 27, further comprising a router of the one or more sounds to a database based on the classification of the sound type.

30. A flag for a display of a computing device, the computing device further comprising a local music database for storing one or more music features, the flag generated by a server coupled to the computing device, the flag visually depicting a determination of whether music features of one or more sounds are already stored in the local music database of the computing device, the flag being transmitted to display on the display of the computing device.

31. A premium row for a display of a computing device, the premium row generated by a server coupled to the computing device, the premium row depicting relevant content relating to music features of one or more sounds, the premium row being transmitted to display on the display of the computing device.