Method and system for music information retrieval

• US 20070282860A1
• Filed: 05/14/2007
• Published: 12/06/2007
• Est. Priority Date: 05/12/2006
• Status: Abandoned Application

• Current Assignee: Owl Multimedia, Inc.
• Original Assignee: Owl Multimedia, Inc.
• Inventors: Geshwind, Frank, Athineos, Marios, Coifman, Ronald, Mandel, Michael, Poliner, Graham
• Application Number:
  US11/803,488
• Publication Number:
  US 20070282860A1
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/634 Query by example, e.g. query by humming
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 16/686 using information manually generated, e.g. tags, keywords, comments, title or artist information, time, location or usage information, user ratings
• CPC Class Codes: G10L 25/48 specially adapted for particular use

Abstract

Systems and methods are disclosed for searching or finding music with music, by searching, e.g., for music from a library that has a sound that is similar to a given sound provided as a search query, and to methods and systems for tracking revenue generated by these computer-user interactions, and for promoting music and selling advertising space. These include, inter alia, systems that allow a user to discover unknown music, and systems that allow a user to look for music based directly on queries formed from sounds that the user likes. In some embodiments these queries are comprised of a clip or relatively small segment of a larger media file. A client server system comprising web graphical elements, advertisements and/or other affiliated revenue links, elements in support of the music query and a music player, a database, elements for matching music clips to clips from a library, and elements to present results.

Claims

1. A computer based method for searching a music library, comprising the steps:

receiving an audio clip from a user;

computing musical features of said audio clip;

transmitting said musical features of said audio clip to a server; and

receiving a segment of a music file from said server determined to be similar to said audio clip by comparing said musical features of said audio clip to musical features associated with segments of a plurality of music files stored in said music library to find said segment from said segments of said plurality of music files stored in said music library that is similar to said audio clip.

2. The computer based method of claim 1, further comprising the step of receiving information identifying said segment of said music from said server.

3. The computer based method of claim 1, wherein the step of receiving said audio clip comprises receiving an audio segment of a predetermined size from said user.

4. The computer based method of claim 3, further comprising the step of selecting said audio segment of said predetermined size from a music file by said user.

5. The computer based method of claim 1, wherein the step of receiving said segment of music file from said server comprises the step of receiving said segment of said music file determined to be similar to said audio clip by determining near matches between said musical features of said audio clip and said musical features of said segment stored in said music library.

6. The computer based method of claim 1, wherein said musical features stored in said music library comprises at least one of spectral musical features, temporal musical features and Mel-frequency cepstral coefficients (MFCC) features;

and wherein the step of computing comprises computing said at least one of said spectral musical features, said temporal musical features and said MFCC features of said audio clip.

7. The computer based method of claim 1, wherein the step receiving said segment of music file from said server comprises the step of receiving said segment of said music file determined to be similar to said audio clip by searching said musical features of said plurality of segments stored in said music library using a hash function.

8. The computer based method of claim 1, further comprising the step of receiving a tag descriptive of said audio clip from said user and storing said audio clip and said tag associated with said audio clip in said music library.

9. The computer based method of claim 8, further comprising the step of searching said music library based on said tag received from said user.

10. A system for searching a segment of music, comprising:

a music library comprising a plurality of music files and a plurality of musical features associated with segments of said plurality of music files;

a client device, associated with a user and connected to a communications network, for selecting an audio clip, playing said audio clip and computing music features of said audio clip; and

a server for receiving said musical features of said audio clip from said client device over said communications network and comparing said musical features of said audio clip to said musical features stored in said music library to find a segment from segments of said plurality of music files that is similar to said audio clip.

11. The system of claim 10, wherein said server is operable to transmit information identifying said segment of said music to said client device.

12. The system of claim 10, wherein said client device is operable to receive said audio clip of a predetermined size from said user.

13. The system of claim 12, wherein said client device is operable to enable said user to select said audio clip of said predetermined size from a music file.

14. The system of claim 10, wherein said musical features stored in said music library comprises at least one of spectral musical features, temporal musical features and Mel-frequency cepstral coefficients (MFCC) features;

and wherein said client device is operable to compute at least one of said spectral musical features, said temporal musical features and MFCC features of said audio clip.

15. The system of claim 10, wherein said server is operable to search said musical features of said music library using a hash function to find said segment of said music similar to said audio clip.

16. The system of claim 10, wherein said server is operable to receive a tag descriptive of said audio clip from said client device, store said audio clip and said tag associated with said audio clip in said music library, and search said music library based on said tag received from said user.

17. A computer medium comprising a code for searching a music library, said code comprising instructions for:

receiving an audio clip from a user;

computing musical features of said audio clip;

transmitting said musical features of said audio clip to a server; and

receiving a segment of a music file from said server determined to be similar to said audio clip by comparing said musical features of said audio clip to musical features associated with segments of a plurality of music files stored in said music library to find said segment from said segments of said plurality of music files stored in said music library that is similar to said audio clip.

18. The computer medium of claim 17, wherein said code further comprises instructions for receiving information identifying said segment of said music from said server.

19. The computer medium of claim 17, wherein said code further comprises instructions for receiving said audio clip of a predetermined size from said user.

20. The computer medium of claim 19, wherein said code further comprises instructions for selecting said audio clip of said predetermined size from a music file by said user.

21. The computer medium of claim 17, wherein said musical features stored in said music library comprises at least spectral musical features, temporal music features and Mel-frequency cepstral coefficients (MFCC) features;

and wherein said code further comprises instructions for computing said at least one of said spectral musical features, said temporal musical features and said MFCC features of said audio clip.

22. The computer medium of claim 17, wherein said code further comprises instructions for searching said musical features of said music library using a hash function to find said segment of said music similar to said audio clip.

23. The computer medium of claim 17, wherein said code further comprises instructions for receiving a tag descriptive of said audio clip from said user, storing said audio clip and said tag associated with said audio clip in said music library, and searching said music library based on said tag received from said user.