Music search by melody input

• US 6,188,010 B1
• Filed: 10/29/1999
• Issued: 02/13/2001
• Est. Priority Date: 10/29/1999
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.), Sony Electronics Inc. (Sony Group Corp.)
• Inventors: Iwamura, Ryuichi
• Primary Examiner(s): Witkowski, Stanley J.
• Application Number:
  US09/429,260
• Time in Patent Office: 473 Days
• Field of Search: 84/609-614, 84/634-638, 84/477 R, 84/478, 434/307 A
• US Class Current: 84/609
• CPC Class Codes: G09B 15/00 Teaching music metronomes G04F5/02
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 2240/056 MIDI or other note-oriented file format
• CPC Class Codes: G10H 2240/141 Library retrieval matching, i.e. any of the steps of matching an inputted segment or phrase with musical database contents, e.g. query by humming, singing or playing; the steps may include, e.g. musical analysis of the input, musical feature extraction, query formulation, or details of the retrieval process
• CPC Class Codes: G10H 2240/305 Internet or TCP/IP protocol use for any electrophonic musical instrument data or musical parameter transmission purposes
• CPC Class Codes: G10H 2250/235 Fourier transform; Discrete Fourier Transform [DFT]; Fast Fourier Transform [FFT]

Abstract

A method to enable one to search for a song title when only its melody is known. An interface is used which allows the user to enter the melody in an easy to understand manner. A remote music database with melody information is searched for the melody entered by the user. using, for example, a peak or differential matching algorithm. Upon receiving a search request, a database server, i.e., a remote computer, which can be accessed by the user via a client PC, sends a web page, for example, in HTML or Java containing the search results to the client PC. The client PC receives and displays the search results on the monitor and exchanges data with the server. Sound may also be played through the sound card to connected speakers.

Claims

1. A method for searching for a musical piece which includes at least one melody comprising the steps of:

a) receiving note information representing the melody provided by a user;

b) converting the received information to a series of values corresponding to each received note information;

c) calculating relative pitch values from said series of values

d) comparing said relative pitch values to values stored in said database representing stored melodies;

e) selecting as the musical piece being searched one of said stored melodies which produces a closest match based on said comparing.

2. The method defined by claim 1 further comprising the step of marking pitch peaks in said stored values and determining peak pitch values from said relative pitch values for said comparison step.

3. The method defined by claim 2 further comprising the step of time shifting said relative pitch values to match a first peak in said relative pitch values with a first peak in said stored values.

4. The method defined by claim 3 further comprising the step of time shifting said relative peak values to match subsequent peaks in said relative pitch values with corresponding subsequent peaks in said stored values.

5. The method defined by claim 4 wherein the closest match is determined by calculating absolute differences between said time shifted relative peak values and said stored values, said closest match being one have a smallest calculated absolute difference.

6. The method defined by claim 1 further comprising the step of marking pitch dips in said stored values and determining dip pitch values from said relative pitch values for said comparison step.

7. The method defined by claim 5 further comprising the step of time shifting said relative pitch values to match a first dip in said relative pitch values swith a first dip in said stored values.

8. The method defined by claim 7 further comprising the step of time shifting said relative dip values to match subsequent dips in said relative pitch values with corresponding subsequent dips in said stored values.

9. The method defined by claim 8 wherein the closest match is determined by calculating absolute differences between said time shifted relative dip values and said stored values, said closest match being one have a smallest calculated absolute difference.

10. The method defined by claim 1 further comprising the step of marking largest pitch differentials in said stored values and determining largest differential pitch values from said relative pitch values for said comparison step.

11. The method defined by claim 10 further comprising the step of time shifting said relative pitch values to match a first largest difference in said relative pitch values with a first largest difference in said stored values.

12. The method defined by claim 11 further comprising the step of time shifting said relative dip values to match subsequent largest differences in said relative pitch values with corresponding subsequent largest differenes in said stored values.

13. The method defined by claim 12 wherein the closest match is determined by calculating absolute differences between said time shifted relative largest difference values and said stored values, said closest match being one have a smallest calculated absolute difference.

14. The method defined by claim 1 wherein said note information is received from a user based on a piano roll grid interface in which cells within an array represent pitch values and are selected by a user using a pointing device.

15. The method defined by claim 1 wherein said note information is received from a user based on a piano keyboard grid interface in which keys on a piano keyboard represent pitch values and are selected by a user using, a pointing device.

16. The method defined by claim 1 wherein said note information is received from a user based upon sounds input to a microphone representing the melody.

17. The method defined by claim 1 farther comprising the step of playing said note information for verification of its correctness.

18. The method defined by claim 1 wherein note information includes at least one wildcard character.

19. The method defined by claim 1 further comprising the step of playing the selected musical piece.

20. The method defined by claim 1 further comprising the step of enabling the user to make an on-line purchase of the selected musical piece.

21. A method for searching for a musical piece which includes at least one melody comprising the steps of:

a) receiving note information representing the melody provided by a user;

b) converting the received information to a series of values corresponding to each received note information;

c) adjusting said series of values by key shifting said values;

d) comparing said key shifted pitch values to absolute pitch values stored in said database representing stored melodies;

e) selecting as the musical piece being searched one of said stored melodies which produces a closest match based on said comparing.

22. The method defined by claim 21 further comprising the step of marking pitch peaks in said stored values and determining peak pitch values from said key shifted pitch values for said comparison step.

23. The method defined by claim 22 further comprising the step of time shifting said key shifted pitch values to match a first peak in said relative pitch values with a first peak in said stored values.

24. The method defined by claim 23 further comprising the step of time shifting said key shifted peak values to match subsequent peaks in said relative pitch values with corresponding subsequent peaks in said stored values.

25. The method defined by claim 24 wherein the closest match is determined by calculating absolute differences between said time shifted and key shifted peak values and said stored values, said closest match being one have a smallest calculated absolute difference.

26. The method defined by claim 21 further comprising the step of marking pitch dips in said stored values and determining dip pitch values from said key shifted pitch values for said comparison step.

27. The method defined by claim 21 further comprising the step of time shifting said key shifted pitch values to match a first dip in said key shifted pitch values with a first dip in said stored values.

28. The method defined by claim 27 further comprising the step of time shifting said key shifted dip values to match subsequent dips in said key shifted pitch values with corresponding subsequent dips in said stored values.

29. The method defined by claim 28 wherein the closest match is determined by calculating absolute differences between said time shifted and key shifted dip values and said stored values, said closest match being one have a smallest calculated absolute difference.

30. The method defined by claim 21 further comprising the step of marking largest pitch differentials in said stored values and determining largest differential pitch values from said key shifted pitch values for said comparison step.

31. The method defined by claim 30 further comprising the step of time shifting said key shifted pitch values to match a first largest difference in said key shifted pitch values with a first largest difference in said stored values.

32. The method defined by claim 31 further comprising the step of time shifting said key shifted dip values to match subsequent largest differences in said key shifted pitch values with corresponding subsequent largest differenes in said stored values.

33. The method defined by claim 32 wherein the closest match is determined by calculating absolute differences between said time shifted and key shifted largest difference values and said stored values, said closest match being one have a smallest calculated absolute difference.

34. The method defined by claim 21 wherein said note information is received from a user based on a piano roll grid interface in which cells within an array represent pitch values and are selected by a user using a pointing device.

35. The method defined by claim 21 wherein said note information is received from a user based on a piano keyboard grid interface in which keys on a piano keyboard represent pitch values and are selected by a user using a pointing device.

36. The method defined by claim 21 wherein said note information is received from a user based upon sounds input to a microphone representing the melody.

37. The method defined by claim 21 further comprising the step of playing said note information for verification of its correctness.

38. The method defined by claim 21 wherein note information includes at least one wildcard character.

39. The method defined by claim 21 further comprising the step of playing the selected musical piece.

40. The method defined by claim 21 further comprising the step of enabling the user to make an on-line purchase of the selected musical piece.