Interactive music training and entertainment system

• US 20090038467A1
• Filed: 08/10/2007
• Published: 02/12/2009
• Est. Priority Date: 08/10/2007
• Status: Active Grant

• Current Assignee: SonicJam, Inc. (JAPAN Creative Platform Group Co., Ltd.)
• Original Assignee: SonicJam, Inc. (JAPAN Creative Platform Group Co., Ltd.)
• Inventors: Brennan, Edward W.
• Granted Patent: US 8,138,409 B2
• Time in Patent Office: Days
• US Class Current: 84/609
• CPC Class Codes: G09B 15/00 Teaching music metronomes G04F5/02
• CPC Class Codes: G09B 5/00 Electrically-operated educational appliances working with questions and answers G09B7/00; simulators G09B9/00; advertising or displaying in general G09F
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/071 for rhythm pattern analysis or rhythm style recognition
• CPC Class Codes: G10H 2210/076 for extraction of timing, tempo; Beat detection
• CPC Class Codes: G10H 2210/091 for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
• CPC Class Codes: G10H 2220/011 Lyrics displays, e.g. for karaoke applications

Abstract

Embodiments of a music training and entertainment system are described that allows a user to input a selection of source music in a native format, and isolates a desired vocal or instrument component within the source music. The user selects the component of the source music against which he or she will be compared. The system suppresses the non-selected components of the source content to isolate the user-selected component. The system receives user input corresponding to the isolated component, such as a vocal track, and matches the receiver'"'"'s performance to the original performance. The system then provides meaningful and entertaining feedback to allow the user to practice and improve his or her performance. In a multi-user configuration a number of users, such as a band or ensemble can provide a performance, or individual users can compete against each other to see who can obtain the highest score.

Claims

1. A method comprising:

receiving a source stream from a source, the source stream comprising a plurality of components;

receiving a user selection of a component of the source stream to be compared against;

suppressing non-selected components within the source stream to isolate the user selected component of the plurality of components;

receiving a user provided component corresponding to the user selected component of the source stream simultaneously with the source stream;

comparing the isolated user selected component with the user provided component; and

providing to the user a numeric score representing a similarity based on a plurality of characteristics of the user selected component of the source stream with the user provided component.

2. The method of claim 1 wherein the source stream comprises music, and the source is selected from the group consisting of:

streaming music content, pre-recorded digital media, pre-recorded analog media, and a live performance by one or more performers.

3. The method of claim 1 wherein the plurality of characteristics is selected from the group consisting of:

pitch, rhythm, and sonic quality.

4. The method of claim 1 wherein the user selected component is selected from the group consisting of vocal, guitar, keyboard, drums, and ensemble of instruments.

5. The method of claim 1 wherein the step of isolating the user selected component comprises:

identifying a frequency range of the user selected component;

separating signals within the frequency range of the user selected component from remaining signals in the source stream;

decreasing an amplitude of the remaining signals to a defined level relative to an amplitude of the user selected component; and

storing the isolated user selected component.

6. The method of claim 5 wherein the step of comparing the isolated user selected component with the user provided component comprises comparing signals within the frequency range of the user selected component are compared with the user provided component through a cross correlation process.

7. The method of claim 1 wherein numeric score ranges from 0 to 100, wherein 100 represents the highest score and 0 represents the lowest score.

8. The method of claim 7 further comprising:

displaying feedback from a virtual panel of a plurality of judges through a device operated by the user; and

transmitting the numeric score from the user-operated device to a server computer coupling the user-operated device to a plurality of other user-operated devices.

9. The method of claim 8 further comprising correlating the numeric score to a qualitative textual summary provided to the user.

10. The method of claim 9 wherein one or more of the judges of the plurality of the judges assigns a different numeric score and qualitative textual summary for the user provided component.

11. The method of claim 9 further comprising:

receiving from a third party advertising server, an advertising message selected on the basis of one or more characteristics of the user provided component; and

displaying the advertising message to the user through a graphical user interface.

12. The method of claim 3 further comprising:

assigning intermediate scores to each characteristic of the plurality of characteristics; and

averaging the intermediate scores to generate the numeric score.

13. The method of claim 12 wherein intermediate scores are weighted by pre-defined weight values.

14. The method of claim 1 wherein the source stream comprises speech, and the source is selected from the group consisting of:

streaming music content, pre-recorded digital media, pre-recorded analog media, and a live performance by one or more performers.

15. The method of claim 1 wherein the user comprises a plurality of users, each providing a different component, and wherein the user selected component comprises two or more components of the plurality of components.

16. An interactive entertainment system comprising:

means receiving a source stream from a source, the source stream comprising a plurality of components;

means for receiving a user provided component corresponding to a specified component of the source stream simultaneously with the source stream;

means for comparing the user provided component with the specified component of the source stream;

means for providing to the user a numeric score representing a similarity of the user provided component with the specified component based on a plurality of characteristics of the source stream; and

means for correlating the numeric score to a qualitative text message, wherein the qualitative text message is provided to the user through a virtual panel of a plurality of judges displayed on a graphical user interface of a playback system operated by the user.

17. The system of claim 16 wherein the source stream comprises music, and the source is selected from the group consisting of:

streaming music content, pre-recorded digital media, pre-recorded analog media, and a live performance by one or more performers.

18. The system of claim 17 wherein the user selected component is selected from the group consisting of vocal, guitar, keyboard, drums, and ensemble of instruments.

19. The system of claim 18 wherein the plurality of characteristics comprises pitch, rhythm, and sonic quality.

20. The system of claim 19 further comprising:

assigning intermediate scores to each characteristic of the plurality of characteristics; and

averaging the intermediate scores to generate the numeric score.

21. The system of claim 20 wherein one or more of the judges of the plurality of the judges assigns a different qualitative textual summary for the user provided component.

22. The system of claim 21 wherein the qualitative summary of one or more of the judges of the plurality of the judges responds to a qualitative summary provided by one or more of the other judges of the virtual panel.

23. The system of claim 22 further comprising transmitting the score, the qualitative summary of the virtual panel, and an audio file of the user component to an accessible network computer.

24. The system of claim 21 further comprising a directed advertising message component configured to display and advertising message to the user, wherein the content of the advertising message depends on the score of the user.