AUTOMATIC PAGE SEQUENCING AND OTHER FEEDBACK ACTION BASED ON ANALYSIS OF AUDIO PERFORMANCE DATA

• US 20080156171A1
• Filed: 12/28/2006
• Published: 07/03/2008
• Est. Priority Date: 12/28/2006
• Status: Active Grant

• Current Assignee: Texas Instruments, Inc.
• Original Assignee: Texas Instruments, Inc.
• Inventors: Guldi, Richard
• Granted Patent: US 7,579,541 B2
• Time in Patent Office: Days
• US Class Current: 84/466
• CPC Class Codes: G09B 15/00 Teaching music metronomes G04F5/02
• CPC Class Codes: G09B 15/002 Electrically operated systems

Abstract

Speech or musical performance is electronically analyzed using DSP techniques and is compared to a stored text script or musical score, to enable display of and automated sequencing through multiple pages of the stored script or score. The performer can modify timing of sequencing if desired, for example dependent on performance speed or musical complexity. Automated highlighting or marking of measures or text assists the performer in keeping track of progress through the performance. During or after the performance, electronic comparison of the performance to the score or script provides feedback to the performer, highlighting differences between the actual performance and the desired performance as described by the score or script. Additional capabilities enhancing the learning process include digital recording and playback of the actual performance, and/or accompaniment by synthesis or playback of digital recording of other performance parts (for example, other instruments in an ensemble or other actors in a play).

Claims

1. A method for providing automatic feedback about a vocal, instrumental or similar performance, comprising:

electronically analyzing audio data signals derived from the performance to identify parameters associated with the performance;

comparing the identified parameters associated with the performance to parameters associated with a known standard for the performance; and

providing feedback about the performance based on the comparison.

2. The method of claim 1, wherein the parameters associated with a known standard for the performance are parameters associated with a score or script.

3. The method of claim 2, wherein the analyzing and comparing steps operate to determine correspondence between time points in the performance and places in the score or script.

4. The method of claim 3, wherein the feedback comprises automatically sequencing pages of the score or script with the performance.

5. The method of claim 4, wherein the feedback comprises displaying a particular page of the score or script on a display at a particular time.

6. The method of claim 5, further comprising setting an advance or delay for the timing of page turns of the score or script;

and displaying the page of the score or script at a time determined by the analysis and comparison and the setting for the advance or delay.

7. The method of claim 6, further comprising electronically analyzing the page turning in a first performance and setting an advance or delay for the timing of page turns for a second performance based on the page turning history of the first performance.

8. The method of claim 6, further comprising marking the page of the score or script to show the current point in the performance.

9. The method of claim 8, further providing an alerting notification when a particular point in the performance is reached.

10. The method of claim 3, wherein the feedback relates to an event scheduled to occur at particular places in the at least one of score or script, wherein the feedback relates to the event'"'"'s timing.

11. The method of claim 10, further comprising providing synthesis of sounds in correspondence with the feedback.

12. The method of claim 11, wherein instrumental sounds of an instrument are provided in tempo correspondence with the event'"'"'s timing in the performance of instrumental sounds of another instrument.

13. Apparatus for providing automatic feedback about a vocal, instrumental or similar performance, comprising:

means for analyzing retrieved audio data signals and identifying parameters associated with the performance, wherein the parameters are associated with at least one of the score or scrint of the performance;

means for comparing the identified parameters associated with the performance to parameters associated with a known standard for the performance; and

means for providing feedback about the performance based on the comparison, wherein the feedback relates to at least one of displaying the difference, commonality or relationship between compared parameters.

14. Apparatus as in claim 13, wherein the parameters associated with a known standard for the performance are parameters associated with a score or script;

and wherein the means for analyzing and the means for comparing operate to determine correspondence between time points in the performance and places in the score or script.

15. Apparatus as in claim 14, wherein the means for providing feedback includes means for automatically sequencing pages of the score or script with the performance.

16. Apparatus as in claim 15, wherein the means for providing feedback includes a display, and a means for displaying a particular page of the score or script on the display.