Methods and systems for providing real-time feedback for karaoke

• US 7,973,230 B2
• Filed: 04/23/2008
• Issued: 07/05/2011
• Est. Priority Date: 12/31/2007
• Status: Expired due to Fees

• Current Assignee: Apple Inc.
• Original Assignee: Apple Inc.
• Inventors: Mahowald, Peter H.
• Primary Examiner(s): Donels; Jeffrey
• Assistant Examiner(s): Millikin; Andrew R
• Application Number:
  US12/107,931
• Publication Number:
  US 20090165634A1
• Time in Patent Office: 1,168 Days
• Field of Search: 846/09, 434/307.A, 463/7
• US Class Current: 84/609
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/091 for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
• CPC Class Codes: G10H 2220/011 Lyrics displays, e.g. for karaoke applications
• CPC Class Codes: G10H 2240/061 MP3, i.e. MPEG-1 or MPEG-2 Audio Layer III, lossy audio compression
• CPC Class Codes: G10H 2240/135 Library retrieval index, i.e. using an indexing scheme to efficiently retrieve a music piece

Abstract

Systems and methods for providing real-time feedback to karaoke users are provided. The systems and methods for providing users with real-time feedback while they are singing karaoke generally relate to receiving the user'"'"'s vocals, determining whether the user is singing on key/pitch and providing real-time feedback to the user while the karaoke song is being sung. The feedback will be positive feedback if user is on key/pitch and it will be negative feedback if user is off key/pitch. For example, the feedback signal if the user is singing too low can be an exaggerated low signal of the user'"'"'s own voice. This will encourage the user to sing at a higher pitch.

Claims

1. A method for assisting a user performing karaoke, comprising:

receiving the user'"'"'s voice signals;

comparing the user'"'"'s voice signals with expected voice signals;

determining whether the user is singing on key/pitch based on the comparison;

generating an altered version of the user'"'"'s voice signals based on the determination; and

providing real-time feedback comprising the altered version of the user'"'"'s voice signals to the user while the user is still performing karaoke, wherein generating comprises generating the altered version of the user'"'"'s voice signals by exaggerating the user'"'"'s voice signals based on the comparison when it is determined that the user is singing off key/pitch.

2. The method defined in claim 1, wherein comparing comprises:

calculating the difference in pitch between the user'"'"'s voice signals and the expected voice signals.

3. The method defined in claim 2, wherein the expected voice signals are based on melody/harmony information from as-recorded music.

4. The method defined in claim 2, wherein the expected voice signals are based on melody/harmony information from vocals of an artist.

5. The method defined in claim 2, wherein exaggerating comprises exaggerating the user'"'"'s voice signals based on the calculated difference in pitch between the user'"'"'s voice signals and the expected voice signals.

6. The method defined in claim 2, wherein the user'"'"'s voice signals are based on melody/harmony information from vocals received from the user.

7. The method defined in claim 1, wherein providing comprises:

playing audible feedback signals to the user.

8. The method defined in claim 1, wherein providing comprises:

playing positive feedback audible signals when the user is on key/pitch; and

playing negative feedback audible signals when the user is off key/pitch.

9. The method defined in claim 1, wherein generating comprises generating the altered version of the user'"'"'s voice signals by enhancing the user'"'"'s voice signals when it is determined that the user is singing on key/pitch.

10. The method defined in claim 1, wherein generating comprises generating the altered version of the user'"'"'s voice signals by enhancing the user'"'"'s voice signals with an echo when it is determined that the user is singing on key/pitch.

11. The method defined in claim 1, wherein exaggerating comprises exaggerating the off pitchedness of the user'"'"'s voice signals.

12. The method defined in claim 1, further comprising:

creating a modified version of the user'"'"'s voice signals when it is determined that the user is singing off key/pitch; and

providing the modified version of the user'"'"'s voice signals to an audience while providing the real-time feedback to the user.

13. The method defined in claim 12, wherein the altered version of the user'"'"'s voice signals differs from the modified version of the user'"'"'s voice signals.

14. The method defined in claim 12, wherein creating comprises creating the modified version of the user'"'"'s voice signals by modifying the pitch of the user'"'"'s voice signals to the expected voice signals.

15. The method defined in claim 12, wherein creating comprises creating the modified version of the user'"'"'s voice signals by fuzzing the user'"'"'s voice signals.

16. A system for assisting a user performing karaoke, comprising control circuitry, an output device and a microphone, wherein the control circuitry comprises processing circuitry and at least one storage device, the control circuitry configured to:

direct the microphone to receive the user'"'"'s voice signals;

compare the user'"'"'s voice signals with expected voice signals stored in the at least one storage device;

determine whether the user is singing on key/pitch based on the comparison;

generate an altered version of the user'"'"'s voice signals based on the determination; and

direct the output device to provide real-time feedback comprising the altered version of the user'"'"'s voice signals to the user while the user is still performing karaoke, wherein the control circuitry is configured to generate the altered version of the user'"'"'s voice signals by exaggerating the user'"'"'s voice signals based on the comparison when it is determined that the user is singing off key/pitch.

17. The system defined in claim 16, wherein the control circuitry is further configured to:

calculate the pitch difference between the user'"'"'s voice signals and the expected voice signals.

18. The system defined in claim 17, wherein the user'"'"'s voice signals are based on melody/harmony information from vocals received from the user.

19. The system defined in claim 17, wherein the expected voice signals are based on melody/harmony information extracted from as-recorded music.

20. The system defined in claim 17, wherein the expected voice signals are based on melody/harmony information from the vocals of an artist.

21. The system defined in claim 17, wherein the control circuitry is configured to exaggerate the user'"'"'s voice signals by exaggerating the user'"'"'s voice signals based on the calculated pitch difference between the user'"'"'s voice signals and the expected voice signals.

22. The system defined in claim 16, wherein the output device comprises an audio output device, and wherein the control circuitry is further configured to:

direct the audio output device to play audible feedback signals to the user comprising the altered version of the user'"'"'s voice signals.

23. The system defined in claim 16, wherein the output device comprises an audio output device, and wherein the control circuitry is further configured to:

direct the audio output device to play positive feedback audible signals comprising the altered version of the user'"'"'s voice signals when the user is on key/pitch; and

direct the audio output device to play negative feedback audible signals comprising the altered version of the user'"'"'s voice signals when the user is off key/pitch.

24. The system of claim 16, wherein the control circuitry is configured to generate the altered version of the user'"'"'s voice signals by enhancing the user'"'"'s voice signals when it is determined that the user is singing on key/pitch.

25. The system of claim 16, wherein the control circuitry is configured to generate the altered version of the user'"'"'s voice signals by enhancing the user'"'"'s voice signals with an echo when it is determined that the user is singing on key/pitch.

26. The system defined in claim 16, wherein the control circuitry is configured to exaggerate the user'"'"'s voice signals by exaggerating the off pitchedness of the user'"'"'s voice signals.

27. The system defined in claim 16 further comprising speakers, wherein the control circuitry is further configured to:

create a modified version of the user'"'"'s voice signals when it is determined that the user is singing off key/pitch; and

direct the speakers to provide the modified version of the user'"'"'s voice signals to an audience while directing the output device to provide the real-time feedback to the user.

28. The system defined in claim 27, wherein the altered version of the user'"'"'s voice signals differs from the modified version of the user'"'"'s voice signals.

29. The system defined in claim 27, wherein the control circuitry is configured to create the modified version of the user'"'"'s voice signals by modifying the pitch of the user'"'"'s voice signals to the expected voice signals.

30. The system defined in claim 27, wherein the control circuitry is configured to create the modified version of the user'"'"'s voice signals by fuzzing the user'"'"'s voice signals.

31. A system for assisting a user performing karaoke, comprising a user device and a host device remote to the user device, the host device comprising control circuitry and communications circuitry, wherein the control circuitry comprises processing circuitry and at least one storage device, the control circuitry configured to:

direct the communications circuitry to receive the user'"'"'s voice signals from the user device;

compare the user'"'"'s voice signals with expected voice signals stored in the at least one storage device;

determine whether the user is singing on key/pitch based on the comparison;

generate an altered version of the user'"'"'s voice signals based on the determination; and

direct the communications circuitry to transmit real-time feedback comprising the altered version of the user'"'"'s voice signals to the user device while the user is still performing karaoke, wherein the control circuitry is configured to generate the altered version of the user'"'"'s voice signals by exaggerating the user'"'"'s voice signals based on the comparison when it is determined that the user is singing off key/pitch.

32. The system defined in claim 31, wherein the control circuitry is further configured to:

calculate the difference in pitch between the user'"'"'s voice signals and the expected voice signals.

33. The system defined in claim 32, wherein the user'"'"'s voice signals are based on melody/harmony information from vocals received from the user.

34. The system defined in claim 32, wherein the expected voice signals are based on melody/harmony information from as-recorded music.

35. The system defined in claim 32, wherein the expected voice signals are based on melody/harmony information from vocals of an artist.

36. The system defined in claim 32, wherein the control circuitry is configured to exaggerate the user'"'"'s voice signals by exaggerating the user'"'"'s voice signals based on the calculated difference in pitch between the user'"'"'s voice signals and the expected voice signals.

37. The system defined in claim 31, wherein the control circuitry is further configured to:

direct the communications circuitry to transmit positive feedback audible signals comprising the altered version of the user'"'"'s voice signals to the user device when the user is on key/pitch; and

direct the communications circuitry to transmit negative feedback audible signals comprising the altered version of the user'"'"'s voice signals to the user device when the user is off key/pitch.

38. The system defined in claim 31, wherein the control circuitry is configured to generate the altered version of the user'"'"'s voice signals by enhancing the user'"'"'s voice signals when it is determined that the user is singing on key/pitch.

39. The system defined in claim 31, wherein the control circuitry is configured to generate the altered version of the user'"'"'s voice signals by enhancing the user'"'"'s voice signals with an echo when it is determined that the user is singing on key/pitch.

40. The system defined in claim 31, wherein the control circuitry is configured to exaggerate the user'"'"'s voice signals by exaggerating the off pitchedness of the user'"'"'s voice signals.

41. The system defined in claim 31 further comprising speakers, wherein the control circuitry is further configured to:

create a modified version of the user'"'"'s voice signals when it is determined that the user is singing off key/pitch; and

direct the communications circuitry to transmit the modified version of the user'"'"'s voice signals to the speakers while directing the communications circuitry to transmit the real-time feedback to the user device.

42. The system defined in claim 41, wherein the altered version of the user'"'"'s voice signals differs from the modified version of the user'"'"'s voice signals.

43. The system defined in claim 41, wherein the control circuitry is configured to create the modified version of the user'"'"'s voice signals by modifying the pitch of the user'"'"'s voice signals to the expected voice signals.

44. The system defined in claim 41, wherein the control circuitry is configured to create the modified version of the user'"'"'s voice signals by fuzzing the user'"'"'s voice signals.