Vocal improvisation

• US 9,773,486 B2
• Filed: 09/28/2016
• Issued: 09/26/2017
• Est. Priority Date: 09/28/2015
• Status: Active Grant

• Current Assignee: Harmonix Music Systems Incorporated (Epic Games, Inc.)
• Original Assignee: Harmonix Music Systems Incorporated (Epic Games, Inc.)
• Inventors: Lopiccolo, Gregory B., Plante, David, Bhat, Sharat
• Primary Examiner(s): Donels, Jeffrey
• Application Number:
  US15/278,596
• Publication Number:
  US 20170092252A1
• Time in Patent Office: 363 Days
• Field of Search: 84610
• CPC Class Codes: G10H 1/0008 Associated control or indicating means
• CPC Class Codes: G10H 1/361 Recording/reproducing of accompaniment for use with an external source, e.g. karaoke systems
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/066 for pitch analysis as part of wider processing for musical purposes, e.g. transcription, musical performance evaluation; Pitch recognition, e.g. in polyphonic sounds; Estimation or use of missing fundamental
• CPC Class Codes: G10H 2210/071 for rhythm pattern analysis or rhythm style recognition rhythm pattern per se G10H2210/341
• CPC Class Codes: G10H 2210/091 for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance. graphical musical score editing G10H2220/121; musical score displays resulting from a transcription G10H2210/086
• CPC Class Codes: G10H 2220/135 Musical aspects of games or videogames; Musical instrument-shaped game input interfaces game background music G10H2210/026; musical game scoring or performance evaluation G10H2210/091
• CPC Class Codes: G10H 2240/145 Sound library, i.e. involving the specific use of a musical database as a sound bank or wavetable; indexing, interfacing, protocols or processing therefor

Abstract

The present disclosure is directed at methods and systems for implementing and scoring a vocal improvisation feature in a music video game. This feature can allow players of music video games to sing improvised harmonies for a song using a microphone controller. The improvised harmonies can be musically consonant with a pre-authored melody track programmed into the music video game. The improvised harmonies can comprise pre-authored notes programmed into the pre-authored melody track, or can be generated by the music video game during run-time based on the pre-authored melody track. The music video game can also display guidelines visually showing permissible harmony tracks in relation to the pre-authored melody track.

Claims

1. A computer system for evaluating a player'"'"'s vocal performance comprising at least some vocal improvisation that does not correspond to a melody of a musical track, the system comprising:

a memory that stores the musical track, the musical track having a first set of notes corresponding to the melody;

at least one processor configured to;

determine a second set of notes corresponding to potential harmonies that are musically consonant with the melody;

receive vocal input corresponding to the player'"'"'s vocal performance;

determine if a pitch of the vocal input falls within a pre-determined range of at least one note of the first set of notes or at least one note of the second set of notes; and

increase a score of the player when the pitch of the vocal input falls within the pre-determined range of at least one note of the first set of notes or at least one note of the second set of notes;

a sound synthesizer coupled to the at least one processor, wherein the at least one processor is further configured to transmit to the sound synthesizer an audible soundtrack.

2. The system of claim 1, wherein the at least one processor is configured to decrease or leave unchanged the score of the player when the pitch of the vocal input does not fall within the pre-determined range of at least one note of the first set of notes and at least one note of the second set of notes.

3. The system of claim 1, further comprising a video rendering module coupled to the at least one processor, wherein the at least one processor is further configured to transmit to the video rendering module display data comprising a lane having a first set of cues corresponding to the first set of notes, and a second set of cues corresponding to the second set of notes.

4. The system of claim 3, wherein the at least one processor is configured to change the appearance of a selected cue in the second set of cues when the pitch of the vocal input falls within the pre-determined range of a note that corresponds to the selected cue.

5. The system of claim 1, wherein:

the score of the player is a score for a musical phrase, the score being subdivided into a first part and a second part; and

the at least one processor is configured to increase the first part of the score when the pitch of the vocal input falls within the pre-determined range of at least one note of the first set of notes, and to increase the second part of the score when the pitch of the vocal input falls within the pre-determined range of at least one note of the second set of notes.

6. The system of claim 1, wherein the at least one processor is further configured to determine if a rhythm of the vocal input corresponds to a rhythm associated with the musical track, and if so, to increase the score of the player.

7. The system of claim 1, wherein the at least one processor is configured to determine the second set of notes during run-time.

8. The system of claim 1, wherein the at least one processor is configured to determine the second set of notes based on metadata associated with the musical track.

9. The system of claim 1, wherein the audible soundtrack corresponds to the musical track and is transmitted to the sound synthesizer by the at least one processor while receiving the vocal input.

10. The system of claim 9, wherein the second set of notes does not correspond to an audible harmony in the audible soundtrack.

11. A method for evaluating a player'"'"'s vocal performance comprising at least some vocal improvisation that does not correspond to a melody of a musical track, the method being executed by a computing device comprising at least one processor and at least one memory in communication with the processor, the method comprising:

accessing the musical track from the at least one memory, the musical track having a first set of notes corresponding to the melody;

determining a second set of notes corresponding to potential harmonies that are musically consonant with the melody;

receiving vocal input corresponding to the player'"'"'s vocal performance;

determining if a pitch of the vocal input falls within a pre-determined range of at least one note of the first set of notes or at least one note of the second set of notes;

increasing a score of the player when the pitch of the vocal input falls within the pre-determined range of at least one note of the first set of notes or at least one note of the second set of notes; and

transmitting an audible soundtrack to a sound synthesizer coupled to the processor.

12. The method of claim 11, further comprising decreasing or leaving unchanged the score of the player when the pitch of the vocal input does not fall within the pre-determined range of at least one note of the first set of notes and at least one note of the second set of notes.

13. The method of claim 11, further comprising transmitting display data comprising a lane having a first set of cues corresponding to the first set of notes, and a second set of cues corresponding to the second set of notes.

14. The method of claim 13, further comprising changing the appearance of a selected cue in the second set of cues when the pitch of the vocal input falls within the pre-determined range of a note that corresponds to the selected cue.

15. The method of claim 11, wherein:

the score of the player is a score for a musical phrase, the score being subdivided into a first part and a second part; and

the method further comprises increasing the first part of the score when the pitch of the vocal input falls within the pre-determined range of at least one note of the first set of notes, and increasing the second part of the score when the pitch of the vocal input falls within the pre-determined range of at least one note of the second set of notes.

16. The method of claim 11, further comprising determining if a rhythm of the vocal input corresponds to a rhythm associated with the musical track, and if so, increasing the score of the player.

17. The method of claim 11, further comprising determining the second set of notes during run-time of the method.

18. The method of claim 11, further comprising determining the second set of notes based on metadata associated with the musical track.

19. The method of claim 11, wherein the audible soundtrack corresponds to the musical track, and is transmitted while receiving the vocal input.

20. The method of claim 19, wherein the second set of notes does not correspond to an audible harmony in the audible soundtrack.

21. Non-transitory computer readable media storing machine-readable instructions that are configured to, when executed by at least one processor, cause the at least one processor to:

access the musical track from at least one memory in communication with the at least one processor, the musical track having a first set of notes corresponding to the melody;

determine a second set of notes corresponding to potential harmonies that are musically consonant with the melody;

receive vocal input corresponding to the player'"'"'s vocal performance;

determine if a pitch of the vocal input falls within a pre-determined range of at least one note of the first set of notes or at least one note of the second set of notes;

increase a score of the player when the pitch of the vocal input falls within the pre-determined range of at least one note of the first set of notes or at least one note of the second set of notes; and

transmit an audible soundtrack to a sound synthesizer coupled to the processor.