In-game interface with performance feedback

• US 7,806,759 B2
• Filed: 05/14/2004
• Issued: 10/05/2010
• Est. Priority Date: 05/14/2004
• Status: Expired due to Fees

• Current Assignee: Konami Digital Entertainment Incorporated (Konami Holdings Corp.)
• Original Assignee: Konami Digital Entertainment Incorporated (Konami Holdings Corp.)
• Inventors: McHale, Mike, Egozy, Eran B.
• Primary Examiner(s): Vo; Peter DungBa
• Assistant Examiner(s): Ahmed; Masud
• Application Number:
  US10/846,420
• Publication Number:
  US 20050255914A1
• Time in Patent Office: 2,335 Days
• Field of Search: 463/7, 463/31, 463/43, 844/76, 844/70.R, 846/09, 846/45, 846/10, 704/270, 704/258, 434/307.A, 715/709, 345/419
• US Class Current: 463/7
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/5375 for graphically or textually suggesting an action, e.g. by displaying an arrow indicating a turn in a driving game
• CPC Class Codes: A63F 13/814 Musical performances, e.g. by evaluating the player's ability to follow a notation
• CPC Class Codes: A63F 2300/303 for displaying additional data, e.g. simulating a Head Up Display
• CPC Class Codes: A63F 2300/308 Details of the user interface
• CPC Class Codes: A63F 2300/61 Score computation
• CPC Class Codes: A63F 2300/8047 Music games
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 2210/091 for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance. graphical musical score editing G10H2220/121; musical score displays resulting from a transcription G10H2210/086
• CPC Class Codes: G10H 2220/151 Musical difficulty level setting or selection

Abstract

An in-game interface for a music video game includes one or more feedback mechanisms configured to provide feedback to a player relating to the player'"'"'s performance of the music video game. A compare module compares the player'"'"'s performance with a reference performance provided by the music video game. A performance evaluation module determines the performance feedback to be presented to the player while the player performs the musical composition. In some embodiments, the player'"'"'s pitch and rhythm are compared against a reference pitch and rhythm. If the player'"'"'s pitch and rhythm matches the reference pitch and rhythm to within a predetermined target range, then the performance feedback is positive. Otherwise, the performance feedback is negative.

Claims

1. A music video game apparatus, comprising:

a first portion of an in-game interface, the first portion configured for displaying graphical representations of music notes of a musical composition, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein a respective note tube visually transforms as it passes through the fixed position on the first portion;

a compare module configured to compare the player'"'"'s rhythm and pitch in a vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

a performance evaluation module coupled to the compare module and configured to generate performance evaluation data based on results of the comparison of the player'"'"'s vocal performance with the reference performance; and

a second portion of the in-game interface, the second portion including a first feedback display mechanism coupled to the performance evaluation module and configured to provide a first feedback indicative of the player'"'"'s rhythm and pitch in the vocal performance of the musical composition based on the performance evaluation data.

2. The apparatus of claim 1, wherein the first feedback display mechanism indicates if the player has performed a pitch of the musical composition correctly.

3. The apparatus of claim 1, wherein the first feedback display mechanism indicates if the player has performed a rhythm of the musical composition correctly.

4. The apparatus of claim 1, wherein the first portion further comprises a music staff that moves from right to left during performance of the musical composition, the music staff including the graphical representations of the music notes.

5. The apparatus of claim 1, wherein at least one note tube is embellished to indicate an enhanced scoring opportunity.

6. The apparatus of claim 1, wherein the first portion further comprises:

an animated representation of a music staff for displaying the graphical representations of notes.

7. The apparatus of claim 6, where the fixed position includes a highlight bar on the music staff for indicating to the player when to vocally perform a note of the musical composition.

8. The apparatus of claim 1, further comprising:

a background portion configured to generate an animated representation of the player of the music video game and an animated virtual audience; and

a third portion including a second feedback display mechanism coupled to the performance evaluation module and configured to provide a second feedback indicative of the reaction of the virtual audience to the player'"'"'s performance of the musical composition.

9. The apparatus of claim 8, wherein the animated representation of the player is controlled at least in part by the performance evaluation data.

10. The apparatus of claim 8, where the animated representation of the virtual audience is controlled at least in part by the performance evaluation data.

11. The apparatus of claim 1, further comprising:

a third portion configured to display lyrics corresponding to the notes of the musical composition to be sung by the player.

12. The apparatus of claim 1, further comprising:

a third portion including a pitch arrow, which is configured to point up if the player sang a note too high in pitch and to point down if the player sang a note that is too low in pitch.

13. The apparatus of claim 1, wherein the performance evaluation data is based on an average of comparisons of the player'"'"'s vocal performance with the reference performance.

14. The apparatus of claim 1, wherein the first feedback display mechanism is a bar graph that fills in response to the performance evaluation data.

15. The apparatus of claim 8, wherein the animated representation of the player includes animated lips, which are synchronized to the player'"'"'s vocal performance of the musical composition provided by the music video game.

16. The apparatus of claim 1, wherein the first feedback display simulates the operation of a Volume Unit (VU) meter.

17. The apparatus of claim 1, wherein the compare module compares a plurality of notes of the player'"'"'s vocal performance with a plurality of notes of the reference performance.

18. A music video game apparatus, comprising:

a background portion of an in-game interface, the background portion configured to generate an animated representation of a player of the music video game and a virtual audience;

a performance feedback interface configured to display graphical representations of music notes of a musical composition, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein a respective note tube visually transforms as it passes through the fixed position on the first portion;

a compare module configured to compare the player'"'"'s vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

a performance evaluation module coupled to the compare module and configured to generate performance evaluation data for the player;

a first feedback mechanism disposed in the performance feedback interface and coupled to the performance evaluation module, the first feedback mechanism configured to provide a first feedback indicative of the player'"'"'s rhythm and pitch in the vocal performance of the musical composition based on the performance evaluation data; and

a second feedback mechanism disposed in the performance feedback interface and coupled to the performance evaluation module, the second feedback mechanism configured to provide a second feedback indicative of the reaction of the virtual audience to the player'"'"'s performance of the musical composition.

19. The apparatus of claim 18, wherein the first feedback mechanism indicates if the player has performed a pitch of the musical composition correctly.

20. The apparatus of claim 18, wherein the first feedback mechanism indicates if the player has performed a rhythm of the musical composition correctly.

21. The apparatus of claim 18, wherein at least one note tube is embellished to indicate to indicate an enhanced scoring opportunity.

22. The apparatus of claim 18, wherein the performance feedback interface, further comprises:

an animated representation of a music staff for displaying the graphical representations of notes.

23. The apparatus of claim 18, where the fixed position includes a highlight bar on the music staff for indicating to the player when to vocally perform a note of the musical composition.

24. The apparatus of claim 18, wherein the performance evaluation data is based on an average of comparisons of the player'"'"'s vocal performance with the reference performance.

25. The apparatus of claim 18, wherein the first feedback mechanism is a bar graph that fills in response to the performance evaluation data.

26. A music video game apparatus comprising:

a first portion of an in-game interface, the first portion configured for displaying graphical representations of music notes of a musical composition, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein a respective note tube visually transforms as it passes through the fixed position on the first portion;

a compare module configured to compare the player'"'"'s vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

a performance evaluation module coupled to the compare module and configured to generate performance evaluation data based on results of the comparison of the player'"'"'s vocal performance with the reference performance; and

a second portion of the in-game interface, the second portion including a first feedback display mechanism coupled to the performance evaluation module and configured to provide a first feedback indicative of the player'"'"'s vocal performance of the musical composition based on the performance evaluation data.

27. The apparatus of claim 26, wherein an orientation of a respective note tube shows the player how to bend the corresponding note.

28. The apparatus of claim 26, the first portion configured for displaying lyrics of the musical composition, wherein each lyric syllable lines up vertically with a corresponding note tube displayed on the first portion.

29. The apparatus of claim 26, the first portion including a set of horizontal lines for displaying the note tubes in a manner indicative of relative pitch of the note tubes.

30. A computer-implemented method comprising:

displaying graphical representations of music notes of a musical composition on a first portion of a music video game, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein a respective note tube visually transforms as it passes through the fixed position on the first portion;

comparing the player'"'"'s vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

generating performance evaluation data based on results of the comparison of the player'"'"'s vocal performance with the reference performance; and

providing a first feedback indicative of the player'"'"'s vocal performance of the musical composition based on the performance evaluation data.

31. The method of claim 30, wherein an orientation of a respective note tube shows the player how to bend the corresponding note.

32. The method of claim 30, further comprising:

displaying lyrics of the musical composition on the first portion, wherein each lyric syllable lines up vertically with a corresponding note tube displayed on the first portion.

33. The method of claim 30, further comprising:

displaying the note tubes in a manner indicative of relative pitch of the note tubes using a set of horizontal lines on the first portion.

34. A tangible computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:

displaying graphical representations of music notes of a musical composition on a first portion of a music video game, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein a respective note tube visually transforms as it passes through the fixed position on the first portion;

comparing the player'"'"'s vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

generating performance evaluation data based on results of the comparison of the player'"'"'s vocal performance with the reference performance; and

providing a first feedback indicative of the player'"'"'s vocal performance of the musical composition based on the performance evaluation data.

35. The computer readable storage medium of claim 34, wherein an orientation of a respective note tube shows the player how to bend the corresponding note.

36. The computer readable storage medium of claim 34, further comprising instructions for:

displaying lyrics of the musical composition on the first portion, wherein each lyric syllable lines up vertically with a corresponding note tube displayed on the first portion.

37. The computer readable storage medium of claim 34, further comprising instructions for:

displaying the note tubes in a manner indicative of relative pitch of the note tubes using a set of horizontal lines on the first portion.

38. A music video game apparatus, comprising:

a first portion of an in-game interface, the first portion configured for displaying graphical representations of music notes of a musical composition, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein an orientation of a respective note tube shows the player how to bend the corresponding note;

a compare module configured to compare the player'"'"'s rhythm and pitch in a vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

a performance evaluation module coupled to the compare module and configured to generate performance evaluation data based on results of the comparison of the player'"'"'s vocal performance with the reference performance; and

a second portion of the in-game interface, the second portion including a first feedback display mechanism coupled to the performance evaluation module and configured to provide a first feedback indicative of the player'"'"'s rhythm and pitch in the vocal performance of the musical composition based on the performance evaluation data.

39. A music video game apparatus, comprising:

a background portion of an in-game interface, the background portion configured to generate an animated representation of a player of the music video game and a virtual audience;

a performance feedback interface configured to display graphical representations of music notes of a musical composition, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes , each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein an orientation of a respective note tube shows the player how to bend the corresponding note;

a compare module configured to compare the player'"'"'s vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

a performance evaluation module coupled to the compare module and configured to generate performance evaluation data for the player;

a first feedback mechanism disposed in the performance feedback interface and coupled to the performance evaluation module, the first feedback mechanism configured to provide a first feedback indicative of the player'"'"'s rhythm and pitch in the vocal performance of the musical composition based on the performance evaluation data; and

a second feedback mechanism disposed in the performance feedback interface and coupled to the performance evaluation module, the second feedback mechanism configured to provide a second feedback indicative of the reaction of the virtual audience to the player'"'"'s performance of the musical composition.

40. A music video game apparatus comprising:

a first portion of an in-game interface, the first portion configured for displaying graphical representations of music notes of a musical composition, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein an orientation of a respective note tube shows the player how to bend the corresponding note;

a compare module configured to compare the player'"'"'s vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

a performance evaluation module coupled to the compare module and configured to generate performance evaluation data based on results of the comparison of the player'"'"'s vocal performance with the reference performance; and

a second portion of the in-game interface, the second portion including a first feedback display mechanism coupled to the performance evaluation module and configured to provide a first feedback indicative of the player'"'"'s vocal performance of the musical composition based on the performance evaluation data.

41. A computer-implemented method comprising:

displaying graphical representations of music notes of a musical composition on a first portion of a music video game, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein an orientation of a respective note tube shows the player how to bend the corresponding note;

comparing the player'"'"'s vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

generating performance evaluation data based on results of the comparison of the player'"'"'s vocal performance with the reference performance; and

providing a first feedback indicative of the player'"'"'s vocal performance of the musical composition based on the performance evaluation data.

42. A tangible computer readable storage medium storing one or more programs configured for execution by a computer, the one or more programs comprising instructions for:

displaying graphical representations of music notes of a musical composition on a first portion of a music video game, wherein the graphical representations of the music notes include note tubes that travel towards a fixed position on the first portion in an order of performance of the music notes, each note tube having a position and width indicative of a start time and indicative of how long the note should be held by a player, wherein an orientation of a respective note tube shows the player how to bend the corresponding note;

comparing the player'"'"'s vocal performance of the musical composition with a reference performance of the musical composition provided by the music video game;

generating performance evaluation data based on results of the comparison of the player'"'"'s vocal performance with the reference performance; and

providing a first feedback indicative of the player'"'"'s vocal performance of the musical composition based on the performance evaluation data.