Instrument game system and method

• US 8,907,193 B2
• Filed: 03/14/2011
• Issued: 12/09/2014
• Est. Priority Date: 02/20/2007
• Status: Active Grant

• Current Assignee: Ubisoft Entertainment S.A.
• Original Assignee: Ubisoft Entertainment S.A.
• Inventors: Cross, Paul, Bonardi, Nicholas, Higo, Naomi
• Primary Examiner(s): FLETCHER, MARLON T
• Application Number:
  US13/047,727
• Publication Number:
  US 20110207513A1
• Time in Patent Office: 1,366 Days
• US Class Current: 84/609
• CPC Class Codes: A63F 13/215 comprising means for detecting acoustic signals, e.g. using a microphone
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/44 involving timing of operations, e.g. performing an action within a time slot
• CPC Class Codes: A63F 13/46 Computing the game score
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/67 adaptively or by learning from player actions, e.g. skill level adjustment or by storing successful combat sequences for re-use
• CPC Class Codes: A63F 13/814 Musical performances, e.g. by evaluating the player's ability to follow a notation
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/6027 using adaptive systems learning from user actions, e.g. for skill level adjustment
• CPC Class Codes: A63F 2300/61 Score computation
• CPC Class Codes: A63F 2300/638 according to the timing of operation or a time limit
• CPC Class Codes: A63F 2300/8047 Music games
• CPC Class Codes: G10H 1/368 displaying animated or moving pictures synchronized with the music or audio part
• CPC Class Codes: G10H 1/38 Chord
• CPC Class Codes: G10H 2210/091 for performance evaluation, i.e. judging, grading or scoring the musical qualities or faithfulness of a performance, e.g. with respect to pitch, tempo or other timings of a reference performance
• CPC Class Codes: G10H 2220/015 Musical staff, tablature or score displays, e.g. for score reading during a performance. graphical musical score editing G10H2220/121; musical score displays resulting from a transcription G10H2210/086
• CPC Class Codes: G10H 2220/151 Musical difficulty level setting or selection

Abstract

A game system and method that uses an instrument as an input encourages a user to play along with the game'"'"'s soundtrack on an instrument (e.g. guitar, bass, etc.). The game cues the player to play notes and/or chords on the instrument at an appropriate time and then data is collected from the instrument via a connection between the instrument and the apparatus running the game. The game then scores the user based on note/chord and timing information it receives.

Claims

1. A non-transitory computer readable storage medium having a computer program stored thereon for instructing a user on playing a musical instrument, wherein the computer program instructs a processing element to perform the following steps:

present, on an electronic display, a graphical representation of a plurality of notes or chords of a song to be played on the musical instrument and by the user during a session,

wherein the session corresponds to a single playing of the song,

wherein each said note or chord is associated with a predetermined data file for the note or chord;

divide the song into a plurality of phrases, wherein each phrase includes at least one of said plurality of notes or chords;

assign at least a first difficulty level and at least a second difficulty level to each phrase;

advance, on the electronic display, the graphical representation of said plurality of notes or chords to present each of the plurality of phrases of the song so as to instruct playing, on the musical instrument and by the user, the song,

wherein at least one of said plurality of phrases is presented on the electronic display at said first difficulty level;

receive an output corresponding to an electronic signal for each of said plurality of notes or chords produced by the musical instrument as played by the user;

compare the received output against said predetermined data file for each of said plurality of notes or chords produced by the musical instrument as played by the user;

for each phrase including at least one note or chord of said plurality of notes or chords, determine an accuracy of play, by the user, of the phrase,

wherein the accuracy of play is at least in part based on said step of comparing the received output against said predetermined data file,

wherein the accuracy of play is determined in real time as the user plays the at least one note or chord of each phrase of the song during the session; and

upon the accuracy of play being above a predetermined threshold for said at least one of said plurality of phrases, automatically adjust the advanced graphical representation of the presented at least one of said plurality of phrases from the first difficulty level to the second difficulty level,

wherein the automatic adjustment of the presented at least one of said plurality of phrases from the first difficulty level to the second difficulty level is performed during the session.

2. The computer readable storage medium of claim 1, wherein the first difficulty level is an initial difficulty level that represents a simplest abbreviation of a phrase.

3. The computer readable storage medium of claim 1, wherein the first difficulty level is based on an average difficulty level of all successfully completed phrases previously played by the user in the single session of the song.

4. The computer readable storage medium of claim 1, wherein the first difficulty level is based on a difficulty level attained by the user during a previous playing of the song in a prior session.

5. The computer readable storage medium of claim 1, wherein the first and second difficulty levels are based on a skill level of the user.

6. The computer readable storage medium of claim 1, wherein each of said plurality of phrases further includes a third difficulty level for the phrase that can be presented during the session.

7. The computer readable storage medium of claim 1, wherein the predetermined data file for each said note or chord includes note tag information and tag time information.

8. The computer readable storage medium of claim 1,

wherein the session begins when the graphical representation of said plurality of notes or chords of the song is presented on the electronic display, and

wherein the session ends when the advancement of the plurality of notes or chords of the song on the electronic display is completed.

9. A method for instructing a user on playing a musical instrument comprising the steps of:

presenting, by at least one processing element and on an electronic display, a graphical representation of a plurality of notes or chords of a song to be played on the musical instrument and by the user during a session,

wherein the session corresponds to a single playing of the song,

wherein each said note or chord is associated with a predetermined data file for the note or chord;

dividing, by at least one processing element, the song into a plurality of phrases, wherein each phrase includes at least one of said plurality of notes or chords;

assigning, by at least one processing element, at least a first difficulty level and at least a second difficulty level to each phrase;

advancing, by at least one processing element and on the electronic display, the graphical representation of said plurality of notes or chords to present each of the plurality of phrases of the song so as to instruct playing, on the musical instrument and by the user, the song,

wherein at least one of said plurality of phrases is presented on the electronic display at said first difficulty level;

receiving, by at least one processing element, an output corresponding to an electronic signal for each of said plurality of notes or chords produced by the musical instrument as played by the user;

comparing, by at least one processing element, the received output against said predetermined data file for each of said plurality of notes or chords produced by the musical instrument as played by the user;

for each phrase including at least one note or chord of said plurality of notes or chords, determining, by at least one processing element, an accuracy of play, by the user, of the phrase,

wherein the accuracy of play is at least in part based on said step of comparing the received output against said predetermined data file,

wherein the accuracy of play is determined in real time as the user plays the at least one note or chord of each phrase of the song during the session; and

upon the accuracy of play being above a predetermined threshold for said at least one of said plurality of phrases, automatically adjusting, by at least one processing element, the advanced graphical representation of the presented at least one of said plurality of phrases from the first difficulty level to the second difficulty level,

wherein the automatic adjustment of the presented at least one of said plurality of phrases from the first difficulty level to the second difficulty level is performed during the session.

10. The method of claim 9, wherein the first difficulty level is an initial difficulty level that represents a simplest abbreviation of a phrase.

11. The method of claim 9, wherein the first difficulty level is based on an average difficulty level of all successfully completed phrases previously played by the user in the single session of the song.

12. The method of claim 9, wherein the first difficulty level is based on a difficulty level attained by the user during a previous playing of the song in a prior session.

13. The method of claim 9, wherein the first and second difficulty levels are based on a skill level of the user.

14. The method of claim 9, wherein each of said plurality of phrases further includes a third difficulty level for the phrase that can be presented during the session.

15. The method of claim 9, wherein the predetermined data file for each said note or chord includes note tag information and tag time information.

16. The method of claim 9,

wherein the session begins when the graphical representation of said plurality of notes or chords of the song is presented on the electronic display, and

wherein the session ends when the advancement of the plurality of notes or chords of the song on the electronic display is completed.

17. A system for instructing a user on playing a musical instrument comprising:

a processing element; and

a memory element associated with a non-transitory computer readable storage medium,

wherein the non-transitory computer readable storage medium has a computer program stored thereon,

wherein the computer program instructs the processing element to perform the following steps;

present, on an electronic display, a graphical representation of a plurality of notes or chords of a song to be played on the musical instrument and by the user during a session,

wherein the session corresponds to a single playing of the song,

wherein each said note or chord is associated with a predetermined data file for the note or chord;

divide the song into a plurality of phrases, wherein each phrase includes at least one of said plurality of notes or chords;

assign at least a first difficulty level and at least a second difficulty level to each phrase;

advance, on the electronic display, the graphical representation of said plurality of notes or chords to present each of the plurality of phrases of the song so as to instruct playing, on the musical instrument and by the user, the song,

wherein at least one of said plurality of phrases is presented on the electronic display at said first difficulty level;

receive an output corresponding to an electronic signal for each of said plurality of notes or chords produced by the musical instrument as played by the user;

compare the received output against said predetermined data file for each of said plurality of notes or chords produced by the musical instrument as played by the user;

for each phrase including at least one note or chord of said plurality of notes or chords, determine an accuracy of play, by the user, of the phrase,

wherein the accuracy of play is at least in part based on said step of comparing the received output against said predetermined data file,

wherein the accuracy of play is determined in real time as the user plays the at least one note or chord of each phrase of the song during the session; and

upon the accuracy of play being above a predetermined threshold for said at least one of said plurality of phrases, automatically adjust the advanced graphical representation of the presented at least one of said plurality of phrases from the first difficulty level to the second difficulty level,

wherein the automatic adjustment of the presented at least one of said plurality of phrases from the first difficulty level to the second difficulty level is performed during the session.

18. The system of claim 17, wherein the first difficulty level is selected from the group consisting of (1) an initial difficulty level that represents a simplest abbreviation of a phrase;

(2) an average difficulty level of all successfully completed phrases previously played by the user in the single session of the song; and

(3) a difficulty level attained by the user during a previous playing of the song in a prior session.

19. The system of claim 17, wherein the predetermined data file for each said note or chord includes note tag information and tag time information.

20. The system of claim 17,

wherein the session begins when the graphical representation of said plurality of notes or chords of the song is presented on the electronic display, and

wherein the session ends when the advancement of the plurality of notes or chords of the song on the electronic display is completed.