Interactive gamepad device and game providing means of learning musical pieces and songs

• US 20040137984A1
• Filed: 01/09/2003
• Published: 07/15/2004
• Est. Priority Date: 01/09/2003
• Status: Abandoned Application

• Current Assignee: Allegro Multimedia, Inc.
• Original Assignee: Allegro Multimedia, Inc.
• Inventors: Salter, Hal C.
• Application Number:
  US10/338,959
• Publication Number:
  US 20040137984A1
• Time in Patent Office: Days
• US Class Current: 463/35
• CPC Class Codes: A63F 13/10 Control of the course of the game, e.g. start, progess, end
• CPC Class Codes: A63F 13/245 specially adapted to a particular type of game, e.g. steering wheels
• CPC Class Codes: A63F 13/42 by mapping the input signals into game commands, e.g. mapping the displacement of a stylus on a touch screen to the steering angle of a virtual vehicle
• CPC Class Codes: A63F 13/44 involving timing of operations, e.g. performing an action within a time slot
• CPC Class Codes: A63F 13/45 Controlling the progress of the video game
• CPC Class Codes: A63F 13/533 for prompting the player, e.g. by displaying a game menu
• CPC Class Codes: A63F 13/577 using determination of contact between game characters or objects, e.g. to avoid collision between virtual racing cars
• CPC Class Codes: A63F 13/63 by the player, e.g. authoring using a level editor
• CPC Class Codes: A63F 13/65 automatically by game devices or servers from real world data, e.g. measurement in live racing competition
• CPC Class Codes: A63F 13/79 involving player-related data, e.g. identities, accounts, preferences or play histories
• CPC Class Codes: A63F 13/814 Musical performances, e.g. by evaluating the player's ability to follow a notation
• CPC Class Codes: A63F 2300/1062 being specially adapted to a type of game, e.g. steering wheel
• CPC Class Codes: A63F 2300/66 for rendering three dimensional images
• CPC Class Codes: A63F 2300/8047 Music games

Abstract

A process for interpreting MIDI files into a computer video game, which can be generated with software for a personal computer, a personal digital assistant, or similar device, or with a hardware component that interfaces directly with a TV and input gamepad. The object is to strike the appropriate tongue on the attached gamepad as a game object, displayed on a graphical user interface (GUI), touches a graphic representing the correct piano key on a virtual piano keyboard. MIDI files storing musical notation and other information generate unique game fields and objects, whereby game objects stream upward or downward toward a virtual piano keyboard. If streaming upwards, then the game objects and a field of play may morph into a musical staff turned vertically (ninety (90) degrees clockwise) to put the pitch axis parallel with the virtual piano keyboard layout with moving musical notation. The virtual piano keyboard and direction of streaming game objects are thus parallel to the player'"'"'s gamepad. The virtual piano keyboard graphic later rotates counter-clockwise ninety (90) degrees and morphs into moving standard musical notation. Game objects are spaced proportionate to the melodic, and rhythmic structure to facilitate interpretation of relative timing in game play, and move toward the virtual piano keyboard in tempo of music, allowing visual and audio anticipation and precise rhythmic play by the user. The game keeps track of hits and misses, generating a score and a musical map for review, and allows the game objects to be numbered for fingering clues.

Claims

1. An apparatus for providing musical instruction comprising:

a) a computing element;

b) a display connected to the computing element;

c) a gamepad connected to the computing element; and

d) software for execution on said computing element linking a virtual keyboard displayed on the display when the software is executed on the computing element with actions by a user of the gamepad as part of a game.

2. The apparatus of claim 1, in which the software translates notes of a musical piece into game objects on the display.

3. The apparatus of claim 2, in which the software comprises an interpreter for converting a representation of a musical piece into commands for generating game objects.

4. The apparatus of claim 3, in which commands for generating game objects drive a game object generator.

5. The apparatus of claim 4, in which the game object generator is associated with a library of game objects.

6. The apparatus of claim 5, in which the game object generator is associated with a set of parameters for setting properties of game objects.

7. The apparatus of claim 2, in which the game objects move with time from an initial launch position on the display toward keys of the virtual piano keyboard which correspond to notes of the musical piece.

8. The apparatus of claim 7, in which game objects move along pre-defined trajectories.

9. The apparatus of claim 1, in which the gamepad is in the general shape of a kalimba.

10. A method of using a computer, comprising the step of linking a gamepad connected to the computer with the action of game objects displayed on a display of the computer with respect to a virtual piano keyboard displayed on the display.

11. The method of claim 10, in which game objects are generated for notes of a musical piece stored in a computer readable format.

12. The method of claim 11, in which the musical piece of one of a library of musical pieces is stored on the computer.

13. The method of claim 10, in which the computer readable format is MDI.

14. The method of claim 10, in which a user receives a reward in the form of at least one of an audio playback, a video or graphical animation display or an award of points.

15. The method of claim 14, in which the reward is granted when a user depresses a key of the gamepad within a time window spanning an instant when a game object intersects with the corresponding key of a virtual keyboard.

16. The method of claim 15, in which at least one profile of user information is stored on the computer for each of a plurality of users.

17. The method of claim 15, in which the profile information may include a set of starting options.

18. The method of claim 15, in which a plurality of methods are available for selection by a user, each method comprising at least one song and a plurality of levels of difficulty for each song.

19. The method of claim 18, in which each level of difficulty comprises a plurality of songs and one or more challenges designed to advance skills in a respective area of competence.

20. A computer program product, comprising:

a) a storage medium;

b) a musical instrument;

c) a computer;

d) a display, electrically coupled to the computer; and

e) a computer program stored on the storage medium, the computer program comprising instructions for linking the musical instrument connected to the computer with action of game objects displayed on the display of the computer with respect to a virtual image representing the musical instrument displayed on the display.

21. The computer program product of claim 20, in which the computer program further comprises instructions for generating game objects for notes of a musical piece stored in a computer readable format.

22. The computer program product of claim 21, in which the computer program further comprises instructions for providing a user with a reward in the form of at least one of an audio playback, a video or graphical animation display or an award of points.

23. The computer program product of claim 22, in which the computer program further comprises instructions for granting the reward when a user strikes a key of the musical instrument within a time window spanning an instant when a game object intersects with the corresponding key of the virtual image representing the musical instrument.

24. The computer program product of claim 23, in which the musical instrument is in the general shape of a kalimba.

25. A method of instructing a user to read musical notation through interaction with a graphical user interface and a gamepad, comprising the steps of:

a) generating the graphical user interface, having a first position, including a virtual keyboard positioned substantially at a top portion of the interface, having a plurality of keys, each key having a corresponding tongue on the gamepad;

b) incorporating a music file into the graphical user interface, wherein the music file contains data corresponding to an arrangement of at least a first and a second musical note in sequence, having a rhythmic pattern;

c) directing a first game object, representing the first musical note in the arrangement, upward, in a first substantially straight trajectory, toward a first key on the virtual keyboard, corresponding to the first musical note, such that the first game object will experience a first collision with the first key of the virtual keyboard;

d) directing a second game object, representing the second musical note in the arrangement, upward, in a second substantially straight trajectory, toward a second key on the virtual keyboard, corresponding to the second musical note, such that the second game object will experience a second collision with the second key of the virtual keyboard, according to the rhythmic pattern of the arrangement; and

e) awarding a value to the user based upon the ability of the user to strike the corresponding tongue on the gamepad approximately simultaneously with the first and second collisions.

26. The method of instructing of claim 25, further comprising the steps of:

a) rotating the interface to a second position, approximately ninety (90) degrees counterclockwise, once a predetermined threshold of user performance has been met, such that the virtual keyboard is positioned substantially on a left side of the interface, and the first and second game objects move along the first and second substantially straight trajectories toward the virtual keyboard; and

b) introducing a series of visible staff lines defining spaces, where the lines and spaces correspond to the straight trajectories along which the game objects travel toward the virtual keyboard, such that the game objects travel along either the lines or the spaces, until colliding with the virtual keyboard at the corresponding key.

27. The method of claim 26, further comprising the step of morphing the game objects into classical musical notation.

28. The method of claim 25, in which the gamepad is in the general shape of a kalimba.

29. A method of instructing a user to read musical notation through interaction with a graphical user interface and a gamepad, comprising the steps of:

a) generating the graphical user interface, having a first position, including a virtual keyboard positioned substantially at a top portion of the interface, having a plurality of keys, each key having a corresponding tongue on the gamepad;

b) incorporating a music file into the graphical user interface, wherein the music file contains data corresponding to an arrangement of a plurality of musical notes in sequence, having a rhythmic pattern, each note being represented by a game object;

c) directing the game objects upward, in substantially straight trajectories, toward keys on the virtual keyboard corresponding to the musical notes;

d) colliding the game objects with the corresponding keys according to the rhythmic pattern of the arrangement;

e) awarding a value to the user based upon the ability of the user to strike the corresponding tongue on the gamepad approximately simultaneously with the collisions;

f) rotating the interface to a second position, approximately ninety (90) degrees counterclockwise, once a predetermined threshold of user performance has been met, such that the virtual keyboard is positioned substantially on a left side of the interface, and the game objects continue to move along the substantially straight trajectories toward the virtual keyboard.

30. The method of claim 29, further comprising the step of introducing a series of visible staff lines defining spaces, where the lines and spaces correspond to the straight trajectories along which the game objects travel toward the virtual piano keyboard, such that the game objects travel along either the lines or the spaces, until colliding with the virtual piano keyboard at the corresponding key.

31. A method of musical instruction comprising the step of converting a musical file into animated game objects for display on a screen.

32. The method of claim 31, in which the game objects flow upward on the screen.

33. The method of claim 32, further comprising the step of morphing game objects into musical notation.

34. The method of claim 33, in which trajectories for the game objects rotate between vertical and horizontal.

35. The method of claim 34, in which the game objects flow upward on the screen, morph into musical notation;

and rotate from vertical to horizontal.

36. The method of claim 35, in which the game objects are selectively colored.

37. An input gamepad device, which is color coordinated with the game objects and virtual target keyboard, designed to be played with the thumbs while the rest of the fingers hold the device, in the general shape of a kalimba.

38. An input gamepad device, which is color coordinated with the game objects and virtual target keyboard, and includes a built in monitor, CPU, and speakers, such as used in a personal digital game, designed to be played with the thumbs while the rest of the fingers hold the device, in the general shape of a kalimba.