Interactive device with sound-based action synchronization

• US 8,715,031 B2
• Filed: 08/06/2009
• Issued: 05/06/2014
• Est. Priority Date: 08/06/2009
• Status: Active Grant

• Current Assignee: Peter Sui Lun Fong
• Original Assignee: Peter Sui Lun Fong
• Inventors: Fong, Peter Sui Lun, Zhu, Xi-Song, Fong, Kelvin Yat-Kit
• Primary Examiner(s): Brewster, William
• Assistant Examiner(s): RADA, ALEX P
• Application Number:
  US12/536,690
• Publication Number:
  US 20110034103A1
• Time in Patent Office: 1,734 Days
• Field of Search: 463/1, 463/7, 463 30- 31, 463 40- 43, 434/118, 434/307.R, 446/175, 446/297, 446/484
• US Class Current: 446/175
• CPC Class Codes: A63F 2300/6045 for mapping control signals received from the input arrangement into game commands
• CPC Class Codes: A63F 2300/6072 of an input signal, e.g. pitch and rhythm extraction, voice recognition
• CPC Class Codes: A63F 2300/6607 for animating game characters, e.g. skeleton kinematics
• CPC Class Codes: A63F 2300/8094 Unusual game types, e.g. virtual cooking
• CPC Class Codes: A63H 2200/00 Computerized interactive toys, e.g. dolls
• CPC Class Codes: A63H 3/28 Arrangements of sound-producing means in dolls; Means in dolls for producing sounds

Abstract

An interactive amusement device and a method therefor are disclosed. The device plays a musical soundtrack in a first game iteration corresponding to a learning mode. A sequence of user input actions received during this learning mode is detected, and timestamps for each is stored into memory. In a second game iteration corresponding to a playback mode, the musical soundtrack is replayed. Additionally, an output signal is generated on at least one interval of the user input actions based on the stored timestamps, and is coordinated with the replaying of the musical soundtrack.

Claims

1. A method for interactive amusement comprising:

playing a musical soundtrack continuously and uninterrupted in a first game iteration corresponding to a learning mode;

detecting a sequence of user input actions received during the learning mode;

storing into memory timestamps of each of the detected sequence of user input actions, each of the timestamps designating a time instant at which the respective user input action was detected relative to the playing of the musical soundtrack in the learning mode and corresponding to one of a plurality of time intervals uniformly segmented over an entire length of the musical soundtrack;

replaying the musical soundtrack continuously and uninterrupted in a second game iteration corresponding to a playback mode; and

generating in the playback mode an output audio signal on at least one interval of the received sequence of user input actions as designated by the recorded timestamps, the output audio signal being generated at substantially the same time instant relative to the replaying of the musical soundtrack in the playback mode as when the respective one of the user input actions was detected during the playing of the musical soundtrack in the learning mode as designated by the timestamp therefor.

2. The method of claim 1, wherein the sequence of user input actions is detected from received sound signals.

3. The method of claim 2, further comprising:

deriving user input action types from the received sound signals;

wherein the output audio signal is generated from a one of a plurality of predefined sound signals corresponding to a particular one of the derived user input action types.

4. The method of claim 3, wherein the user input action type is based upon a characteristic selected from a group consisting of:

the length of the sound signal, the frequency of the sound signal, and the amplitude of the sound signal.

5. The method of claim 2, wherein the user input actions correspond to hand claps.

6. The method of claim 1, wherein the output audio signal is generated from predefined sound signals stored in the memory.

7. The method of claim 1, further comprising:

generating an audible instructional command prior to playing the musical soundtrack in the first game iteration.

8. The method of claim 1, further comprising:

activating on at least one interval of the received sequence of user input actions a mechanical actuator coupled to a movable element.

9. The method of claim 1, further comprising:

generating on a display device an animation coordinated with the received sequence of user input actions.

10. The method of claim 1, wherein playing the musical soundtrack includes:

retrieving a digital representation of the musical soundtrack from a memory; and

generating an audio signal of the musical soundtrack from the digital representation.

11. The method of claim 10 wherein the retrieved digital representation of a musical soundtrack is chosen from a plurality of digital representations of musical soundtracks stored in the memory.

12. The method of claim 11 wherein the retrieved digital representation of a musical soundtrack is chosen by an association with a user input action.

13. The method of claim 1, wherein the timestamps are derived from timer values generated by a programmable data processor.

14. The method of claim 1, wherein the timestamps are derived from instruction cycle count values generated by a programmable data processor.

15. A method for interactive amusement comprising:

playing a background multimedia sequence continuously and uninterrupted in a first game iteration corresponding to a learning mode;

detecting a sequence of sound-based user input actions received during the learning mode based upon external sound signals;

deriving user input action types from the external sound signals for each of the sound-based user input actions based upon an evaluation of signal characteristics including at least one of signal length, signal frequency, and signal amplitude;

storing into memory timestamps of each of the detected sequence of sound-based user input actions, each of the timestamps designating a time instant at which the respective sound-based user input action was detected relative to the playing of the background multimedia sequence in the learning mode and corresponding to one of a plurality of time intervals uniformly segmented over an entire length of the background multimedia sequence;

replaying the background multimedia sequence continuously and uninterrupted in a second game iteration corresponding to a playback mode; and

generating in the playback mode an output signal on at least one interval of the received sequence of sound-based user input actions as designated by the recorded timestamps, the output signal being generated at substantially the same time instant relative to the replaying of the background multimedia sequence in the playback mode as when the respective one of the sound-based user input actions was detected during the playing of the background multimedia sequence in the learning mode as designated by the timestamp therefor, the output signal being generated from a one of a plurality of predefined signals corresponding to a particular one of the derived user input action types.

16. The method of claim 15, wherein the user input actions correspond to hand claps.

17. The method of claim 15, wherein the output signal is generated from predefined signals stored in the memory.

18. The method of claim 15, further comprising:

generating an audible instructional command prior to playing the background multimedia sequence in the first game iteration.

19. The method of claim 15, further comprising:

activating on at least one interval of the received sequence of sound-based user input actions a mechanical actuator coupled to a movable element.

20. The method of claim 15, further comprising:

generating on a display device an animation coordinated with the received sequence of sound-based user input actions.

21. The method of claim 15, wherein playing the background multimedia sequence includes:

retrieving a digital representation of the background multimedia sequence from a memory; and

generating an audio signal of the background multimedia sequence from the digital representation.

22. The method of claim 21 wherein the retrieved digital representation of a background multimedia sequence is chosen from a plurality of digital representations of background multimedia sequences stored in the memory.

23. The method of claim 21 wherein the retrieved digital representation of a background multimedia sequence is chosen by an association with a sound-based user input action.

24. The method of claim 15, wherein the timestamps are derived from timer values generated by a programmable data processor.

25. The method of claim 15, wherein the timestamps are derived from instruction cycle count values generated by a programmable data processor.

26. A method for interactive amusement comprising:

playing a graphical output continuously and uninterrupted in a first game iteration corresponding to a learning mode;

detecting a sequence of user input actions received during the learning mode;

storing into memory timestamps of each of the detected sequence of user input actions, each of the timestamps designating a time instant at which the respective user input action was detected relative to the playing of the graphical output in the learning mode and corresponding to one of a plurality of time intervals uniformly segmented over an entire length of the graphical output;

replaying the graphical output in a second game iteration corresponding to a playback mode; and

generating in the playback mode an output signal on at least one interval of the received sequence of user input actions based upon the recorded timestamps, the output signal being coordinated with the replaying of the graphical output,

generating in the playback mode an output signal on at least one interval of the received sequence of user input actions as designated by the recorded timestamps, the output signal being generated at substantially the same time instant relative to the replaying of the graphical output in the playback mode as when the respective one of the user input actions was detected during the playing of the graphical output in the learning mode as designated by the timestamp therefor.

27. The method of claim 26, wherein the sequence of user input action s detected from received signals.

28. The method of claim 27, further comprising:

deriving user input action types from the received signals;

wherein the output signal is generated from a one of a plurality of predefined signals corresponding to a particular one of the derived user input action types.

29. The method of claim 28, wherein the user input action type is based upon a characteristic of the received signals selected from a group consisting of:

the length of the signal, the frequency of the signal, and the amplitude of the signal.

30. The method of claim 26, wherein the user input actions correspond to hand claps.

31. The method of claim 26, wherein the output signal is generated from predefined signals stored in the memory.

32. The method of claim 26, further comprising:

generating at least one of an audible or a visual instructional command prior to playing the graphical output in the first game iteration.

33. The method of claim 26, further comprising:

activating on at least one interval of the received sequence of user input actions a mechanical actuator coupled to a movable element.

34. The method of claim 26, wherein playing the graphical output includes:

retrieving a digital representation of the graphical output from a memory; and

generating a visualization of the graphical output from the digital representation.

35. The method of claim 34, wherein the retrieved digital representation of a graphical output is chosen from a plurality of digital representations of graphical outputs stored in the memory.

36. The method of claim 35, wherein the retrieved digital representation of a graphical output is chosen by an association with a user input action.

37. The method of claim 26, wherein the timestamps are derived from one of timer values and instruction cycle count values generated by a programmable data processor.