System and method for synchronization of data and audio

• US 10,430,151 B1
• Filed: 03/14/2016
• Issued: 10/01/2019
• Est. Priority Date: 08/28/2014
• Status: Active Grant

• Current Assignee: Sonic Bloom, LLC
• Original Assignee: Sonic Bloom, LLC
• Inventors: Robinson, Eric D.
• Primary Examiner(s): Brahmachari, Mandrita
• Application Number:
  US15/069,862
• Time in Patent Office: 1,296 Days
• CPC Class Codes: A63F 13/44 involving timing of operations, e.g. performing an action within a time slot
• CPC Class Codes: A63F 13/54 involving acoustic signals, e.g. for simulating revolutions per minute [RPM] dependent engine sounds in a driving game or reverberation against a virtual wall
• CPC Class Codes: A63F 13/55 Controlling game characters or game objects based on the game progress
• CPC Class Codes: A63F 13/814 Musical performances, e.g. by evaluating the player's ability to follow a notation
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel

Abstract

The present disclosure relates to a method for synchronization of audio data, such as music, with events that occur in interactive media, such as computer games. In particular, a user can define choreography data that an interactive computer application can use to synchronize to audio, such as music, one or more aspects of the application, such as the GUI, animations, rendering, sound effects, etc.

Claims

1. A method of using an interactive media application, comprising:

receiving choreography data, the choreography data comprising at least one event, and at least one payload corresponding to the at least one event;

playing a media file via a media module, the choreography data including a unique identifier associated with the media file and being distinct from the media file;

monitoring, via a choreographer module, a position of the media file, the choreography module being distinct from the media module;

comparing, via a processor, the monitored position of the media file to at least one event start position corresponding to the at least one event;

delivering, via the choreography module, the payload when both (a) the at least one event start position is less than the monitored position of the media file and (b) an event end position is greater than or equal to a previously monitored position of the media file, wherein the payload is processed in an offset manner corresponding to an event position that it offset over a range of time.

2. The method of claim 1, wherein the monitored position comprises a range of time corresponding to a frame of the interactive media.

3. The method of claim 2, wherein the at least one event comprises a plurality of events and the at least one payload comprises a plurality of payloads.

4. The method of claim 3, wherein the plurality of events each have event start positions that fall within the range of time.

5. The method of claim 1, wherein the range of time corresponds to a frame of interactive media.

6. A method of using an interactive media application, comprising:

receiving choreography data, the choreography data comprising at least one event;

playing a media file via a media module, the media file being distinct from the choreography data;

monitoring, via a choreographer module, a position of the media file, the choreography module being distinct from the media module;

comparing, via a processor, the monitored position of the media file to at least one event start position corresponding to the at least one event;

delivering, via the choreography module, a message when both (a) the at least one event start position is less than the monitored position of the media file and (b) an event end position is greater than or equal to a previously monitored position of the media file, wherein the message is processed in an offset manner corresponding to an event position that is offset over a range of time.

7. The method of claim 6, wherein the monitored position comprises a range of time corresponding to a frame of the interactive media.

8. The method of claim 7, wherein the at least one event comprises a plurality of events and the at least one message comprises a plurality of messages.

9. The method of claim 8, wherein the plurality of events each have event start positions that fall within the range of time.

10. The method of claim 6, wherein the range of time corresponds to a frame of interactive media.

11. A system for using an interactive media application, comprising:

a memory having computer executable instructions stored thereon;

one or more processors that when executing the instructions are configured to,

receive choreography data, the choreography data comprising at least one event, and at least one payload corresponding to the at least one event;

play a media file via a media module, the choreography data including a unique identifier associated with the media file and being distinct from the media file;

monitor, via a choreographer module, a position of the media file, the choreography module being distinct from the media module;

compare the monitored position of the media file to at least one event start position corresponding to the at least one event;

deliver, via the choreography module, the payload when both (a) the at least one event start position is less than the monitored position of the media file and (b) an event end position is greater than or equal to a previously monitored position of the media file, wherein the payload is processed in an offset manner corresponding to an event position that is offset over a range of time.

12. The system of claim 11, wherein the monitored position comprises a range of time corresponding to a frame of the interactive media.

13. The system of claim 12, wherein the at least one event comprises a plurality of events and the at least one payload comprises a plurality of payloads.

14. The system of claim 13, wherein the plurality of events each have event start positions that fall within the range of time.

15. The system of claim 11, wherein the range of time corresponds to a frame of interactive media.

16. A system for using an interactive media application, comprising:

a memory having computer executable instructions stored thereon;

one or more processors that when executing the instructions are configured to,

receive choreography data, the choreography data comprising at least one event;

play a media file via a media module, the media file being distinct from the choreography data;

monitor, via a choreographer module, a position of the media file, the choreography module being distinct from the media module;

compare the monitored position of the media file to at least one event start position corresponding to the at least one event;

deliver, via the choreography module, a message when both (a) the at least one event start position is less than the monitored position of the media file and (b) an event end position is greater than or equal to a previously monitored position of the media file, wherein the message is processed in an offset manner corresponding to an event position that is offset over a range of time.

17. The system of claim 16, wherein the monitored position comprises a range of time corresponding to a frame of the interactive media.

18. The system of claim 17, wherein the at least one event comprises a plurality of events and the at least one message comprises a plurality of messages.

19. The system of claim 18, wherein the plurality of events each have event start positions that fall within the range of time.

20. The system of claim 18, wherein the range of time corresponds to a frame of interactive media.