DELIVERY OF SYNCHRONISED SOUNDTRACKS FOR ELECTRONIC MEDIA CONTENT

• US 20150025663A1
• Filed: 07/16/2014
• Published: 01/22/2015
• Est. Priority Date: 07/17/2013
• Status: Active Grant

• Current Assignee: Booktrack Holdings Limited
• Original Assignee: Booktrack Holdings Limited
• Inventors: Cameron, Paul Charles, Cameron, Mark Steven, Wilson, Craig Andrew, Buer, Mark Anthony
• Granted Patent: US 9,836,271 B2
• Time in Patent Office: Days
• US Class Current: 700/94
• CPC Class Codes: G06F 16/685 using automatically derived transcript of audio data, e.g. lyrics speech recognition G10L15/00
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier
• CPC Class Codes: H04L 65/60 Network streaming of media packets
• CPC Class Codes: H04N 21/2335 involving reformatting operations of audio signals, e.g. by converting from one coding standard to another details of audio signal transcoding G10L19/173
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/44218 Detecting physical presence or behaviour of the user, e.g. using sensors to detect if the user is leaving the room or changes his face expression during a TV program methods or arrangements for recognising human body or animal bodies or body parts G06V40/10; methods or arrangements for acquiring or recognising human faces, facial parts, facial sketches, facial expressions G06V40/16; methods or arrangements for recognising movements or behaviour G06V40/20; arrangements for identifying users in broadcast systems H04H60/45
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 21/81 Monomedia components thereof
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/858 Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot

Abstract

A method and system for streaming a soundtrack from a server to a remote user device for a reader of electronic media content. The soundtrack is defined by multiple audio regions. Each audio region defined by an audio track for playback in the audio region, a start position in the electronic media content corresponding to where the playback of the audio region is to begin, and a stop position in the electronic media content corresponding to where the playback of the audio region is to cease. The streaming of the soundtrack is based on control data generated by the remote user device.

Claims

1. A method of streaming a compiled soundtrack to a remote user device for a reader of electronic media content, the soundtrack defined by multiple audio regions, each audio region defined by:

an audio track for playback in the audio region, a start position in the electronic media content corresponding to where the playback of the audio region is to begin, and a stop position in the electronic media content corresponding to where the playback of the audio region is to cease, the method comprising;

receiving from a remote user device over a network control data indicative of the user'"'"'s reading speed; and

streaming a compiled soundtrack to the user device over the network based on the received control data.

2. The method according to claim 1 wherein the compiled soundtrack is a pre-compiled soundtrack and is selected from a range of pre-compiled soundtracks that have been pre-compiled at different reading speeds.

3. The method according to claim 2 wherein the method further comprises selecting the pre-compiled soundtrack for streaming having an associated reading speed that most closely matches the control data indicative of the user'"'"'s reading speed.

4. The method according to claim 1 wherein the compiled soundtrack is a real-time compiled soundtrack and the method further comprises compiling the soundtrack in real-time based on the control data indicative of the user'"'"'s reading speed.

5. The method according to claim 4 wherein the soundtrack is compiled progressively and the method comprises streaming the compiled portion of the soundtrack while the remaining portion is being compiled.

6. The method according to claim 1 wherein the method further comprises receiving control data from the remote user device indicative of the user'"'"'s desired commencement reading position and commencing streaming of the compiled soundtrack to the user device at a data position within the compiled soundtrack that corresponds to the user'"'"'s desired commencement reading position.

7. The method according to claim 6 wherein the data position is at the start of the compiled soundtrack or at an offset position within the compiled soundtrack.

8. The method according to claim 1 wherein the method further comprises receiving control data from the remote user device indicative of a change in reading position of the user to a new reading position in the electronic media content, and modifying the streaming of the compiled soundtrack based on the received control data.

9. The method according to claim 8 wherein modifying the streaming of the compiled soundtrack comprises adjusting the streaming of the compiled soundtrack to a new data position within the compiled soundtrack that corresponds to the new reading position.

10. The method according to claim 1 wherein the method further comprises receiving control data from the remote user device indicative of a change in reading speed of the user to a new user reading speed, and modifying the streaming of the compiled soundtrack based on the received control data.

11. The method according to claim 10 wherein the compiled soundtrack is a pre-compiled soundtrack, and wherein modifying the streaming of the compiled soundtrack based on a new user reading speed comprises selecting a new pre-compiled soundtrack having a reading speed that more closely matches the new user reading speed and commencing streaming of the new pre-compiled soundtrack.

12. The method according to claim 11 wherein the method further comprises initiating a transition protocol for transitioning the streaming from the current pre-compiled soundtrack to the new selected pre-compiled soundtrack.

13. The method according to claim 12 wherein the transition protocol comprises receiving control data from the remote user device indicative of the user'"'"'s current playback position in the streamed soundtrack and commencing streaming of the new selected pre-compiled soundtrack at a data position corresponding to the user'"'"'s current playback position.

14. The method according to claim 12 wherein the transition protocol comprises analyzing the remaining unstreamed portion of the current pre-compiled soundtrack and identifying a transition position based on transition criteria, and commencing streaming of the new selected pre-compiled soundtrack at a data position corresponding to the identified transition position.

15. The method according to claim 10 wherein the compiled soundtrack is a real-time compiled soundtrack, and wherein modifying the streaming of the compiled soundtrack based on a new user reading position comprises commencing compiling of the soundtrack at the new user reading speed and commencing streaming of the new compiled soundtrack.

16. The method according to claim 15 wherein the method further comprises initiating a transition protocol for transitioning the streaming from the current real-time compiled soundtrack to the new real-time compiled soundtrack.

17. The method according to claim 16 wherein the transition protocol comprises receiving control data from the remote user device indicative of the user'"'"'s current playback position in the streamed soundtrack and commencing streaming of the new real-time compiled soundtrack at a data position corresponding to the user'"'"'s current playback position.

18. The method according to claim 16 wherein the transition protocol comprises analyzing the remaining unstreamed portion of the current real-time compiled soundtrack and identifying a transition position based on transition criteria, and commencing streaming of the new real-time compiled soundtrack at a data position corresponding to the identified transition position.

19. The method according to claim 1 wherein the method comprises streaming the compiled soundtrack as a single digital audio file.

20. The method according to claim 1 wherein the method comprises streaming the compiled soundtrack as a plurality of digital audio files, for concurrent playback at the remote user device.

21. The method according to claim 20 wherein the audio regions of the soundtrack are categorised into different types and the compiled soundtrack is provided as separate audio files, each audio file comprising the audio regions associated with one type.

22. A soundtrack server for streaming a compiled soundtrack to a remote user device for a reader of electronic media content, the soundtrack defined by multiple audio regions, each audio region defined by:

an audio track for playback in the audio region, a start position in the electronic media content corresponding to where the playback of the audio region is to begin, and a stop position in the electronic media content corresponding to where the playback of the audio region is to cease, the soundtrack server being configured to;

receive from a remote user device over a network control data indicative of the user'"'"'s reading speed; and

stream a compiled soundtrack to the user device over the network based on the received control data.

23. A method of playing a compiled soundtrack on a user device for a reader of electronic media content, the soundtrack defined by multiple audio regions, each audio region defined by:

an audio track for playback in the audio region, a start position in the electronic media content corresponding to where the playback of the audio region is to begin, and a stop position in the electronic media content corresponding to where the playback of the audio region is to cease, the method comprising;

sending control data to a remote server over a network indicative of the user'"'"'s reading speed;

receiving an incoming stream of a compiled soundtrack from the remote server over the network, the compiled soundtrack having an associated reading speed that corresponds to the sent control data;

processing the streamed compiled soundtrack and commencing playback of the soundtrack on the user device.

24. A method of playing an uncompiled soundtrack on a user device for a reader of electronic media content, the soundtrack defined by multiple audio regions, each audio region defined by:

an audio track for playback in the audio region, a start position in the electronic media content corresponding to where the playback of the audio region is to begin, and a stop position in the electronic media content corresponding to where the playback of the audio region is to cease, the method comprising;

sending control data to a remote server over a network requesting a soundtrack for playback;

receiving a soundtrack data file from the remote serve in response to the sent control data, the soundtrack data file defining the audio regions of the soundtrack;

processing the soundtrack data file to determine at least the next audio region due for playback based on a user reading position variable indicative of the user'"'"'s reading position in the electronic media content;

sending periodic or arbitrary control data to one or more audio track file sources requesting at least the audio track file corresponding to the next audio region due for playback;

receiving and storing requested audio track files from the one or more audio track file sources in memory; and

co-ordinating playback of the stored audio track files as defined by their associated audio regions in the soundtrack data file based on the user reading position variable.

25. The method according to claim 24 wherein the soundtrack data file comprises source data indicative of the one or more audio track file sources to request each audio track file from.

26. The method according to claim 25 wherein the soundtrack data file defines a single audio track file source from which to request all the audio track files.

27. The method according to claim 25 wherein the soundtrack data file defines two or more different audio track file sources from which to request the audio track files.

28. The method according to claim 26 wherein the audio track file source is the remote server, and the method comprises requesting all audio track files from the remote server.

29. The method according to claim 27 wherein the audio track file sources comprise the remote server and one or more other audio track file sources, and the method comprises requesting the audio track files from the remote server or the one or more other audio track file sources based on the source data in the soundtrack data file.

30. The method according to claim 29 wherein some audio track files are sourced from the remote server, while other audio track files are sourced from one or more other audio track file sources.

31. The method according to claim 25 wherein the one or more audio track file sources are separate to the remote server, and the method comprises requesting all audio track files from the one or more separate audio track file sources such that all audio track files are sourced from somewhere other than the remote server.

32. The method according to claim 24 wherein the method comprises sending control data to the one or more audio track file sources requesting individual audio track files one by one.

33. The method according to claim 24 wherein the method comprises sending control data to the one or more audio track file sources comprising a single request for all audio track files associated with the audio regions of the soundtrack.

34. The method according to claim 24 wherein the method comprises sending control data to the one or more audio track file sources requesting batches of audio track files.

35. The method according to claim 24 wherein the method comprises maintaining a sliding download window relative to the user reading position variable, and sending control data to the one or more audio track file sources requesting all audio track files associated with audio regions falling within the sliding download window such that the all audio track files associated with audio regions in the sliding window are received and stored ready for future playback based on the user reading position variable.

36. The method according to claim 35 wherein size of the sliding download window is configurable.

37. The method according to claim 24 wherein the method further comprises deleting from memory the audio track files after their corresponding audio regions have completed playback either immediately or after a configurable predetermined delay.

38. The method according to claim 24 wherein the method further comprises analyzing the soundtrack data file for audio track files that are repeated in more than one audio region of the soundtrack, and tagging those audio track files as repeated audio tracks upon receipt and storage, and further retaining each such repeated audio tracks in memory until the last audio region associated with the audio track has completed playback.

39. A user device for playing an uncompiled soundtrack for a reader of electronic media content, the soundtrack defined by multiple audio regions, each audio region defined by:

an audio track for playback in the audio region, a start position in the electronic media content corresponding to where the playback of the audio region is to begin, and a stop position in the electronic media content corresponding to where the playback of the audio region is to cease, the user device comprising;

a user interface configured to receive user input to control the device;

an audio output system that is operable to generate audio output for the user to hear; and

a processor configured to;

send control data to a remote server over a network requesting a soundtrack for playback;

receive a soundtrack data file from the remote serve in response to the sent control data, the soundtrack data file defining the audio regions of the soundtrack;

process the soundtrack data file to determine at least the next audio region due for playback based on a user reading position variable indicative of the user'"'"'s reading position in the electronic media content;

send periodic or arbitrary control data to one or more audio track file sources requesting at least the audio track file corresponding to the next audio region due for playback;

receive and store requested audio track files from the one or more audio track file sources in memory on the user device; and

co-ordinate playback of the stored audio track files as defined by their associated audio regions in the soundtrack data file based on the user reading position variable.

40. A method of streaming an uncompiled soundtrack to a remote user device for a reader of electronic media content, the soundtrack defined by multiple audio regions, each audio region defined by:

an audio track for playback in the audio region, a start position in the electronic media content corresponding to where the playback of the audio region is to begin, and a stop position in the electronic media content corresponding to where the playback of the audio region is to cease, the method comprising;

sending a soundtrack data file to the remote user device over a network, the soundtrack data file comprising data defining the audio regions of the soundtrack;

receiving control data from the remote user device over the network requesting one or more audio track files corresponding to the audio regions of the soundtrack; and

sending one or more audio track files to the remote user device over the network in response to the received control data.