Method and system for making and playing soundtracks

• US 10,255,028 B2
• Filed: 08/12/2015
• Issued: 04/09/2019
• Est. Priority Date: 07/04/2008
• Status: Active Grant

• Current Assignee: Booktrack Holdings Limited
• Original Assignee: Booktrack Holdings Limited
• Inventors: Cameron, Mark Steven, Cameron, Paul Charles
• Primary Examiner(s): King, Simon
• Application Number:
  US14/824,589
• Publication Number:
  US 20150348532A1
• Time in Patent Office: 1,336 Days
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/36 Monitoring, i.e. supervising the progress of recording or reproducing for digital recording G11B20/00 and s.gr.; for monitoring, testing or measuring of TV recorders of the type covered by H04N5/76 and subgroups, see H04N17/06

Abstract

A composite variable duration soundtrack for a user to play while reading a text source, the soundtrack duration being defined by a soundtrack timeline. The soundtrack comprises multiple sound layers configured to play concurrently through the soundtrack timeline, each sound layer having an arrangement of one or more audio features that are configured to play at preset start times in the soundtrack timeline. At least one sound layer is adapted for modifying the preset start and stop times of its audio features to match the reading speed of a user based on a reading speed input.

Claims

1. A digital composite soundtrack for an associated text source, the soundtrack being recorded on a non-transient tangible medium readable by a processor and the soundtrack comprising:

a voice sound layer comprising an oral reading of the text source for playback; and

a synchronised soundtrack comprising a soundtrack timeline, and at least one sound layer having an arrangement of audio features that are configured to play at respective start positions in the soundtrack timeline to correspond to respective portions of the text source such that the playback timing of the audio features is synchronised with the oral reading of the text source of the voice sound layer, and

wherein the soundtrack is configured such that the or each sound layer of the synchronised soundtrack of the composite soundtrack is selectively mutable during playback.

2. A digital composite soundtrack for an associated text source according to claim 1 wherein the text source is a book and the oral reading of the voice sound layer of the composite soundtrack is an audiobook.

3. A digital composite soundtrack for an associated text source according to claim 1 wherein the volume of the voice sound layer of the composite soundtrack is configured to decrease over time during playback.

4. A digital composite soundtrack for an associated text source according to claim 1 wherein the composite soundtrack is for a reader to play while reading the associated text source, and wherein the synchronised soundtrack of the composite soundtrack is a variable duration soundtrack that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed such that the playback timing of such audio features is matched to the text reading speed of the reader.

5. A digital composite soundtrack for an associated text source according to claim 4 wherein the playback timing of at least some audio features of the synchronised soundtrack of the composite soundtrack is timed to synchronise with events occurring in the text source as it is read by the reader by providing variable start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader.

6. A digital composite soundtrack for an associated text source according to claim 4 wherein the playback speed of the voice sound layer of the composite soundtrack is the same as the reading speed input associated with the synchronized soundtrack of the composite soundtrack.

7. A digital composite soundtrack for an associated text source according to claim 4 wherein the playback speed of the voice sound layer of the composite soundtrack is adjustable to match the reading speed input associated with the synchronized soundtrack of the composite soundtrack.

8. A digital composite soundtrack for an associated text source according to claim 4 wherein the reading speed input associated with the synchronized soundtrack of the composite soundtrack is adjustable to match the playback speed of the voice sound layer of the composite soundtrack.

9. A digital composite soundtrack for an associated text source according to claim 1 wherein the synchronised soundtrack of the composite soundtrack comprises a plurality of sound layers configured to play concurrently through the soundtrack timeline, each sound layer having an arrangement of one or more audio features.

10. A digital composite soundtrack for an associated text source according to claim 9 wherein the synchronised soundtrack of the composite soundtrack comprises a music layer comprising one or more audio features corresponding to background music, a background layer comprising one or more audio features corresponding to scene related sound, and an effects layer comprising one or more audio features corresponding to sound effects timed to play with events occurring in the text source as it is read by a reader.

11. A digital composite soundtrack for an associate text source according to claim 1 wherein the voice sound layer is configured for playback at an oral reading speed determined by an adjustable oral reading speed input, and wherein the synchronised soundtrack is a variable duration soundtrack comprising a soundtrack timeline that is dynamically adjustable to be shortened or lengthened based on the oral reading speed input such that the playback timing of the audio features in the at least one sound layer of the soundtrack is synchronised with the oral reading of the text source in the voice sound layer.

12. A method of producing a composite soundtrack for an associated text source, the soundtrack comprising:

a voice sound layer comprising an oral reading of the text source; and

a synchronised soundtrack comprising a soundtrack timeline, and at least one sound layer having an arrangement of audio features that are configured to play at respective start positions in the soundtrack timeline to correspond to respective portions of the text source such that the playback timing of the audio features is synchronised with the oral reading of the text source of the voice sound layer, and wherein the soundtrack is configured such that the or each sound layer of the synchronised soundtrack of the composite soundtrack is selectively mutable during playback, the method being executable on a system comprising a processor and memory, and the method comprising the steps of;

(a) receiving and storing as soundtrack data a voice sound layer comprising an oral reading of the text source;

(b) receiving or generating configuration data for creating each audio feature of the synchronised soundtrack of the composite soundtrack and storing that configuration data as soundtrack data in memory, the configuration data for each audio feature comprising;

a start position in the soundtrack timeline that determines when the audio feature starts playing in the soundtrack timeline; and

an audio file selected from a database accessible to the system to be associated for playback with each audio feature;

(c) configuring the or each sound layer of the synchronised soundtrack of the composite soundtrack to be selectively mutable during playback; and

(d) compiling and outputting the configured soundtrack data into a soundtrack data file or files for playback.

13. A method according to claim 12 wherein the text source is a book and the oral reading of the voice sound layer of the composite soundtrack is an audiobook.

14. A method according to claim 12 further comprising configuring the volume of the voice sound layer of the composite soundtrack is configured to decrease over time during playback.

15. A method according to claim 12 wherein the synchronised soundtrack of the composite soundtrack is for a reader to play while reading the associated text source, and wherein the synchronised soundtrack is a variable duration soundtrack that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed, wherein the playback timing of at least some audio features is timed to synchronise with events occurring in the text source as it is read by the reader by providing variable start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader, the method further comprising configuring the playback speed of the voice sound layer of the composite soundtrack to be adjustable to match the reading speed input associated with the synchronized soundtrack.

16. A method according to claim 12 wherein the synchronised soundtrack of the composite soundtrack is for a reader to play while reading the associated text source, and wherein the synchronised soundtrack is a variable duration soundtrack that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed, wherein the playback timing of at least some audio features is timed to synchronise with events occurring in the text source as it is read by the reader by providing variable start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader, the method further comprising configuring the reading speed input associated with the synchronised soundtrack to be adjustable to match the playback speed of the voice sound layer of the composite soundtrack.

17. A method according to claim 12 wherein step (b) further comprises automatically selecting audio files for playback from the database for at least some of the audio features based on one or more characteristics of the respective portions of the text source to which the audio features are synchronised with.

18. A method according to claim 17 wherein automatically selecting audio files for playback from the database for at least some of the audio features comprises automatically selecting an audio file for an audio feature based on the mood or type of activity occurring in the portion of the text source to which the audio feature is synchronised with.

19. A method according to claim 17 wherein automatically selecting audio files for playback from the database for at least some of the audio features comprises automatically selecting an audio file for an audio feature based on the event occurring in the portion of the text source to which the audio feature is synchronised with.

20. A method according to claim 17 wherein automatically selecting audio files for playback from the database for at least some of the audio features comprises automatically selecting an audio file for an audio feature based on any one or more of the following:

popularity, genre, beat, tempo, and/or pitch of the audio files.

21. A method of producing a composite soundtrack for an associated text source according to claim 12 wherein the voice sound layer is configured for playback at an oral reading speed determined by an adjustable oral reading speed input, and wherein the synchronised soundtrack is a variable duration soundtrack comprising a soundtrack timeline that is dynamically adjustable to be shortened or lengthened based on the oral reading speed input such that the playback timing of the audio features in the at least one sound layer of the soundtrack is synchronised with the oral reading of the text source in the voice sound layer.

22. A soundtrack playback system for playback of a digital composite soundtrack for an associated text source, the soundtrack comprising a voice sound layer comprising an oral reading of the text source;

and a synchronised soundtrack comprising a soundtrack timeline, and at least one sound layer having an arrangement of audio features that are configured to play at respective start positions in the soundtrack timeline to correspond to respective portions of the text source such that the playback timing of the audio features is synchronised with the oral reading of the text source of the voice sound layer, and wherein the soundtrack is configured such that the or each sound layer of the synchronised soundtrack of the composite soundtrack is selectively mutable during playback, the system comprising;

a processor configured to process a soundtrack data file or files representing the composite soundtrack, each audio feature in the synchronised soundtrack of the composite soundtrack comprising data representing the following configured audio properties;

a start position in the soundtrack timeline that determines when the audio feature starts playing in the soundtrack timeline; and

an audio file to be associated for playback with each audio feature,

and wherein the processor is configured to co-ordinate playback of the voice sound layer of the composite soundtrack and the at least one layer of the synchronised soundtrack of the composite soundtrack and generate a soundtrack audio output signal;

an audio output system that is configured to receive and convert the soundtrack audio output signal into audible sound;

memory accessible by the processor and which is configured to store the soundtrack data file or files;

an output display operated by the processor;

a user interface comprising an operable graphical user interface displayed on the output display and which is operable by a user to interact with modules of the system; and

a soundtrack modification module that is operable by a user to selectively mute one or more sound layers of the synchronised soundtrack of the composite soundtrack during playback.

23. A soundtrack playback system according to claim 22 wherein the text source is a book and the oral reading of the voice sound layer of the composite soundtrack is an audiobook.

24. A soundtrack playback system according to claim 22 wherein the composite soundtrack is for a reader to play while reading the associated text source, and wherein the synchronised soundtrack of the composite soundtrack is a variable duration soundtrack that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed, the system further comprising a reading speed module that is configured to receive a reading speed input and which modifies the playback timing of any audio features of the synchronised soundtrack of the composite soundtrack based on the received reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader.

25. A soundtrack playback system according to claim 24 wherein the system is configured to adjust the playback speed of the voice sound layer of the composite soundtrack to match the reading speed input associated with the synchronized soundtrack of the composite soundtrack.

26. A soundtrack playback system according to claim 24 wherein the system is configured to adjust the reading speed input associated with the synchronized soundtrack of the composite soundtrack to match the playback speed of the voice sound layer of the composite soundtrack.

27. A soundtrack playback system for playback of a digital composite soundtrack for an associated text source according to claim 22 wherein the voice sound layer is configured for playback at an oral reading speed determined by an adjustable oral reading speed input, and wherein the synchronised soundtrack is a variable duration soundtrack comprising a soundtrack timeline that is dynamically adjustable to be shortened or lengthened based on the oral reading speed input such that the playback timing of the audio features in the at least one sound layer of the soundtrack is synchronised with the oral reading of the text source in the voice sound layer.