Method and system for making and playing soundtracks

• US 10,095,466 B2
• Filed: 08/13/2015
• Issued: 10/09/2018
• Est. Priority Date: 07/04/2008
• Status: Active Grant

• Current Assignee: Booktrack Holdings Limited
• Original Assignee: Booktrack Holdings Limited
• Inventors: Cameron, Mark Steven, Cameron, Paul Charles
• Primary Examiner(s): Patel, Hemant
• Application Number:
  US14/825,371
• Publication Number:
  US 20150347083A1
• Time in Patent Office: 1,153 Days
• Field of Search: 700 94
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/36 Monitoring, i.e. supervising the progress of recording or reproducing for digital recording G11B20/00 and s.gr.; for monitoring, testing or measuring of TV recorders of the type covered by H04N5/76 and subgroups, see H04N17/06

Abstract

A composite variable duration soundtrack for a user to play while reading a text source, the soundtrack duration being defined by a soundtrack timeline. The soundtrack comprises multiple sound layers configured to play concurrently through the soundtrack timeline, each sound layer having an arrangement of one or more audio features that are configured to play at preset start times in the soundtrack timeline. At least one sound layer is adapted for modifying the preset start and stop times of its audio features to match the reading speed of a user based on a reading speed input.

Claims

1. A soundtrack production system for producing a digital variable duration soundtrack for a reader to play while reading an associated text source or while listening to an audiobook of the text source, the soundtrack having a soundtrack timeline with a variable duration that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed or listening speed of the audiobook, and at least one sound layer comprising an arrangement of audio features that are configured to play at respective preset start positions in the soundtrack timeline, and wherein the playback timing of at least some audio features is timed to synchronise with events occurring in the text source as it is read by the reader or listened to via the audiobook by providing variable preset start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook, the system comprising:

a processor configured to operate the modules of the system;

memory accessible by the processor and which is configured to store soundtrack data relating to the soundtrack production;

an output display operated by the processor;

a user interface comprising an operable graphical user interface displayed on the output display and which is operable by a user to interact with modules of the system;

a database of audio files that is accessible by a user and wherein the audio files of the database are selectable as audio features in the soundtrack timeline of the soundtrack;

an audio features configuration module that is operable by a user to create and arrange each audio feature of the soundtrack by configuring and storing as soundtrack data in memory the following audio properties for each audio feature created;

a preset start position in the soundtrack timeline that determines when the audio feature starts playing in the soundtrack timeline; and

an audio file selected from the database to be associated for playback with each audio feature, wherein the audio features configuration module is further operable by a user to configure an audio feature to have a variable preset start position that is dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook; and

a soundtrack compiler that is operable by a user to compile and output the configured soundtrack data into a soundtrack data file or files for playback,

wherein the audio features configuration module is further operable by a user to configure one or more playback effects associated with the playback of each audio feature, and wherein the playback effects comprise any one or more of the following;

volume, fade in/out effects, looping effects, and transition effects; and

wherein the transition effect configured for an audio feature determines the playback of the remaining portion of the audio feature if it is playing when a reader or listener initiates a transition from one position in the soundtrack timeline to another position, the transition effect including any one or more of the following;

continue playing, stop playing, fade-out, or loop.

2. A soundtrack production system according to claim 1 wherein the audio features configuration module is further operable by a user to configure a preset stop position for each audio feature, the preset stop position determining when the audio feature stops playing in the soundtrack timeline, and wherein the audio features configuration module is further operable by a user to configure the preset stop position of an audio feature as being a variable preset stop position such that it is dependent on the reading speed input representing the user'"'"'s text reading speed or listening speed of the audiobook.

3. A soundtrack production system according to claim 1 wherein the audio features configuration module is further operable by a user to associate each audio feature with a respective text chunk of the text source, such that the audio feature is played during the reading of that text chunk by the reader or listening to that text chunk in the audiobook by the listener.

4. A soundtrack production system according to claim 1 wherein the database of audio files is integral to the soundtrack production system, or wherein the database of audio files is an audio file library accessible over a network.

5. A soundtrack production system according to claim 1 further comprising a module that is operable by a user to select or input a reading speed input that is indicative of the reader'"'"'s text reading speed or listening speed of the audiobook, and wherein the system alters the preset start positions of audio features having variable preset start positions based on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook.

6. A soundtrack production system according to claim 1 wherein the soundtrack compiler is operable by a user to compile and output a soundtrack data file or files comprising the configured soundtrack data in combination with the selected audio files associated with the audio features of the soundtrack, or wherein the soundtrack compiler is operable by a user to compile and output a soundtrack data file or files comprising the configured soundtrack data, and wherein the soundtrack data comprises linking or file path information for retrieving the audio files associated with each audio feature of the soundtrack from the database for soundtrack playback.

7. A soundtrack production system according to claim 1 wherein the system further comprises an automatic function in the audio features configuration module that is configured to automatically select audio files for playback from the database for one or more of the audio features.

8. A soundtrack production system according to claim 7 wherein the automatic function is configured to select an audio file for an audio feature based on any one or more of popularity, genre, beat, tempo, pitch and/or mood of the audio files, or wherein the automatic function is configured to select an audio file for an audio feature based on the type of activity occurring in a scene of the text source corresponding to which the audio feature is synchronised with.

9. A soundtrack production system for producing a digital variable duration soundtrack for a reader to play while reading an associated text source or while listening to an audiobook of the text source, the soundtrack having a soundtrack timeline with a variable duration that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed or listening speed of the audiobook, and at least one sound layer comprising an arrangement of audio features that are configured to play at respective preset start positions in the soundtrack timeline, and wherein the playback timing of at least some audio features is timed to synchronise with events occurring in the text source as it is read by the reader or listened to via the audiobook by providing variable preset start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook, the system comprising:

a processor configured to operate the modules of the system;

memory accessible by the processor and which is configured to store soundtrack data relating to the soundtrack production;

an output display operated by the processor;

a user interface comprising an operable graphical user interface displayed on the output display and which is operable by a user to interact with modules of the system;

a database of audio files that is accessible by a user and wherein the audio files of the database are selectable as audio features in the soundtrack timeline of the soundtrack;

an audio features configuration module that is operable by a user to create and arrange each audio feature of the soundtrack by configuring and storing as soundtrack data in memory the following audio properties for each audio feature created;

a preset start position in the soundtrack timeline that determines when the audio feature starts playing in the soundtrack timeline; and

an audio file selected from the database to be associated for playback with each audio feature, wherein the audio features configuration module is further operable by a user to configure an audio feature to have a variable preset start position that is dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook; and

a soundtrack compiler that is operable by a user to compile and output the configured soundtrack data into a soundtrack data file or files for playback, and

wherein the audio features configuration module is configured to display on the output display a graphical view of the soundtrack being created, including graphical representations of the audio features at their respective preset start positions in the soundtrack timeline, and wherein the audio features configuration module is operable by a user to create a new audio feature in the soundtrack by indicating on the graphical view of the soundtrack, via the user interface, the desired start position along the soundtrack timeline at which the new audio feature is to start playing.

10. A soundtrack production system according to claim 9 wherein the audio features configuration module is configured to automatically configure the preset start position of the newly created audio feature to correspond with the desired start position indicated by the user, via the user interface, on the displayed graphical view of the soundtrack being created.

11. A soundtrack production system according to claim 9 wherein the audio features configuration module is further operable by a user to configure a preset stop position for each audio feature, the preset stop position determining when the audio feature stops playing in the soundtrack timeline, and wherein the audio features configuration module is further operable by a user to configure the preset stop position of an audio feature as being a variable preset stop position such that it is dependent on the reading speed input representing the user'"'"'s text reading speed or listening speed of the audiobook.

12. A soundtrack production system according to claim 9 wherein the audio features configuration module is further operable by a user to associate each audio feature with a respective text chunk of the text source, such that the audio feature is played during the reading of that text chunk by the reader or listening to that text chunk in the audiobook by the listener.

13. A soundtrack production system according to claim 9 wherein the database of audio files is integral to the soundtrack production system, or wherein the database of audio files is an audio file library accessible over a network.

14. A soundtrack production system according to claim 9 further comprising a module that is operable by a user to select or input a reading speed input that is indicative of the reader'"'"'s text reading speed or listening speed of the audiobook, and wherein the system alters the preset start positions of audio features having variable preset start positions based on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook.

15. A soundtrack production system according to claim 9 wherein the soundtrack compiler is operable by a user to compile and output a soundtrack data file or files comprising the configured soundtrack data in combination with the selected audio files associated with the audio features of the soundtrack, or wherein the soundtrack compiler is operable by a user to compile and output a soundtrack data file or files comprising the configured soundtrack data, and wherein the soundtrack data comprises linking or file path information for retrieving the audio files associated with each audio feature of the soundtrack from the database for soundtrack playback.

16. A soundtrack production system according to claim 9 wherein the system further comprises an automatic function in the audio features configuration module that is configured to automatically select audio files for playback from the database for one or more of the audio features, and wherein the automatic function is configured to select an audio file for an audio feature based on any one or more of popularity, genre, beat, tempo, pitch and/or mood of the audio files, or wherein the automatic function is configured to select an audio file for an audio feature based on the type of activity occurring in a scene of the text source corresponding to which the audio feature is synchronised with.

17. A soundtrack production system for producing a digital variable duration soundtrack for a reader to play while reading an associated text source or while listening to an audiobook of the text source, the soundtrack having a soundtrack timeline with a variable duration that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed or listening speed of the audiobook, and at least one sound layer comprising an arrangement of audio features that are configured to play at respective preset start positions in the soundtrack timeline, and wherein the playback timing of at least some audio features is timed to synchronise with events occurring in the text source as it is read by the reader or listened to via the audiobook by providing variable preset start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook, the system comprising:

a processor configured to operate the modules of the system;

memory accessible by the processor and which is configured to store soundtrack data relating to the soundtrack production;

an output display operated by the processor;

a user interface comprising an operable graphical user interface displayed on the output display and which is operable by a user to interact with modules of the system;

a database of audio files that is accessible by a user and wherein the audio files of the database are selectable as audio features in the soundtrack timeline of the soundtrack;

an audio features configuration module that is operable by a user to create and arrange each audio feature of the soundtrack by configuring and storing as soundtrack data in memory the following audio properties for each audio feature created;

a preset start position in the soundtrack timeline that determines when the audio feature starts playing in the soundtrack timeline; and

an audio file selected from the database to be associated for playback with each audio feature, wherein the audio features configuration module is further operable by a user to configure an audio feature to have a variable preset start position that is dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook; and

a soundtrack compiler that is operable by a user to compile and output the configured soundtrack data into a soundtrack data file or files for playback,

wherein the soundtrack further comprises a plurality of sound layers configured to play concurrently through the soundtrack timeline, each sound layer having an arrangement of one or more audio features, and the system further comprising a soundtrack layer configuration module that is operable by a user to configure the number of sound layers in the soundtrack.

18. A soundtrack production system according to claim 17 wherein the audio features configuration module is further operable by a user to configure a preset stop position for each audio feature, the preset stop position determining when the audio feature stops playing in the soundtrack timeline.

19. A soundtrack production system according to claim 18 wherein the audio features configuration module is further operable by a user to configure the preset stop position of an audio feature as being a variable preset stop position such that it is dependent on the reading speed input representing the user'"'"'s text reading speed or listening speed of the audiobook.

20. A soundtrack production system according to claim 17 wherein the audio features configuration module is further operable by a user to associate each audio feature with a respective text chunk of the text source, such that the audio feature is played during the reading of that text chunk by the reader or listening to that text chunk in the audiobook by the listener.

21. A soundtrack production system according to claim 17 wherein the soundtrack configuration module is further operable by a user to add or delete sound layers to the soundtrack.

22. A soundtrack production system according to claim 17 wherein the database of audio files is integral to the soundtrack production system, or wherein the database of audio files is an audio file library accessible over a network.

23. A soundtrack production system according to claim 17 further comprising playback controls that are operable by a user, via the user interface, to control playback of the soundtrack being created over an audio output device or devices connected to the system, for testing of the soundtrack being created.

24. A soundtrack production system according to claim 17 further comprising a module that is operable by a user to select or input a reading speed input that is indicative of the reader'"'"'s text reading speed or listening speed of the audiobook, and wherein the system alters the preset start positions of audio features having variable preset start positions based on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook.

25. A soundtrack production system according to claim 17 wherein the soundtrack compiler is operable by a user to compile and output a soundtrack data file or files comprising the configured soundtrack data in combination with the selected audio files associated with the audio features of the soundtrack, or wherein the soundtrack compiler is operable by a user to compile and output a soundtrack data file or files comprising the configured soundtrack data, and wherein the soundtrack data comprises linking or file path information for retrieving the audio files associated with each audio feature of the soundtrack from the database for soundtrack playback.

26. A soundtrack production system according to claim 17 wherein the system further comprises an automatic function in the audio features configuration module that is configured to automatically select audio files for playback from the database for one or more of the audio features.

27. A soundtrack production system according to claim 26 wherein the automatic function is configured to select an audio file for an audio feature based on any one or more of popularity, genre, beat, tempo, pitch and/or mood of the audio files.

28. A soundtrack production system according to claim 26 wherein the automatic function is configured to select an audio file for an audio feature based on the type of activity occurring in a scene of the text source corresponding to which the audio feature is synchronised with.

29. A soundtrack production system according to claim 17 wherein the system comprises any one of:

a personal computer, desktop, laptop, PDA, mobile phone, e-book system, or portable audio player, or wherein the system is provided on a website platform accessible over the internet.