Method and system for making and playing soundtracks

• US 10,140,082 B2
• Filed: 08/13/2015
• Issued: 11/27/2018
• Est. Priority Date: 07/04/2008
• Status: Active Grant

• Current Assignee: Booktrack Holdings Limited
• Original Assignee: Booktrack Holdings Limited
• Inventors: Cameron, Mark Steven, Cameron, Paul Charles
• Primary Examiner(s): Patel, Hemant S
• Application Number:
  US14/825,379
• Publication Number:
  US 20150347084A1
• Time in Patent Office: 1,202 Days
• Field of Search: 700 94, 704272-278
• CPC Class Codes: G05B 15/02 electric
• CPC Class Codes: G06F 16/435 Filtering based on additional data, e.g. user or group profiles
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 16/639 using playlists
• CPC Class Codes: G06F 16/951 Indexing; Web crawling techniques
• CPC Class Codes: G06F 3/16 Sound input; Sound output speech processing G10L
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G09B 5/04 with audible presentation of the material to be studied sound recording or reproducing G11B
• CPC Class Codes: G10L 13/00 Speech synthesis; Text to speech systems
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: G11B 27/36 Monitoring, i.e. supervising the progress of recording or reproducing for digital recording G11B20/00 and s.gr.; for monitoring, testing or measuring of TV recorders of the type covered by H04N5/76 and subgroups, see H04N17/06

Abstract

A composite variable duration soundtrack for a user to play while reading a text source, the soundtrack duration being defined by a soundtrack timeline. The soundtrack comprises multiple sound layers configured to play concurrently through the soundtrack timeline, each sound layer having an arrangement of one or more audio features that are configured to play at preset start times in the soundtrack timeline. At least one sound layer is adapted for modifying the preset start and stop times of its audio features to match the reading speed of a user based on a reading speed input.

Claims

1. A soundtrack playback system for playback of a digital variable duration soundtrack for a reader to play while reading an associated text source or while listening to an audiobook of the text source, the soundtrack having a soundtrack timeline with a variable duration that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed or listening speed of the audiobook, and at least one sound layer comprising an arrangement of audio features that are configured to play at respective preset start positions in the soundtrack timeline, and wherein the playback timing of at least some audio features is timed to synchronise with events occurring in the text source as it is read by the reader or listened to via the audiobook by providing variable preset start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook, the system comprising:

a processor configured to process a soundtrack data file or files representing the soundtrack, each audio feature in the soundtrack comprising data representing the following configured audio properties;

a preset start position in the soundtrack timeline that determines when the audio feature starts playing in the soundtrack timeline; and

an audio file to be associated for playback with each audio feature,

and wherein the processor is configured to co-ordinate playback of the audio features of the soundtrack and generate a soundtrack audio output signal;

an audio output system that is configured to receive and convert the soundtrack audio output signal into audible sound;

memory accessible by the processor and which is configured to store the soundtrack data file or files;

an output display operated by the processor;

a user interface comprising an operable graphical user interface displayed on the output display and which is operable by a user to interact with modules of the system; and

a reading speed module that is configured to receive a reading speed input and which modifies the playback timing of any audio features of the soundtrack that have variable preset start positions based on the received reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook.

2. A soundtrack playback system according to claim 1 wherein the reading speed module is configured to receive the reading speed input from the user via the graphical user interface.

3. A soundtrack playback system according to claim 1 wherein the reading speed module is configured to automatically calculate and update the reading speed input based on signals representing the navigation of the user through the text source.

4. A soundtrack playback system according to claim 3 wherein the text source is electronic text displayed on the output display and the reading speed module is configured to automatically calculate and update the reading speed input based on sensed scrolling or navigation through the electronic text by the reader.

5. A soundtrack playback system according to claim 1 wherein the reading speed module is operable to receive or calculate an updated reading speed input during playback of the soundtrack, and wherein the reading speed module is configured to modify the playback timing of any audio features of the un-played portion of the soundtrack that have variable preset start positions based on the updated reading speed input.

6. A soundtrack playback system according to claim 1 wherein the system further comprises a navigation module that is operable by a reader, via the graphical user interface, to update their playback position of the soundtrack within the soundtrack timeline to synchronise the soundtrack playback with their reading position in the text source.

7. A soundtrack playback system according to claim 6 wherein the text source is electronic text displayed on the output display and the navigation module is configured to sense scrolling or navigation through the electronic text by the reader and automatically update the playback position of the soundtrack within the soundtrack timeline to synchronise the soundtrack playback with their reading position in the electronic text.

8. A soundtrack playback system according to claim 6 wherein the navigation module is configured to control playback transition effects associated with the audio features of the soundtrack based on signals representing user initiated transitioning from one position in the soundtrack timeline to another position.

9. A soundtrack playback system according to claim 8 wherein the signals representing user initiated transitioning from one position in the soundtrack timeline to another position are generated by the system in response to the user operation of the navigation module to alter their playback position within the soundtrack timeline.

10. A soundtrack playback according to claim 1 wherein the system further comprises a navigation module that is operable to update the reader'"'"'s playback position of the soundtrack within the soundtrack timeline to synchronise the soundtrack playback with the reader'"'"'s reading position in the text source, and wherein the system is connected to a remote device that is operable by the reader to generate signals for the navigation module to alter their playback position within the soundtrack timeline.

11. A soundtrack playback system according to claim 1 further comprising a soundtrack modification module that is operable by a user to modify one or more audio features of the soundtrack prior to playback.

12. A soundtrack playback system according to claim 11 wherein the soundtrack modification module is operable by a user to insert new audio features into the soundtrack timeline and/or replace existing audio features in the soundtrack timeline with audio files from a music library, database, website, network, and/or internet accessible by the system.

13. A soundtrack playback system according to claim 11 wherein the soundtrack modification module is operable to automatically replace one or more audio features in the soundtrack timeline with audio features comprising audio files from the user'"'"'s personal music library, database, website, network, and/or internet based on selection criteria.

14. A soundtrack playback system according to claim 13 wherein the selection criteria is based on popularity, genre, beat, tempo, pitch and/or mood of the audio files.

15. A soundtrack playback system according to claim 13 wherein the selection criteria comprises the type of activity occurring in a scene of the text source corresponding to which the audio feature is synchronised with.

16. A soundtrack playback system according to claim 11 wherein the soundtrack comprises a plurality of sound layers configured to play concurrently through the soundtrack timeline, each sound layer having an arrangement of one or more audio features, and wherein the soundtrack modification module is operable by a user to deselect one or more sound layers of the soundtrack such that audio features of those deselected sound layers are muted during playback of the soundtrack.

17. A soundtrack playback system according to claim 1 wherein the system comprises any one of:

a personal computer, desktop, laptop, PDA, mobile phone, e-book system, or portable audio player.

18. A soundtrack playback system according to claim 1 wherein the system is provided on a website platform accessible over the internet.

19. A soundtrack playback system according to claim 1 wherein the system comprises an e-book system and the text source is an e-book displayed on the output display of the e-book system.

20. A soundtrack playback system according to claim 1 wherein the text source is online text viewable on the output display.

21. A soundtrack playback system according to claim 1 wherein the soundtrack data file or files comprise the audio files associated with the audio features of the soundtrack, and wherein the processor is configured to retrieve the audio files from the soundtrack data file or files when co-ordinating playback of the audio features of the soundtrack.

22. A soundtrack playback system according to claim 1 wherein the each audio feature of the soundtrack comprises data indicative of a link or file path information to its associated audio file, and wherein the processor is configured to retrieve the audio files from a network database or other storage medium accessible by the system based on the link or file path information of each audio feature when co-ordinating playback of the audio features of the soundtrack.

23. A method of playing a digital variable duration soundtrack to a reader while the reader is reading an associated text source or while listening to an audiobook of the text source, the method being executable on a system comprising a processor, memory, output display, an audio output device or devices, and an operable graphical user interface displayed on the output display, the method comprising the steps of:

(a) loading a soundtrack into memory, the soundtrack having a soundtrack timeline with a variable duration that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed or listening speed of the audiobook, and at least one sound layer comprising an arrangement of audio features that are configured to play at respective preset start positions in the soundtrack timeline, and wherein the playback timing of at least some audio features is timed to synchronise with events occurring in the text source as it is read by the reader or listened to via the audiobook by providing variable preset start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed or listening speed of the audiobook of the reader;

(b) receiving a reading speed input indicative of the reader'"'"'s expected text reading speed or listening speed of the audiobook;

(c) receiving a navigation input indicative of the user'"'"'s reading or listening position within the text source; and

(d) co-ordinating playback of the audio features of the soundtrack over the audio output device or devices based on the reading speed input and navigation input.

24. A method according to claim 23 wherein step (b) comprises receiving a reading speed input from the user.

25. A method according to claim 23 wherein the soundtrack playback system comprises an e-book system and the text source is an e-book displayed on the output display of the e-book system, and wherein step (b) comprises receiving a reading speed input from the e-book system that is automatically calculated by the e-book system.

26. A method according to claim 23 wherein the soundtrack playback system is implemented on a website platform accessible over the internet.

27. A method according to claim 23 wherein the text source is online text viewable on the output display.

28. A method according to claim 23 wherein step (b) comprises receiving the reading speed input prior to commencing soundtrack playback.

29. A method according to claim 23 wherein step (b) further comprises receiving an updated reading speed input during soundtrack playback, and then co-ordinating the playback of the audio features of the un-played portion of the remaining soundtrack based on the updated reading speed input.

30. A method according to claim 23 wherein step (d) comprises modifying the variable preset start positions of audio features in the soundtrack timeline based on the reading speed input.

31. A non-transitory computer-readable medium having stored thereon computer-executable instructions that, when executed on a processing device, cause the processing device to perform a method of playing a digital variable duration soundtrack to a reader while the reader is reading an associated text source or while listening to an audiobook of the text source, the method comprising the steps of:

(a) loading a soundtrack into memory, the soundtrack having a soundtrack timeline with a variable duration that is dynamically adjustable to be shortened or lengthened based on a reading speed input representing the reader'"'"'s text reading speed or listening speed of the audiobook, and at least one sound layer comprising an arrangement of audio features that are configured to play at respective preset start positions in the soundtrack timeline, and wherein the playback timing of at least some audio features is timed to synchronise with events occurring in the text source as it is read by the reader or listened to via the audiobook by providing variable preset start positions that are dependent on the reading speed input such that the playback timing of such audio features is matched to the text reading speed of the reader or listening speed of the audiobook;

(b) receiving a reading speed input indicative of the reader'"'"'s expected text reading speed or listening speed of the audiobook;

(c) receiving a navigation input indicative of the user'"'"'s reading or listening position within the text source; and

(d) co-ordinating playback of the audio features of the soundtrack based on the reading speed input and navigation input.