Soundtrack for electronic text

• US 9,613,653 B2
• Filed: 01/24/2014
• Issued: 04/04/2017
• Est. Priority Date: 07/26/2011
• Status: Active Grant

• Current Assignee: Booktrack Holdings Limited
• Original Assignee: Booktrack Holdings Limited
• Inventors: Davenport, Andrew Russell, McGrath, Paul Anthony, Cameron, Paul Charles, Cameron, Mark Steven, Zhang, Rui
• Primary Examiner(s): Saunders, Jr., Joseph
• Application Number:
  US14/163,225
• Publication Number:
  US 20140143642A1
• Time in Patent Office: 1,166 Days
• CPC Class Codes: G06F 3/0483 Interaction with page-structured environments, e.g. book metaphor
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G09B 5/06 with both visual and audible presentation of the material to be studied
• CPC Class Codes: G09B 5/065 Combinations of audio and video presentations, e.g. videotapes, videodiscs, television systems
• CPC Class Codes: G10L 21/10 Transforming into visible information
• CPC Class Codes: G11B 20/10527 Audio or video recording; Data buffering arrangements G11B20/12 - G11B20/18 take precedence
• CPC Class Codes: G11B 27/005 Reproducing at a different information rate from the information rate of recording for television signals H04N5/783
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/11 by using information not detectable on the record carrier

Abstract

A soundtrack creation method and user playback system for soundtracks synchronized to electronic text. Synchronization is achieved by maintaining a reading speed variable indicative of the user'"'"'s reading speed. The system provides for multiple channels of audio to enable concurrent playback of two or more partially or entirely overlapping audio regions so as to create an audio output having, for example, sound effects, ambience, music or other audio features that are triggered to playback at specific portions in the electronic text to enhance the reading experience.

Claims

1. A method for controlling the commencement of playback of a soundtrack for an electronic text, the soundtrack comprising multiple audio regions configured for playback during corresponding text regions of the electronic text based on a reading position counter corresponding to the estimated text position indicative of the word in the electronic text that a user is currently reading and which increments at a rate based at least partly on a configurable user reading speed variable representing the user'"'"'s reading speed, each audio region being defined by audio data comprising:

an audio track for playback in the audio region;

a start text position indicative of the word in the electronic text corresponding to where the playback of the audio track is to begin; and

a stop text position indicative of the word in the electronic text corresponding to where playback of the audio track is to cease, comprising;

receiving an arbitrary commencement text position indicative of any arbitrary word within the electronic text at which the soundtrack is to commence playback;

processing the audio data of the soundtrack to identify any one or more active audio regions within the soundtrack at that commencement text position by searching the audio data for audio regions in which the commencement text position falls between the start text position and stop text position of the audio regions;

calculating respective offset cue times relative to default start times for the audio tracks of any active audio regions based on the respective offset positions of the commencement text position relative to the start text positions of the audio regions and a configurable user reading speed variable indicative of the user'"'"'s reading speed; and

initiating playback of the audio tracks of any active audio regions at their respective calculated offset cue times to commence soundtrack playback.

2. A method according to claim 1 wherein the electronic text has a designated text index based on the number of words or characters in the electronic text and the start text position, stop text position, and commencement text position are represented by a start index value, a stop index value, and a commencement index value, respectively.

3. A method according to claim 2 wherein calculating respective offset cue times relative to default start times for audio tracks of any active audio regions comprises for each active audio region calculating a commencement offset value representing the difference between the commencement index value and start index value of the audio region, and then calculating the offset cue time for the audio region based on the commencement offset value and the user reading speed variable.

4. A method according to claim 1 wherein initiating playback comprises initiating playback of all active audio regions at the commencement text position simultaneously at their respective offset cue times.

5. A method according to claim 1 wherein receiving a commencement text position comprises sensing a user manual selection input of the commencement text position within the electronic text displayed on a display screen.

6. A method according to claim 5 wherein receiving a commencement text position comprises displaying the electronic text on a touch screen display and detecting a user manual selection input in the form of a touch input on the touch screen display in the vicinity of the word or character corresponding to the commencement text position.

7. A method according to claim 1 further comprising updating the value of the reading position counter to correspond to the received arbitrary commencement text position.

8. A method according to claim 1 wherein the default start time for each audio track is zero seconds.

9. A method according to claim 1 wherein initiating playback of the audio tracks of any active audio regions at their respective calculated offset cue times to commence soundtrack playback further comprises applying a volume fade-in over a configurable time period during playback initiation.

10. A system for displaying electronic text and controlling playback of a soundtrack synchronized to the reading speed of a user comprising:

a display configured to display the electronic text;

a user interface configured to receive user input to control the system;

an audio output system that is operable to generate audio output for the user to hear;

an electronic text display module configured to process electronic text data representing the electronic text and control display of the electronic text on the display in response to user input from the user interface;

a reading position module configured to generate a reading position counter corresponding to the estimated current text position indicative of the word in the electronic text that the user is currently reading, the reading position counter incrementing at a rate based at least partly on a configurable user reading speed variable representing the user'"'"'s reading speed; and

a soundtrack playback module configured to process soundtrack data representing the soundtrack to control playback of the soundtrack over the audio output system, the soundtrack data defining multiple audio regions for the soundtrack, each audio region being defined by audio data comprising;

an audio track for playback in the audio region;

a start text position indicative of the word in the electronic text corresponding to where the playback of the audio region is to begin; and

a stop text position indicative of the word in the electronic text corresponding to where the playback of the audio region is to cease;

and wherein the soundtrack playback module is configured to coordinate playback of the audio regions based on the reading position counter to synchronize playback of the audio regions of the soundtrack with the user'"'"'s reading of the electronic text, and

wherein the soundtrack playback module is further operable to commence playback of the soundtrack at any arbitrarily user-selected commencement text position indicative of any arbitrary word within the electronic text by;

processing the soundtrack data to identify any one or more active audio regions within the soundtrack at the arbitrarily user-selected commencement text position by searching the soundtrack data for any active audio regions in which the commencement text position falls between the start text position and stop text position of the audio regions; and

triggering each audio track of any one or more active audio regions at the user-selected commencement text position to playback at a respective offset cue time from the default start of the audio track that is calculated based on the respective offset position of the commencement text position relative to the start text position of the audio region and the user reading speed variable.

11. A system according to claim 10 wherein the electronic text has a designated text index based on the number of words or characters in the electronic text and the start text position, stop text position, and commencement text position are represented by a start index value, a stop index value, and a commencement index value, respectively.

12. A system according to claim 11 wherein the soundtrack playback module is configured to calculate the respective offset cue times relative to default start times for audio tracks of any active audio regions by for each active audio region calculating a commencement offset value representing the difference between the commencement index value and start index value of the audio region, and then calculating the offset cue time for the audio region based on the commencement offset value and the user reading speed variable.

13. A system according to claim 11 wherein the soundtrack playback module is configured to apply a volume fade-in over a configurable time period during commencement of the soundtrack at the commencement text position.

14. A system according to claim 10 wherein the soundtrack playback module is configured to commence playback of the soundtrack by initiating playback of all active audio regions at the commencement text position simultaneously at their respective offset cue times.

15. A system according to claim 10 wherein the soundtrack playback module is configured to receive data indicative of the user-selected commencement text position by sensing via the user interface a user manual selection input of the commencement text position within the electronic text displayed on the display.

16. A system according to claim 10 wherein the display and user interface comprises a touch screen display and the soundtrack playback module is configured to receive data indicative of the user-selected commencement text position by detecting a user manual selection input in the form of a touch input on the touch screen display in the vicinity of the word or character corresponding to the commencement text position.

17. A system according to claim 10 wherein the reading position module is configured to update the reading position counter to correspond to the commencement text position.

18. A system according to claim 10 wherein the default start time of each audio track of an audio region is zero seconds.