Managing playback of synchronized content

• US 8,948,892 B2
• Filed: 03/23/2011
• Issued: 02/03/2015
• Est. Priority Date: 03/23/2011
• Status: Active Grant

• Current Assignee: Audible Incorporated (Amazon.com, Inc.)
• Original Assignee: Audible Incorporated (Amazon.com, Inc.)
• Inventors: Story, Guy A. Jr., Israel, Bruce N.
• Primary Examiner(s): Tsang, Fan
• Assistant Examiner(s): SIEGEL, DAVID F
• Application Number:
  US13/070,439
• Publication Number:
  US 20120245721A1
• Time in Patent Office: 1,413 Days
• Field of Search: None
• US Class Current: 700/94
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G10H 2220/005 Non-interactive screen display of musical or status data graphical user interfaces specifically adapted for electrophonic musical instruments G10H2220/091; fingering displays G10H2220/041

Abstract

A computing device may provide a control interface that enables the user to manage the synchronized output of companion content (e.g., textual content and corresponding audio content). For example, the computing device may display a visual cue to identify a current location in textual content corresponding to a current output position of companion audio content. As the audio content is presented, the visual cue may be advanced to maintain synchronization between the output position within the audio content and a corresponding position in the textual content. The computing device may adjust the speed at which the audio content is presented and the visual cue is advanced based at least in part on an input corresponding to the user'"'"'s performance on a task (e.g., a speed on an exercise machine).

Claims

1. A system for synchronizing output of audio content with textual content, the system comprising:

one or more data stores that store textual content, audio content, and content synchronization information, wherein the content synchronization information correlates positions within the textual content to corresponding positions within the audio content;

an input device that obtains an input value corresponding to performance of a user at a task;

a display device that presents the textual content;

an output device that outputs the audio content; and

a processor in communication with the one or more data stores, the input device and the output device, the processor configured to;

cause output of the audio content via the output device;

determine an output position for the textual content corresponding to a current output position of the audio content based at least in part on the content synchronization information;

cause presentation of a portion of the textual content corresponding to the output position on the display device;

during output of the audio content via the output device;

determine, based at least in part on the synchronization information, an updated output position for the textual content corresponding to the current output position of the audio content output via the output device, wherein the current output position of the audio content advances during output of the audio content;

cause presentation on the display device of an updated portion of the textual content corresponding to the updated output position;

obtain the input value from the input device corresponding to performance of the user at the task;

determine that the user'"'"'s performance at the task has dropped below a threshold value based at least in part on the input value from the input device, wherein the threshold value is associated with a predetermined playback speed; and

responsive to the determination that the user'"'"'s performance at the task has satisfied the threshold value, modify;

a speed at which the audio content is output via the output device to correlate to the predetermined playback speed associated with the threshold value; and

a speed of presentation on the display device of additional portions of the textual content.

2. The system of claim 1, wherein modifying a speed at which the audio content is output includes at least one of increasing or decreasing the speed at which the audio content is output.

3. The system of claim 1, wherein the input device comprises at least one of a heart rate monitor, a location monitor, a pedometer, a smart shoe, or an exercise machine.

4. The system of claim 1, wherein the input value from the input device corresponds to at least one of a user heart rate, a user calorie expenditure, a user speed, a user pace, a user distance traveled, a user voltage generated, a user amperage generated, a user score, or a difficulty level.

5. The system of claim 1, wherein the processor is further operative to:

determine that the user'"'"'s performance at the task has exceeded the threshold value based at least in part on the input value from the input device; and

modify the speed at which the audio content is output based at least in part on the determination that the user'"'"'s performance at the task has exceeded the threshold value.

6. The system of claim 1, wherein the processor is further operative to cause presentation of at least one of a visual, auditory, or tactile representation of the output position of the textual content.

7. The system of claim 1, wherein the processor is further operative to cause presentation of at least one of a visual or tactile representation of the threshold value.

8. A computer-implemented method outputting content, the computer-implemented method comprising:

under control of one or more computing devices,

causing output of an audio content;

determining an output position for a textual content based at least in part on synchronization information that correlates one or more positions within the audio content to one or more corresponding positions within the second textual content, wherein the determined output position corresponds to a current output position of the audio content;

causing output of at least a portion of the textual content corresponding to the determined output position; and

during output of the audio content;

determine, based at least in part on the synchronization information, an updated output position for the textual content corresponding to the current output position of the audio content, wherein the current output position of the audio content advances during output of the audio content;

causing output of presentation on the display device of an updated portion of the textual content corresponding to the updated output position;

obtaining an input value from an input device corresponding to performance of a user at a task;

determining that the user'"'"'s performance at the task has satisfied a threshold value based at least in part on the input value from the input device, wherein the threshold value is associated with a predetermined playback attribute; and

responsive to the determination that the user'"'"'s performance at the task has satisfied the threshold value, modifying first attribute associated with the output of the audio content and a second attribute associated with output of the textual content in accordance with the predetermined playback attribute associated with the threshold value.

9. The computer-implemented method of claim 8, wherein determining that the user'"'"'s performance has satisfied a threshold value based at least in part on the input value from the input device includes at least one of determining that the user'"'"'s performance at the task has exceeded the threshold value or determining that the user'"'"'s performance at the task has dropped below the threshold value.

10. The computer-implemented method of claim 8 further comprising determining a threshold value based at least in part on information associated with the user'"'"'s past performance at a task.

11. The computer-implemented method of claim 8, wherein modifying the first attribute associated with the output of the audio content comprises at least one of increasing or decreasing a speed at which the audio content is output.

12. The computer-implemented method of claim 8, wherein the input device comprises at least one of a heart rate monitor, a location monitor, a pedometer, a smart shoe, or an exercise machine.

13. The computer-implemented method of claim 8, wherein the input value corresponds to at least one of a user heart rate, a user calorie expenditure, a user speed, a user pace, a user distance traveled, a user voltage generated, user amperage generated, a user score, or a difficulty level.

14. The computer-implemented method of claim 8 further comprising causing presentation of at least one of a visual, auditory, or tactile representation of the output position of the textual content.

15. The computer-implemented method of claim 8 further comprising causing presentation of at least one of a visual, auditory, or tactile representation of the threshold value.

16. A system comprising:

a data store; and

a processor in communication with the data store, the processor operative to;

cause output of audio content; and

during the output of audio content;

determine an output position for a textual content based at least in part on synchronization information that correlates one or more positions within the audio content to one or more corresponding positions within the textual content, wherein the determined output position corresponds to a current output position of the audio content;

cause output of at least a portion of the textual content corresponding to the determined output position;

obtain an input value corresponding to performance of a user at a task;

determine that the user'"'"'s performance at the task has satisfied a threshold value based at least in part on the input value, wherein the threshold value is associated with a predetermined playback attribute; and

responsive to the determination that the user'"'"'s performance has satisfied the threshold value, modify a first attribute associated with the output of the audio content and a second attribute associated with the output of the textual content in accordance with the predetermined playback attribute associated with the threshold value.

17. The system of claim 16, wherein the processor is further operable to maintain, based at least in part on the synchronization information, synchronization of the output position of the textual content with an associated position of the audio content that advances during output of the audio content.

18. The system of claim 16, wherein the processor is further operative to cause the presentation of at least one of a visual, auditory, or tactile representation of the output position of the textual content.

19. The system of claim 16, wherein determining that the user'"'"'s performance at the task has satisfied a threshold value based at least in part on the input value comprises at least one of determining that the user'"'"'s performance at the task has exceeded the threshold value or determining that the user'"'"'s performance at the task has dropped below the threshold value.

20. The system of claim 16, wherein the processor is further operable to determine a threshold value based at least in part on information associated with the user'"'"'s past performance at a task.

21. The system of claim 16, wherein modifying a first attribute associated with the output of the audio content comprises at least one of increasing and decreasing a speed at which the audio content is output.

22. The system of claim 16, wherein the input value is obtained from an input device comprising at least one of a heart rate monitor, a location monitor, a pedometer, a smart shoe, or an exercise machine.

23. The system of claim 16, wherein the input value comprises at least one of a user heart rate, a user calorie expenditure, a user speed, a user pace, a user distance traveled, a user voltage generated, a user amperage generated, a user score, or a difficulty level.

24. The system of claim 16, wherein the processor is further operative to cause presentation of at least one of a visual, auditory, or tactile representation of the threshold value.

25. A computer readable, non-transitory storage medium having at least one computer-executable component for providing synchronized content, the at least one computer-executable component comprising:

a content synchronization module operative to;

cause output of an audio content;

determine an output position for a textual content based at least in part on synchronization information that correlates one or more positions within the audio content to one or more corresponding positions within the textual content, wherein the determined output position corresponds to a current output position of the audio content;

causing output of at least a portion of the textual content corresponding to the determined output position; and

during output of the audio content;

determine, based at least in part on synchronization information, an updated output position for the textual content corresponding to the current output position of the audio content being output, wherein the current output position of the audio content advances during output of the audio content;

cause output of presentation on the display device of an updated portion of the textual content corresponding to the updated output position;

obtain an input value from an input device corresponding to performance of a user at a task;

determine that the user'"'"'s performance at the task has satisfied a threshold value based at least in part on the input value from the input device, wherein the threshold value is associated with a predetermined playback attribute; and

responsive to the determination that the user'"'"'s performance at the task has satisfied the threshold value, modify a first attribute associated with the output of the audio content and a second attribute associated with output of the textual content in accordance with the predetermined playback attribute associated with the threshold value.

26. The computer readable, non-transitory storage medium of claim 25, wherein determining that the user'"'"'s performance has satisfied a threshold value based at least in part on the input value from the input device includes at least one of determining that the user'"'"'s performance at the task has exceeded the threshold value or determining that the user'"'"'s performance at the task has dropped below the threshold value.

27. The computer readable, non-transitory storage medium of claim 25 wherein the content synchronization module is further operable to determine a threshold value based at least in part on information associated with the user'"'"'s past performance at a task.

28. The computer readable, non-transitory storage medium of claim 25, wherein modifying a first attribute associated with the output of the audio content comprises at least one of increasing or decreasing a speed at which the audio content is output.

29. The computer readable, non-transitory storage medium of claim 25, wherein the input device comprises at least one of a heart rate monitor, a location monitor, a pedometer, a smart shoe, or an exercise machine.

30. The computer readable, non-transitory storage medium of claim 25, wherein the input value corresponds to at least one of a user heart rate, a user calorie expenditure, a user speed, a user pace, a user distance traveled, a user voltage generated, a user amperage generated, a user score, or a difficulty level.

31. The computer readable, non-transitory storage medium of claim 25 further comprising causing presentation of at least one of a visual, auditory, or tactile representation of the output position of the textual content.

32. The computer readable, non-transitory storage medium of claim 25 further comprising causing presentation of at least one of a visual, auditory, or tactile representation of the threshold value.