MANAGING PLAYBACK OF SYNCHRONIZED CONTENT

• US 20150026577A1
• Filed: 10/06/2014
• Published: 01/22/2015
• Est. Priority Date: 03/23/2011
• Status: Active Grant

• Current Assignee: Audible Incorporated (Amazon.com, Inc.)
• Original Assignee: Audible Incorporated (Amazon.com, Inc.)
• Inventors: Story, Guy A., Israel, Bruce N.
• Granted Patent: US 9,792,027 B2
• Time in Patent Office: Days
• US Class Current: 715/720
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/165 Management of the audio stream, e.g. setting of volume, audio stream path
• CPC Class Codes: G09B 5/062 Combinations of audio and printed presentations, e.g. magnetically striped cards, talking books, magnetic tapes with printed texts thereon
• CPC Class Codes: G10H 2220/096 using a touch screen touch screen note input, e.g. using a displayed keyboard G10H2220/241; personal digital assistant [PDA] G10H2230/015
• CPC Class Codes: G10H 2240/325 Synchronizing two or more audio tracks or files according to musical features or musical timings synchronised lyrics, e.g. for karaoke G10H2220/011

Abstract

A computing device may provide a control interface that enables the user to manage the synchronized output of companion content (e.g., textual content and corresponding audio content). For example, the computing device may display a visual cue to identify a current location in textual content corresponding to a current output position of companion audio content. As the audio content is presented, the visual cue may be advanced to maintain synchronization between the output position within the audio content and a corresponding position in the textual content. The user may control the synchronized output by dragging her finger across the textual content displayed on the touch screen. Accordingly, the control interface may provide a highlight or other visual indication of the distance between the advancing position in the textual content and the location of a pointer to the textual content indicated by the current position of the user'"'"'s finger.

Claims

1. A system comprising:

a data store storing at least a portion of sequential content and a corresponding portion of visual content; and

a processor in communication with the data store, the processor configured with specific computer-executable instructions to at least;

during output of the sequential content, display an output indicator within the visual content indicating a position within the visual content corresponding to a current output position of the sequential content, wherein the output indicator advances during output of the sequential content;

obtain an input pointer that references an input position within the visual content, wherein the input position is distinct from the position indicated by the output indicator;

during advancement of the output pointer, determine a distance between the input position and the position indicated by the output indicator; and

modify the output of the sequential content based at least in part on the determined distance between the input position and the position indicated by the output indicator.

2. The system of claim 1, wherein the processor is further configured to at least generate the sequential content based at least in part on the visual content.

3. The system of claim 1, wherein the visual content comprises at least one of a text, a music score, a picture or sequence of pictures, a diagram, a chart, or a presentation.

4. The system of claim 1, wherein the sequential content comprises at least one of spoken audio, music, or video.

5. The system of claim 1, wherein the processor is further configured to at least modify the output of the sequential content by increasing or decreasing a speed at which the sequential content is output.

6. The system of claim 5, wherein increasing the speed at which the sequential content is output includes skipping output of one or more segments of the sequential content.

7. The system of claim 5, wherein the sequential content comprises audio content, and a current pitch of the audio content is maintained during increasing or decreasing the speed at which the sequential content is output.

8. A computer-implemented method comprising

causing output of a sequential content and a visual content, wherein output of the visual content is synchronized to output of the sequential content;

causing display within the visual content of an output indicator, wherein the output indicator advances during output of the sequential content and indicates a position within the visual content corresponding to a current output position of the sequential content;

causing reception of an input pointer referencing an input position within the visual content that is distinct from the position indicated by the output indicator; and

during advancement of the output pointer, causing output of the sequential content to be modified based at least in part on a distance between the position indicated by the output indicator and the input position.

9. The computer-implemented method of claim 8, wherein the distance between the input position and the position indicated by the output indicator is determined based at least in part on a length of time required, at a current output speed, to alter the current output position of the sequential content to correspond to the received input pointer.

10. The computer-implemented method of claim 8, wherein the output of the visual content is synchronized to the output of the sequential content based at least in part on synchronization information.

11. The computer-implemented method of claim 8, wherein the input position corresponds to at least one of a word, syllable, letter, sentence, line, paragraph, chapter, stanza, section, or column in the visual content.

12. The computer-implemented method of claim 8, wherein the input pointer is obtained from at least one of a touchscreen, a mouse, a stylus, a remote control, a video game controller, or a motion detector.

13. The computer-implemented method of claim 8, wherein modifying output of the sequential content comprises at least one of:

outputting the sequential content at a first rate when the distance between the input position and the position indicated by the output indicator satisfies a first threshold value for a first predetermined length of time;

outputting the sequential content at a second rate when the distance between the input position and the position indicated by the output indicator satisfies a second threshold value for a second predetermined length of time, wherein the second rate is faster than the first rate;

or

outputting the sequential content at a third rate when the distance between the input position and the position indicated by the output indicator satisfies a third threshold value for a third predetermined length of time, wherein the third rate is faster than the second rate.

14. The system of claim 13, wherein the first rate corresponds to at least one of a rate at which the sequential content was recorded, a rate determined by a user of the system, or a rate determined by a provider of the sequential content.

15. Non-transitory computer-readable storage media including computer-executable instructions that, when executed by one or more processors, cause the one or more processors to at least:

during output of a sequential content and a visual content, wherein output of the sequential content is synchronized to output of the sequential content, cause display within the visual content of an output indicator that advances during output of the sequential content and indicates a position within the visual content corresponding to a current output position of the sequential content;

causing input of an input pointer referencing an input position within the visual content that is distinct from the position indicated by the output indicator; and

during advancement of the output pointer, causing output of the sequential content to be modified based at least in part on a distance between the position indicated by the output indicator and the input position.

16. The non-transitory computer-readable storage media of claim 15, wherein the computer-executable instructions further cause the one or more processors to output a visual cue of the distance between the input position and the position indicated by the output indicator.

17. The non-transitory computer-readable storage media of claim 16, wherein an appearance of the visual cue is altered based at least on part on whether the distance between the input position and the position indicated by the output indicator satisfies a threshold value.

18. The non-transitory computer-readable storage media of claim 15, wherein the computer-executable instructions further cause the one or more processors to determine that the distance between the input position and the position indicated by the output indicator satisfies a threshold value.

19. The non-transitory computer-readable storage media of claim 18, wherein the threshold value is determined based at least in part on input by a user.

20. The non-transitory computer-readable storage media of claim 18, wherein the computer-executable instructions further cause the one or more processors to determine that the distance between the input position and the position indicated by the output indicator satisfies the threshold value for a threshold time period.

21. The non-transitory computer-readable storage media of claim 15, wherein the computer-executable instructions further cause the one or more processors to update a current output position of the sequential content to a position in the sequential content corresponding to the input pointer.