Synchronizing a plurality of digital media streams by using a descriptor file

• US 9,729,907 B2
• Filed: 03/07/2016
• Issued: 08/08/2017
• Est. Priority Date: 12/13/2005
• Status: Active Grant

• Current Assignee: Audio Pod IP, LLC (Audio Pod Inc.)
• Original Assignee: Audio Pod Inc.
• Inventors: McCue, John, Shostakovsky, Gregory, McCue, Glenn, McCue, Robert
• Primary Examiner(s): Chou, Alan S
• Application Number:
  US15/062,610
• Publication Number:
  US 20160255383A1
• Time in Patent Office: 519 Days
• Field of Search: 709231
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/278 Content descriptor database or directory service for end-user access details of content or meta data based information retrieval of video data in video databases G06F16/739
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/439 Processing of audio elementary streams
• CPC Class Codes: H04N 21/4394 involving operations for analysing the audio stream, e.g. detecting features or characteristics in audio streams arrangements characterised by components specially adapted for monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/6125 involving transmission via Internet transmission by internet of broadcast information H04H60/82
• CPC Class Codes: H04N 21/8106 involving special audio data, e.g. different tracks for different languages
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/84 Generation or processing of descriptive data, e.g. content descriptors systems specially adapted for using meta-information in broadcast systems H04H60/73
• CPC Class Codes: H04N 21/8456 by decomposing the content in the time domain, e.g. in time segments
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

A method is provided in which a descriptor file is created for synchronizing a plurality of digital media streams. A plurality of time offsets are identified in a timeline of a digital audio narration of a first digital media stream, and the plurality of time offsets and a corresponding plurality of content points are stored in the descriptor file in a manner indicating a correlation therebetween. Synchronization points are identified in digital media content of one or more other digital media streams, and synchronization time offsets are selected that correspond to the synchronization points from the plurality of time offsets. The synchronization time offsets and the corresponding synchronization points are stored in the descriptor file in a manner indicating a correlation therebetween, such that the descriptor file allows a synchronized rendering of the plurality of digital media streams on a client device.

Claims

1. A method comprising:

creating a descriptor file for synchronizing a plurality of digital media streams, wherein the plurality of digital media streams each contain digital media content corresponding to a same originating work, wherein the plurality of digital media streams includes a first digital media stream containing a digital audio narration of the originating work and one or more other digital media streams, and wherein the descriptor file is external to the first digital media stream;

storing location information for the plurality of digital media streams in the descriptor file;

identifying a plurality of time offsets in a timeline of the digital audio narration of the first digital media stream, wherein the plurality of time offsets correspond to a plurality of content points in the digital audio narration;

storing the plurality of time offsets and the plurality of content points in the descriptor file in a manner indicating a correlation between the plurality of time offsets and the plurality of content points;

identifying synchronization points in the digital media content of the one or more other digital media streams;

selecting synchronization time offsets that correspond to the synchronization points from the plurality of time offsets; and

storing the synchronization time offsets and the synchronization points in the descriptor file in a manner indicating a correlation between the synchronization time offsets and the synchronization points, such that the descriptor file allows a synchronized rendering of the plurality of digital media streams on a client device.

2. The method of claim 1, further comprising:

storing the descriptor file on a server that is accessible to the client device.

3. The method of claim 1, further comprising:

simultaneously rendering two or more of the plurality of digital media streams on the client device by using the descriptor file to synchronize the two or more of the plurality of digital media streams.

4. The method of claim 3, further comprising:

tracking a current position in at least one of the two or more of the plurality of digital media streams as the two or more of the plurality of digital media streams are rendered; and

creating a bookmark by setting the current position as a bookmarked position, wherein the bookmark includes the bookmarked position and identifies the descriptor file.

5. The method of claim 4, further comprising:

rendering one or more of the plurality of digital media streams starting from the bookmarked position on the client device or on a second other client device.

6. The method of claim 5, wherein the one or more of the plurality of digital media streams were not used to create the bookmark.

7. The method of claim 3, wherein at least one of the two or more of the plurality of digital media streams contains visually rendered digital media content, the method further comprising:

providing automated page turns as the two or more of the plurality of digital media streams are simultaneously rendered.

8. The method of claim 1, wherein at least some of the synchronization time offsets are selected in dependence on natural language gaps, inter-word gaps, punctuation marks, or parts of speech.

9. The method of claim 1, wherein the first digital media stream includes a plurality of content segments, and wherein the plurality of content segments are defined by the plurality of time offsets in the descriptor file.

10. The method of claim 9, wherein the plurality of time offsets includes start times of the content segments, end times of the content segments, durations of the content segments, or a combination thereof.

11. The method of claim 1, further comprising:

selecting two or more of the plurality of digital media streams;

determining a first position in the digital media content of the two or more of the plurality of digital media streams in dependence on the synchronization time offsets in the descriptor file; and

simultaneously rendering the two or more of the plurality of digital media streams on the client device starting from the first position by using the descriptor file to synchronize the two or more of the plurality of digital media streams.

12. The method of claim 11, wherein determining the first position comprises detecting a user interaction with a media rendering utility or a user interface on the client device.

13. The method of claim 11, wherein determining the first position comprises determining the first position in dependence on the synchronization time offsets in the descriptor file and in dependence on a bookmarked position or a default position.

14. The method of claim 1, wherein the descriptor file contains information that is human readable when rendered.

15. The method of claim 1, further comprising:

coordinating delivery of the digital media content of the plurality of digital media streams from one or more servers to the client device in dependence on the synchronization time offsets in the descriptor file.

16. The method of claim 15, further comprising:

managing network connections between the client device and the one or more servers in dependence on service failure, service degradation, digital data throughput rate, or a combination thereof.

17. The method of claim 1, wherein the digital media content of each of the plurality of digital media streams includes an audio recording, a video recording, an audio/video recording, a static image, a moving image, an animation, an illustration, text content, footnote content, quotation content, user-entered content, advertising content, or a combination thereof.

18. The method of claim 1, further comprising:

navigating one or more of the plurality of digital media streams by using the descriptor file on the client device, wherein at least some of the digital media content of the one or more of the plurality of digital media streams is not resident on the client device.

19. The method of claim 1, wherein one or more of the plurality of digital media streams are discontinuous media streams that are discontinuous when rendered.

20. The method of claim 1, wherein the location information for one or more of the plurality of digital media streams indicates that the one or more of the plurality of digital media streams are located within the descriptor file.

21. A non-transitory computer-readable storage medium having stored thereon instructions which, when executed by a processor of a computing device, cause the computing device to:

create a descriptor file for synchronizing a plurality of digital media streams, wherein the plurality of digital media streams each contain digital media content corresponding to a same originating work, wherein the plurality of digital media streams includes a first digital media stream containing a digital audio narration of the originating work and one or more other digital media streams, and wherein the descriptor file is external to the first digital media stream;

store location information for the plurality of digital media streams in the descriptor file;

identify a plurality of time offsets in a timeline of the digital audio narration of the first digital media stream, wherein the plurality of time offsets correspond to a plurality of content points in the digital audio narration;

store the plurality of time offsets and the plurality of content points in the descriptor file in a manner indicating a correlation between the plurality of time offsets and the plurality of content points;

identify synchronization points in the digital media content of the one or more other digital media streams;

select synchronization time offsets that correspond to the synchronization points from the plurality of time offsets; and

store the synchronization time offsets and the synchronization points in the descriptor file in a manner indicating a correlation between the synchronization time offsets and the synchronization points, such that the descriptor file allows a synchronized rendering of the plurality of digital media streams on a client device.