Automatic synchronization of subtitles based on audio fingerprinting
First Claim
Patent Images
1. A computer-implemented method for synchronizing supplemental content to a multimedia stream, the method comprising:
- obtaining, by a processor, the multimedia stream;
obtaining, by the processor, the supplemental content;
identifying by the processor, beginning at an anchor time start point in the multimedia stream, an audio fingerprint of a sound track of the multimedia stream; and
inserting by the processor into the supplemental content the audio fingerprint, wherein the audio fingerprint is inserted into the supplemental content in association with a time start point to match the audio fingerprint inserted into the supplemental content with the audio fingerprint of a sound track of the multimedia stream at a time period in the multimedia file beginning at the start point in the supplemental content,wherein the multimedia stream comprises a multimedia file, andwherein multiple audio fingerprints are identified at different time start points throughout the multimedia file, and the multiple audio fingerprints with corresponding time start points that match the respective different time start points in the multimedia file are inserted into the supplemental content, for allowing resynchronization of the supplemental content to the multimedia stream at the different time start points in the multimedia file that is played.
1 Assignment
0 Petitions
Accused Products
Abstract
Various mechanisms presented in this disclosure provide for dynamically adjusting the exhibition of subtitles. In one example, check-points are introduced into the subtitle file format that, once achieved by a multimedia player, provoke the rescheduling of the moment in which the texts contained in the subtitle file will be exhibited.
-
Citations
18 Claims
-
1. A computer-implemented method for synchronizing supplemental content to a multimedia stream, the method comprising:
-
obtaining, by a processor, the multimedia stream; obtaining, by the processor, the supplemental content; identifying by the processor, beginning at an anchor time start point in the multimedia stream, an audio fingerprint of a sound track of the multimedia stream; and inserting by the processor into the supplemental content the audio fingerprint, wherein the audio fingerprint is inserted into the supplemental content in association with a time start point to match the audio fingerprint inserted into the supplemental content with the audio fingerprint of a sound track of the multimedia stream at a time period in the multimedia file beginning at the start point in the supplemental content, wherein the multimedia stream comprises a multimedia file, and wherein multiple audio fingerprints are identified at different time start points throughout the multimedia file, and the multiple audio fingerprints with corresponding time start points that match the respective different time start points in the multimedia file are inserted into the supplemental content, for allowing resynchronization of the supplemental content to the multimedia stream at the different time start points in the multimedia file that is played. - View Dependent Claims (2, 3, 4, 5)
-
-
6. A computer readable storage medium storing a program of instructions executable by a machine to perform a method of synchronizing supplemental content to a multimedia file, the method comprising:
-
obtaining by a processor the multimedia file, wherein the multimedia file includes therein a soundtrack; obtaining by the processor the supplemental content, wherein the supplemental content includes therein at least one audio fingerprint and wherein the audio fingerprint included in the supplemental content is associated with a time start point; identifying by the processor, in the supplemental content, the audio fingerprint; identifying by the processor, in the supplemental content, the time start point associated with the identified audio fingerprint; determining by the processor whether, at a time period in the multimedia file beginning at a time corresponding to the identified time start point in the supplemental content, an audio fingerprint of the sound track of the multimedia file matches the identified audio fingerprint of the supplemental content; responsive to determining that at the time period in the multimedia file beginning at the time corresponding to the identified time start point in the supplemental content the audio fingerprint of the sound track of the multimedia file does not match the identified audio fingerprint of the supplemental content; searching, by the processor, the sound track of the multimedia file from a beginning of the multimedia file towards an end of the multimedia file to determine whether the sound track of the multimedia file contains an audio fingerprint that matches the identified audio fingerprint of the supplemental content; and responsive to determining that the sound track of the multimedia file contains an audio fingerprint that matches the identified audio fingerprint of the supplemental content; identifying, by the processor, a fingerprint time period in the sound track of the multimedia file where the multimedia file contains the audio fingerprint that matches the identified audio fingerprint of the supplemental content; and determining, by the processor, an offset time difference between a start time of the fingerprint time period in the soundtrack of the multimedia file and the time start point in the supplemental content associated with the identified audio fingerprint. - View Dependent Claims (7, 8, 9, 10, 11, 12, 13)
-
-
14. A computer readable storage medium storing a program of instructions executable by a machine to perform a method of synchronizing supplemental content to a multimedia broadcast, the method comprising:
-
obtaining by a processor the multimedia broadcast, wherein the multimedia broadcast includes therein a soundtrack; obtaining by the processor the supplemental content, wherein the supplemental content includes therein at least one audio fingerprint and wherein the audio fingerprint included in the supplemental content is associated with a time start point; identifying by the processor, in the supplemental content, the audio fingerprint; identifying by the processor, in the supplemental content, the time start point associated with the identified audio fingerprint; determining by the processor whether, at a time period in the multimedia broadcast beginning at a time corresponding to the identified time start point in the supplemental content, an audio fingerprint of the sound track of the multimedia broadcast matches the identified audio fingerprint of the supplemental content; responsive to determining that at the time period in the multimedia broadcast beginning at the time corresponding to the identified time start point in the supplemental content the audio fingerprint of the sound track of the multimedia broadcast does not match the identified audio fingerprint of the supplemental content; monitoring, by the processor, the sound track of the multimedia broadcast as the multimedia broadcast is obtained to determine whether the sound track of the multimedia broadcast contains an audio fingerprint that matches the identified audio fingerprint of the supplemental content; and responsive to determining that the sound track of the multimedia broadcast contains an audio fingerprint that matches the identified audio fingerprint of the supplemental content; identifying, by the processor, a fingerprint time period in the sound track of the multimedia broadcast where the multimedia broadcast contains the audio fingerprint that matches the identified audio fingerprint of the supplemental content; and determining, by the processor, an offset time difference between a start time of the fingerprint time period in the soundtrack of the multimedia broadcast and the time start point in the supplemental content associated with the identified audio fingerprint. - View Dependent Claims (15, 16, 17, 18)
-
Specification