Method and apparatus for synchronizing media data

• US 10,440,449 B2
• Filed: 12/22/2014
• Issued: 10/08/2019
• Est. Priority Date: 02/21/2014
• Status: Expired due to Fees

• Current Assignee: Samsung Electronics Co. Ltd.
• Original Assignee: Samsung Electronics Co. Ltd.
• Inventors: Um, Chang-Gun
• Primary Examiner(s): Marandi, James R
• Application Number:
  US15/120,622
• Publication Number:
  US 20170013329A1
• Time in Patent Office: 1,751 Days
• Field of Search: None
• CPC Class Codes: H04N 21/43072 of multiple content streams on the same device
• CPC Class Codes: H04N 21/854 Content authoring
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content

Abstract

Disclosed are a method and an apparatus for synchronizing media. A method of synchronizing media includes: receiving first media data and second media data; acquiring a first time of at least a partial interval of the first media data and a second time of at least a partial interval of the second media data; controlling at least the second time based on at least a part of the first time and the second time; and combining the first media data and the second media data based on the first time and the controlled second time.

Claims

1. A method of synchronizing media data, the method comprising:

receiving first media data and second media data;

identifying a first time of the first media data and a second time of the second media data, wherein the identified first time is a time when an output of one part among video data and audio data of the first media data which ends later ends, and the identified second time is a time when an output of one part among video data and audio data of the second media data which is received earlier starts;

modifying the identified second time of the second media data to be the identified first time of the first media data; and

combining the first media data and the second media data to output the one part of the second media data which is received earlier, at the modified second time upon the output of the one part of the first media data which ends later.

2. The method of claim 1, wherein the modifying of the identified second time comprises modifying time information of the identified second time of the second media data to be time information of the identified first time of the first media data.

3. The method of claim 1, wherein the identifying of the first time comprises calculating a first end time of the first media data when an output of the audio data of the first media data ends and a second end time of the first media data when an output of the video data of the first media data ends;

and

wherein the modifying of the identified second time comprises modifying time information of the identified second time of the second media data based on the calculated first end time or the calculated second end time.

4. The method of claim 3, wherein the identifying of the first time of the first media data comprises identifying of the first time having a larger value among the first end time generated by adding an audio frame length to a start time of a last audio frame of the first media data and the second end time generated by adding a video frame length to a start time of a last video frame of the first media data.

5. The method of claim 3, wherein the calculating of the second end time of the first media data comprises calculating an end time of a last video frame of the first media data when a video data length of the first media data is longer than or equal to an audio data length of the first media data.

6. The method of claim 3, wherein the calculating of the first end time of the first media data comprises calculating an end time of a last audio frame of the first media data when an audio data length of the first media data is longer than or equal to a video data length of the first media data.

7. The method of claim 3, wherein the modifying of the time information of the identified second time of the second media data comprises, when the video data of the second media data is first received, modifying time information of a start time of the received video data of the second media data to be the calculated first end time or the calculated second end time of the first media data.

8. The method of claim 3, wherein the modifying of the time information of the identified second time of the second media data comprises, when the audio data of the second media data is first received, modifying time information of a start time of the received audio data of the second media data to be the calculated first end time or the calculated second end time of the first media data.

9. An electronic device comprising:

a communication interface for receiving first media data and second media data; and

a media sync module for identifying a first time of the first media data and a second time of the second media data, wherein the identified first time is a time when an output of one part among video data and audio data of the first media data which ends later ends, and the identified second time is a time when an output of one part among video data and audio data of the second media data which is received earlier starts,

modifying the identified second time of the second media data to be the identified first time of the first media data, and

combining the first media data and the second media data to output the one part of the second media data which is received earlier, at the modified second time upon the output of the one part of the first media data which ends later.

10. The electronic device of claim 9, wherein the media sync module modifies time information of the identified second time of the second media data to be time information of the identified first time of the first media data.

11. The electronic device of claim 9, wherein the media sync module calculates a first end time of the first media data when an output of the audio data of the first media data ends and a second end time of the first media data when an output of the video data of the first media data ends, and modifies time information of the identified second time of the second media data based on the calculated first end time or the calculated second end time.

12. The electronic device of claim 11, wherein the media sync module identifies the first time having a larger value among the first end time generated by adding an audio frame length to a start time of a last audio frame of the first media data and the second end time generated by adding a video frame length to a start time of a last video frame of the first media data.

13. The electronic device of claim 11, wherein the media sync module calculates an end time of a last video frame of the first media data when a video data length of the first media data is longer than or equal to an audio data length of the first media data.

14. The electronic device of claim 11, wherein the media sync module calculates an end time of a last audio frame of the first media data when an audio data length of the first media data is longer than or equal to a video data length of the first media data.

15. The electronic device of claim 11, wherein, when the video data of the second media data is first received, the media sync module modifies time information of a start time of the received video data of the second media data to be the calculated first end time or the calculated second end time of the first media data.

16. The electronic device of claim 11, wherein, when the audio data of the second media data is first received, the media sync module modifies time information of a start time of the received audio data of the second media data to be the calculated first end time or the calculated second end time of the first media data.

17. A non-transitory computer-readable storage medium for storing commands, the computer-readable recording medium recording a program for executing the operations of:

receiving first media data and second media data;

identifying a first time of the first media data and a second time of the second media data, wherein the identified first time is a time when an output of one part among video data and audio data of the first media data which ends later ends, and the identified second time is a time when an output of one part among video data and audio data of the second media data which is received earlier starts;

modifying the identified second time of the second media data to be the identified first time of the first media data; and

combining the first media data and the second media data to output the one part of the second media data which is received earlier, at the modified second time upon the output of the one part of the first media data, which ends later.