Information processing apparatus

• US 20030123556A1
• Filed: 09/26/2002
• Published: 07/03/2003
• Est. Priority Date: 09/27/2001
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Komori, Yoko
• Granted Patent: US 7,274,862 B2
• Time in Patent Office: Days
• US Class Current: 375/240.26
• CPC Class Codes: G11B 2220/20 Disc-shaped record carriers
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/10 Indexing; Addressing; Timing or synchronising; Measuring tape travel
• CPC Class Codes: G11B 27/3027 used signal is digitally coded
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18

Abstract

Audio data is prevented from not synchronizing with video data when splicing. A first GOP of a video stream of a second program is spliced to a last GOP of a video stream of a first program. A first GOP of an audio stream of the second program is spliced to a last GOP of an audio stream of the first program. In this case, a gap amount PTS_FS required for synchronizing video data and audio data after the splicing is computed for each GOP. For the splicing processing, a gap amount PTS_FS_SPLYCE caused when the last GOP is spliced to the first GOP directly and the PTS_FS are used.

Claims

1. An information processing apparatus for processing input video data in a processing unit and input audio data in a processing unit different from the processing unit for the input video data in size, comprising:

ending time information calculating means for calculating ending time information of the processing unit of the input video data and ending time information of the processing unit of the input audio data from the input video data in the processing unit and the input audio data in the processing unit;

first gap amount information calculating means for, when the input video data in the processing unit and the input audio data in the processing unit are spliced to previous processing units directly, calculating, for each of the processing units, first gap amount information indicating a gap amount between the input video data in the processing unit and the input audio data in the processing unit for synchronizing the input video data in the processing unit and the input audio data in the processing unit;

second gap amount information calculating means for calculating, for each of the processing units, second gap amount information indicating a gap amount between ending time information of the video data in the previous processing unit and the input audio data in the processing unit for synchronizing the input audio data in the processing unit and the input video data in the processing unit; and

mute data inserting means for, when the second gap amount is larger than the first gap amount, inserting mute information indicating a mute between the previous audio data and the input audio data for each of the processing unit.

2. An information processing apparatus according to claim 1, further comprising:

determination means for determining whether or not a value of the first gap amount information is larger than a value of the second gap amount and a difference between the value of the first gap amount information and the value of the second gap amount is equal to or more than one encoding unit of the audio data; and

deletion means for deleting the audio data in the previous processing unit by the encoding unit included in the processing unit of the audio data such that the difference between the value of the first gap amount information and the value of the second gap amount can be smaller than one encoding unit of the audio data when the determination means determines that the value of the first gap amount information is larger than the value of the second gap amount and the difference is equal to or more than one encoding unit of the audio data.

3. An information processing method for processing input video data in a processing unit and input audio data in a processing unit different from the processing unit for the input video data in size, comprising the steps of:

calculating ending time information of the processing unit of the input video data and ending time information of the processing unit of the input audio data from the input video data in the processing unit and the input audio data in the processing unit;

when the input video data in the processing unit and the input audio data in the processing unit are spliced to previous processing units directly, calculating, for each of the processing units, first gap amount information indicating a gap amount between the input video data in the processing unit and the input audio data in the processing unit for synchronizing the input video data in the processing unit and the input audio data in the processing unit;

calculating, for each of the processing units, second gap amount information indicating a gap amount between ending time information of video data in the previous processing unit and the input audio data in the processing unit for synchronizing the input audio data in the processing unit and the input video data in the processing unit; and

when the second gap amount is larger than the first gap amount, inserting mute information indicating a mute between the previous audio data and the input audio data for each of the processing unit.

4. A recording medium storing a program for processing input video data in a processing unit and input audio data in a processing unit different from the processing unit for the input video data in size, said program comprising the steps of:

calculating ending time information of the processing unit of the input video data and ending time information of the processing unit of the input audio data from the input video data in the processing unit and the input audio data in the processing unit;

when the input video data in the processing unit and the input audio data in the processing unit are spliced to previous processing units directly, calculating, for each of the processing units, first gap amount information indicating a gap amount between the input video data in the processing unit and the input audio data in the processing unit for synchronizing the input video data in the processing unit and the input audio data in the processing unit;

calculating, for each of the processing units, second gap amount information indicating a gap amount between ending time information of video data in the previous processing unit and the input audio data in the processing unit for synchronizing the input audio data in the processing unit and the input video data in the processing unit; and

when the second gap amount is larger than the first gap amount, inserting mute information indicating a mute between the previous audio data and the input audio data for each of the processing unit.

5. A program for processing input video data in a processing unit and input audio data in a processing unit different from the processing unit for the input video data in size, comprising the steps of:

calculating ending time information of the processing unit of the input video data and ending time information of the processing unit of the input audio data from the input video data in the processing unit and the input audio data in the processing unit;

when the input video data in the processing unit and the input audio data in the processing unit are spliced to previous processing units directly, calculating, for each of the processing units, first gap amount information indicating a gap amount between the input video data in the processing unit and the input audio data in the processing unit for synchronizing the input video data in the processing unit and the input audio data in the processing unit;

calculating, for each of the processing units, second gap amount information indicating a gap amount between ending time information of video data in the previous processing unit and the input audio data in the processing unit for synchronizing the input audio data in the processing unit and the input video data in the processing unit; and

when the second gap amount is larger than the first gap amount, inserting mute information indicating a mute between the previous audio data and the input audio data for each of the processing unit.

6. An information processing apparatus for processing video data in a processing unit and audio data in a processing unit different from the processing unit of the video data in size, comprising:

detecting means for detecting a synchronization gap amount for each of the processing units of the audio data and the video data;

first gap amount computing means for, when the audio data and the video data in the processing units are spliced to previous processing units, computing a first gap amount indicating a gap amount for synchronizing the audio data and the video data based on the synchronization gap amount detected by the detecting means;

first creating means for creating a header for each of the processing units including the first gap amount; and

second creating means for creating a block of the processing units of the audio data and the video data and adding the header created by the first creating means thereto.

7. An information processing apparatus according to claim 6, further comprising:

determination means for determining whether or not the synchronization gap amount is longer than a length of an encoding unit included in the processing unit of the video data; and

correction means for correcting the synchronization gap amount by subtracting an amount corresponding to the length of the encoding unit from the synchronization gap amount when the determination means determines that the synchronization gap amount is longer than the length of the encoding unit,

wherein the first gap amount computing means computes the first gap amount based on the gap amount corrected by the correction means.

8. An information processing apparatus according to claim 7, wherein the processing unit is a group of pictures of the video data;

and

the encoding unit is a video frame.

9. An information processing apparatus according to claim 6, further comprising output means for outputting the block including the audio data and the video data to which the header is added by the second creating means.

10. An information processing apparatus according to claim 9, wherein the output means supplies the processing unit to a recording medium to record.

11. An information processing apparatus according to claim 10, further comprising:

extracting means for extracting the first gap amount included in the header of each of the blocks from input data;

second gap amount computing means for computing, for each of the blocks, a second gap amount corresponding to a synchronization gap amount between the processing units of the audio data and the video data when the processing units of the audio data and the video data are spliced to previous processing units; and

gap amount correction means for correcting the gap amount of the processing units based on the first gap amount extracted by the extracting means and the second gap amount computed by the second gap amount computing means.

12. An information processing apparatus according to claim 11, wherein the second gap amount computing means computes the second gap amount based on a time stamp of the previous processing unit computed for the processing units and the length of the processing units.

13. An information processing apparatus according to claim 12, wherein the second gap amount computing means computes the second gap amount based on a difference between a value in which a length of the audio data in the processing unit is added to a presentation time stamp of the audio data in the previous processing unit and a value in which the length of the video data in the processing unit is added to a decoding time stamp of the video data in the previous processing unit.

14. An information processing apparatus according to claim 13, further comprising:

determination means for determining whether or not the first gap amount is larger than the second gap amount; and

inserting means for inserting mute data in one encoding unit to the audio data in the previous processing unit when the determination means determines that the first gap amount is larger than the second gap amount.

15. An information processing apparatus according to claim 13, further comprising:

determination means for determining whether or not the second gap amount is larger than the first gap amount and a difference between the second gap amount and the first gap amount is equal to or more than one encoding unit of the audio data; and

deletion means for deleting the audio data in the previous processing unit by the encoding unit included in the processing unit of the audio data such that the difference between the second gap amount and the first gap amount can be smaller than one encoding unit of the audio data when the determination means determines that the second gap amount is larger than the first gap amount and the difference is equal to or more than one encoding unit of the audio data.

16. An information processing apparatus according to claim 9, further comprising determination means for determining whether or not a number of channels of the audio data is smaller than a maximum value of the number of processable channels,

wherein the output means increases the number of channels such that the number of channels can be equal to the maximum value and adds and outputs mute data to the increased channels when the determination means determines that the number of channels of the audio data is smaller than the maximum value.

17. An information processing method for processing video data in a processing unit and audio data in a processing unit different from the processing unit of the video data in size, comprising the steps of:

detecting a synchronization gap amount for each of the processing units of the audio data and the video data;

when the audio data and the video data in the processing units are spliced to previous processing units, computing a first gap amount indicating a gap amount for synchronizing the audio data and the video data based on the synchronization gap amount detected by processing at the detecting step;

creating a header for each of the processing units including the first gap amount; and

creating a block of the processing units of the audio data and the video data and adding the header created by the processing at the first creating step thereto.

18. A recording medium for storing a program for processing video data in a processing unit and audio data in a processing unit different from the processing unit of the video data in size, said program comprising the steps of:

detecting a synchronization gap amount for each of the processing units of the audio data and the video data;

when the audio data and the video data in the processing units are spliced to previous processing units, computing a first gap amount indicating a gap amount for synchronizing the audio data and the video data based on the synchronization gap amount detected by processing at the detecting step;

creating a header for each of the processing units including the first gap amount; and

creating a block of the processing units of the audio data and the video data and adding the header created by the processing at the first creating step thereto.

19. A program for processing video data in a processing unit and audio data in a processing unit different from the processing unit of the video data in size, comprising the steps of:

detecting a synchronization gap amount for each of the processing units of the audio data and the video data;

when the audio data and the video data in the processing units are spliced to previous processing units, computing a first gap amount indicating a gap amount for synchronizing the audio data and the video data based on the synchronization gap amount detected by processing at the detecting step;

creating a header for each of the processing units including the first gap amount; and

creating a block of the processing units of the audio data and the video data and adding the header created by the processing at the first creating step thereto.

20. An information processing apparatus for processing video data in a processing unit and audio data in a processing unit different from the size of the processing unit of the video data, comprising:

extracting means for extracting blocks of the processing units including audio data and video data from input data and extracting, from a header included in each of the blocks, a first gap amount corresponding to a gap amount for synchronizing the audio data and the video data when the audio data and the video data in the processing units are spliced to previous processing units;

computing means for computing, for each of the blocks, a second gap amount corresponding to a synchronization gap amount of the processing units of the audio data and the video data when the processing units of the audio data and the video data are spliced to previous processing units; and

splicing means for splicing the processing units based on the first gap amount and the second gap amount.

21. An information processing apparatus according to claim 20, wherein the computing means computes the second gap amount based on a time stamp of the previous processing unit computed for each of the processing units and a length of the processing unit.

22. An information processing apparatus according to claim 21, wherein the computing means computes the second gap amount based on a difference between a value in which the length of the audio data in the processing unit is added to a presentation time stamp of the audio data in the previous processing unit and a value in which the length of the video data in the processing unit is added to a decoding time stamp of the video data in the previous processing unit.

23. An information processing apparatus according to claim 22, further comprising:

determination means for determining whether or not the first gap amount is larger than the second gap mount; and

inserting means for inserting mute data in one encoding unit to the audio data in the previous processing unit when the determination means determines that the first gap amount is larger than the second gap amount.

24. An information processing apparatus according to claim 22, further comprising:

determination means for determining whether or not the second gap amount is larger than the first gap amount and a difference between the second gap amount and the first gap amount is equal to or more than one encoding unit of the audio data; and

deletion means for deleting the audio data in the previous processing unit by the encoding unit included in the processing unit of the audio data such that the difference between the second gap amount and the first gap amount can be smaller than one encoding unit of the audio data when the determination means determines that second gap amount is larger than the first gap amount and the difference is equal to or more than one encoding unit of the audio data.

25. An information processing apparatus according to claim 20, further comprising:

determination means for determining whether or not a number of channels of the audio data is smaller than a maximum value of the number of processable channels; and

output means for, when the determination means determines the number of channels of the audio data is smaller than the maximum value, increasing the number of channels such that the number of channels is equal to the maximum value and adding and outputting mute data to the increased channels.

26. An information processing method for processing video data in a processing unit and audio data in a processing unit different from the size of the processing unit of the video data, comprising the steps of:

extracting blocks of the processing units including audio data and video data from input data and extracting, from a header included in each of the blocks, a first gap amount corresponding to a gap amount for synchronizing the audio data and the video data when the audio data and the video data in the processing units are spliced to previous processing units;

computing, for each of the blocks, a second gap amount corresponding to a synchronization gap amount of the processing units of the audio data and the video data when the processing units of the audio data and the video data are spliced to previous processing units; and

splicing the processing units based on the first gap amount and the second gap amount.

27. A recording medium for storing a program for processing video data in a processing unit and audio data in a processing unit different from the size of the processing unit of the video data, said program comprising the steps of:

extracting blocks of the processing units including audio data and video data from input data and extracting, from a header included in each of the blocks, a first gap amount corresponding to a gap amount for synchronizing the audio data and the video data when the audio data and the video data in the processing units are spliced to previous processing units;

computing, for each of the blocks, a second gap amount corresponding to a synchronization gap amount of the processing units of the audio data and the video data when the processing units of the audio data and the video data are spliced to previous processing units; and

splicing the processing units based on the first gap amount and the second gap amount.

28. A program for processing video data in a processing unit and audio data in a processing unit different from the size of the processing unit of the video data, comprising the steps of:

extracting blocks of the processing units including audio data and video data from input data and extracting, from a header included in each of the blocks, a first gap amount corresponding to a gap amount for synchronizing the audio data and the video data when the audio data and the video data in the processing units are spliced to previous processing units;

computing, for each of the blocks, a second gap amount corresponding to a synchronization gap amount of the processing units of the audio data and the video data when the processing units of the audio data and the video data are spliced to previous processing units; and

splicing the processing units based on the first gap amount and the second gap amount.