Multiplex scheme conversion apparatus

• US 20050169303A1
• Filed: 01/13/2005
• Published: 08/04/2005
• Est. Priority Date: 01/15/2004
• Status: Active Grant

• Current Assignee: Sovereign Peak Ventures, LLC (Dominion Harbor Enterprises, LLC)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Toma, Tadamasa, Matsui, Yoshinori
• Granted Patent: US 7,567,584 B2
• Time in Patent Office: Days
• US Class Current: 370/466
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/23608 Remultiplexing multiplex streams, e.g. involving modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/2404 Monitoring of server processing errors or hardware failure error or fault detection G06F11/07; monitoring in general G06F11/30
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

A multiplex scheme conversion apparatus (103) includes (i) a packet loss judgment unit 202 that judges the packet loss of a TS packet, performs error processing in the case where a packet loss is detected, and outputs the payload data on which error processing has already been performed and (ii) a Box making unit 206 that makes ‘moov’ including error information and ‘mdat’ based on inputted AU data and the display time in a PES header.

Claims

1. A multiplex scheme conversion apparatus that (i) packet-multiplexes the coded media data using a second scheme which is different from a first scheme by which the coded media data has been packet-multiplexed and (ii) outputs the coded media data that is packet-multiplexed using the second scheme, said multiplex scheme conversion apparatus comprising:

a packet loss judgment unit operable to judge whether or not a packet loss has occurred in the coded media data that is packet-multiplexed using the first scheme;

a loss information making unit operable to make loss information concerning a loss of data, based on a position at which the data is lost in the coded media data, in the case where said packet loss judgment unit is operable to judge that a packet loss has occurred; and

a multiplex unit operable to store the loss information made by said loss information making unit in a packet that is multiplexed using the second scheme and to packet-multiplex the coded media data using the second scheme.

2. The multiplex scheme conversion apparatus according to claim 1, further comprising

a packet separation unit operable to separate a header from a payload of a packet of the coded media data that is packet-multiplexed using the first scheme.

3. The multiplex scheme conversion apparatus according to claim 2,

wherein said packet loss judgment unit is operable to judge whether or not a packet loss has occurred based on the header separated by said packet separation unit.

4. The multiplex scheme conversion apparatus according to claim 2, further comprising

a frame separation unit operable to detect, in the payload separated by said packet separation unit, a boundary of frames in the coded media data and separate the frames,

wherein said loss information making unit is operable to make loss information concerning a loss of data on a frame-by-frame basis based on a position at which the data is lost in the coded media data in the case where said packet loss judgment unit is operable to judge that a packet loss has occurred, and

said multiplex unit is operable to store loss information made, on a frame-by-frame basis, by said loss information making unit, in the packet that is multiplexed using the second scheme.

5. The multiplex scheme conversion apparatus according to claim 4,

wherein said loss information making unit is operable to make, as loss information, information indicating the area including frames (i) at which data necessary for decoding are not lost and (ii) that are placed continuously in a decoding order.

6. The multiplex scheme conversion apparatus according to claim 5,

wherein said loss information making unit is operable to make information concerning a leading frame of the area, as the information indicating the area.

7. The multiplex scheme conversion apparatus according to claim 5,

wherein said loss information making unit is operable to make information concerning a last frame of the area, as the information indicating the area.

8. The multiplex scheme conversion apparatus according to claim 4, further comprising

a table making unit operable to make a table for registering a randomly-accessible frame,

wherein said multiplex unit is operable to judge whether or not data necessary for decoding a frame is lost in the frame, based on a position at which data is lost in the coded media data, at the time of registering, in the table, a randomly-accessible frame in the coded media data, and, in the case where data necessary for decoding a frame is lost in the frame, said multiplex unit is operable not to register, in the table, the frame as a randomly-accessible frame.

9. The multiplex scheme conversion apparatus according to claim 4, further comprising

a conversion unit operable to convert a storage format of the coded media data.

10. The multiplex scheme conversion apparatus according to claim 9,

wherein the frame is composed of one or more sub-frame units, and

said conversion unit is operable to (i) determine sub-frame data to be stored in the packet that is multiplexed using the second scheme and a size of the sub-frame data, based on the position at which data is lost in the coded media data, and (ii) convert the storage format by adding size information of the sub-frame unit to the top of each sub-frame unit.

11. The multiplex scheme conversion apparatus according to claim 9,

wherein the frame is composed of one or more sub-frame units, and

said conversion unit is operable to insert the sub-frame unit indicating a loss of data into the position at which data is lost in the coded media data and to packet-multiplex the coded media data using the second scheme.

12. The multiplex scheme conversion apparatus according to claim 1,

wherein said loss information making unit is operable to make information indicating whether or not data necessary for decoding a predetermined unit is lost, as the loss information.

13. A demultiplexer that decodes packet-multiplexed data of coded media data, comprising:

a loss information extraction unit operable to extract, from the multiplexed data, loss information concerning a loss of data;

a loss information analysis unit operable to determine data to be decoded in the coded media data, based on the loss information extracted by said loss information extraction unit; and

a decode unit operable to decode the data to be decoded determined by said loss information analysis unit.

14. The demultiplexer according to claim 13, further comprising

a loss information notification unit operable to make a notification concerning reproduction quality to a user based on the loss information extracted by said loss information extraction unit.

15. The demultiplexer according to claim 14,

wherein said loss information notification unit is operable to receive an indication of the user based on the notification.

16. A multiplex scheme conversion method for (i) packet-multiplexes the coded media data using a second scheme which is different from a first scheme by which the coded media data has been packet-multiplexed and (ii) outputs the converted coded media data that is packet-multiplexed using the second scheme, said multiplex scheme conversion method comprising:

judging whether or not a packet loss has occurred in the coded media data that is packet-multiplexed using the first scheme;

making loss information concerning a loss of data, based on a position at which the data is lost in the coded media data, in the case where it is judged that a packet loss has occurred; and

storing the loss information made, in said making, in a packet that is multiplexed using the second scheme and packet-multiplexing the coded media data using the second scheme.

17. A program for causing a computer to (i) packet-multiplex the coded media data using a second scheme which is different from a first scheme by which the coded media data has been packet-multiplexed and (ii) output the coded media data that is packet-multiplexed using the second scheme, said program comprising:

judging whether or not a packet loss has occurred in the coded media data that is packet-multiplexed using the first scheme;

making loss information concerning a loss of data, based on a position at which the data is lost in the coded media data, in the case where it is judged that a packet loss has occurred; and

storing the loss information made, in said making, in a packet that is multiplexed using the second scheme and packet-multiplexing the coded media data using the second scheme.