Multimedia information processing system

• US 5,671,226 A
• Filed: 06/05/1995
• Issued: 09/23/1997
• Est. Priority Date: 02/09/1995
• Status: Expired due to Term

• Current Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Original Assignee: Mitsubishi Denki Kabushiki Kaisha (Mitsubishi Electric Corporation)
• Inventors: Murakami, Tokumichi, Kato, Yoshiaki, Matsuzaki, Kazuhiro, Ohira, Hideo
• Primary Examiner(s): MARCELO, MELVIN C
• Application Number:
  US08/462,519
• Time in Patent Office: 841 Days
• Field of Search: 370/60, 370/60.1, 370/94.1, 370/94.2, 370/99, 370/389, 370/474, 370/537-541, 348/423, 348/429, 395/514 A
• US Class Current: 370/474
• CPC Class Codes: H04N 21/236 Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream multiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2368 Multiplexing of audio and video streams
• CPC Class Codes: H04N 21/2383 Channel coding or modulation of digital bit-stream, e.g. QPSK modulation arrangements for detecting or preventing errors in the information received by adapting the channel coding H04L1/0009; analogue front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/4302 Content synchronisation processes, e.g. decoder synchronisation
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4341 Demultiplexing of audio and video streams
• CPC Class Codes: H04N 21/4344 Remultiplexing of multiplex streams, e.g. by modifying time stamps or remapping the packet identifiers
• CPC Class Codes: H04N 21/4348 Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/4382 Demodulation or channel decoding, e.g. QPSK demodulation analog front ends or means for connecting modulators, demodulators or transceivers to a transmission line H04L27/0002
• CPC Class Codes: H04N 21/64322 IP
• CPC Class Codes: H04N 7/52 Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal assembling of a multiplex stream by combining a video stream with other content or additional data, remultiplexing of multiplex streams, insertion of stuffing bits into the multiplex stream, assembling of a packetised elementary stream at server side H04N21/236; disassembling of a multiplex stream, remultiplexing of multiplex streams, extraction or processing of Service Information, disassembling of packetised elementary stream at client side H04N21/434

Abstract

A multimedia information processing system comprises an information-source coding section for generating an element packet containing coded multimedia information and additional information to specify the packet, a packet multiplexing section for generating multiplexed stream by multiplexing the element packet, and a transmission processing section for outputting the multiplexed stream as a transmission signal corresponding transmission media. In this multimedia information processing system, a processing sequence from selection of multimedia information to transmission or storage processing is classified, and the processing contents and input/output data are determined for each hierarchy. Data exchange between services such as broadcasting, communication, storage in computer and so on can be easily attained. Additionally, hardware structure of this system can be simplified, and additional functions can be easily added.

Claims

1. A multimedia information processing system executing transmission and/or storage of multimedia information from a respective media unit, the system comprising:

information-source coding means for inputting media information, coding the media information from the respective media unit, adding sub-information pertaining to media identification, packet synchronization and synchronization between elements that form the media information, and generating element packets constructed in signal forms that have interchangeability with other systems;

packet multiplexing means for executing speed matching and multiplexing of the element packets for the respective media unit which said information-source coding means outputs, and generating multiplexed streams in signal forms that have interchangeability between systems; and

transmitting processing means for converting said multiplexed streams in accordance with transmission media and/or storage media and outputting transmission signals.

2. A multimedia information processing system according to claim 1, further comprising:

element media selecting means for editing the media information into element media information; and

wherein said information-source coding means comprises;

coding means for reducing the amount of said element media information; and

element packet generating means for inputting the output of said coding means to generate element packets.

3. A multimedia information processing system according to claim 1, wherein said packet multiplexing means comprises:

packet generating means for adding additional information to the element packets for media identification corresponding to the media information, and synchronization information for packet reproduction; and

packet multiplexing means for executing speed matching for the element packets and for, generating multiplexed streams.

4. A multimedia information processing system according to claim 1, wherein said transmitting processing means comprises:

error correction coding means for correcting errors in accordance with transmission media or storage media;

transmission frame generating means for processing transmission framing to output data of said error correction coding means; and

modulating means for modulating output data of said transmission frame generating means for transmitting or recording.

5. A multimedia information processing system according to claim 1, further comprising:

software processing means having application program for changing operation modes of said information-source coding means or said packet multiplexing means.

6. A multimedia information processing system according to claim 1, wherein said packet multiplexing means adds additional information to the element packets pertaining to media identification corresponding to media information, packet synchronization, and fixed packet length synchronization, and said packet multiplexing means multiplexes by using a fixed-length packet as a unit while executing speed matching.

7. A multimedia information processing system according to claim 1, wherein said transmitting processing means executes TCP/UDP/XTP processing for the multiplexed streams, and then executes IP processing to send the multiplexed stream to internet protocol transmission line.

8. A multimedia information processing system according to claim 1, further comprising:

element packet storage means for storing an element packet generated by the information-source coding means by using the element packet as a unit;

address managing means for memorizing addresses of the element packet stored in said element packet storage means; and

element packet transmitting means for outputting the element packet indicated by said address managing means from said element packet storage means to the packet multiplexing means.

9. A multimedia information processing system according to claim 1, further comprises:

multiplexed stream storage means for storing a multiplexed stream generated by the packet multiplexing means;

multiplexed stream managing means for memorizing the address of said multiplexed stream stored in said multiplexed stream storage means; and

multiplexed stream transmitting means for outputting the multiplexed stream indicated by the multiplexed stream managing means from said multiplexed stream storage means to said transmitting processing means.

10. A multimedia information processing system executing reception and/or storage of multimedia information comprises:

receive processing means for decoding a packet multiplexed signal transmitted in a format suited to a particular transmission media, in accordance with the characteristics of said transmission media to output a multiplexed stream;

packet separating means for separating an element packet required for generating media information at a media unit from the multiplexed stream; and

information-source decoding means for executing information-source decoding of the separated element packet at the media unit and reproducing media information according to additional information added to the separated element packet to execute media identification, packet synchronization and reproductive synchronization.

11. A multimedia information processing system according to claim 10, wherein said receive processing means comprises:

demodulating means for demodulating the packet multiplexed signal in accordance with the characteristics of transmission media;

transmission frame reproducing means for establishing transmission frame synchronization from the output signal of said demodulating means to decompose frame; and

error correction decoding means for establishing error correction frame synchronization from the output of said transmission frame reproducing means to execute error correction decoding and outputting multiplexed stream.

12. A multimedia information processing system according to claim 11, wherein when uncorrectable error has been generated, the error correction decoding means outputs a correction generating signal that indicates the area where the error exists in addition to multiplexed stream.

13. A multimedia information processing system according to claim 10, wherein said information-source decoding means comprises:

packet separating means for separating additional information in the element packet, and coded element media information;

decoding means for decoding said coded element media information; and

decoded data reproducing means for synchronizing decoded element media information, which said information-source decoding means output, to generate media information.

14. A multimedia information processing system according to claim 10, further comprises:

software processing means having an application program that changes operation mode of said information-source decoding processing means or said packet separating means.

15. A multimedia information processing system according to claim 10, wherein said packet separating means separates multiplexed stream multiplexed by using an element packet as a unit, to each element packet unit and outputs each element packet to said information-source decoding processing means.

16. A multimedia information processing system according to claim 10, wherein said packet separating means separates multiplexed stream multiplexed by using a fixed length packet in which divided element packets were contained as a unit, to a fixed length packet unit to reform the element packet, and outputs each element to said information-source decoding processing means.

17. A multimedia information processing system according to claim 10, wherein said receive processing means executes IP processing of data that is transmitted from an internet protocol transmission line, and then, executes TCP/UDP/XTP processing to receive packet multiplexed stream.

18. A-multimedia information processing system according to claim 10, wherein said packet separating means comprises:

received element packet storage portion for storing separated element packets;

received program managing means for memorizing the addresses of the element packets stored in said received element packet storage portion; and

received element packet reading means for outputting an element packet necessary for generating a program instructed from said received program managing means, from said received element packet storage means to said information-source decoding processing means.

19. A multimedia information processing system executing transmission and/or storage of multimedia information comprises:

received processing means for inputting packet multiplexed signals which are multiplexed into packet and transmitted in a format suited to a particular transmission media, from one or more transmission media, and generating a packet multiplexed stream for each transmission media;

packet separating means for separating the packet multiplexed stream into an element packet for each transmission media;

packet re-multiplexing means for re-multiplexing the element packet into one multiplexed stream; and

transmission processing means for outputting the one multiplexed stream, which said packet re-multiplexing means outputs, to a transmission media as a transmission signal in accordance with characteristics of the transmission media.

20. A multimedia information processing system comprises:

information-source coding processing means for executing information-source coding of respective different types of signals to generate respective coded bit sequences;

media multiplexing means for storing identification information to identify the type of signal and the respective coded bit sequences in a fixed length packet unit to generate a fixed length packet sequence;

structure multiplexing means for setting a predetermined number of fixed length packets in said fixed length packet sequence, into a given sized frame together with various data; and

transmission processing means for generating a transmission signal with a transmission frame suited to a particular transmission media corresponding to the frame sequence output from said structure multiplexing means.

21. A multimedia information processing system according to claim 20, wherein said structure multiplexing means multiplexes the fixed length packet with data of control information, instruction information or clock information.

22. A multimedia information processing system comprises:

receive processing means for receiving a transmission signal having transmission frame sequences each having a predetermined number of fixed length packets in a predetermined sized frame together with various data, and for reproducing multiplexed bit sequences;

structure separating means for reproducing fixed length packet sequences and various data from said multiplexed bit sequence;

media separating means for taking out fixed length packets from the fixed length packet sequences, and reproducing coded bit sequences corresponding to identification information that identifies a type of transmission signal; and

information-source decoding processing means for decoding said coded bit sequence to reproduce the transmission signal in accordance with a particular kind of transmission media.

23. A multimedia information processing system according to claim 23, wherein said structure separating means separates various data from said multiplexed bit sequence, such as control information, instruction information or clock information, and a fixed length packet.