Stream encoder and stream decoder

• US 20070297509A1
• Filed: 06/20/2007
• Published: 12/27/2007
• Est. Priority Date: 06/21/2006
• Status: Abandoned Application

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Mizobuchi, Tomoki, Goto, Osamu, Higuchi, Toshio, Nagahara, Kosaku, Kusakabe, Tomoaki
• Application Number:
  US11/812,555
• Publication Number:
  US 20070297509A1
• Time in Patent Office: Days
• US Class Current: 375/240.12
• CPC Class Codes: H04N 19/17 the unit being an image region, e.g. an object
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 19/70 characterised by syntax aspects related to video coding, e.g. related to compression standards
• CPC Class Codes: H04N 19/85 using pre-processing or post-processing specially adapted for video compression
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/234336 by media transcoding, e.g. video is transformed into a slideshow of still pictures or audio is converted into text
• CPC Class Codes: H04N 21/234381 by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
• CPC Class Codes: H04N 21/23614 Multiplexing of additional data and video streams arrangements for simultaneous broadcast of plural pieces of information H04H20/28
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/242 Synchronization processes, e.g. processing of PCR [Program Clock References] arrangements for synchronising broadcast or distribution via plural systems in broadcast distribution systems H04H20/18
• CPC Class Codes: H04N 21/42646 for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM
• CPC Class Codes: H04N 21/431 Generation of visual interfaces for content selection or interaction; Content or additional data rendering
• CPC Class Codes: H04N 21/4316 for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window
• CPC Class Codes: H04N 21/434 Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream demultiplexing of data packets for data networks, e.g. RTP/UDP H04L65/00
• CPC Class Codes: H04N 21/4347 Demultiplexing of several video streams
• CPC Class Codes: H04N 21/4348 : Demultiplexing of additional data and video streams
• CPC Class Codes: H04N 21/440263 : by altering the spatial resolution, e.g. for displaying on a connected PDA
• CPC Class Codes: H04N 5/772 : the recording apparatus and the television camera being placed in the same enclosure
• CPC Class Codes: H04N 5/85 : on discs or drums
• CPC Class Codes: H04N 9/8042 : involving data reduction
• CPC Class Codes: H04N 9/8205 : involving the multiplexing of an additional signal and the colour video signal

Abstract

A stream encoder includes a video encoder for receiving and encoding first and second angle video data, and outputting the results as first and second encoded video data, a first video buffer for storing the first encoded video data, and a second video buffer for storing the second encoded video data. The video encoder includes a motion compensation prediction encoder which can encode two or more frames per frame cycle of the first or second angle video data.

Claims

1. A stream encoder comprising:

a video encoder for receiving and encoding first and second angle video data, and outputting the results as first and second encoded video data;

a first video buffer for storing the first encoded video data; and

a second video buffer for storing the second encoded video data,

wherein the video encoder comprises;

a first angle control section for outputting a first angle control signal for controlling switching to be performed every time when encoding of one frame of the first or second angle video data is completed;

a frame selector for selecting and outputting the first or second angle video data in accordance with the first angle control signal;

a motion compensation prediction encoder for encoding an output of the frame selector, and outputting the result as the first or second encoded video data; and

a buffer selector for outputting the first encoded video data to the first video buffer and the second encoded video data to the second video buffer in accordance with the first angle control signal, and

the motion compensation prediction encoder comprises;

a first prediction memory;

a second prediction memory;

a memory selector for outputting reference images for the first and second angle video data to the first and second prediction memories, respectively, in accordance with the first angle control signal;

a motion compensation prediction section for performing a motion compensation prediction process using a reference image stored in any one of the first prediction memory and the second prediction memory in accordance with the first angle control signal,

wherein the motion compensation prediction encoder can encode two or more frames per frame cycle of the first or second angle video data.

2. The stream encoder of claim 1, further comprising:

a system encoder for producing and outputting a stream from the first and second encoded video data and encoded audio data common to the first and second encoded video data,

wherein the system encoder comprises;

a video selector for selecting and outputting the first encoded video data or the second encoded video data from the first video buffer or the second video buffer in accordance with a second angle control signal;

a second angle control section for outputting as the second angle control signal a signal for controlling switching to be performed every time when the number of video frames of the encoded video data selected by the video selector reaches a predetermined frame number;

a video packet generating section for generating and outputting a video packet header from the received first encoded video data or second encoded video data;

an audio packet generating section for generating and outputting an audio packet from the encoded audio data when the first encoded video data is selected in accordance with the second angle control signal;

an audio packet holding section for storing the audio packet; and

an audio selector for selecting and outputting the audio packet output from the audio packet generating section when the first encoded video data is selected in accordance with the second angle control signal, and the audio packet held by the audio packet holding section when the second encoded video data is selected in accordance with the second angle control signal,

wherein the system encoder can encode two or more frames of the first or second encoded video data per frame cycle of the first or second angle video data.

3. The stream encoder of claim 2, wherein

the system encoder further comprises:

a video packet header holding section for storing the video packet header, and

the video packet generating section generates and outputs the video packet header or reads and outputs the video packet header from the video packet header holding section, in accordance with the second angle control signal.

4. The stream encoder of claim 1, further comprising:

a camera control section for controlling shooting magnification factors of a first camera for outputting the first angle video data and a second camera for shooting in the same direction as that of the first camera and outputting the second angle video data, and outputting shooting magnification factor information indicating the shooting magnification factors of the first and second cameras; and

an overlapping video converting section for calculating a portion of video captured by one of the first and second cameras having a smaller shooting magnification factor, the portion overlapping video captured by the other camera, based on the shooting magnification factor information, and converting the overlapping portion into video having a small load in an encoding process.

5. The stream encoder of claim 4, further comprising:

a magnification factor detection compensating section for outputting to the camera control section a signal for adjusting the shooting magnification factors of the first and second cameras so that a boundary of the overlapping portion coincides with a boundary of a macroblock for encoding, based on the shooting magnification factor information received from the camera control section.

6. The stream encoder of claim 4, further comprising:

a bit rate adjusting section for obtaining and outputting, as bit rate information, bit rates at which the pieces of video captured by the first and second cameras are encoded, depending on a proportion of the portion overlapping video captured by the other camera to the video captured by one of the first and second cameras having the shooting magnification factor lower than that of the other,

wherein the video encoder further comprises;

an encoding control section for adjusting the bit rates at which the first and second angle video data are encoded, based on the first angle control signal and the bit rate information.

7. The stream encoder of claim 1, further comprising:

a camera control section for controlling shooting magnification factors of a first camera for outputting the first angle video data and a second camera for shooting in the same direction as that of the first camera and outputting the second angle video data, and outputting shooting magnification factor information indicating the shooting magnification factors of the first and second cameras; and

a zoom region information adding section for calculating a portion of video captured by one of the first and second cameras having a smaller shooting magnification factor, the portion overlapping video captured by the other camera, based on the shooting magnification factor information, and combining and outputting a display indicating a range of the video captured by the other camera with the video captured by the one camera having the smaller shooting magnification factor.

8. The stream encoder of claim 1, further comprising:

a camera control section for controlling shooting magnification factors of a first camera for outputting the first angle video data and a second camera for shooting in the same direction as that of the first camera and outputting the second angle video data, and outputting shooting direction information indicating shooting directions of the first and second cameras; and

a camera deviation detecting section for detecting a change in positions and shooting directions of the first and second cameras based on the shooting direction information, and when a change in any of the position and the shooting direction is detected, outputting a signal for controlling to simultaneously display pieces of video of the first and second angle video data.

9. A stream decoder comprising:

a data reading section for reading and outputting stream data including first encoded video data, and second encoded video data obtained by shooting in the same direction as a direction in which the first encoded video data is captured and with a magnification factor higher than that of the first encoded video data;

a data transferring section for receiving the stream data output by the data reading section, separating the stream data into the first and second encoded video data, and outputting the first and second encoded video data;

a first decoder for decoding the first encoded video data and outputting first video data;

a second decoder for decoding the second encoded video data and outputting second video data;

a resizing process section for converting the second video data into video data having a size of a portion overlapping video of the first video data and outputting the resultant video data; and

a combining section for superposing and combining the video after the conversion in the resizing process section with the portion overlapping the video of the first video data, and outputting the resultant video data.