Method and apparatus for multiplexing multi-view three-dimensional moving picture

• US 7,136,415 B2
• Filed: 11/12/2002
• Issued: 11/14/2006
• Est. Priority Date: 08/07/2002
• Status: Active Grant

• Current Assignee: Electronics and Telecommunications Research Institute
• Original Assignee: Electronics and Telecommunications Research Institute
• Inventors: Ahn, Chieteuk, Yun, Kug Jin, Lee, Jin Hwan, Hahm, Young Kwon, Cho, Suk-Hee, Choi, Yun Jung
• Primary Examiner(s): An, Shawn S.
• Application Number:
  US10/291,627
• Publication Number:
  US 20040027452A1
• Time in Patent Office: 1,463 Days
• Field of Search: 375/240.01, 375/240.26, 375/240.28, 348/48, 348/42, 348/52, 348/51, 348/36, 348/47, 382/235
• US Class Current: 375/240.26
• CPC Class Codes: H04N 13/243 using three or more 2D image sensors
• CPC Class Codes: H04N 13/30 Image reproducers optical systems for producing stereoscopic or other three-dimensional effects G02B30/00
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 21/21805 enabling multiple viewpoints, e.g. using a plurality of cameras
• CPC Class Codes: H04N 21/234327 by decomposing into layers, e.g. base layer and one or more enhancement layers
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/2365 Multiplexing of several video streams
• CPC Class Codes: H04N 21/2393 involving handling client requests scheduling or organising the servicing of application requests H04L67/60
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/6587 Control parameters, e.g. trick play commands, viewpoint selection
• CPC Class Codes: H04N 7/17336 Handling of requests in head-ends

Abstract

An apparatus and method for multiplexing a multi-view three-dimensional moving picture according to a user'"'"'s request is disclosed. The apparatus multiplexes a multi-view three-dimensional moving pictures by receiving moving pictures and information inputted from multi-view cameras and generating multi-view encoded streams corresponding to received moving pictures and information, receiving back channel information of the user, selecting necessary multi-view encoded streams according to the back channel information and multiplexing the selected multi-view encoded streams by a frame or a field having same time information. The present invention can effectively process the multi-view three-dimensional moving picture according to the display mode and system environment requested from the user by simplifying a synchronization process.

Claims

1. An apparatus for multiplexing multi-view three-dimensional moving pictures, comprising:

a stream generator for receiving moving pictures and information inputted from a first predetermined number of cameras and generating the first predetermined number of multi-view encoded streams corresponding to the moving pictures and information;

an information receiver for receiving back channel information including viewpoint information and a display mode selected by a user;

a multiplexor for selecting a second predetermined number of multi-view encoded streams among the first predetermined number of the multi-view encoded streams according to the back channel information and multiplexing the selected multi-view encoded streams each having the same time information, on a frame by frame basis or a field by field basis; and

a packetizer for generating a packet having a header and a payload and transmitting the packet, wherein the header includes the back channel information and additional information, which contains information of encoding method of the multi-view encoded streams generated in the stream generator, and the payload includes the multiplexed multi-view encoded stream.

2. The apparatus as recited in claim 1, wherein the display mode includes a two-dimensional display mode, a panorama display mode, a stereoscopic display mode and an auto-stereoscopic display mode.

3. A method for multiplexing multi-view three-dimensional moving pictures, comprising the steps of:

a) receiving moving pictures and information inputted from a first predetermined number of cameras and generating the first predetermined number of multi-view encoded streams corresponding to the moving pictures and information;

b) receiving back channel information including viewpoint information and a display mode selected by a user;

c) selecting a second predetermined number of multi-view encoded streams among the first predetermined number of the multi-view encoded streams according to the back channel information and multiplexing the selected multi-view encoded streams each having the same time information, on a frame by frame basis or a field by field basis; and

d) generating a packet having a header and a payload and transmitting the packet, wherein the header includes the back channel information and additional information, which contains information of encoding method of the multi-view encoded streams generated in the step a), and the payload includes the multiplexed multi-view encoded stream.

4. The method as recited in claim 3 wherein the display mode includes a two-dimensional display mode, a panorama display mode, a stereoscopic display mode and an auto-stereoscopic display mode.

5. The method as recited in claim 4, wherein if the two-dimensional display mode is selected, a multi-view encoded stream of one viewpoint selected by a user is multiplexed and transmitted.

6. The method as recited in claim 4, wherein if the panorama display mode is selected, multi-view encoded streams of two or more viewpoints selected by the user are multiplexed and transmitted.

7. The method as recited in claim 4, wherein if the stereoscopic display mode is selected, multi-view encoded streams of two viewpoints selected by the user are multiplexed and transmitted.

8. The method as recited in claim 4, wherein if the auto-stereoscopic display mode is selected, multi-view encoded streams of two or more viewpoints selected by the user are multiplexed and transmitted.

9. The method as recited in claim 4, wherein the header is generated by using only one among lots of additional information of multi-view encoded streams selected for multiplexing.

10. A computer readable recording medium storing instructions for executing a method for multiplexing multi-view three-dimensional moving pictures, comprising functions of:

a) receiving moving pictures and information inputted from a first predetermined number of cameras and generating the first predetermined number of multi-view encoded streams corresponding to the moving pictures and information;

b) receiving back channel information including viewpoint information and a display mode selected by a user;

c) selecting a second predetermined number of multi-view encoded streams among the first predetermined number of the multi-view encoded streams according to the back channel information and multiplexing the selected multi-view encoded streams each having the same time information, on a frame by frame basis or a field by field basis; and

d) generating a packet having a header and a payload and transmitting the packet, wherein the header includes the back channel information and additional information, which contains information of encoding method of the multi-view encoded streams generated in the step a), and the payload includes the multiplexed multi-view encoded stream.