Stereoscopic coding system

• US 5,633,682 A
• Filed: 10/21/1994
• Issued: 05/27/1997
• Est. Priority Date: 10/22/1993
• Status: Expired due to Term

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Tahara, Katsumi
• Primary Examiner(s): Britton, Howard W.
• Assistant Examiner(s): Le, Vu
• Application Number:
  US08/327,364
• Time in Patent Office: 949 Days
• Field of Search: 348/43, 348/42, 348/44, 348/46, 348/48, 348/51, 348/384, 348/394, 348/400-407, 348/409-413, 348/416
• US Class Current: 375/240.23
• CPC Class Codes: H04N 13/10 Processing, recording or transmission of stereoscopic or multi-view image signals
• CPC Class Codes: H04N 13/15 for colour aspects of image signals
• CPC Class Codes: H04N 13/189 Recording image signals; Reproducing recorded image signals
• CPC Class Codes: H04N 13/194 Transmission of image signals
• CPC Class Codes: H04N 13/239 using two 2D image sensors having a relative position equal to or related to the interocular distance H04N13/243 takes precedence
• CPC Class Codes: H04N 13/341 using temporal multiplexing
• CPC Class Codes: H04N 13/363 using image projection screens volumetric display H04N13/388
• CPC Class Codes: H04N 13/398 Synchronisation thereof; Control thereof
• CPC Class Codes: H04N 19/597 specially adapted for multi-view video sequence encoding
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 2013/0085 Motion estimation from stereoscopic image signals

Abstract

A coding system for transmitting stereo image data, wherein an image for the left eye is disposed in odd fields and an image for the right eye is disposed in even fields, respectively. Frames F1, F2, F3 and F4 are sequentially coded in an order of I picture, B picture, P picture and B picture. The picture in each frame is coded by adaptively switching between a frame prediction mode or field prediction mode or a frame DCT mode or field DCT mode. Thereby, the parallax can be efficiently coded.

Claims

1. An image signal coding method, comprising the steps of:

receiving a first image signal and a second image signal, said first and second image signals representing stereoscopic images perceived by left and right eyes;

producing a stereo image signal from said first and second image signals, said stereo image signal including frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal;

dividing each of said frames of said stereo image signal into units of blocks;

selecting either a first prediction mode or a second prediction mode;

frame prediction encoding, when said first prediction mode is selected, each of said frames to produce a predictively coded signal;

field prediction encoding, when said second prediction mode is selected, said first and second fields of a frame using data from other first or second fields of a frame to produce said predictively coded signal;

orthogonally transforming the predictively coded signal to produce an orthogonally transformed signal;

quantizing the orthogonally transformed signal to produce a quantized signal; and

variable length coding the quantized signal.

2. The image signal coding method according to claim 1 wherein said stereo image signal includes groups of frames, each group having a plurality of frames, and the step of field prediction encoding is carried out by producing a predictively coded signal such that the first and second fields of a first one of said frames in said each group are both intracoded to produce intraframe encoded pictures, the first and second fields of a second one of said frames are both bidirectionally-predictively coded to produce bidirectional-predictive-encoded pictures, and the first and second fields of a third one of said frames are both predictively coded to produce predictive-encoded pictures.

3. The image signal coding method of claim 1, wherein the step of field prediction encoding is carried out by field prediction encoding the first field of a frame from either a first field or a second field of one of said frames, and by field prediction encoding the second field of said frame from either a first field or a second field of one of said frames.

4. An image signal coding apparatus, comprising:

means for receiving a first image signal and a second image signal, said first and second image signals representing stereoscopic images perceived by left and right eyes;

means for producing a stereo image signal from said first and second image signals, said stereo image signal including frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal;

means for dividing each of said frames of said stereo image signal into units of blocks

means for selecting either a first prediction mode or a second prediction mode;

means for frame prediction encoding, when said first prediction mode is selected, each of said frames to produce a predictively coded signal;

means for field prediction encoding, when said second prediction mode is selected, said first and second fields of a frame using data from other first or second fields of a frame to produce said predictively coded signal;

means for orthogonally transforming the predictively coded signal to produce an orthogonally transformed signal;

quantization means for quantizing the orthogonally transformed signal to produce a quantized signal; and

variable length coding means for variable length coding the quantized signal.

5. The image signal coding apparatus according to claim 4, wherein said stereo image signal includes groups of frames, each group having a plurality of frames, and the step of field prediction encoding is carried out by producing a predictively coded signal such that the first and second fields of a first one of said frames in said each group are both intracoded to produce intraframe encoded pictures, the first and second fields of a second one of said frames are both bidirectionally-predictively coded to produce bidirectional-predictive-encoded pictures, and the first and second fields of a third one of said frames are both predictively coded to produce predictive-encoded pictures.

6. The image signal coding apparatus of claim 4, wherein the means for field prediction encoding is operable to field prediction encode the first field of a frame from either a first field or a second field of one of said frames, and to field prediction encode the second field of said frame from either a first field or a second field of one of said frames.

7. An image signal decoding method for decoding a coded stereo image signal produced from first and second image signals representing stereoscopic images perceived by left and right eyes, said stereo image signal including frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal, each of said frames being either frame prediction encoded or field prediction encoded and having a respective prediction flag indicating the type of prediction coding, and each of said field prediction encoded frames having encoded first and second fields encoded using data from other first or second fields of a frame, the decoding method comprising steps of:

variable length decoding the coded stereo image signal to produce a variable length decoded signal;

separating each said prediction flag from said coded stereo image signal;

inversely quantizing the variable length decoded signal to produce an inverse quantized signal;

inverse orthogonally transforming the inverse quantized signal;

producing a prediction error signal corresponding to the orthogonally transformed signal based on said prediction flag; and

decoding the orthogonally transformed signal using said prediction error signal.

8. An image signal decoding apparatus for decoding a coded stereo image signal produced from first and second image signals representing stereoscopic images perceived by left and right eyes, said stereo image signal including frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal, each of said frames being either frame prediction encoded or field prediction encoded and having a respective prediction flag indicating the type of prediction coding, and each of said field prediction encoded frames having encoded first and second fields encoded using data from other first or second fields of a frame, the decoding apparatus comprising:

variable length decoding means for variable length decoding the coded stereo image signal to produce a variable length decoded signal and for separating each said prediction flag from said coded stereo image signal;

inverse quantization means for inversely quantizing the variable length decoded signal to produce an inverse quantized signal;

means for inverse orthogonally transforming the inverse quantized signal;

producing means for producing a prediction error signal corresponding to the inverse orthogonally transformed signal based on said prediction flag; and

decoding means for decoding the inverse orthogonally transformed signal using said prediction error signal.

9. An image signal coding method, comprising the steps of:

receiving a first image signal and a second image signal, said first and second image signals representing stereoscopic images perceived by left and right eyes;

producing a stereo image signal from said first and second image signals, said stereo image signal including frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal;

predictively coding said stereo image signal to produce a predictively coded signal;

selecting either a first transformation mode or a second transformation mode;

dividing each frame of the predictively coded signal into units of blocks, each of said blocks including data of both said first and second fields when said first transformation mode is selected, and each of said blocks corresponding to only one of said first and second fields when said second transformation mode is selected;

orthogonally transforming the blocks of the predictively coded signal to produce an orthogonally transformed signal;

quantizing the orthogonally transformed signal to produce a quantized signal; and

variable length coding the quantized signal.

10. The image signal coding method according to claim 9, wherein said step of orthogonally transforming is carried out by discrete cosine transforming the blocks to produce a discrete cosine transformed signal.

11. An image signal coding apparatus, comprising:

means for receiving a first image signal and a second image signal, said first and second image signals representing stereoscopic images perceived by left and right eyes;

producing a stereo image signal from said first and second image signals, said stereo image signal including frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal;

predictive coding means for predictively coding said stereo image signal to produce a predictively coded signal;

means for selecting either a first transformation mode or a second transformation mode;

means for dividing each frame of the predictively coded signal into units of blocks, each of said blocks including data of both said first and second fields when said first transformation mode is selected, and each of said blocks corresponding to only one of said first and second fields when said second transformation mode is selected;

means for orthogonally transforming the blocks of the predictively coded signal to produce an orthogonally transformed signal;

quantization means for quantizing the orthogonally transformed signal to produce a quantized signal; and

variable length coding means for variable length coding the quantized signal.

12. The image signal coding apparatus according to claim 11, wherein said means for orthogonally transforming is a discrete cosine transformer.

13. An image signal decoding method for decoding a coded stereo image signal produced from first and second image signals representing stereoscopic images perceived by left and right eyes, said stereo image signal including frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal, each of said frames being divided into units of blocks each corresponding to both first and second fields of the respective frame in a first transformation mode and being divided into units of blocks each corresponding to either only said first or second field of the respective frame in a second transformation mode, and having a respective transformation flag indicating the transformation mode during coding, the decoding method comprising steps of:

variable length decoding the coded stereo image signal to produce a variable length decoded signal;

separating each said transformation flag from said coded stereo image signal;

inversely quantizing the variable length decoded signal to produce an inverse quantized signal;

inverse orthogonally transforming the inverse quantized signal to produce an inverse transformed signal;

producing a prediction error signal corresponding to the inverse transformed signal based on said transformation flag; and

decoding the inverse transformed signal using said prediction error signal.

14. The image signal decoding method according to claim 13, wherein said coded stereo image signal includes groups of frames, each group having a plurality of frames, the first and second fields of a first one of said frames in said each group are both intraframe encoded pictures, the first and second fields of a second one of said frames are both bidirectional-predictive-encoded pictures, and the first and second fields of a third one of said frames are both predictive-encoded pictures.

15. An image signal decoding apparatus for decoding a coded stereo image signal produced from first and second image signals representing stereoscopic images perceived by left and right eyes, said stereo image signal including frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal, each of said frames being divided into units of blocks each corresponding to both first and second fields of the respective frame in a first transformation mode and being divided into units of blocks each corresponding to either only said first or second field of the respective frame in a second transformation mode, and having a respective transformation flag indicating the transformation mode during coding, said decoding apparatus comprising:

variable length decoding means for variable length decoding the coded stereo image signal and for separating each said transformation flag from said coded stereo image signal;

inverse quantization means for inversely quantizing the variable length decoded signal to produce an inverse quantized signal;

means for inverse orthogonally transforming the inverse quantized signal to produce an inverse transformed signal;

producing means for producing a prediction error signal corresponding to the inverse transformed signal based on said transformation flag; and

decoding means for decoding the inverse transformed signal using said prediction error signal.

16. The image signal decoding according to claim 15, wherein said stereo image signal includes groups of frames, each group having a plurality of frames, the first and second fields of a first one of said frames in said each group are both intraframe encoded pictures, the first and second fields of a second one of said frames are both bidirectional-predictive-encoded pictures, and the first and second fields of a third one of said frames are both predictive-encoded pictures.

17. An image signal coding method, comprising the steps of:

receiving a first image signal and a second image signal, said first and second image signals representing stereoscopic images perceived by left and right eyes;

producing a stereo image signal from said first and second image signals, said stereo image signal including groups of frames, each group having a plurality of frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal;

coding each said first and second fields of each said frame in each said group of said stereo image signal to produce a predictively coded signal, said first field of a first one of said frames in said each group being intracoded to produce an intraframe encoded picture, said second field of said first one of said frames being predictively coded to produce a predictive-encoded picture, and said first and second fields of a second one of said frames in said each group being predictively coded to produce predictive-encoded pictures, and said first field of said second frame in said each group being predictively coded using a selected one of said first and second fields of said first frame as a prediction image signal;

orthogonally transforming the predictively coded signal to produce an orthogonally transformed signal;

quantizing the orthogonally transformed signal to produce a quantized signal; and

variable length coding the quantized signal.

18. The image signal coding method of claim 17, wherein said second field of each except the first of said frames in said each group is predictively coded using a selected one of said first field of the respective frame and said second field of a previous frame as the prediction image signal.

19. An image signal coding apparatus, comprising the steps of:

means for receiving a first image signal and a second image signal, said first and second image signals representing stereoscopic images perceived by left and right eyes;

means for producing a stereo image signal from said first and second image signals, said stereo image signal including groups of frames, each group having a plurality of frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal;

predictive coding means for coding each said first and second fields of each said frame in each said group of said stereo image signal to produce a predictively coded signal, said first field in a first one of said frames in said each group being intracoded to produce an intraframe encoded picture, said second field of said first one of said frames being predictively coded to produce a predictive-encoded picture, and said first and second fields of a second one of said frames in said each group being predictively coded to produce predictive-encoded pictures, and said first field of said second frame in said each group being predictively coded using a selected one of said first and second fields of said first frame as a prediction image signal;

means for orthogonally transforming the predictively coded signal to produce an orthogonally transformed signal;

quantization means for quantizing the orthogonally transformed signal to produce a quantized signal; and

variable length coding means for variable length coding the quantized signal.

20. The image signal coding apparatus of claim 19, wherein said predictive coding means is operable to predictively code the second field of each except the first of said frames in said each group using a selected one of said first field of the respective frame and said second field of a previous frame as the prediction image signal.

21. An image signal decoding method for decoding a coded stereo image signal produced from first and second image signals representing stereoscopic images perceived by left and right eyes, said stereo image signal including groups of frames, each group having a plurality of frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal, said first field in a first one of said frames in said each group being an intraframe encoded picture, said second field of said first one of said frames being a predictive-encoded picture, and said first and second fields of a second one of said frames in said each group being predictive-encoded pictures, and said first field of said second frame in said each group being predictively coded using a selected one of said first and second fields of said first frame as a prediction image signal, the decoding method comprising steps of:

variable length decoding the coded stereo image signal to produce a variable length decoded signal;

inversely quantizing the variable length decoded signal to produce an inverse quantized signal;

inverse orthogonally transforming the inverse quantized signal;

producing a prediction error signal corresponding to the orthogonally transformed signal; and

decoding the orthogonally transformed signal using said prediction error signal.

22. An image signal decoding apparatus for decoding a coded stereo image signal produced from first and second image signals representing stereoscopic images perceived by left and right eyes, said stereo image signal including groups of frames, each group having a plurality of frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal, said first field in a first one of said frames in said each group being an intraframe encoded picture, said second field of said first one of said frames being a predictive-encoded picture, and said first and second fields of a second one of said frames in said each group being predictive-encoded pictures, and said first field of said second frame in said each group being predictively coded using a selected one of said first and second fields of said first frame as a prediction image signal, the decoding apparatus comprising:

variable length decoding means for variable length decoding the coded stereo image signal to produce a variable length decoded signal;

inverse quantization means for inversely quantizing the variable length decoded signal to produce an inverse quantized signal;

means for inverse orthogonally transforming the inverse quantized signal;

producing means for producing a prediction error signal corresponding to the orthogonally transformed signal; and

decoding means for decoding the orthogonally transformed signal using said prediction error signal.

23. An image signal coding method, comprising the steps of:

receiving a first image signal and a second image signal, said first and second image signals representing stereoscopic images perceived by left and right eyes;

producing a stereo image signal from said first and second image signals, said stereo image signal including groups of frames, each group having a plurality of frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal;

coding each said first and second fields of each said frame in each said group of said stereo image signal to produce a predictively coded signal, said first field of a first one of said frames in said each group being intracoded to produce an intraframe encoded picture, said second field of said first one of said frames being predictively coded to produce a predictive-encoded picture, said first and second fields of a second one of said frames in said each group being bidirectionally-predictively coded to produce bidirectional-predictive-encoded pictures, and said first and second fields of a third one of said frames in said each group being predictively coded to produce predictive-encoded pictures, and each of said first and second fields of said second frame in said each group being bidirectionally-predictively coded using first and second prediction image signals, said first prediction image signal corresponding to a selected one of said first and second fields of said first frame, and said second prediction image signal corresponding to a selected one of said first and second fields of said third frame;

orthogonally transforming the predictively coded signal to produce an orthogonally transformed signal;

quantizing the orthogonally transformed signal to produce a quantized signal; and

variable length coding the quantized signal.

24. An image signal coding apparatus, comprising the steps of:

means for receiving a first image signal and a second image signal, said first and second image signals representing stereoscopic images perceived by left and right eyes;

means for producing a stereo image signal from said first and second image signals, said stereo image signal including groups of frames, each group having a plurality of frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal;

predictive coding means each said first and second fields of each said frame in each said group of said stereo image signal to produce a predictively coded signal, said first field of a first one of said frames in said each group being intracoded to produce an intraframe encoded picture, said second field of said first one of said frames being predictively coded to produce a predictive-encoded picture, said first and second fields of a second one of said frames in said each group being bidirectionally-predictively coded to produce bidirectional-predictive-encoded pictures, and said first and second fields of a third one of said frames in said each group being predictively coded to produce predictive-encoded pictures, and each of said first and second fields of said second frame in said each group being bidirectionally-predictively coded using first and second prediction image signals, said first prediction image signal corresponding to a selected one of said first and second fields of said first frame, and said second prediction image signal corresponding to a selected one of said first and second fields of said third frame;

means for orthogonally transforming the predictively coded signal to produce an orthogonally transformed signal;

quantization means for quantizing the orthogonally transformed signal to produce a quantized signal; and

variable length coding means for variable length coding the quantized signal.

25. An image signal decoding method for decoding a coded stereo image signal produced from first and second image signals representing stereoscopic images perceived by left and right eyes, said stereo image signal including groups of frames, each group having a plurality of frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal, said first field of a first one of said frames in said each group being an intraframe encoded picture, said second field of said first one of said frames being a predictive-encoded picture, said first and second fields of a second one of said frames in said each group being bidirectional-predictive-encoded pictures, and said first and second fields of a third one of said frames in said each group being predictive-encoded pictures, and each of said first and second fields of said second frame in said each group being bidirectionally-predictively coded using first and second prediction image signals, said first prediction image signal corresponding to a selected one of said first and second fields of said first frame, and said second prediction image signal corresponding to a selected one of said first and second fields of said third frame, the decoding method comprising steps of:

variable length decoding the coded stereo image signal to produce a variable length decoded signal;

inversely quantizing the variable length decoded signal to produce an inverse quantized signal;

inverse orthogonally transforming the inverse quantized signal;

producing a prediction error signal corresponding to the orthogonally transformed signal; and

decoding the orthogonally transformed signal using said prediction error signal.

26. An image signal decoding apparatus for decoding a coded stereo image signal produced from first and second image signals representing stereoscopic images perceived by left and right eyes, said stereo image signal including groups of frames, each group having a plurality of frames, each of said frames having a first field corresponding to said first image signal and a second field corresponding to said second image signal, said first field of a first one of said frames in said each group being an intraframe encoded picture, said second field of said first one of said frames being a predictive-encoded picture, said first and second fields of a second one of said frames in said each group being bidirectional-predictive-encoded pictures, and said first and second fields of a third one of said frames in said each group being predictive-encoded pictures, and each of said first and second fields of said second frame in said each group being bidirectionally-predictively coded using first and second prediction image signals, said first prediction image signal corresponding to a selected one of said first and second fields of said first frame, and said second prediction image signal corresponding to a selected one of said first and second fields of said third frame, the decoding apparatus comprising:

variable length decoding means for variable length decoding the coded stereo image signal to produce a variable length decoded signal;

inverse quantization means for inversely quantizing the variable length decoded signal to produce an inverse quantized signal;

means for inverse orthogonally transforming the inverse quantized signal;

producing means for producing a prediction error signal corresponding to the orthogonally transformed signal; and

decoding means for decoding the orthogonally transformed signal using said prediction error signal.