Moving image signal coding apparatus and coded signal decoding apparatus

• US RE36,822 E
• Filed: 10/02/1998
• Issued: 08/15/2000
• Est. Priority Date: 11/08/1991
• Status: Expired due to Term

• Current Assignee: JVC Kenwood Corporation
• Original Assignee: Victor Company of Japan Limited (JVC Kenwood Corporation)
• Inventors: Sugiyama, Kenji
• Primary Examiner(s): Couso, Jose L.
• Application Number:
  US09/165,356
• Time in Patent Office: 683 Days
• Field of Search: 382/232, 382/234, 382/236, 382/238, 382/250, 358/342, 348/409, 348/415, 348/416, 348/420, 348/421, 348/423, 348/384
• US Class Current: 382/236
• CPC Class Codes: H04N 19/51 Motion estimation or motion compensation
• CPC Class Codes: H04N 19/517 by encoding
• CPC Class Codes: H04N 19/577 Motion compensation with bidirectional frame interpolation, i.e. using B-pictures
• CPC Class Codes: H04N 19/89 involving methods or arrangements for detection of transmission errors at the decoder

Abstract

A coding apparatus which codes moving image signals into block units, is configured from a signal processing element which performs motion compensation for moving image signals for over a plural number of frames or fields and codes inter-image signals, and a transfer element which recombines coded information for each block coded by said processing element, into macroblock units which are a plural number of block units of each type of coded information, and transfers them. In addition, a decoding apparatus for moving image signals which have been coded in block units is configured from a detector element which detects transfer code errors for each type of coded information, and a processing element which performs motion compensation and inter-image processing of the coded information using only correct frames which do not include transfer code errors, and without using frames which have transfer code errors, by changing a method of inter-frame processing for motion compensation in accordance with the transfer coding errors in the coded information which has been detected for each type.

Claims

1. A coding apparatus for coding moving image signals into block units, comprising:

image processing means for performing motion compensation between a plural number of frames.Iadd./fields per .Iaddend..[.in each.]. block of a plurality of blocks which constitute one .[.image screen.]. .Iadd.frame/field.Iaddend., thereby outputting motion vector data, inter-image processing data indicative of what inter-image processing is performed, and image data, respectively;

a plurality of data memory means for storing multiple types of said motion vector data, said inter-image processing data, and said image data; and

transfer means for time division multiplexing said multiple types of said motion vector data, said inter-image processing data, and said image data, such that said multiple types of said motion vector data for a group of blocks are time multiplexed together in one time division, the inter-image processing data for said group of blocks is time multiplexed together in another time division, and said image data for said group of blocks is time multiplexed to a further time division, and thereby transferring the multiplexed data.

2. The coding apparatus of claim 1, wherein:

said image processing means comprises;

a first changeover switch which switches signals of a bidirection (B) frame.Iadd./field .Iaddend.predicted for front and back of image signals supplied via the first changeover switch and an image signal input terminal, and both signals of a skip-predicted prediction (P) frame.Iadd./field .Iaddend.and an independently-coded intra- (I) frame/.Iadd.field.Iaddend.;

a first frame.Iadd./field .Iaddend.memory which stores signals of said B-frame.Iadd./field .Iaddend.so as to delay them until the end of coding of signals of both said I-frame.Iadd./field .Iaddend.and P-frame.Iadd./field.Iaddend.;

a second changeover switch which switches B-frame.Iadd./field .Iaddend.signals from said first frame.Iadd./field .Iaddend.memory and said I- and P-frame.Iadd./field .Iaddend.signals switched by said first changeover switch;

first and second motion vector estimators which estimate motion vectors of signals of both said I-frame.Iadd./field .Iaddend.and said P-frame.Iadd./field.Iaddend.;

an adaptive predictor which receives signals of frames.Iadd./fields .Iaddend.switched by said second changeover switch;

a residual subtracter which calculates a remainder of signals of frames.Iadd./fields .Iaddend.switched by said second changeover switch, and prediction mode of output information output from said adaptive predictor;

an intra-frame.Iadd./field .Iaddend.coder which codes signals output from said residual subtracter;

a third changeover switch which switches coded signals from said intra-frame.Iadd./field .Iaddend.coder on the basis of B-frames.Iadd./fields.Iaddend., and I-frames.Iadd./fields .Iaddend.and P-frames.Iadd./fields.Iaddend.;

an intra-frame.Iadd./field .Iaddend.decoder which decodes coded signals of each frame.Iadd./field .Iaddend.and from said third changeover switch;

a residual adder which adds signals from said intra-frame.Iadd./field .Iaddend.decoder and said adaptive predictor;

a second frame.Iadd./field .Iaddend.memory which stores one of I-frame.Iadd./field .Iaddend.and P-frame.Iadd./field .Iaddend.signals from said adder so as to delay them;

a third frame.Iadd./field .Iaddend.memory which stores another of I-frame.Iadd./field .Iaddend.and P-frame.Iadd./field .Iaddend.signals which have passed through said second frame.Iadd./field .Iaddend.memory;

said first motion vector estimator which estimates a motion vector of moving image signals for one of I-frames.Iadd./fields .Iaddend.and P-frames.Iadd./fields .Iaddend.said motion vector being supplied via said first changeover switch;

said second motion vector estimator which estimates .[.an other.]. .Iadd.another .Iaddend.motion vector of moving image signals for another of I-frames.Iadd./fields .Iaddend.and P-frames.Iadd./fields.Iaddend., said other motion vector being supplied via said first changeover switch;

a first motion compensator which performs motion compensation of moving image signals of F-frames.Iadd./fields.Iaddend., by an output of said third frame.Iadd./field .Iaddend.memory and an output of said first motion vector estimator; and

a second motion compensator which performs motion compensation of moving image signals of B-frames.Iadd./fields.Iaddend., by an output of said second frame.Iadd./field .Iaddend.memory and an output of said second motion vector estimator; and

wherein

said adaptive predictor uses both reproduced image signals which have been moved by a motion vector portion of F-frames.Iadd./fields .Iaddend.and B-frames.Iadd./fields .Iaddend.supplied from said first and second motion compensators and moving image signals supplied via said second changeover switch, as the basis for creating a plural number of prediction signals from a plural number of signals which have been motion compensation by the same clock and for which motion vector detection has been performed, and outputs an optimum prediction signal within said plural number of prediction signals as prediction mode signals to said residual subtracter, said residual adder and said transfer means.

3. The coding apparatus according to claim 2, wherein said plurality of data memory means comprises;

a first memory which stores coded signals output from said intra-frame.Iadd./field .Iaddend.coder of said processing means;

a second memory which stores prediction mode signals output from said adaptive predictor;

a third memory which stores first motion vector signals output from said first motion vector estimator; and

a fourth memory which stores second motion vector signals output from said second motion vector estimator; and

wherein said transfer means comprises a coder which successively selects and outputs signals stored in said first through fourth memories in response to a required number of block pulses.

4. The coding apparatus according to claim 1, wherein said plurality of data memory means comprises:

a first memory which stores coded signals output from said image processing means;

a second memory which stores prediction mode signals output from said image processing means;

a third memory which stores the first motion vector signals output from said image processing means; and

a fourth memory which stores second motion vector signals output from said image processing means; and

wherein said transfer means comprises a selector which successively selects and outputs signals stored in said first through fourth memories in response to a required number of clock pulses.

5. A decoding apparatus for decoding moving image signals coded in block units, comprising:

detection means for receiving input data which includes at least motion vector data, inter-image processing data indicative of what inter-image processing is performed, and image data which are time-division multiplexed and received by the detection means, said detecting means detecting transfer code errors for each of said inter-image processing data and said image data, and outputting the coded information for each data type having said code errors; and

processing means for performing motion compensation and inter-image processing of said coded information using only frames.Iadd./fields .Iaddend.which do not include said transfer code error within a plurality of frames.Iadd./fields .Iaddend.which are to be used for prediction purposes, and without the use of frames.Iadd./fields .Iaddend.which have said transfer code errors within said plurality of frames.Iadd./fields .Iaddend.which are to be used for prediction purposes, by selecting a method of inter-frame.Iadd./field .Iaddend.processing for motion compensation in accordance with said detected transfer code errors, wherein one .[.image screen.]. .Iadd.frame/field .Iaddend.comprises a plurality of blocks, .[.each block comprises a plurality of frames,.]. and wherein motion compensation and inter-image processing is performed .[.in each.]. .Iadd.per .Iaddend.block.

6. The decoding apparatus according to claim 5, wherein said processing means uses only those frames.Iadd./fields .Iaddend.which do not have coding errors, to perform motion compensation of said coded information.

7. The decoding apparatus according to claim 5, wherein said detection means comprises an error detector which detects said transfer code errors included in coded information supplied from a coding apparatus via a data input terminal.

8. The decoding apparatus according to claim 5, wherein said processing means comprises:

an adaptive predictor responsive to output of said detection means for generating as output prediction signals from prediction mode information included in said coded information; and

a variable adder responsive to output of said detection means and said adaptive predictor for adding decoded signals of said coded information and prediction signals of said adaptive predictor.

9. The decoding apparatus according to claim 5, and further comprising:

a selector which separates DCT (discrete cosine transform) information, prediction mode information, first motion vector information and second motion vector information multiplexed in said coded information signals;

first, second, third and fourth memories which respectively store said DCT information, prediction mode information, first motion vector information and second motion vector information separated by selector; and

wherein said detecting means comprises;

an error detector which detects transfer code errors in said coded information signals;

an intra-frame.Iadd./field .Iaddend.decoder which decodes said DCT information stored in said first memory;

a first frame.Iadd./field .Iaddend.memory;

a second frame.Iadd./field .Iaddend.memory;

a first motion compensator which uses signals of the first frame.Iadd./field .Iaddend.memory as the basis for performing motion compensation for said first motion vector information stored in said third memory;

a second motion compensator which uses signals of the second frame.Iadd./field .Iaddend.memory as the basis for performing motion compensation for said second motion vector information stored in said fourth memory;

an adaptive predictor which uses first and second compensation signals output from said first and second motion compensator, and output signals of said error detector as the basis for generating prediction signals from said prediction mode information stored in said second memory;

a variable adder which adds prediction signals from said adaptive predictor, decoded signals from said intra-frame.Iadd./field .Iaddend.decoder and output signals of said error detector; and

changeover switch means for switching between outputs of said variable adder and which is connected to said first and second frame.Iadd./field .Iaddend.memory.

10. The decoder apparatus according to claim 9, further provided with a matching decider which judges matching between decoded signals from said intra-frame.Iadd./field .Iaddend.decoder and prediction signals from said adaptive predictor and outputs to said variable adder.

11. A coding apparatus for coding moving image signals into block units, comprising:

image processing means for dividing one .[.screen.]. .Iadd.frame/field .Iaddend.into a plurality of blocks, .[.each block comprising a plurality of frames,.]. and performing motion compensation image processing between a plural number of frames.Iadd./fields .Iaddend..[.in each.]. .Iadd.per .Iaddend.block, and outputting primary motion vector data which is used for a motion compensation, .[.in said primary motion vector data, in.]. inter-image processing data indicative of what inter-image processing is performed, and .[.in.]. image data .Iadd.which is inter-image processed.Iaddend.;

motion vector detection means for detecting secondary motion vector data which is used in providing error concealment in a decoding apparatus when code errors occur during a data transmission; and

transfer means for multiplexing said primary motion vector data, said secondary motion vector data, said inter-image processing data and said image data.

12. A decoding apparatus for decoding moving image signals coded in block units, comprising:

detection means for receiving input data including at least primary motion vector data which is used for motion compensation, inter-image processing data indicative of what inter-image processing is performed, and image data .Iadd.which is inter-image processed.Iaddend., and for detecting code errors included in said input data;

reception means for receiving secondary motion vector data which is used in providing error concealment .[.in said decoding apparatus.]. only when code errors occur during a data transmission; and

image processing means for performing motion compensation and inter-image processing between a plurality of frames.Iadd./fields .Iaddend..[.that make up a block, and wherein.]. .Iadd.per block of .Iaddend.a plurality of blocks .[.make up an image screen.]. .Iadd.which constitutes one frame/field.Iaddend., the motion compensation and inter-image processing employing said primary motion vector data only when there is no code error in said input data, and said image processing means performing motion compensation and inter-image processing using said secondary motion vector data when the input data has code errors.

13. A decoding apparatus for decoding moving image signals coded in block units, comprising:

detection means for receiving input data which includes at least motion vector data, inter-image processing data, and image data and which is transferred by time division multiplexing said input data such that said motion vector data for a group of blocks are time multiplexed together in one time division, the inter-image processing data for said group of blocks is time multiplexed together in another time division, and said image data for said group of blocks is time multiplexed to a further time division, said detecting means detecting transfer code errors for each of said inter-image processing data and said image data, and outputting coded information signals for each type having said code errors;

wherein said detection means comprises

an error detector which detects transfer cod errors in said coded information signals;

and intra-frame.Iadd./field .Iaddend.decoder which decodes a discrete cosine transform (DCT) information in a first memory;

a predictor which uses first and second compensation signals output from a first and second motion compensators, respectively, and output signals of said error detector as the basis for generating prediction signals from prediction mode information stored in a second memory; and

a variable adder which adds said prediction signals from said predictor, decoded signals from said intra-frame.Iadd./field .Iaddend.decoder and output signals from said error detector.