VIDEO ENCODING DEVICE, VIDEO ENCODING METHOD, VIDEO ENCODING PROGRAM, VIDEO DECODING DEVICE, VIDEO DECODING METHOD, AND VIDEO DECODING PROGRAM

• US 20090116759A1
• Filed: 07/05/2006
• Published: 05/07/2009
• Est. Priority Date: 07/05/2005
• Status: Active Grant

• Current Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Original Assignee: NTT Docomo Incorporated (Nippon Telegraph and Telephone Corporation)
• Inventors: Boon, Choong Seng, Kobayashi, Mitsuru, Suzuki, Yoshinori
• Granted Patent: US 8,369,628 B2
• Time in Patent Office: Days
• US Class Current: 382/238
• CPC Class Codes: H04N 19/537 Motion estimation other than block-based
• CPC Class Codes: H04N 19/573 Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
• CPC Class Codes: H04N 19/587 involving temporal sub-sampling or interpolation, e.g. decimation or subsequent interpolation of pictures in a video sequence
• CPC Class Codes: H04N 19/593 involving spatial prediction techniques
• CPC Class Codes: H04N 19/61 in combination with predictive coding

Abstract

A video encoding device including a region division section for dividing a frame image constituting video data into a plurality of regions as encoding target regions, an encoding section for encoding an image of each region, an inverse transformation section and an addition section for generating reproduced image of the encoded image, a storage section for storing reproduced images, a prediction generation section for searching a region which is highly correlated to a reproduced image of a template region, which is adjacent to the region of the encoding target image in a predetermined positional relationship and is a part of the reproduced image, from the reproduced image, and determining a prediction signal based on the searched region and the above-mentioned positional relationship, and a subtraction section for generating a difference signal between the prediction signal and the encoding target image as a signal for encoding.

Claims

1. :

A video encoding device for encoding video data in block units, comprising;

division means for dividing a frame image constituting said video data into a plurality of encoding target blocks;

encoding means for encoding said encoding target block;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said encoding target block;

storage means for storing reproduced video data generated from said reproduced signal; and

prediction signal generation means for generating a prediction block, which is a prediction signal of said encoding target block, using a template generated from a reproduced signal, which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, wherein

said encoding means generates a difference block, which is a difference signal of said encoding target block, by subtracting said prediction block from said encoding target block in pixel units, and encodes said difference block, and

said reproduced image generation means generates a decoded difference block, which is a reproduced signal of the difference block encoded by said encoding means, and generates a decoded block by adding said decoded difference block and said prediction block in pixel units.

2. :

A video encoding device for encoding video data in block units, comprising;

division means for dividing a frame image constituting said video data into a plurality of encoding target blocks;

encoding means for encoding said encoding target block;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said encoding target block;

storage means for storing reproduced video data generated from said reproduced signal;

search means for searching a pixel group, which is highly correlated to a template generated from a reproduced signal, which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, from the reproduced video data stored in said storage means; and

prediction signal determination means for determining a prediction block which is a prediction signal of said encoding target block, from the reproduced video data stored in said storage means, based on the pixel group searched by said search means and said predetermined positional relationship, wherein

said encoding means generates a difference block, which is a difference signal of said encoding target block, by subtracting said prediction block from said encoding target block in pixel units, and encodes said difference block, and

said reproduced image generation means generates a decoded difference block, which is a reproduced signal of the difference block encoded by said encoding means, and generates a decoded block by adding said decoded difference block and said prediction block in pixel units.

3. :

The video encoding device according to claim 2, further comprising;

estimation means for comparing said template and the reproduced video data stored in said storage means, to estimate a spatial continuity of an image of said encoding target block based on the comparison result; and

setting means for further dividing said encoding target block, setting the divided encoding target block obtained by division as a new encoding target block and setting a template for said new encoding target block, based on the spatial continuity of the image estimated by said estimation means.

7. :

The video encoding device according to claim 2, wherein

said encoding means generates a reduced difference block, of which number of pixels is smaller than said difference block, by a reduction processing which decreases the number of pixels of said difference block by a predetermined method, and encodes said reduced difference block, and

said reproduced image generation means generates a decoded reduced difference block, which is a reproduced signal of said reduced difference block, and generates a decoded block from said decoded reduced difference block by an enlargement processing which increases the number of pixels by a predetermined method.

15. :

The video encoding device according to claim 3, wherein said prediction signal determination means selects one template out of a plurality of the templates having different shapes.

16. :

The video encoding device according to claim 15, wherein said prediction signal determination means selects said one template by referring to a reproduced signal of the reproduced video data stored in said storage means or information on said reproduced signal.

17. :

The video encoding device according to claim 15, wherein said encoding means encodes information for identifying the template selected by said prediction signal determination means.

4. :

A video decoding device for reproducing encoded data of video data into reproduced video data in block units, comprising;

decoding means for decoding encoded data required for reproducing a decoding target block to be decoded;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said decoding target block, from the encoded data decoded by said decoding means;

storage means for storing reproduced video data generated from said reproduced signal; and

prediction signal generation means for generating a prediction block, which is a prediction signal of said decoding target block, using a template generated from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, wherein

said decoding means generates a decoded difference block, which is a difference signal of said decoding target block, and

said reproduced image generation means generates a decoded block by adding said decoded difference block and said prediction block in pixel units.

5. :

A video decoding device for reproducing encoded data of video data into reproduced video data in block units, comprising;

decoding means for decoding encoded data required for reproducing a decoding target block to be decoded;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said decoding target block, from the encoded data decoded by said decoding means;

storage means for storing reproduced video data generated from said reproduced signal;

search means for searching a pixel group, which is highly correlated to a template generated from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, from the reproduced video data stored in said storage means; and

prediction signal determination means for determining a prediction block, which is a prediction signal of said decoding target block, from the reproduced video data stored in said storage means, based on the pixel group searched by said search means and said predetermined positional relationship, wherein

said decoding means generates a decoded difference block, which is a difference signal of said decoding target block, and

said reproducing image generation means generates a decoded block by adding said decoded difference block and said prediction block in pixel units.

6. :

The video decoding device according to claim 5, further comprising;

estimation means for comparing said template and the reproduced video data stored in said storage means, to estimate a spatial continuity of images of said decoding target block based on the comparison result; and

setting means for further dividing said decoding target block, setting the divided decoding target block obtained by division as a new decoding target block and setting a template for said new decoding target block, based on the spatial continuity of the image estimated by said estimation means.

8. :

The video decoding device according to claim 5, characterized in that wherein

said decoding means generates a decoded reduced difference block, of which number of pixels is smaller than said difference block, by decoding said encoded data, and

said reproduced image generation means generates a decoded block from said decoded reduced difference block by an enlargement processing which increases the number of pixels by said predetermined method.

18. :

The video decoding device according to claim 6, wherein said prediction signal determination means selects one template out of a plurality of the templates having different shapes.

19. :

The video decoding device according to claim 18, wherein said prediction signal determination means selects said one template by referring to a reproduced signal of the reproduced video data stored in said storage means or information on said reproduced signal.

20. :

The video decoding device according to claim 18, wherein

said decoding means decodes the information for identifying the selected template, and

said prediction signal determination means selects one template out of said plurality of templates having different shapes by referring to the information for identifying the selected template decoded by said decoding means.

9. :

A video encoding device for encoding video data in block units, comprising;

division means for dividing a frame image constituting said video data into a plurality of encoding target blocks as a target region of said encoding;

encoding means for encoding said encoding target block;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said encoding target block;

storage means for storing reproduced video data generated from said reproduced signal; and

prediction signal generation means for generating a prediction block, which is a prediction signal of said encoding target block, using a predetermined method, from a reproduced signal, which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, wherein

said encoding means generates a reduced difference block, of which number of pixels is smaller than a difference block, which is a difference signal of said encoding target block obtained by subtracting said prediction block from said encoding target block in pixel units, using a reduction processing which decreases the number of pixels of said difference block by a predetermined method, and encodes said reduced difference block, and

said reproduced image generation means generates a decoded reduced difference block which is a reproduced signal of said reduced difference block, and generates a decoded block from said decoded reduced difference block using an enlargement processing which increases the number of pixels by a predetermined method.

11. :

The video encoding device according to claim 9, wherein

said encoding means applies said reduction processing to said encoding target block and said prediction block respectively to generate a reduced block and a reduced prediction block, and generates a reduced difference block by subtracting said reduced prediction block from said reduced block, and

said reproduced image generation means generates a decoded block by generating a decoded reduced difference block, which is a reproduced signal of the reduced difference block encoded by said encoding means, generating a decoded reduced block by adding said decoded reduced difference block and said reduced prediction block in pixel units, and applying the enlargement processing to said decoded reduced block.

12. :

The video encoding device according to claim 9, wherein

said encoding means generates a reduced difference block by applying said reduction processing to said difference block, and

said reproduced image generation means generates a decoded block by generating a decoded reduced difference block which is a reproduced signal of the reduced difference block encoded by said encoding means, generating a decoded difference block by applying the enlargement processing to said decoded reduced difference block, and adding said decoded difference block and said prediction block in pixel units.

10. :

A video decoding device for reproducing encoded data of video data into reproduced video data in block units, comprising;

decoding means for decoding encoded data required for reproducing a decoding target block to be decoded;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said decoding target block, from encoded data decoded by said decoding means;

storage means for storing the reproduced video data generated from said reproduced signal; and

prediction signal generation means for generating a prediction block, which is a prediction signal of said decoding target block, using a predetermined method, from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means;

wherein

said decoding means generates a decoded reduced difference block, of which number of pixels is smaller than a difference block which is a difference signal of said decoding target block, by decoding said encoded data, and

said reproduced image generation means generates a decoded block from said decoded reduced difference block using an enlargement processing which increases the number of pixels by a predetermined method.

13. :

The video decoding device according to claim 10, wherein

said reproduced image generation means generates a decoded block by generating a reduced prediction block by applying said reduction processing to said prediction block, generating a decoded reduced block by adding said decoded reduced difference block and said reduced prediction block in pixel units, and applying the enlargement processing to said decoded reduced block.

14. :

The video decoding device according to claim 10, wherein

said reproduced image generation means generates a decoded block by generating a decoded difference block by applying said enlargement processing to said decoded reduced difference block, and adding said decoded difference block and said prediction block in pixel units.

21. :

A video encoding method for a video encoding device for encoding video data in block units, comprising;

a division step of dividing a frame image constituting said video data into a plurality of encoding target blocks;

an encoding step of encoding said encoding target block;

a reproduced image generation step of generating a decoded block, which is a reproduced signal of said encoding target block;

a storage step of storing reproduced video data generated from said reproduced signal; and

a prediction signal generation step of generating a prediction block, which is a prediction signal of said encoding target block, using a template generated from a reproduced signal which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage step, wherein

in said encoding step, a difference block, which is a difference signal of said encoding target block, is generated by subtracting said prediction block from said encoding target block in pixel units, and said difference block is encoded, and

in said reproduced image generation step, a decoded difference block, which is a reproduced signal of the difference block encoded in said encoding step, is generated, and a decoded block is generated by adding said decoded difference block and said prediction block in pixel units.

22. :

A video encoding method for a video encoding device for encoding video data in block units, comprising;

a division step of dividing a frame image constituting said video data into a plurality of encoding target blocks;

an encoding step of encoding said encoding target block;

a reproduced image generation step of generating a decoded block, which is a reproduced signal of said encoding target block;

a storage step of storing reproduced video data generated from said reproduced signal;

a search step of searching a pixel group, which is highly correlated to a template generated from a reproduced signal which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage step, from the reproduced video data stored in said storage step; and

a prediction signal determination step of determining a prediction block, which is a prediction signal of said encoding target block, from the reproduced video data stored in said storage step, based on the pixel group searched in said search step and said predetermined positional relationship, wherein

in said encoding step, a difference block, which is a difference signal of said encoding target block, is generated by subtracting said prediction block from said encoding target block in pixel units, and said difference block is encoded, and

in said reproduced image generation step, a decoded difference block, which is a reproduced signal of the difference block encoded in said encoding step, is generated, and a decoded block is generated by adding said decoded difference block and said prediction block in pixel units.

23. :

A video decoding method for a video decoding device for reproducing encoded data of video data into reproduced video data in block units, comprising;

a decoding step of decoding encoded data required for reproducing a decoding target block to be decoded;

a reproduced image generation step of generating a decoded block, which is a reproduced signal of said decoding target block, from the encoded data decoded in said decoding step;

a storage step of storing reproduced video data generated from said reproduced signal; and

a prediction signal generation step of generating a prediction block, which is a prediction signal of said decoding target block, using a template generated from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage step, wherein

in said decoding step, a decoded difference block, which is a difference signal of said decoding target block, is generated, and

in said reproduced image generation step, a decoded block is generated by adding said decoded difference block and said prediction block in pixel units.

24. :

A video decoding method for a video decoding device for reproducing encoded data of video data into reproduced video data in block units, comprising;

a decoding step of decoding encoded data required for reproducing a decoding target block to be decoded;

a reproduced image generation step of generating a decoded block, which is a reproduced signal of said decoding target block, from the encoded data decoded in said decoding step;

a storage step of storing reproduced video data generated from said reproduced signal;

a search step of searching a pixel group, which is highly correlated to a template generated from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage step, from the reproduced video data stored in said storage step; and

a prediction signal determination step of determining a prediction block, which is a prediction signal of said decoding target block, from the reproduced video data stored in said storage step, based on the pixel group searched in said search step and said predetermined positional relationship, wherein

in said decoding step, a decoded difference block, which is a difference signal of said decoding target block, is generated, and

in said reproduced image generation step, a decoded block is generated by adding said decoded difference block and said prediction block in pixel units.

25. :

A video encoding method for a video encoding device for encoding video data in block units, comprising;

a division step of dividing a frame image constituting said video data into a plurality of encoding target blocks as a target region of said encoding;

an encoding step of encoding said encoding target block;

a reproduced image generation step of generating a decoded block, which is a reproduced signal of said encoding target block;

a storage step of storing reproduced video data generated from said reproduced signal; and

a prediction signal generation step of generating a prediction block, which is a prediction signal of said encoding target block, using a predetermined method, from a reproduced signal, which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage step, wherein

in said encoding step, a reduced difference block, of which number of pixels is smaller than a difference block, which is a difference signal of said encoding target block obtained by subtracting said prediction block from said encoding target block in pixel units, is generated using a reduction processing which decreases the number of pixels of said difference block by a predetermined method, and said reduced difference block is encoded, and

in said reproduced image generation step, a decoded reduced difference block, which is a reproduced signal of said reduced difference block, is generated, and a decoded block is generated from said decoded reduced difference block using an enlargement processing which increases the number of pixels by a predetermined method.

26. :

A video decoding method for a video decoding device for reproducing encoded data of video data into reproduced video data in block units, comprising;

a decoding step of decoding encoded data required for reproducing a decoding target block to be decoded;

a reproduced image generation step of generating a decoded block, which is a reproduced signal of said decoding target block, from encoded data decoded in said decoding step;

a storage step of storing the reproduced video data generated from said reproduced signal; and

a prediction signal generation step of generating a prediction block, which is a prediction signal of said decoding target block, using a predetermined method, from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage step, wherein

in said decoding step, a decoded reduced difference block, of which number of pixels is smaller than a difference block, which is a difference signal of said decoding target block, is generated by decoding said encoded data, and

in said reproduced image generation step, a decoded block is generated from said decoded reduced difference block using an enlargement processing which increases the number of pixels by a predetermined method.

27. :

A video encoding program for controlling a video encoding device for encoding video data in block units, the program causing said video encoding device to function as;

division means for dividing a frame image constituting said video data into a plurality of encoding target blocks;

encoding means for encoding said encoding target block;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said encoding target block;

storage means for storing reproduced video data generated from said reproduced signal; and

prediction signal generation means for generating a prediction block, which is a prediction signal of said encoding target block, using a template generated from a reproduced signal, which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, wherein

said encoding means generates a difference block, which is a difference signal of said encoding target block, by subtracting said prediction block from said encoding target block in pixel units, and encodes said difference block, and

said reproduced image generation means generates a decoded difference block, which is a reproduced signal of the difference block encoded by said encoding means, and generates a decoded block by adding said decoded difference block and said prediction block in pixel units.

28. :

A video encoding program for controlling a video encoding device for encoding video data in block units, the program causing said video encoding device to function as;

division means for dividing a frame image constituting said video data into a plurality of encoding target blocks;

encoding means for encoding said encoding target block;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said encoding target block;

storage means for storing reproduced video data generated from said reproduced signal;

search means for searching a pixel group, which is highly correlated to a template generated from a reproduced signal, which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, from the reproduced video data stored in said storage means; and

prediction signal determination means for determining a prediction block, which is a prediction signal of said encoding target block, from the reproduced video data stored in said storage means, based on the pixel group searched by said search means and said predetermined positional relationship, wherein

said encoding means generates a difference block, which is a difference signal of said encoding target block, by subtracting said prediction block from said encoding target block in pixel units, and encodes said difference block, and

said reproduced image generation means generates a decoded difference block, which is a reproduced signal of the difference block encoded by said encoding means, and generates a decoded block by adding said decoded difference block and said prediction block in pixel units.

29. :

A video decoding program for controlling a video decoding device for reproducing encoded data of video data into reproduced video data in block units, the program causing said video decoding device to function as;

decoding means for decoding encoded data required for reproducing a decoding target block to be decoded;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said decoding target block, from the encoded data decoded by said decoding means;

storage means for storing reproduced video data generated from said reproduced signal; and

prediction signal generation means for generating a prediction block, which is a prediction signal of said decoding target block, using a template generated from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, wherein

said decoding means generates a decoded difference block, which is a difference signal of said decoding target block, and

said reproduced image generation means generates a decoded block by adding said decoded difference block and said prediction block in pixel units.

30. :

A video decoding program for controlling a video decoding device for reproducing encoded data of video data into reproduced video data in block units, the program causing said video decoding device to function as;

decoding means for decoding encoded data required for reproducing a decoding target block to be decoded;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said decoding target block, from the encoded data decoded by said decoding means;

storage means for storing reproduced video data generated from said reproduced signal;

search means for searching a pixel group, which is highly correlated to a template generated from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, from the reproduced video data stored in said storage means; and

prediction signal determination means for determining a prediction block, which is a prediction signal of said decoding target block, from the reproduced video data stored in said storage means, based on the pixel group searched by said search means and said predetermined positional relationship, wherein

said decoding means generates a decoded difference block, which is a difference signal of said decoding target block, and

said reproduced image generation means generates a decoded block by adding said decoded difference block and said prediction block in pixel units.

31. :

A video encoding program for controlling a video encoding device for encoding video data in block units, the program causing said video encoding device to function as;

division means for dividing a frame image constituting said video data into a plurality of encoding target blocks as a target region of said encoding;

encoding means for encoding said encoding target block;

reproduced image generation means for generating a decoded block, which is a reproduced signal of said encoding target block;

storage means for storing reproduced video data generated from said reproduced signal; and

prediction signal generation means for generating a prediction block, which is a prediction signal of said encoding target block, using a predetermined method, from a reproduced signal, which is adjacent to said encoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, wherein

said encoding means generates a reduced difference block, of which the number of pixels is smaller than a difference block, which is a difference signal of said encoding target block obtained by subtracting said prediction block from said encoding target block in pixel units, using a reduction processing which decreases the number of pixels of said difference block by a predetermined method, and encodes said reduced difference block, and

said reproduced image generation means generates a decoded reduced difference block, which is a reproduced signal of said reduced difference block, and generates a decoded block from said decoded reduced difference block using an enlargement processing which increases the number of pixels by a predetermined method.

32. :

A video decoding program for controlling a video decoding device for reproducing encoded data of video data into reproduced video data in block units, the program causing said video decoding device to function as;

decoding means for decoding encoded data required for reproducing a decoding target block to be decoded;

reproduced image generation means for generating a decoded block which is a reproduced signal of said decoding target block from encoded data decoded by said decoding means;

storage means for storing reproduced video data generated from said reproduced signal; and

prediction signal generation means for generating a prediction block, which is a prediction signal of said decoding target block, using a predetermined method, from a reproduced signal, which is adjacent to said decoding target block in a predetermined positional relationship and belongs to the reproduced video data stored in said storage means, wherein

said decoding means generates a decoded reduced difference block, of which number of pixels is smaller than a difference block, which is a difference signal of said decoding target block, by decoding said encoded data, and

said reproduced image generation means generates a decoded block from said decoded reduced difference block using an enlargement processing which increases the number of pixels by a predetermined method.

33. :

A video encoding device for encoding video data, comprising;

division means for dividing a frame image constituting said video data into a plurality of regions as encoding target regions;

encoding means for encoding an image of each region obtained by division by said division means;

reproduced image generation means for generating a reproduced image of the image encoded by said encoding means;

storage means for storing reproduced image generated by said reproduced image generation means;

search means for searching an region of an image highly correlated to a reproduced image in a template region, which is adjacent to an region of an encoding target image by said encoding means in a predetermined positional relationship and is a part of the reproduced image stored in said storage means, from the reproduced image stored in said storage means; and

prediction signal determination means for determining a prediction signal in the region to be encoded from the reproduced image stored in said storage means, based on the region searched by said search means and said predetermined positional relationship, wherein

said encoding means generates a difference signal between the prediction signal determined by said prediction signal determination means and the image of the region to be encoded, and encodes said difference signal.

34. :

A video decoding device for decoding video data in which a frame image divided into a plurality of regions is encoded, comprising;

decoding means for decoding the encoded data in each of said regions;

reproduced image generation means for generating reproduced image from the difference image decoded by said decoding means;

storage means for storing the image generated by said reproduced image generation means;

search means for searching an region of an image highly correlated to a reproducing image in a template region which is adjacent to a region of a decoding target image by said decoding means in a predetermined positional relationship and is a part of the reproduced image stored in said storage means, from the reproduced image stored in said storage means; and

prediction signal determination means for determining a prediction signal in the region to be decoded from the reproduced image stored in said storage means, based on the region searched by said search means and said predetermined positional relationship, wherein

said reproduced image generation means generates a sum signal of the prediction signal determined by said prediction signal determination means and a signal of said difference image decoded by said decoding means to generate a signal of a reproduced image.