Image processing device and method

• US 10,595,021 B2
• Filed: 02/26/2016
• Issued: 03/17/2020
• Est. Priority Date: 03/13/2015
• Status: Active Grant

• Current Assignee: Sony Corporation (Sony Group Corp.)
• Original Assignee: Sony Corporation (Sony Group Corp.)
• Inventors: Ueki, Nobuo, Nagumo, Takefumi, Ihara, Toshinori
• Primary Examiner(s): Kelley, Christopher S
• Assistant Examiner(s): Walsh, Kathleen M
• Application Number:
  US15/554,575
• Publication Number:
  US 20180098069A1
• Time in Patent Office: 1,481 Days
• Field of Search: 37524012
• CPC Class Codes: H04N 19/117 Filters, e.g. for pre-processing or post-processing sub-band filter banks H04N19/635
• CPC Class Codes: H04N 19/126 Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
• CPC Class Codes: H04N 19/157 Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
• CPC Class Codes: H04N 19/159 Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
• CPC Class Codes: H04N 19/172 the region being a picture, frame or field
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/82 involving filtering within a prediction loop
• CPC Class Codes: H04N 19/86 involving reduction of coding artifacts, e.g. of blockiness

Abstract

The present disclosure relates to an image processing device and method that can suppress deterioration of the picture quality by encoding. The image processing device includes a decoding unit configured to decode encoded data obtained by lossy encoding an image of a frame encoded already which is used as a reference image in encoding of an image of a current frame and perform rounding of a decoded image obtained by the decoding with a rounding value whose value is changed over in a time direction of the image. The present disclosure can be applied, for example, to an image processing device, an image encoding device or the like.

Claims

1. An image processing device, comprising:

an encoder configured to generate simplified encoded data based on lossy encode of a previous frame image of a plurality of frame images, wherein

a current frame image of the plurality of frame images is encoded based on a reference image, and

the reference image corresponds to the previous frame image; and

a decoder configured to;

decode the simplified encoded data to generate decoded data;

add a rounding value to the decoded data to compensate for an error between the previous frame image and the simplified encoded data, wherein

the error is based on the lossy encode of the previous frame image,

the previous frame image is encoded with respect to an obtained reference image, and

the current frame image is subsequent to the previous frame image.

2. The image processing device according to claim 1, wherein the decoder is further configured to change the rounding value at a random timing.

3. The image processing device according to claim 1, wherein the decoder is further configured to change the rounding value for each frame image of the plurality of frame images.

4. The image processing device according to claim 3, wherein

header information of the simplified encoded data includes a picture order count (POC), and

the decoder is further configured to change the rounding value based on the POC.

5. The image processing device according to claim 1, wherein the decoder is further configured to change the rounding value at a P picture.

6. The image processing device according to claim 5, wherein

the decoder is further configured to compensate an I picture and a B picture based on a particular rounding value of a plurality of rounding values associated with the compensation of the P picture, and

the particular rounding value exhibits specific characteristics from among the plurality of rounding values.

7. The image processing device according to claim 5, wherein

header information of the simplified encoded data includes:

first information that indicates a picture order count (POC); and

second information that indicates a picture type, and

the decoder is further configured to change the rounding value based on the first information and the second information.

8. The image processing device according to claim 1, further comprising a processor configured to generate an orthogonal transformation coefficient based on the encode of the previous frame image, wherein

the compensation for the error is based on the generated orthogonal transformation coefficient, and

the decoder is further configured to change the rounding value at a first block of a picture based on the generated orthogonal transformation coefficient.

9. The image processing device according to claim 8, wherein the decoder is further configured to change the rounding value at the first block of a P picture.

10. The image processing device according to claim 9, wherein

the decoder is further configured to compensate an I picture, a B picture and a second block of the P picture based on a particular rounding value of a plurality of rounding values associated with compensation of the first block of the P picture, and

the particular rounding value exhibits specific characteristics from among the plurality of rounding values.

11. The image processing device according to claim 8, wherein

header information of the simplified encoded data includes:

first information that indicates a picture order count (POC);

second information that indicates a picture type; and

third information that indicates a generation quantity of the orthogonal transformation coefficient, and

the decoder is further configured to change the rounding value based on the first information, the second information, and the third information.

12. The image processing device according to claim 1, wherein the decoder is further configured to compensate lower bits of each pixel value of the decoded data.

13. The image processing device according to claim 1, wherein

the rounding value is a random number, and

the decoder is further configured to update a value of the random number in a time direction of the previous frame image.

14. The image processing device according to claim 1, wherein the decoder is further configured to alternately update the rounding value in a time direction of the previous frame image with two 5-bit values “

10000” and

“

01111”

.

15. The image processing device according to claim 1, wherein the decoder is further configured to update the rounding value in a time direction of the previous frame image with three 4-bit values “

1001,”

“

1000” and

“

0111”

in order.

16. The image processing device according to claim 1, further comprising a processor configured to generate an orthogonal transformation coefficient based on the encode of the previous frame image wherein,

the compensation for the error is based on the generated orthogonal transformation coefficient, and

the decoder is further configured to:

change the rounding value in a time direction of the previous frame image; and

decrease the orthogonal transformation coefficient based on the change of the rounding value.

17. The image processing device according to claim 1, further comprising a memory configured to store the simplified encoded data, wherein

the decoder is further configured to obtain the simplified encoded data from the memory.

18. The image processing device according to claim 1, further comprising a processor configured to:

orthogonally transform a difference image between the current frame image and the reference image; and

generate an orthogonal transformation coefficient for the compensation for the error.

19. An image processing method, comprising:

generating simplified encoded data based on lossy encode of a previous frame image of a plurality of frame images, wherein

a current frame image of the plurality of frame images is encoded based on a reference image, and

the reference image corresponds to the previous frame image;

decoding the simplified encoded data to generate decoded data; and

adding a first rounding value to the decoded data to compensate for an error between the previous frame image and the simplified encoded data, wherein

the error is based on the lossy encode of the previous frame image,

the previous frame image is encoded with respect to an obtained reference image, and

the current frame image is subsequent to the previous frame image.