GENERATIVE ADVERSARIAL NETWORK BASED INTRA PREDICTION FOR VIDEO CODING
First Claim
1. A method for video coding, the method comprising:
- providing a Generative Adversarial Network (GAN) based intra prediction engine having a plurality of intra prediction modes configured for GAN based intra prediction using a latent variable; and
generating, by the GAN based intra prediction engine, a plurality of prediction blocks for an input image to be coded using the plurality of intra prediction modes configured for GAN based intra prediction.
1 Assignment
0 Petitions
Accused Products
Abstract
Systems and methods which provide Generative Adversarial Network (GAN) based intra prediction for video coding are described. GAN based intra prediction as implemented according to embodiments may be modeled as an inpainting task. For example, intra prediction may be formulated as a learning based inpainting task, wherein a latent variable is designed to control different generation modes. GAN based intra prediction provided according to embodiments of the invention may be implemented alone or in combination with one or more other video compression technique, such as a direction intra prediction technique. The intra prediction module of such a HEVC encoder/decoder may be redesigned to also apply GAN based inpainting in intra prediction, wherein Rate-Distortion Optimization (RDO) may be performed to select the best intra prediction mode between the intra prediction approaches.
-
Citations
25 Claims
-
1. A method for video coding, the method comprising:
-
providing a Generative Adversarial Network (GAN) based intra prediction engine having a plurality of intra prediction modes configured for GAN based intra prediction using a latent variable; and generating, by the GAN based intra prediction engine, a plurality of prediction blocks for an input image to be coded using the plurality of intra prediction modes configured for GAN based intra prediction. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14)
-
-
15. A method for video coding, the method comprising:
-
generating a plurality of prediction blocks for an input image to be coded by inpainting based intra prediction using a plurality of inpainting intra prediction modes; generating a plurality of prediction blocks for the input image to be coded by direction based intra prediction using a plurality of direction intra prediction modes; and selecting an intra prediction mode for video coding with respect to the input image based on the intra prediction mode of the inpainting based intra prediction and the direction based intra prediction having a minimum Rate Distortion (RD) cost. - View Dependent Claims (16, 17, 18, 19, 20, 21, 22)
-
-
23. A system for video coding, the system comprising:
-
a Generative Adversarial Network (GAN) based inpainting intra prediction engine configured to generate a plurality of prediction blocks for an input image to be coded by inpainting based intra prediction using a plurality of inpainting intra prediction modes; a direction based intra prediction engine configured to generate a plurality of prediction blocks for the input image to be coded by direction based intra prediction using a plurality of direction intra prediction modes; and prediction model selection logic configured to select an intra prediction mode for video coding with respect to the input image based on the intra prediction mode of the inpainting based intra prediction and the direction based intra prediction. - View Dependent Claims (24, 25)
-
Specification