Method of coding, decoding, coder and decoder
First Claim
Patent Images
1. A method for coding pictures of a video sequence, the video sequence comprises at least one key picture and at least one intermediary picture, the method comprising the following steps:
- a) calculating a saliency map of at least one of the key picture(s);
b) estimating for a picture portion of an intermediary picture to be coded, at least one motion vector pointing towards a portion of the key picture(s);
c) motion compensating at least one portion of the saliency map using one or each estimated motion vector to obtain, for said picture portion, at least one portion of a predicted saliency map, andd) coding the picture portion according to a saliency level of each portion(s) of the predicted saliency map,wherein step d) comprises the following steps;
determining the saliency level of each portion(s) of the predicted saliency map;
comparing a predefined saliency level and the saliency level of the portion of the predicted saliency map, andcoding the picture portion using a first coding method when the saliency level of the portion is greater than the predefined saliency level and using a second coding method when the saliency level of the portion is lower than the predefined saliency level, said first coding method being a coding method with motion compensation and residue coding and said second method being a coding method with a more precise motion compensation than the motion compensation of the first coding method and without residue coding.
4 Assignments
0 Petitions
Accused Products
Abstract
A method for coding a picture portion of a picure of a video sequence is disclosed, at least one picture of the video sequence being a key picture. The method comprises the following steps:
- a) calculate a saliency map of the key picture,
- b) estimate for the picture portion to be coded, at least one motion vector pointing towards a portion of the key picture,
- c) motion compensate at least one portion of the saliency map using an estimated motion vector to obtain, for said picture portion, at least one portion of the predicted saliency map, and
- d) code the picture portion according to the saliency level of the portion of the predicted saliency map.
The invention also relates to a method for decoding a binary stream, a coder able to code pictures of a video sequence and a decoder of a binary stream.
-
Citations
13 Claims
-
1. A method for coding pictures of a video sequence, the video sequence comprises at least one key picture and at least one intermediary picture, the method comprising the following steps:
-
a) calculating a saliency map of at least one of the key picture(s); b) estimating for a picture portion of an intermediary picture to be coded, at least one motion vector pointing towards a portion of the key picture(s); c) motion compensating at least one portion of the saliency map using one or each estimated motion vector to obtain, for said picture portion, at least one portion of a predicted saliency map, and d) coding the picture portion according to a saliency level of each portion(s) of the predicted saliency map, wherein step d) comprises the following steps; determining the saliency level of each portion(s) of the predicted saliency map; comparing a predefined saliency level and the saliency level of the portion of the predicted saliency map, and coding the picture portion using a first coding method when the saliency level of the portion is greater than the predefined saliency level and using a second coding method when the saliency level of the portion is lower than the predefined saliency level, said first coding method being a coding method with motion compensation and residue coding and said second method being a coding method with a more precise motion compensation than the motion compensation of the first coding method and without residue coding. - View Dependent Claims (2, 3, 4, 5, 6, 7)
when the number of pixels counted is greater than a predefined number, coding the portion of the second intermediary picture using the portion of the first intermediary picture and by the method selected to code the portion of the first intermediary picture.
-
-
6. A method for coding according to claim 1, in which during a bi-directional coding of an intermediary picture from a portion of a first key picture and a portion of a second key picture, the saliency level compared to the predefined saliency level being a function of the saliency level of a first portion of the predicted saliency map from a first motion vector, and the saliency level of a second portion of the predicted saliency map from a second motion vector;
- said intermediary picture portion being coded from a mean of predictions of the portion of the first key picture and the portion of the second key picture, said mean being weighted by said saliency levels of the first and the second portions of the predicted saliency map.
-
7. A method for coding according to claim 1, in which step
a) comprises a coding step of the key picture(s), said step generating reconstructed key picture(s), the saliency map being calculated from the reconstructed key picture(s).
-
8. A method for decoding a binary stream comprising compressed data representative of motion vectors, of intermediary pictures and of key picture(s) of a video sequence with a view to reconstructing a picture portion of an intermediary picture to be reconstructed, the method comprising the following steps:
-
a) reconstructing the key picture(s) from the compressed data, b) calculating a saliency map of at least one of the reconstructed key picture(s), c) decoding at least one motion vector for the picture portion to be reconstructed pointing towards a portion of the key picture(s), d) motion compensating at least one portion of the saliency map using the decoded motion vector to obtain for said picture portion to be reconstructed, a portion of a predicted saliency map, and e) reconstructing the picture portion to be reconstructed according to a saliency level of the predicted saliency map, wherein step e) comprises the following steps; determining the saliency level of each portion(s) of the predicted saliency map, comparing a predefined saliency level and the saliency level of the portion of the predicted saliency map and reconstructing the picture portion to be reconstructed using a first decoding method when the saliency level of the portion is greater than the predefined saliency level and using a second decoding method when the saliency level of the portion is lower than the predefined saliency level, said first decoding method being a decoding method with motion compensation and residue decoding and said second method being a decoding method with a more precise motion compensation than the motion compensation of the first decoding method and without residue decoding. - View Dependent Claims (9, 10, 11)
-
-
12. A coder able to code pictures of a video sequence, the video sequence comprising at least one key picture and at least one intermediary picture, the coder comprising:
-
a calculation unit of a saliency map of at least one the key picture(s); an estimation unit able to estimate for a picture portion of an intermediary picture to be coded at least one motion vector pointing towards a portion of the key picture(s); a compensation unit able to motion compensate the portion(s) of the saliency map using the estimated motion vector(s) to obtain for said picture portion, at least one portion of a predicted saliency map, and a coding unit able to code the picture portion according to a saliency level of the portion(s) of the predicted saliency map, said coding unit comprising ; a unit able to determine the saliency level of each portion(s) of the predicted saliency map; a unit able to compare a predefined saliency level and the saliency level of the portion of the predicted saliency map; a unit able to code the picture portion using a first coding method when the saliency level of the portion is greater than the predefined saliency level and using a second coding method when the saliency level of the portion is lower than the predefined saliency level, said first coding method being a coding method with motion compensation and residue coding and said second method being a coding method with a more precise motion compensation than the motion compensation of the first coding method and without residue coding.
-
-
13. A decoder of a binary stream comprising the compressed data representative of motion vectors, of intermediary pictures and of key picture(s) of a video sequence with a view to reconstruct a picture portion of an intermediary picture to be reconstructed, the decoder comprising:
-
a reconstruction unit of the key picture(s) from the compressed data, a calculation unit of a saliency map of at least one of the reconstructed key picture(s), a decoding unit able to decode at least one motion vector for said picture portion to be reconstructed pointing towards a portion of the key picture(s), a motion compensation unit able to motion compensate at least one portion of the saliency map using a decoded motion vector to obtain, for said picture portion to be reconstructed, a portion of the predicted saliency map, and a reconstruction unit able to reconstruct the picture portion to be reconstructed according to the saliency level of the portion of the predicted saliency map, said reconstruction unit comprising; a unit able to determine the saliency level of each portion(s) of the predicted saliency map, a unit able to compare a predefined saliency level and the saliency level of the portion of the predicted saliency map and a unit able to reconstruct the picture portion to be reconstructed using a first decoding method when the saliency level of the portion is greater than the predefined saliency level and using a second decoding method when the saliency level of the portion is lower than the predefined saliency level, said first decoding method being a decoding method with motion compensation and residue decoding and said second method being a decoding method with a more precise motion compensation than the motion compensation of the first decoding method and without residue decoding.
-
Specification