Estimating quality of a video signal

• US 9,237,289 B2
• Filed: 10/24/2012
• Issued: 01/12/2016
• Est. Priority Date: 10/25/2011
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Carlsson, Pontus, Jefremov, Andrei, Silkin, Sergey, Zhao, David
• Primary Examiner(s): Philippe, Gims
• Application Number:
  US13/659,573
• Publication Number:
  US 20130114002A1
• Time in Patent Office: 1,175 Days
• Field of Search: 37524001-24029, 348/180, 348/720, 370/256
• US Class Current: 1/1
• CPC Class Codes: H04N 17/04 for receivers
• CPC Class Codes: H04N 19/139 Analysis of motion vectors, e.g. their magnitude, direction, variance or reliability
• CPC Class Codes: H04N 19/176 the region being a block, e.g. a macroblock
• CPC Class Codes: H04N 19/895 in combination with error concealment
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 5/44 Receiver circuitry for the reception of television signals according to analogue transmission standards H04N5/14 takes precedence

Abstract

Method, device and computer program product for estimating quality of a video signal, wherein frames of the video signal are received at receiving means of the device, each frame comprising a plurality of blocks of pixels. A section of a first frame of the video signal, which is correctly received, is used to provide a concealed block for use in place of a block of a second frame of the video signal. A difference measure is determined indicative of a difference between at least some of the pixels surrounding the block in the second frame and the corresponding pixels surrounding the section in the first frame. The difference measure is used to estimate the quality of the second frame of the video signal.

Claims

1. A method of estimating quality of a video signal at a device, the method comprising:

receiving frames of the video signal at the device, each frame comprising a plurality of blocks of pixels;

using a section of a first frame of the video signal, which is correctly received, to provide a concealed block for use in place of a block of a second frame of the video signal, the block of the second frame having a motion vector indicating complex motion, the motion vector having been received in the video signal;

determining a difference measure indicative of a difference between at least some of the pixels surrounding the block in the second frame and the corresponding pixels surrounding the section in the first frame; and

using the difference measure to estimate the quality of the second frame of the video signal.

2. The method of claim 1, wherein the using a section of a first frame of the video signal to provide a concealed block comprises using the motion vector of the block of the second frame to map the block of the second frame to the section of the first frame.

3. The method of claim 1, further comprising identifying that the motion vector of the block of the second frame indicates complex motion by determining an absolute difference in the motion vector of the block of the second frame and a motion vector of the section of the first frame, wherein if said absolute difference is greater than a threshold value then the motion vector of the block of the second frame is identified as indicating complex motion.

4. The method of claim 1, wherein a plurality of concealed blocks are provided for use in place of a respective plurality of blocks of the second frame, the method further comprising:

determining which of said plurality of blocks of the second frame have motion vectors indicating complex motion;

determining difference measures for said determined plurality of blocks of the second frame which have motion vectors indicating complex motion; and

using the determined difference measures for said determined plurality of blocks of the second frame which have motion vectors indicating complex motion to estimate the quality of the second frame of the video signal.

5. The method of claim 1, wherein the block of the second frame of the video signal is coded with reference to another section of another frame of the video signal using a motion vector of the block of the second frame, and wherein there is an error in the transmission of said another section of said another frame to the device, and wherein the method comprises:

extrapolating the motion vector of the block of the second frame to identify the section of the first frame of the video signal.

6. The method of claim 1, wherein a further block of a further frame of the video signal is coded with reference to at least the block of the second frame and wherein the method comprises determining a difference measure for the further block using the difference measure for the block in the second frame.

7. The method of claim 6, wherein said determining a difference measure for the further block comprises determining the extent to which the further block is coded with reference to the block of the second frame, wherein the difference measure for the block of the second frame is used to said extent in determining the difference measure for the further block.

8. The method of claim 1, further comprising determining whether to display the second frame or another frame of the video signal based on the estimated quality of the second frame of the video signal.

9. The method of claim 1, wherein the difference measure is a function of differences between said at least some of the pixels surrounding the block in the second frame and the corresponding pixels surrounding the section in the first frame.

10. A device for estimating quality of a video signal, the device comprising:

a processing unit; and

a memory comprising instructions executable by the processing unit to;

receive frames of the video signal, each frame comprising a plurality of blocks of pixels;

use a section of a first frame of the video signal, which is correctly received, to provide a concealed block for use in place of a block of a second frame of the video signal, the block of the second frame having a motion vector indicating complex motion, the motion vector having been received in the video signal;

determine a difference measure indicative of a difference between at least some of the pixels surrounding the block in the second frame and the corresponding pixels surrounding the section in the first frame; and

estimate, using the determined difference measure, the quality of the second frame of the video signal.

11. The device of claim 10, wherein the use of a section of a first frame of the video signal to provide a concealed block comprises the use of the motion vector of the block of the second frame to map the block of the second frame to the section of the first frame.

12. The device of claim 10, the instructions further executable to:

identify that the motion vector of the block of the second frame indicates complex motion by determining an absolute difference in the motion vector of the block of the second frame and a motion vector of the section of the first frame, wherein if said absolute difference is greater than a threshold value then the motion vector of the block of the second frame is identified as indicating complex motion.

13. A computer-readable hardware medium comprising instructions for estimating quality of a video signal, the instructions executable by a processor of a device to perform operations comprising:

receiving frames of the video signal at the device, each frame comprising a plurality of blocks of pixels;

using a section of a first frame of the video signal, which is correctly received, to provide a concealed block for use in place of a block of a second frame of the video signal, the block of the second frame having a motion vector indicating complex motion, the motion vector having been received in the video signal;

determining a difference measure indicative of a difference between at least some of the pixels surrounding the block in the second frame and the corresponding pixels surrounding the section in the first frame; and

using the difference measure to estimate the quality of the second frame of the video signal.

14. The computer-readable hardware medium of claim 13, wherein the using a section of a first frame of the video signal to provide a concealed block comprises using the motion vector of the block of the second frame to map the block of the second frame to the section of the first frame.

15. The computer-readable hardware medium of claim 13, the instructions further executable to perform identifying that the motion vector of the block of the second frame indicates complex motion by determining an absolute difference in the motion vector of the block of the second frame and a motion vector of the section of the first frame, wherein if said absolute difference is greater than a threshold value then the motion vector of the block of the second frame is identified as indicating complex motion.

16. The computer-readable hardware medium of claim 13, wherein a plurality of concealed blocks are provided for use in place of a respective plurality of blocks of the second frame, the instructions further executable to perform:

determining which of said plurality of blocks of the second frame have motion vectors indicating complex motion;

determining difference measures for said determined plurality of blocks of the second frame which have motion vectors indicating complex motion; and

using the determined difference measures for said determined plurality of blocks of the second frame which have motion vectors indicating complex motion to estimate the quality of the second frame of the video signal.

17. The computer-readable hardware medium of claim 13, wherein the block of the second frame of the video signal is coded with reference to another section of another frame of the video signal using a motion vector of the block of the second frame, and wherein there is an error in the transmission of said another section of said another frame to the device, and wherein the instructions are further executable to perform:

identifying the section of the first frame of the video signal by extrapolating the motion vector of the block of the second frame.

18. The computer-readable hardware medium of claim 13, wherein a further block of a further frame of the video signal is coded with reference to at least the block of the second frame and wherein the instructions are further executable to perform:

determining a difference measure for the further block using the difference measure for the block in the second frame.

19. The computer-readable hardware medium of claim 18, wherein said determining a difference measure for the further block comprises determining the extent to which the further block is coded with reference to the block of the second frame, wherein the difference measure for the block of the second frame is used to said extent in determining the difference measure for the further block.

20. The computer-readable hardware medium of claim 13, the instructions further configured to perform:

determining whether to display the second frame or another frame of the video signal based on the estimated quality of the second frame of the video signal.