System and method for providing a scalable dynamic objective metric for automatic video quality evaluation

• US 6,798,919 B2
• Filed: 12/12/2000
• Issued: 09/28/2004
• Est. Priority Date: 12/12/2000
• Status: Expired due to Fees

• Current Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Original Assignee: Koninklijke Philips Electronics N.V. (Koninklijke Philips N.V.)
• Inventors: Van Zon, Cornelis, Ali, Walid S. I.
• Primary Examiner(s): Au, Amelia M.
• Assistant Examiner(s): TUCKER, WESLEY J
• Application Number:
  US09/734,823
• Publication Number:
  US 20020071614A1
• Time in Patent Office: 1,386 Days
• Field of Search: 348/180, 348/184, 348/192, 348/438.1, 348/455, 348/193, 382/162, 382/254, 382/260, 382/272, 382/286, 702/182, 702/183, 702/66-69
• US Class Current: 382/272
• CPC Class Codes: H04N 17/004 for digital television systems

Abstract

There is disclosed an improved system and method for providing a scalable dynamic objective metric for automatically evaluating the video quality of a video image. The system comprises an objective metric controller that is capable of receiving a plurality of objective metric figures of merit from a plurality of objective metric model units. The system determines a scalable dynamic objective metric from a weighted average of the plurality of objective metric figures of merit. The scalable dynamic objective metric represents the best correlation of objective metric measurements of the video image with subjective measurements of the video image. The weight value of individual objective metric figures of merit may be increased or decreased depending upon the type of video image being evaluated. Individual objective metric figures of merit may be added to the system or deleted from the system. The system is capable of continually determining a new value of the scalable dynamic objective metric as the plurality of objective metric model units receive new video images.

Claims

1. A system for providing a scalable dynamic objective metric for evaluating video quality of a video image, said system comprising:

an objective metric controller capable of receiving a plurality of objective metric figures of merit from a plurality of objective metric model units, said objective metric controller comprising a weighting unit dial is capable of assigning a weight value to each of said plurality of objective metric figures of merit by using a correlation factor r(i), for each of said objective metric figures of merit, where each correlation factor r(i) for an objective metric figure of merit represents how well the objective metric figure of merit evaluates video image characteristics;

wherein said objective metric controller is capable of calculating a plurality of sums where each sum, S(r(i)), is equal to the sum of each product of weight value, w(i) and figure of merit f(i), for each of said correlation factors, r(i); and

wherein said objective metric controller is capable of determining said scalable dynamic objective metric from said plurality of objective metric figures of merit using said sums.

2. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 wherein the number of said plurality of objective metric figures of merit may vary from two to N, where N is an integer number.

3. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 wherein said objective metric controller is capable of determining said scalable dynamic objective metric from a weighted average of said plurality of objective metric figures of merit.

4. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 wherein said correlation factor, r(i), is given by:

5. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 wherein said weighting unit obtains each of said correlation factors, r(i), from a metric parameter look up table coupled to said objective metric controller, wherein said look up table contains previously recorded values of said correlation factors, r(i).

6. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 wherein said objective metric controller is capable of obtaining said scalable dynamic objective metric by selecting said scalable dynamic objective metric to be the maximum value of the plurality of sums, S(r(i)), where said maximum value represents the best correlation of objective metric measurements of said video image with subjective measurements of said video image.

7. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 wherein said objective metric controller is capable of continually determining a new value of said scalable objective metric from new values of said plurality of objective figures of merit as said plurality of objective metric model units continually receive new video images.

8. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 wherein said objective metric controller is capable of adding at least one objective metric to said plurality of objective figures of merit, and wherein said objective metric controller is capable of deleting at least one objective metric from said plurality of objective figures of merit.

9. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 wherein said objective metric controller comprises:

a controller capable of receiving a plurality of objective metric figures of merit, f(i), from a plurality of objective metric model units; and

a metric calculation algorithm contained within a memory coupled to said controller, said metric calculation algorithm containing instructions capable of being executed by said controller to determine a value, F, for said scalable dynamic objective metric from a weighted average of said plurality of objective metric figures of merit, f(i).

10. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 9 wherein said metric calculation algorithm contains instructions capable of being executed by said controller to determine said value, F, for said scalable dynamic objective metric according to the formula:

11. The system for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 1 comprising:

a plurality of objective metric model units;

an objective metric controller capable of receiving a plurality of objective metric figures of merit from said plurality of objective metric model units, and capable of determining a value, F, for said scalable dynamic objective metric from a weighted average of said plurality of objective metric figures of merit, f(i), wherein said value F represents an objective metric that represents a maximum level of correlation of objective metric measurements of video quality and subjective measurements of video quality.

12. A system for providing a static objective metric for evaluating video quality of a video image, said system comprising:

an objective metric controller capable of receiving a plurality of objective metric figures of merit from a plurality of objective metric model units, said objective metric controller comprising a weighting unit that is capable of assigning a weight value to each of said plurality of objective metric figures of merit by using a correlation factor r(i), for each of said objective metric figures of merit, where each correlation factor r(i), for an objective metric figure of merit represents how well the objective metric figure of merit evaluates video image characteristics;

wherein said objective metric controller is capable of calculating a plurality of sums where each sum, S(r(i)), is equal to the sum of each product of weight value, w(i), and figure of merit f(i), for each of said correlation factors, r(i); and

wherein said objective metric controller is capable of determining said static objective metric from said plurality of objective metric figures of merit using said sums.

13. A method for providing a scalable dynamic objective metric for evaluating video quality of a video image comprising the steps of:

receiving in an objective metric controller a plurality of objective metric figures of merit from a plurality of objective metric model units;

obtaining a correlation factor, r(i), for each of said plurality of objective metric figures of merit that represents how well an affective metric figure of merit evaluates video image characteristics;

assigning a weight value to each of said plurality of said objective metric figures of merit using said correlation factor, r(i);

calculating a plurality of sums where each sum, S(r(i)), is equal to the sum of each product of weight value w(i), and figure of merit f(i) for each of said correlation factors r(i); and

determining said scalable dynamic objective metric from said plurality of said objective metric figures of merit using said sums.

14. The method for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 13 wherein the step of determining said scalable dynamic objective metric from said plurality of said objective metric figures of merit comprises the step of:

determining said scalable dynamic objective metric from a weighted average of said plurality of said objective metric figures of merit.

15. The method for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 14 further comprising the step of:

selecting said scalable dynamic objective metric to be the maximum value of the plurality of sums, S(r(i)), where said maximum value represents the best correlation of objective metric measurements of said video image with subjective measurements of said video image.

16. The method for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 14 further comprising the steps of:

assigning a low weight value to an objective metric that produces an undesirable objective metric figure of merit; and

assigning a high weight value to an objective metric that produces an desirable objective metric figure of merit.

17. The method for providing a scalable dynamic objective metric for evaluating video quality of a video image as claimed in claim 13 further comprising the steps of:

receiving in said objective metric controller new values of said plurality of objective metric figures of merit from said plurality of objective metric model units as said plurality of objective metric model units receive new video images; and

continually determining a new value of said scalable dynamic objective metric from said new values of said plurality of objective metric figures of merit.

18. A method for providing a static objective metric for evaluating video quality of a video image comprising the steps of:

receiving in an objective metric controller a plurality of objective metric figures of merit from a plurality of objective metric model units;

obtaining a correlation factor, r(i), for each of said plurality of objective metric figures of merit that represents how well an objective metric figure of merit evaluates video image characteristics;

determining a weight value, w(i), for each of said plurality of objective metric figures of merit;

keeping said weight values constant;

calculating a plurality of sums where each sum, S(r(i)), is equal to the sum of each product of weight value, w(i), and figure of merit, f(i), for each of said correlation factors, r(i); and

calculating said static objective metric using said constant weight values and said sums.