System and method for evaluating streaming multimedia quality

• US 7,873,727 B2
• Filed: 03/13/2008
• Issued: 01/18/2011
• Est. Priority Date: 03/13/2008
• Status: Expired due to Fees

• Current Assignee: Board of Regents of the University of Texas System (University of Texas System)
• Original Assignee: Board of Regents of the University of Texas System (University of Texas System)
• Inventors: Basu, Kalyan, Das, Sajal, Pal, Sourav, Kundu, Sumantra
• Primary Examiner(s): VU, VIET DUY
• Application Number:
  US12/048,029
• Publication Number:
  US 20090234940A1
• Time in Patent Office: 1,041 Days
• Field of Search: 709/217, 709/219, 709/223, 709/224, 709/227, 709/228, 709/230, 709/231
• US Class Current: 709/224
• CPC Class Codes: H04L 65/80 Responding to QoS

Abstract

A system and computer program for evaluating in real-time streaming multimedia quality. The system including a multimedia server connected to a multimedia source and a remote client in communication with the multimedia server over a network. The multimedia server is configured to receive multimedia content from the multimedia source and to transmit the multimedia content as a multimedia stream. The multimedia stream includes a plurality of audio frames and a plurality of video frames. The remote client is configured to establish a multimedia session with the multimedia server, receive the multimedia stream via the multimedia session, monitor the media quality of the multimedia stream, and passively compute a subjective quality of the multimedia stream.

Claims

1. A method for evaluating multimedia quality, the method comprising:

receiving, at a client data processing system, multimedia content from a multimedia server, wherein the multimedia content comprises a plurality of audio frames containing audio information content and a plurality of video frames containing video information content;

at the client data processing system, computing an information theoretic measurement for at least one of the video frames, wherein the information theoretic measurement measures complexity of the video information content of the video frame; and

using the information theoretic measurement to compute a quality measurement for the multimedia content received by the client data processing system; and

wherein the operation of using the information theoretic measurement to compute the quality measurement for the multimedia content received by the client data processing system comprises computing the quality measurement based on factors including;

the information theoretic measurement; and

a measurement of synchronization between the audio frames and the video frames.

2. A method according to claim 1, wherein:

the information theoretic measurement computed at the client data processing comprises a downstream information theoretic measurement; and

the method further comprises;

receiving, at the client data processing system, an upstream information theoretic measurement for the video frame, wherein the upstream information theoretic measurement measures complexity of the video information content of the video frame at the multimedia server; and

using the upstream and downstream information theoretic measurements for the same video frame to compute the quality metric.

3. A method according to claim 2, wherein the operation of computing the quality measurement for the multimedia content received by the client data processing system is performed by the client data processing system.

4. A method according to claim 1, wherein the operation of computing the information theoretic measurement for at least one of the video frames comprises:

computing multiple information content measurements for respective portions of the video frame; and

using the multiple information content measurements to compute an entropy measurement for the video frame.

5. A method according to claim 1, wherein the operation of computing the information theoretic measurement for at least one of the video frames comprises:

computing multiple state measurements for respective portions of the video frame;

computing a probability distribution for the multiple state measurements;

computing an entropy measurement for the video frame, based on the probability distribution for the multiple state measurements; and

computing an H factor for the video frame, based on the entropy measurement.

6. A method according to claim 1, wherein:

the operation of receiving multimedia content from the multimedia server comprises receiving a multimedia stream from the multimedia server; and

the operations further comprise;

generating decoded view frames from the video frames; and

displaying the decoded video frames for an end user.

7. A method according to claim 1, wherein the multimedia content comprises at least one type of content from the group consisting of:

a live multimedia session, a stored multimedia session, a Internet protocol (IP) television (IPTV) session, a voice over IP session, and a Telepresence session.

8. A method according to claim 1, wherein the operation of using the information theoretic measurement to compute the quality measurement for the multimedia content received by the client data processing system comprises:

computing the quality measurement based on measurement parameters comprising;

a frame loss factor.

9. An article of manufacture, comprising:

a machine accessible storage medium; and

instructions in the machine accessible storage medium which, when executed by a data processing system, enable the data processing system to perform operations comprising;

after the data processing system has established a multimedia session for receiving multimedia content from a multimedia server, wherein the multimedia content comprises a plurality of audio frames containing audio information content and a plurality of video frames containing video information content, computing an information theoretic measurement for at least one of the video frames, wherein the information theoretic measurement measures complexity of the video information content of the video frame; and

using the information theoretic measurement to compute a quality measurement for the multimedia content received by from the multimedia server; and

wherein the operation of using the information theoretic measurement to compute the quality measurement for the multimedia content received by the client data processing system comprises computing the quality measurement based on factors including;

the information theoretic measurement; and

a measurement of synchronization between the audio frames and the video frames.

10. An article of manufacture according to claim 9, wherein:

the information theoretic measurement computed at the client data processing comprises a downstream information theoretic measurement; and

the operations further comprise;

receiving, at the client data processing system, an upstream information theoretic measurement for the video frame, wherein the upstream information theoretic measurement measures complexity of the video information content of the video frame at the multimedia server; and

using upstream and downstream information theoretic measurements for the same video frame to compute the quality metric.

11. An article of manufacture according to claim 9, wherein the operation of computing the information theoretic measurement for at least one of the video frames comprises:

computing multiple information content measurements for respective portions of the video frame; and

using the multiple information content measurements to compute an entropy measurement for the video frame.

12. An article of manufacture according to claim 9, wherein the operation of computing the information theoretic measurement for at least one of the video frames comprises:

computing multiple state measurements for respective portions of the video frame;

computing a probability distribution for the multiple state measurements;

computing an entropy measurement for the video frame, based on the probability distribution for the multiple state measurements; and

computing an H factor for the video frame, based on the entropy measurement.

13. An article of manufacture according to claim 9, wherein:

the operation of receiving multimedia content from the multimedia server comprises receiving a multimedia stream from the multimedia server; and

the operations further comprise;

generating decoded view frames from the video frames; and

displaying the decoded video frames for an end user.

14. An article of manufacture according to claim 9, wherein the operation of using the information theoretic measurement to compute the quality measurement for the multimedia content received by the client data processing system comprises:

computing the quality measurement based on measurement parameters comprising;

a frame loss factor.

15. A data processing system comprising:

a processor;

a machine accessible storage medium responsive to the processor; and

instructions in the machine accessible storage medium which, when executed by the processor, enable the data processing system to perform operations comprising;

after the data processing system has established a multimedia session for receiving multimedia content from a multimedia server, wherein the multimedia content comprises a plurality of audio frames containing audio information content and a plurality of video frames containing video information content, computing an information theoretic measurement for at least one of the video frames, wherein the information theoretic measurement measures complexity of the video information content of the video frame; and

using the information theoretic measurement to compute a quality measurement for the multimedia content received by from the multimedia server; and

wherein the operation of using the information theoretic measurement to compute the quality measurement for the multimedia content received by the client data processing system comprises computing the quality measurement based on factors including;

the information theoretic measurement; and

a measurement of synchronization between the audio frames and the video frames.

16. A data processing system according to claim 15, wherein:

the information theoretic measurement computed at the client data processing comprises a downstream information theoretic measurement; and

the operations further comprise;

receiving an upstream information theoretic measurement for the video frame, wherein the upstream information theoretic measurement measures complexity of the video information content of the video frame at the multimedia server; and

using upstream and downstream information theoretic measurements for the same video frame to compute the quality metric.

17. A data processing system according to claim 15, wherein the operation of using the information theoretic measurement to compute the quality measurement for the multimedia content received by the client data processing system comprises:

computing the quality measurement based on factors including;

a frame loss factor.