Systems and methods for automatic evaluation of subjective quality of packetized telecommunication signals while varying implementation parameters
First Claim
1. A method of automatically determining a subjective measure of quality of signals over a packet-switched network, comprising:
- transmitting input signals to a model of the packet-switched network to obtain transmittal input signals wherein the model of the packet-switched network includes a bursty loss model in which a start of a packet burst is determined according to a Bernoulli trial, and a burst length is Poisson distributed;
altering the transmitted input signals using the model of the packet-switched network to obtain altered signals, the altered signals representing results of transmitting the transmitted input signals through the packet-switched network;
modifying the altered signals to obtain output signals;
measuring an objective quality of the output signals based on the input signals; and
transforming the objective quality to the subjective measure of quality.
2 Assignments
0 Petitions
Accused Products
Abstract
A system and method automates the process of objectively measuring the subjective quality of packetized telecommunication signals as a function of network quality-of-service (QoS) parameters, implementation choices, and other related parameters. Computer-based simulation may be used in conjunction with objective quality measurement algorithms and pre-recorded reference or test signals. A system (300) employing this simulation method does not require the use of human subjects in subjective quality evaluation. The system and method are applicable to various types of telecommunication signals such as, for example, voice, video, audio, and multimedia.
35 Citations
32 Claims
-
1. A method of automatically determining a subjective measure of quality of signals over a packet-switched network, comprising:
-
transmitting input signals to a model of the packet-switched network to obtain transmittal input signals wherein the model of the packet-switched network includes a bursty loss model in which a start of a packet burst is determined according to a Bernoulli trial, and a burst length is Poisson distributed; altering the transmitted input signals using the model of the packet-switched network to obtain altered signals, the altered signals representing results of transmitting the transmitted input signals through the packet-switched network; modifying the altered signals to obtain output signals; measuring an objective quality of the output signals based on the input signals; and transforming the objective quality to the subjective measure of quality. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10)
-
-
11. A method of automatically determining a subjective quality of voice signals transmitted over a packet-switched network, comprising:
-
encoding and streaming input voice signals to obtain streamed input signals; perturbing the streamed input signals using a packet-switched network model to obtain perturbed voice signals wherein the packet-switched network model includes a bursty loss model in which a start of a packet burst is determined according to a Bernoulli trial, and a burst length is Poisson distributed; buffering and decoding the perturbed voice signals to obtain output voice signals; and automatically determining a subjective measure of quality of the output voice signals based on the input voice signals. - View Dependent Claims (12, 13, 14, 15, 16)
-
-
17. A computer-readable medium that stores instructions executable by one or more processors to perform a method for automatically determining a subjective quality of signals received over a packet-switched network, comprising:
-
instructions for encoding an input signal to produce an encoded signal; instructions for packetizing the encoded signal to produce a packetized signal; instructions for streaming the packetized signal to produce a streamed signal; instructions for performing a discrete event simulation of the network on the streamed signal to produce an output signal wherein the packet-switched network simulation includes a bursty loss simulation in which a start of a packet burst is determined according to a Bernoulli trial and a burst length is Poisson distributed; instructions for buffering the output signal to produce a packetized output signal; instructions for depacketizing the packetized output signal to produce an encoded output signal; instructions for decoding the encoded output signal to produce a received signal; instructions for producing an objective quality measurement of the received signal using an objective quality measurement algorithm and the input signal; and instructions for transforming the objective quality measurement of the received signal into a subjective quality score for the received signal. - View Dependent Claims (18, 19, 20, 21, 22, 23, 24)
-
-
25. A computer-readable medium that stores instructions executable by one or more processors that constitute a simulation engine for automatically determining a subjective quality of signals received over a packet-switched network, comprising:
-
instructions for transmitting an input signal to a model of the network to obtain a transmitted signal; instructions for perturbing the transmitted signal by the network model to obtain a perturbed signal wherein the network model includes a bursty loss model in which a start of a packet burst is determined according to a Bernoulli trial, and a burst length is Poisson distributed; instructions for receiving the perturbed signal from the network model to obtain a received signal; instructions for producing a subjective measure of quality from the received signal and the input signal; and instructions for changing parameters in the instructions for transmitting, the instructions for perturbing, and the instructions for receiving. - View Dependent Claims (26)
-
-
27. A device for automatically determining a subjective quality of audio signals received over a packet-switched network, comprising:
-
means for encoding, packetizing, and streaming input audio signals to obtain streamed input signals; means for impairing the streamed input signals to obtain impaired audio signals wherein the impaired signals include bursty loss signals in which a start of a packet burst is determined according to a Bernoulli trial, and a burst length is Poisson distributed; means for buffering, depacketizing, and decoding the impaired audio signals to obtain output audio signals; and means for automatically determining a subjective measure of quality of the output audio signals based on the input audio signals.
-
-
28. A method of automatically determining a subjective measure of quality of signals over a packet-switched network, comprising:
-
transmitting input signals to a model of the packet-switched network to obtain transmittal input signals wherein the model of the packet-switched network includes a delay jitter model in which background traffic that arrives according to a Poisson process is interspersed with packets associated with the streamed input signals; altering the transmitted input signals using the model of the packet-switched network to obtain altered signals, the altered signals representing results of transmitting the transmitted input signals through the packet-switched network; modifying the altered signals to obtain output signals; measuring an objective quality of the output signals based on the input signals; and transforming the objective quality to the subjective measure of quality.
-
-
29. A method of automatically determining a subjective quality of voice signals transmitted over a packet-switched network, comprising:
-
encoding and streaming input voice signals to obtain streamed input signals; perturbing the streamed input signals using a packet-switched network model to obtain perturbed voice signals wherein the packet-switched network model includes a delay jitter model in which background traffic that arrives according to a Poisson process is interspersed with packets associated with the streamed input signals; buffering and decoding the perturbed voice signals to obtain output voice signals; and automatically determining a subjective measure of quality of the output voice signals based on the input voice signals.
-
-
30. A computer-readable medium that stores instructions executable by one or more processors to perform a method for automatically determining a subjective quality of signals received over a packet-switched network, comprising:
-
instructions for encoding an input signal to produce an encoded signal; instructions for packetizing the encoded signal to produce a packetized signal; instructions for streaming the packetized signal to produce a streamed signal; instructions for performing a discrete event simulation of the network on the streamed signal to produce an output signal wherein the packet-switched network simulation includes a delay jitter simulation in which background traffic that arrives according to a Poisson process is interspersed with packets associated with the streamed input signals; instructions for buffering the output signal to produce a packetized output signal; instructions for depacketizing the packetized output signal to produce an encoded output signal; instructions for decoding the encoded output signal to produce a received signal; instructions for producing an objective quality measurement of the received signal using an objective quality measurement algorithm and the input signal; and instructions for transforming the objective quality measurement of the received signal into a subjective quality score for the received signal.
-
-
31. A computer-readable medium that stores instructions executable by one or more processors that constitute a simulation engine for automatically determining a subjective quality of signals received over a packet-switched network, comprising:
-
instructions for transmitting an input signal to a model of the network to obtain a transmitted signal; instructions for perturbing the transmitted signal by the network model to obtain a perturbed signal wherein the network model includes a delay jitter model in which background traffic that arrives according to a Poisson process is interspersed with packets associated with the streamed input signals; instructions for receiving the perturbed signal from the network model to obtain a received signal; instructions for producing a subjective measure of quality from the received signal and the input signal; and instructions for changing parameters in the instructions for transmitting, the instructions for perturbing, and the instructions for receiving.
-
-
32. A device for automatically determining a subjective quality of audio signals received over a packet-switched network, comprising:
-
means for encoding, packetizing, and streaming input audio signals to obtain streamed input signals; means for impairing the streamed input signals to obtain impaired audio signals wherein the impaired signals include delay jitter signals in which background traffic that arrives according to a Poisson process is interspersed with packets associated with the streamed input signals; means for buffering, depacketizing, and decoding the impaired audio signals to obtain output audio signals; and means for automatically determining a subjective measure of quality of the output audio signals based on the input audio signals.
-
Specification