Perception-based audio visual synchronization measurement system
First Claim
1. A quality measurement system for measuring an audio-visual quality of a destination audio-visual signal, comprising:
- source audio feature extraction means for extracting source audio features from a source audio-visual signal corresponding to the destination audio-visual signal;
source video feature extraction means for extracting source video features from a source audio-visual signal corresponding to the destination audio-visual signal;
destination audio feature extraction means for extracting destination audio features from the destination audio-visual signal;
destination video feature extraction means for extracting destination video features from the destination audio-visual signal;
source time referencing means for providing a source time reference for each one of the source audio features and for each one of the source video features;
destination time referencing means for providing a destination time reference for each one of the destination audio features and for each one of the destination video features;
communication circuit means for communicating the source audio features, the source video features, the source time references, the destination audio features, the destination video features, and the destination time references;
audio quality parameter generation means for generating audio quality parameters, indicative of the audio quality of the destination audio-visual signal based on the source audio-visual signal, from at least one source and at least one destination audio feature;
video quality parameter generation means for generating video quality parameters, indicative of the video quality of the destination audio-visual signal based on the source audio-visual signal, from at least one source and at least one destination video feature; and
audio-visual quality parameter generation means for generating audio-visual quality parameters, indicative of the audio-visual quality of the destination audio-visual signal based on the source audio-visual signal, from at least one audio quality parameter and at least one video quality parameter.
1 Assignment
0 Petitions
Accused Products
Abstract
A method for objectively and non-intrusively measuring the audio-visual quality of a destination audio-video signal that generates measurement parameters that are indicative of human image quality perceptions. Subjective human test panel results are generated for a variety of audio-video test samples and objective test results are also generated by the apparatus of the invention for the variety of audio-video test samples. Accordingly, when the apparatus extracts test frames from the actual source and destination audio-video signals and compares them, audio-visual quality parameters are output by the apparatus that are indicative of the audio-visual quality of the destination audio-visual signal based upon the source audio-visual signal.
121 Citations
12 Claims
-
1. A quality measurement system for measuring an audio-visual quality of a destination audio-visual signal, comprising:
-
source audio feature extraction means for extracting source audio features from a source audio-visual signal corresponding to the destination audio-visual signal; source video feature extraction means for extracting source video features from a source audio-visual signal corresponding to the destination audio-visual signal; destination audio feature extraction means for extracting destination audio features from the destination audio-visual signal; destination video feature extraction means for extracting destination video features from the destination audio-visual signal; source time referencing means for providing a source time reference for each one of the source audio features and for each one of the source video features; destination time referencing means for providing a destination time reference for each one of the destination audio features and for each one of the destination video features; communication circuit means for communicating the source audio features, the source video features, the source time references, the destination audio features, the destination video features, and the destination time references; audio quality parameter generation means for generating audio quality parameters, indicative of the audio quality of the destination audio-visual signal based on the source audio-visual signal, from at least one source and at least one destination audio feature; video quality parameter generation means for generating video quality parameters, indicative of the video quality of the destination audio-visual signal based on the source audio-visual signal, from at least one source and at least one destination video feature; and audio-visual quality parameter generation means for generating audio-visual quality parameters, indicative of the audio-visual quality of the destination audio-visual signal based on the source audio-visual signal, from at least one audio quality parameter and at least one video quality parameter. - View Dependent Claims (2, 3, 4, 5, 6, 7)
-
-
8. An audio-visual quality measurement system for measuring a change quality between a source audio-visual signal and a corresponding destination audio-visual signal, the audio-visual quality measurement system comprising:
-
first audio feature extraction means for extracting a first plurality of audio features from the source audio-visual signal based on at least one objective audio measurement criteria; second audio feature extraction means for extracting a second plurality of audio features from the destination audio-visual signal based on the at least one objective audio measurement criteria; audio alignment means coupled to the first and the second audio feature extraction means for performing time alignment between corresponding audio features of the first and the second plurality of audio features; audio quality parameter generation means for combining time aligned corresponding features of the first and the second plurality of audio features to generate at least one audio quality indication; first video feature extraction means for extracting a first plurality of video features from the source audio-visual signal based on at least one objective video measurement criteria; second video feature extraction means for extracting a second plurality of video features from the destination audio-visual signal based on the at least one objective video measurement criteria; video alignment means coupled to the first and the second video feature extraction means for performing time alignment between corresponding video features of the first and the second plurality of video features; video quality parameter generation means for combining time aligned corresponding features of the first and the second plurality of video features to generate at least one video quality indication; and audio-visual combining means for combining the time aligned corresponding audio and video quality parameters of the first and the second plurality of audio and video features according to a plurality of learned parameters, the plurality of learned parameters having been determined from a joint statistical analysis of a plurality of subjective viewer judgments. - View Dependent Claims (9, 10)
-
-
11. A quality measurement system for measuring an audio-visual quality of a destination audio-visual signal, comprising:
-
source audio feature extraction means for extracting source audio features from a source electromagnetic audio-visual signal corresponding to the destination electromagnetic audio-visual signal; destination audio feature extraction means for extracting destination audio features from the destination electromagnetic audio-visual signal; source time referencing means for providing a source time reference for each one of the source audio features; destination time referencing means for providing a destination time reference for each one of the destination audio features; communication circuit means for communicating the source audio features, the source time references, the destination audio features, and the destination time references; and audio quality parameter generation means for generating audio quality parameters, indicative of the audio quality of the destination electromagnetic audio-visual signal based on the source electromagnetic audio-visual signal, from at least one source and at least one destination audio feature. - View Dependent Claims (12)
-
Specification