Real-time feature-based video stream validation and distortion analysis system using color moments
First Claim
1. A video stream distortion analysis system comprising:
- a baseline preparation processor operable to perform an analysis of a baseline video stream having a plurality of baseline frames, the analysis including determining a plurality of baseline color moments, including a plurality of baseline color moment types, for the baseline video stream, and to transmit a baseline signal including the plurality of baseline color moments; and
a remote comparison processor operable to perform an analysis of a broadcast video stream having a plurality of broadcast frames, the analysis including determining a plurality of broadcast color moments, including a plurality of broadcast color moment types, for the broadcast video stream, to receive the baseline signal, and to determine variations between the baseline color moments and the broadcast color moments.
1 Assignment
0 Petitions
Accused Products
Abstract
A real-time distortion analysis system (20) utilizes a baseline preparation processor (38) and a remote comparison processor (50) to determine (72, 78) a plurality of color and central moments for baseline and broadcast video streams respectively. The baseline stream is taken from a broadcast signal sent from a broadcast station (26), and the broadcast video stream is taken from a viewer signal sent from a remote receiving station (28, 30, 32) to viewers (34). The remote comparison processor (50) compares (82), on a frame by frame basis, the baseline and broadcast moments and determines a cumulative absolute difference which reflects differences between the two video streams. To conduct a frame by frame analysis of the two video streams, the system (20) temporally aligns the video streams. Alternatively, the system (20) uses a moment database (88) to compare the moments at a time subsequent to broadcast.
79 Citations
65 Claims
-
1. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having a plurality of baseline frames, the analysis including determining a plurality of baseline color moments, including a plurality of baseline color moment types, for the baseline video stream, and to transmit a baseline signal including the plurality of baseline color moments; and
a remote comparison processor operable to perform an analysis of a broadcast video stream having a plurality of broadcast frames, the analysis including determining a plurality of broadcast color moments, including a plurality of broadcast color moment types, for the broadcast video stream, to receive the baseline signal, and to determine variations between the baseline color moments and the broadcast color moments. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18)
-
-
19. A videostream distortion analysis system comprising:
-
a baseline video feed device operable to introduce a baseline video stream having baseline frames into the system;
a baseline preparation processor operable to perform an analysis on the baseline video stream frames, the analysis including determining a plurality of baseline moments, a plurality of baseline moment types, for the baseline video steam frames;
a baseline transmitter operable to transmit a baseline signal including the plurality of moments; and
a plurality of remote sites, each remote site including;
a remote video feed device operable to introduce a broadcast video stream having broadcast frames into the system;
a remote receiver operable to receive the baseline signal from the baseline transmitter; and
a remote comparison processor operable to perform an analysis on the broadcast video stream frames, the analysis including determining a plurality of broadcast moments, including a plurality of broadcast moment types, for the broadcast video stream, and to determine variations between the baseline moments and the broadcast moments. - View Dependent Claims (20, 21, 22)
-
-
23. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline color moments, including a plurality of baseline color moment types, for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast color moments, including a plurality of broadcast color moments, for the broadcast video stream;
comparing the baseline color moments, including a plurality of baseline color moment types, with the broadcast color moments; and
determining variations between the baseline color and the broadcast color moments. - View Dependent Claims (24, 25, 26, 27, 28, 29, 30, 31, 32, 33)
determining a plurality of baseline central moments for the baseline video stream;
determining a plurality of broadcast central moments for the broadcast video stream;
comparing the baseline central moments with the broadcast central moments;
and determining variations between the broadcast central moments and the baseline central moments.
-
-
33. The method according to claim 23 wherein determining variations between the baseline color moments and the broadcast color moments comprises determining Euclidean distances for between corresponding moments for each pair of corresponding frames under comparison.
-
34. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline central moments, including a plurality of baseline central moment types, for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast central moments, including a plurality of broadcast central moment types, for the broadcast video stream;
comparing the baseline central moments with the broadcast central moments; and
determining variations between the baseline central moments and the broadcast central moments. - View Dependent Claims (35)
-
-
36. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having baseline frames, the analysis including determination of a plurality of baseline moments including a plurality of baseline moment types, for the baseline video stream;
a remote comparison processor operable to perk an analysis of a broadcast video stream having broadcast frames, the analysis including determination of a plurality of broadcast moments, including a plurality of broadcast moment types, for the broadcast video stream;
a communications apparatus operable to exchange the baseline moments and the broadcast moments between the baseline processor and the remote processor; and
a selected one of the baseline processor and the remote processor being operable to determine variations between the baseline color moments and the broadcast color moments. - View Dependent Claims (37, 38, 39)
-
-
40. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having a plurality of baseline frames, the analysis including determining a plurality of baseline color moments for the baseline video stream, and to transmit a baseline signal including the plurality of baseline color moments;
a remote comparison processor operable to perform an analysis of a broadcast video stream having a plurality of broadcast frames, the analysis including determining a plurality of broadcast color moments for the broadcast video stream, to receive the baseline signal, and to determine variations between the baseline color moments and the broadcast color moments; and
a baseline digital video recorder operable to record desired segments of the baseline video stream, and a remote digital video recorder operable to record desired segments of the broadcast video stream, and wherein the remote processor is operable to transmit a record signal to the baseline processor, so that the baseline recorder and remote recorder record substantially simultaneously.
-
-
41. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having a plurality of baseline frames, the analysis including determining a plurality of baseline color moments for the baseline video stream, and to transmit a baseline signal including the plurality of baseline color moments;
a remote comparison processor operable to perform an analysis of a broadcast video stream having a plurality of broadcast frames, the analysis including determining a plurality of broadcast color moments for the broadcast video stream, to receive the baseline signal, and to determine variations between the baseline color moments and the broadcast color moments;
the baseline processor is further operable to determine a plurality of baseline central moments for the baseline video stream, and the remote comparison processor is further operable to determine a plurality of broadcast central moments for the broadcast signal and determine variations between the baseline central moments and the broadcast central moments; and
the baseline processor is operable to determine and the plurality of the baseline central moments includes a plurality of first baseline central moments representing centers of image intensity, a plurality of second baseline central moments representing standard deviation of image intensity, and a plurality of third baseline central moments representing skews of image intensity; and
the remote processor is operable to determine and the plurality of the broadcast central moments includes a plurality of first broadcast central moments representing centers of image intensity, a plurality of second broadcast central moments representing standard deviation of image intensity, and a plurality of third broadcast central moments representing skews of image intensity.
-
-
42. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having a plurality of baseline frames, the analysis including determining a plurality of baseline color moments for the baseline video stream, and to transmit a baseline signal including the plurality of baseline color moments; and
a remote comparison processor operable to perform an analysis of a broadcast video stream having a plurality of broadcast frames, the analysis including determining a plurality of broadcast color moments for the broadcast video stream, to receive the baseline signal, and to determine variations between the baseline color moments and the broadcast color moments;
the baseline processor is further operable to determine a plurality of baseline central moments for the baseline video stream, and the remote comparison processor is further operable to determine a plurality of broadcast central moments for the broadcast signal and determine variations between the baseline central moments and the broadcast central moments; and
the baseline central moments include baseline gray-scale intensity moments, and the broadcast central moments include broadcast gray-scale intensity moments.
-
-
43. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having a plurality of baseline frames, the analysis including determining a plurality of baseline color moments for the baseline video stream, and to transmit a baseline signal including the plurality of baseline color moments;
a remote comparison processor operable to perform an analysis of a broadcast video stream having a plurality of broadcast frames, the analysis including determining a plurality of broadcast color moments for the broadcast video stream, to receive the baseline signal, and to determine variations between the baseline color moments and the broadcast color moments; and
the baseline processor is operable to determine and the plurality of baseline color moments includes a plurality of first baseline red moments, a plurality of first baseline green moments, and a plurality of first baseline blue moments, the first moments representing averages of color values;
the remote comparison processor is operable to determine and the plurality of broadcast color moments includes a plurality of first broadcast red moments, a plurality of first broadcast green moments, and a plurality of first broadcast blue moments.
-
-
44. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having a plurality of baseline frames, the analysis including determining a plurality of baseline color moments for the baseline video stream, and to transmit a baseline signal including the plurality of baseline color moments;
a remote comparison processor operable to perform an analysis of a broadcast video stream having a plurality of broadcast frames, the analysis including determining a plurality of broadcast color moments for the broadcast video stream, to receive the baseline signal, and to determine variations between the baseline color moments and the broadcast color moments; and
the baseline processor is operable to determine and the plurality of baseline color moments includes a plurality of second baseline red moments, a plurality of second baseline green moments, and a plurality of second baseline blue moments, the second moments representing standard deviations of color values;
the remote comparison processor is operable to determine and the plurality of broadcast color moments includes a plurality of second broadcast red moments, a plurality of second broadcast green moments, and a plurality of second broadcast blue moments.
-
-
45. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having a plurality of baseline frames, the analysis including determining a plurality of baseline color moments for the baseline video stream, and to transmit a baseline signal including the plurality of baseline color moments;
a remote comparison processor operable to perform an analysis of a broadcast video stream having a plurality of broadcast frames, the analysis including determining a plurality of broadcast color moments for the broadcast video stream, to receive the baseline signal, and to determine variations between the baseline color moments and the broadcast color moments; and
the baseline processor is operable to determine and the plurality of baseline color moments includes a plurality of third baseline red moments, a plurality of third baseline green moments, and a plurality of third baseline blue moments, the third moments representing skews of color values;
the remote comparison processor is operable to determine and the plurality of broadcast color moments includes a plurality of third broadcast red moments, a plurality of third broadcast green moments, and a plurality of third broadcast blue moments.
-
-
46. A video stream distortion analysis system comprising:
-
a baseline video feed device operable to introduce a baseline video stream having baseline frames into the system;
a baseline preparation processor operable to perform an analysis on the baseline video stream frames, the analysis including determining a plurality of baseline moments, including a plurality of baseline moment types for the baseline video stream frames;
a baseline transmitter operable to transmit a baseline signal including the plurality of moments; and
a plurality of remote sites, each remote site including;
a remote video feed device operable to introduce a broadcast video stream having broadcast frames into the system;
a remote receiver operable to receive the baseline signal from the baseline transmitter;
a remote comparison processor operable to perform an analysis on the broadcast video stream frames, the analysis including determining a plurality of broadcast moments for the broadcast video stream including a plurality of broadcast moment types, and to determine variations between the baseline moments and the broadcast moments; and
the frame variation comprises a sum of absolute differences between the plurality of baseline moments and the plurality of broadcast moments.
-
-
47. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline color moments for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast color moments for the broadcast video stream;
comparing the baseline color moments with the broadcast color moments;
determining variations between the baseline color moments and the broadcast color moments; and
recording the broadcast video stream upon detection of a variation value above a predetermined variation value.
-
-
48. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline color moments for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast color moments for the broadcast video stream;
comparing the baseline color moments with the broadcast color moments;
determining variations between the baseline color moments and the broadcast color moments; and
determining the plurality of broadcast color moments comprises determining a second color moment and a third color moment for a selected one of the broadcast frames based on a first moment from an immediately previous broadcast frame to the selected broadcast frame, determining a first moment for the selected frame, and comparing the first moment from the previous broadcast frame with the first moment from the selected broadcast frame. - View Dependent Claims (49)
-
-
50. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline color moments for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast color moments for the broadcast video stream;
comparing the baseline color moments with the broadcast color moments;
determining variations between the baseline color moments and the broadcast color moments; and
determining the broadcast color moments comprises determining a first order color moment representing an average value, determining a second order color moment representing a standard deviation value, and a third order color moment representing a skew value.
-
-
51. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline color moments for the baseline video streams including a plurality of baseline color moment types;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast color moments, including a plurality of broadcast color moment types, for the broadcast video stream;
comparing the baseline color moments with the broadcast color moments;
determining variations between the baseline color moments and the broadcast color moments; and
transmitting a baseline signal, including the baseline color moments, from a baseline transmitter to a remote receiver. - View Dependent Claims (52, 53, 54)
-
-
55. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline color moments for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast color moments for the broadcast video stream;
comparing the baseline color moments with the broadcast color moments;
determining variations between the baseline color moments and the broadcast color moments;
determining a plurality of baseline central moments for the baseline video stream;
determining a plurality of broadcast central moments for the broadcast video stream;
comparing the baseline central moments with the broadcast central moments;
determining variations between the broadcast central moments and the baseline central moments; and
determining the baseline central moments comprises determining a plurality of first baseline central moments representing centers of image intensity, determining a plurality of second baseline central moments representing standard deviation of image intensity, and determining a plurality of third baseline central moments representing skews of image intensity; and
determining the broadcast central moments comprises determining a plurality of first broadcast central moments representing centers of image intensity, determining a plurality of second broadcast central moments representing standard deviation of image intensity, and determining a plurality of third broadcast central moments representing skews of image intensity.- View Dependent Claims (56)
-
-
57. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline color moments for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast color moments for the broadcast video stream;
comparing the baseline color moments with the broadcast color moments;
determining variations between the baseline color moments and the broadcast color moments;
determining the plurality of baseline color moments comprises;
determining a plurality of first baseline red moments, a plurality of first baseline green moments, and a plurality of first baseline blue moments, the first moments representing averages of color values;
determining a plurality of second baseline red moments, a plurality of second baseline green moments, and a plurality of second baseline blue moments, the second moments representing standard deviations of color values; and
determining a plurality of third baseline red moments, a plurality of third baseline green moments, and a plurality of third baseline blue moments, the third moments representing skews of color values; and
determining the plurality of broadcast color moments comprises;
determining a plurality of first broadcast red moments, a plurality of first broadcast green moments, and a plurality of first broadcast blue moments;
determining a plurality of second broadcast red moments, a plurality of second broadcast green moments, and a plurality of second broadcast blue moments; and
determining a plurality of third broadcast red moments, a plurality of third broadcast green moments, and a plurality of third broadcast blue moments. - View Dependent Claims (58, 59)
comparing the first baseline red moments, the first baseline green moments, and the first baseline blue moments with the first broadcast red moments, the first broadcast green moments, and the first broadcast blue moments, respectively;
comparing the second baseline red moments, the second baseline green moments, and the second baseline blue moments with the second broadcast red moments, the second broadcast green moments, and the second broadcast blue moments, respectively; and
comparing the third baseline red moments, the third baseline green moments, and the third baseline blue moments with the third broadcast red moments, the third broadcast green moments, and the third broadcast blue moments, respectively.
-
-
60. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline color moments for the baseline video stream;
including a plurality of baseline color moment types;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast color moments for the broadcast video stream, including a plurality of broadcast color moment types;
comparing the baseline color moments with the broadcast color moments;
determining variations between the baseline color moments and the broadcast color moments; and
determining variations between the baseline color moments and the broadcast color moments comprises determining a sum absolute difference for each pair of corresponding frames under comparison and determining a cumulative difference for a selected number of pairs of corresponding frames.
-
-
61. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline central moments for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast central moments for the broadcast video stream;
comparing the baseline central moments with the broadcast central moments;
determining variations between the baseline central moments and the broadcast central moments; and
determining the baseline central moments comprises determining six baseline central moments per baseline frame and determining the broadcast central moments comprises determining six broadcast central moments per broadcast frame. - View Dependent Claims (62)
-
-
63. A method for detecting video stream distortion with a video stream distortion detection system, the method comprising:
-
introducing a baseline video stream having a plurality of baseline frames into the system;
determining a plurality of baseline central moments for the baseline video stream;
introducing a broadcast video stream having a plurality of broadcast frames into the system;
determining a plurality of broadcast central moments for the broadcast video stream;
comparing the baseline central moments with the broadcast central moments;
determining variations between the baseline central moments and the broadcast central moments; and
determining a plurality of baseline color moments for the baseline video stream comprises determining nine baseline color moments per baseline frame, and determining the plurality of broadcast color moments for the broadcast video stream comprises determining nine broadcast color moments per broadcast frame. - View Dependent Claims (64)
-
-
65. A video stream distortion analysis system comprising:
-
a baseline preparation processor operable to perform an analysis of a baseline video stream having baseline frames, the analysis including determination of a plurality of baseline moments for the baseline video stream;
a remote comparison processor operable to perform an analysis of a broadcast video stream having broadcast frames, the analysis including determination of a plurality of broadcast moments for the broadcast video stream;
a communications apparatus operable to exchange the baseline moments and the broadcast moments between the baseline processor and the remote processor;
a selected one of the baseline processor and the remote processor being operable to determine variations between the baseline color moments and the broadcast color moments; and
the baseline moments comprise baseline audio moments, and the broadcast moments comprise broadcast audio moments.
-
Specification