Method and apparatus for detecting near-duplicate videos using perceptual video signatures
First Claim
Patent Images
1. A method for identifying a video signal comprising the steps of:
- receiving the video signal at a processing device from an input device operably connected to the processing device;
executing the following steps on the processing device;
a) selecting a portion of the video signal;
b) generating at least one histogram corresponding to a frequency of occurrence of a feature in the portion of the video signal;
c) assigning a weighting value to each of the features represented in one of the plurality of histograms;
d) selecting at least a portion of the features according to the weighting value assigned;
e) creating a digital fingerprint for the portion of the video signal from the features selected;
f) repeating steps (a)-(e) to generate a plurality of the digital fingerprints for the video signal;
g) concatenating the plurality of digital fingerprints to generate a digital signature for the video signal; and
h) storing the digital signature in a database.
3 Assignments
0 Petitions
Accused Products
Abstract
Methods and apparatus for detection and identification of duplicate or near-duplicate videos using a perceptual video signature are disclosed. The disclosed apparatus and methods (i) extract perceptual video features, (ii) identify unique and distinguishing perceptual features to generate a perceptual video signature, (iii) compute a perceptual video similarity measure based on the video edit distance, and (iv) search and detect duplicate and near-duplicate videos. A complete framework to detect unauthorized copying of videos on the Internet using the disclosed perceptual video signature is disclosed.
-
Citations
19 Claims
-
1. A method for identifying a video signal comprising the steps of:
-
receiving the video signal at a processing device from an input device operably connected to the processing device; executing the following steps on the processing device; a) selecting a portion of the video signal; b) generating at least one histogram corresponding to a frequency of occurrence of a feature in the portion of the video signal; c) assigning a weighting value to each of the features represented in one of the plurality of histograms; d) selecting at least a portion of the features according to the weighting value assigned; e) creating a digital fingerprint for the portion of the video signal from the features selected; f) repeating steps (a)-(e) to generate a plurality of the digital fingerprints for the video signal; g) concatenating the plurality of digital fingerprints to generate a digital signature for the video signal; and h) storing the digital signature in a database. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 11, 12)
-
-
10. A method of identifying a video signal comprising the steps of:
-
receiving the video signal at a processing device from an input device operably connected to the processing device; executing the following steps on the processing device; selecting a portion of the video signal; obtaining a plurality of frames from the portion of the video signal; segmenting each of the plurality of frames into a plurality of regions; generating a plurality of histograms from the plurality of frames, each histogram corresponding to a frequency of occurrence of a feature in the plurality of frames; assigning a weighting value to each of the features represented in one of the plurality of histograms, wherein the weighting value is a magnitude and a direction of the motion identified in each of the regions; selecting at least one of the plurality of regions to include in the digital fingerprint according to the motion in the region; including the magnitude and the direction of the motion and a centroid and a size of each selected region in the digital fingerprint; selecting at least a portion of the features according to the weighting value assigned; creating a digital fingerprint from the features selected; storing the digital fingerprint in a database; selecting at least one additional feature from the plurality of frames of the video signal; and including the additional feature in the digital fingerprint, wherein each additional feature is one of a scene change and an object displayed in the video signal.
-
-
13. A method for identifying a near duplicate video signal, comprising the steps of:
-
receiving a first video signal at a processing device from an input device operably connected to the processing device; extracting a first digital signature of the first video signal using the processing device, wherein the first digital signature corresponds to at least one perceptual feature of the first video; assigning a cost value to each of a plurality of edit operations; comparing the first digital signature to a second digital signature using the processing device to determine a number of edit operations between the first digital signature and the second digital signature; adding each of the edit operations to determine a total cost of the edit operations; and comparing the total cost of the edit operations against a predetermined level to determine whether the second digital signature corresponds to a second video signal that is a near-duplicate of the first video signal.
-
-
14. A system for comparing a first video signal to a second video signal for the purpose of identifying near-duplicate video signals, the system comprising:
-
a processing device configured to receive the first video signal, wherein the processing device is configured to; a) select a portion of the first video signal, b) generate at least one histogram corresponding to at least one perceptual feature in the portion of the first video signal selected, c) assign a weighting value to each perceptual feature represented in the histogram, d) select at least a portion of the perceptual features according to the weighting value assigned, e) create a digital fingerprint for the portion of the first video signal from the selected features, f) repeat steps (a)-(e) to generate a plurality of digital fingerprints for the first video signal, and g) concatenate the plurality of digital fingerprints to generate a first digital signature for the first video signal; and a database operatively connected to the processing device and storing a plurality of additional digital signatures, each additional digital signature comprising a plurality of digital fingerprints; wherein the processing device is further configured to compare the first digital signature to at least a portion of the additional digital signatures to identify near-duplicate video signals. - View Dependent Claims (15, 16, 17, 18, 19)
-
Specification