Creating fingerprints

• US 20060271947A1
• Filed: 05/23/2005
• Published: 11/30/2006
• Est. Priority Date: 05/23/2005
• Status: Abandoned Application

• Current Assignee: Video Identification Discoveries LLC
• Original Assignee: Video Identification Discoveries LLC
• Inventors: Lienhart, Christine, Lienhart, Rainer W.
• Application Number:
  US11/135,135
• Publication Number:
  US 20060271947A1
• Time in Patent Office: Days
• US Class Current: 725/19
• CPC Class Codes: G06F 16/7834 using audio features
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06F 16/786 using motion, e.g. object motion or camera motion
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04H 2201/90 characterised by the use of signatures
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]

Abstract

A method and system for the determination of new video segments is presented in which candidate sequences are recognized and stored, and analysis is performed on fingerprints of segments of the candidate sequences to isolate repeating video sequences, without prior knowledge of those repeating sequences. The repeating sequences are then added to a fingerprint library.

Claims

1. A method for identifying repeating video sequences comprising:

determining a set of candidate video sequences from at least one video stream;

creating video fingerprints for subsequences of the candidate repeating video sequences;

comparing the video fingerprints of the subsequences of the candidate repeating video sequences against each other to create matched subsequences; and

grouping the matched subsequences as repeating video sequences.

2. The method of claim 1 further comprising:

presenting repeating video sequences to a viewer;

receiving viewer selections of repeating video sequences of interest; and

eliminating candidate repeating video sequences not of interest.

3. The method of claim 1 wherein the step of determining the set of candidate repeating video sequences is accomplished by feature based detection.

4. The method of claim 3 wherein the feature based detection is by monochrome frames.

5. The method of claim 3 wherein the feature based detection is by scene breaks.

6. The method of claim 3 wherein the feature based detection is by hard cuts.

7. The method of claim 3 wherein the feature based detection is by dissolves.

8. The method of claim 3 wherein the feature based detection is by fades.

9. The method of claim 3 wherein the feature based detection is by action changes.

10. The method of claim 3 wherein the feature based detection is by edge change ratio.

11. The method of claim 3 wherein the feature based detection is by motion length vector changes.

12. The method of claim 1 wherein the step of creating video fingerprints is accomplished by creating color histograms of the subsequences.

13. The method of claim 1 wherein the step of creating video fingerprints is accomplished by creating color coherence vectors of the subsequences.

14. The method of claim 12 wherein the color histograms are created from a sub-sampled representation of the subsequence.

15. The method of claim 13 wherein the color coherence vectors of the subsequences are created from a sub-sampled representation of the subsequence.

16. The method of claim 1 further comprising:

adding the repeating video sequence to a fingerprint library.

17. The method of claim 16 further comprising:

storing information associated with the repeating video sequence in the fingerprint library.

18. The method of claim 17 wherein the information associated with the repeating video sequence is channel information.

19. The method of claim 17 wherein the information associated with the repeating video sequence is advertisement break information.

20. The method of claim 19 wherein the advertisement break information is typical break duration information.

21. The method of claim 16 further comprising:

disseminating the fingerprint library to a plurality of clients.

22. A computer based system for automated detection of repeating video sequences comprising:

a subsystem for the feature based detection of candidate sequences;

a subsystem for the generation of video fingerprints from sequences of the candidate sequences;

a subsystem for the matching of video fingerprints of the candidate sequences; and

a subsystem for the isolation of repeating sequences based on matching of the video fingerprints of the candidate sequences.

23. The system of claim 22 wherein the subsystem for the feature based detection is further comprised of sequence detection software operating on a computing device for detecting hard cuts in a video stream.

24. The system of claim 22 wherein the subsystems for the generation and matching of video fingerprints is further comprised of color coherence vector software operating on a computing device for generating and matching color coherence vectors of sequences of the candidate sequences.

25. A computer based method for the creation of a library of repeating advertisements comprising:

creating a set of candidate sequences from an incoming video stream wherein the creating is done based on the presence of features within the incoming video stream;

creating a set of video fingerprints from subsequences of the candidate sequences;

comparing the set of video fingerprints against each other to determine matching subsequences; and

grouping the matching subsequences to create a repeating advertisement;

26. The computer based method of claim 25 further comprising the step of:

adding the repeating advertisement to the library of repeating advertisements.

27. A computer-based system to identify a repeating video sequence comprising:

means for determining a set of candidate repeating video sequences in at least one video stream;

means for creating video fingerprints for subsequences of the candidate repeating video sequences;

means for comparing the video fingerprints of the subsequences of the candidate repeating video sequences against each other to create matched subsequences; and

means for grouping the matched subsequences as the repeating video sequence.

28. The computer based system of claim 27 further comprising:

means for adding the repeating video sequence to a fingerprint library.

29. The computer based system of claim 27 further comprising:

means for distributing the fingerprint library.