Method and apparatus for automatic detection and identification of unidentified Broadcast audio or video signals

• US 8,229,751 B2
• Filed: 12/30/2005
• Issued: 07/24/2012
• Est. Priority Date: 02/26/2004
• Status: Active Grant

• Current Assignee: Mediaguide, Inc. (Mobile Research Labs, Ltd.)
• Original Assignee: Mediaguide, Inc. (Mobile Research Labs, Ltd.)
• Inventors: Cheung, Kwan
• Primary Examiner(s): Godbold, Douglas
• Application Number:
  US11/322,706
• Publication Number:
  US 20070109449A1
• Time in Patent Office: 2,398 Days
• Field of Search: 704/270, 704/276
• US Class Current: 704/270
• CPC Class Codes: G06F 16/634 Query by example, e.g. query by humming
• CPC Class Codes: G06F 16/683 using metadata automatically derived from the content
• CPC Class Codes: G06F 2218/16 by matching signal segments
• CPC Class Codes: H04H 20/14 for monitoring programmes
• CPC Class Codes: H04H 60/58 of audio determination or detection of speech characteristics in general G10L25/00; speech recognition in general G10L15/00

Abstract

A system and method of detecting unidentified broadcast electronic media content using a self-similarity technique is presented. The process and system catalogues repeated instances of content that has not be positively identified, but are sufficiently similar as to infer repetitive broadcasts. These catalogued instances may be further processed on the basis of different broadcast channels, sources, geographic locations of broadcasts or format to further assist the identification thereof.

Claims

1. In a computer comprising a storage medium and an application running on said computer a method for detecting at least two substantially similar instances of the same piece of unregistered program in one or more program signals comprising:

determining using the computer whether two or more unregistered portions of said one or more program signals is sufficiently similar to each other by detecting one or more sufficiently matching features in the two or more unregistered portions; and

determining whether the time positions associated with the corresponding one or more detected matching features in the two or more unregistered portions advance in sufficient synchrony to meet a pre-determined sequencing criteria; and

storing in computer memory at least one data value representing the result of such test.

2. The method of claim 1 further comprising assigning an identification number to one of the unregistered portions.

3. The method of claim 1 further comprising determining whether the piece of unregistered program is substantially the same as a known piece of programming with indicia of identity associated with it and then changing an indicia of identity associated with the unregistered program to the indicia of identity associated with the known program.

4. The method of claim 3 further comprising converting an identification number assigned to the piece of unregistered program to an identification number corresponding to the known piece of programming.

5. The method of claim 1 where the detection step is further comprised of:

determining if the two or more unregistered portions overlap in time.

6. The method of claim 1 further comprising:

determining the relative audio quality of the two or more unregistered portions; and

selecting the unregistered portion with the higher audio quality.

7. The method of claim 1 where the detection step is further comprised of:

determining whether the time positions associated with the matching features in the two or more unregistered portions advance in sufficient synchrony.

8. The method of claim 1 where the detection step is further comprised of:

determining if the two or more unregistered portions overlap in time.

9. The method of claim 1 where the detection step is further comprised of:

determining which of the matching unregistered portions is the longest in duration.

10. The method of claim 1 where the process detects self-similar portions of the signal in one pass through the signal data.

11. The method of claim 1 where the process is not adjusted for the type of signal content being processed.

12. The method of claim 1, where the sequencing criteria comprises:

calculating an error value associated with determining the sufficiently matching features;

selecting from possible matching unregistered portions the portion comprised of a matching feature with the lowest error value.

48. A data storage device containing data that when executed as computer instructions executes the method of any of claims 1, 14, 7, 9, or 47.

50. A computer readable data storage medium comprising computer programming code that, when loaded into a computer and executed as a program, causes the computer to execute any of the processes claimed in claims 1, 2, 5, 6, 13-35, 7, 46, 12, 47.

13. In a computer comprising a storage medium and an application running on said computer a method for detecting self-similar repetition in a program signal comprising:

detecting using a computer processor a thread comprising a sequence of one or more portions of a first unregistered piece of programming, in one pass through the signal data, where each substantially consecutive portion of the first unregistered piece is determined to be sufficiently similar to a corresponding substantially consecutive portion of a second unregistered piece of unregistered programming by means of a sequencing test and storing in a computer memory at least one data value representing the result of said test, said sequencing test comprising first determining matching features in the two or more unregistered portions; and

then determining whether the time positions associated with the matching features advance in sufficient synchrony to meet a pre-determined sequencing criteria.

14. The method of claim 13 further comprising:

storing in computer memory as a single piece of programming the consecutive sequence of sufficiently similar portions where for each portion, the audio quality is determined to be better than the other corresponding sufficiently similar consecutive portion.

15. The method of claim 13, wherein the step of determining to be sufficiently self-similar comprises detecting sufficiently similar sets of pattern vectors associated with each of the substantially consecutive portions.

16. The method of claim 13 further comprising:

assigning a unique identification number to one or more sets of pattern vectors that comprise the portions.

17. The method of claim 13 further comprising:

determining an end of the thread by detecting one or more insufficiently similar portions of the first piece as compared to the corresponding portions of the second piece.

18. The method of claim 17, wherein the number of detections of insufficient similarity is a number greater than a predetermined threshold.

19. The method of claim 17 further comprising determining one of an approximate start time, approximate end time and approximate duration time corresponding to the thread.

20. The method of claim 13 where the first piece and the second piece do not substantially overlap.

21. The method of claim 13 further comprising:

identifying a piece of unregistered programming in which sufficient similarities have been detected between a piece of registered programming and said piece of unregistered programming; and

converting the status of said identified piece of unregistered programming from unregistered to registered.

22. The method of claim 13 further comprising determining whether the piece of unregistered program is substantially the same as a registered piece of programming and then changing an indicia of identity associated with the unregistered program to an indicia of identity associated with the registered program.

23. The method of claim 13 wherein each of said portions comprises one or more frames in duration.

24. The method of claim 13 where each of said portions is equal to or less than approximately 10 seconds.

25. The system of claim 14 wherein said sequencing test is further comprised of determining whether the time positions associated with the matching features advance in sufficient synchrony.

26. In a computer comprising a storage medium and an application running on said computer a method for detecting self-similar repetition in a program signal comprising:

detecting by using a computer in a single pass through the signal data retrieved from computer memory insufficient self-similarities between two non-overlapping pieces of unregistered programming of a program signal by determining the number of pairs of insufficiently self-similar corresponding portions from each of the two pieces of unregistered programming, wherein said pairs of insufficiently self-similar corresponding portions substantially succeed a substantial number of detected substantially consecutive pairs of sufficiently self-similar corresponding portions, said consecutive pairs determined by detecting the self-similar portions by detecting sufficiently matching features in portions of the signal and determining whether the time indices corresponding to those detected matching features meet a sequencing criteria.

27. The method of claim 26 further comprising detecting insufficiently similar sets of pattern vectors associated with each of the two unregistered corresponding portions of the program signal.

28. The method of claim 26 further comprising assigning a unique identification number to one or more sets of pattern vectors that comprise each of the corresponding portions.

29. The method of claim 26 further comprising:

accumulating a thread of portions determined to be sufficiently self-similar, wherein each accumulated portion is uniquely selected from each of said pairs of sufficient self-similar corresponding portions; and

accumulating a thread of said selected portions, wherein the portions are ordered sequentially in time according to the relative order of the pair from which the portion was selected.

30. The method of claim 29 wherein the portion selected is selected for having at least relatively better audio quality.

31. The method of claim 26 further comprising determining one of an approximate start time, approximate end time and approximate duration time corresponding to the thread.

32. The method of claim 26 wherein said sufficient number comprises a number greater than a predetermined threshold.

33. The method of claim 26 further comprising:

identifying a piece of unregistered programming in which sufficient similarities have been detected between a piece of registered programming and said piece of unregistered programming; and

converting the status of said identified piece of unregistered programming from unregistered to registered.

34. The method of claim 26 further comprising determining whether the piece of unregistered program is substantially the same as a registered piece of programming and then changing an indicia of identity associated with the unregistered program to an indicia of identity associated with the registered program.

35. The method of claim 26 wherein each of said portions comprises one or more frames in duration.

36. A digital signal processing system for detecting at least two substantially similar instances of the same piece of unregistered program in one or more program signals comprising:

a computer comprised of a computer processor; and

a computer memory where the computer is adapted for detecting whether two or more unregistered portions of said one or more program signals is sufficiently self-similar by using a sequencing test on the at least two instances, said sequencing test comprising detecting sufficiently matching features in the two or more unregistered portions; and

determining whether the time positions associated with the detected matching features advance in sufficient synchrony to meet a pre-determined sequencing criteria.

37. The system of claim 36 where the computer is further adapted for assigning an identification number to one or more of the unregistered portions.

38. The system of claim 36 where the computer is further adapted for determining whether the piece of unregistered program is substantially the same as a known piece of programming and then changing the indicia of identity associated with the unregistered program to the indicia of identity associated with the known program.

39. The system of claim 36 wherein said computer is further adapted for converting an identification number assigned to the piece of unregistered program to an identification number corresponding to the registered piece of programming.

40. The system of claim 36 where the computer is further adapted for determining if the two or more unregistered portions overlap in time.

41. The system of claim 36 where the computer is adapted so that it identifies when the two or more unregistered portions of one of said one or more program signals are substantially non-overlapping in time.

42. A digital signal processing system for detecting self-similar repetition in a program signal comprising:

a computer comprising a computer processor; and

a computer memory, where the computer is adapted for detecting in one pass through the signal data, a thread comprising a sequence of one or more portions of a first unregistered piece of programming, where each consecutive portion of the first unregistered piece is determined to be sufficiently similar to a corresponding substantially consecutive portion in a second unregistered piece of unregistered programming by means of a sequencing test, said sequencing test comprising detecting sufficiently matching features in the two or more unregistered portions; and

comparing the time positions associated with the detected matching features to determine whether the time positions associated with the detected matching features advance in sufficient synchrony to meet a pre-determined sequencing criteria.

43. The system of claim 42 where the computer is further adapted for identifying a piece of unregistered programming in which sufficient similarities have been detected between a piece of registered programming and said piece of unregistered programming;

and

converting the status of said identified piece of unregistered programming from unregistered to registered.

44. The system of claim 42 where the computer processor and computer memory are further adapted for determining whether the piece of unregistered program is substantially the same as a registered piece of programming and then changing an indicia of identity associated with the unregistered program to an indicia of identity associated with the registered program.

45. The system of claim 42 wherein said sequencing test is further comprised of determining whether the time positions associated with the matching features advance in sufficient synchrony.

46. In a computer, a method of detecting self similarity in a program signal by means of:

for at least one pair of signal data samples in a plurality of signal data samples retrieved from computer memory signal, an at least one first sample of the pair from a first portion of the signal and an at least one second sample of the pair from a second portion of the signal, determining using a computer whether the at least one first samples have sufficiently the same value as the corresponding at least one second samples; and

determining using a computer, whether the time values associated with the plurality of determined first samples increases in sufficient synchrony with the time values associated with the corresponding plurality of second samples.

47. The method of claim 46 further comprising:

determining using a computer if the sufficiently same values are within a pre-determined error threshold.

49. A computer comprising a computer processor and a computer memory, where the computer is adapted by means of programming code stored in the computer memory to perform any of the processes claimed in claims .