Digital video signature apparatus and methods for use with video program identification systems

• US 8,020,180 B2
• Filed: 07/28/2010
• Issued: 09/13/2011
• Est. Priority Date: 09/12/2003
• Status: Expired due to Fees

• Current Assignee: Nielsen Media Research, Inc. (Nielsen Holdings plc)
• Original Assignee: The Nielsen Company LLC (MOOD Media Corporation)
• Inventors: Deng, Kevin
• Primary Examiner(s): Lonsberry; Hunter B
• Application Number:
  US12/845,660
• Publication Number:
  US 20100306791A1
• Time in Patent Office: 412 Days
• Field of Search: 725/19, 725/20, 725/33
• US Class Current: 725/19
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04H 20/14 for monitoring programmes
• CPC Class Codes: H04H 2201/90 characterised by the use of signatures
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 17/004 for digital television systems
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/2547 Third Party Billing, e.g. billing of advertiser
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

Digital video signature apparatus and methods for use with video program identification systems are disclosed. The disclosed apparatus and methods identify a video program using a sequence of signatures. Each of the signatures includes a set of centroids corresponding to one of a plurality of frames of the video program. The apparatus and methods compare the sequence of signatures to a set of reference sequences of signatures and identify the video program based on the comparison of the sequence of signatures to the set of reference sequences of signatures.

Claims

1. A method of generating a video signature, comprising:

receiving compressed video information;

selecting a frame from the compressed video information based on a number or proportion of intra-coded macro blocks within the frame;

calculating image component centroid information based on the selected frame; and

generating the video signature using the image component centroid information.

2. A method as defined in claim 1, wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

3. A method as defined in claim 1, further comprising extracting scaled image information from the frame and using the scaled image information to calculate the image component centroid information.

4. A method as defined in claim 3, wherein extracting the scaled image information from the frame includes extracting only intra-coded macro blocks from the frame.

5. A method as defined in claim 4, wherein extracting the scaled image information includes extracting only a portion of each of the intra-coded macro blocks.

6. A method as defined in claim 5, wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

7. A method as defined in claim 3, further comprising converting the scaled image information to spatial domain information and using the spatial domain information to calculate the image component centroid information.

8. A method as defined in claim 3, further comprising weighting the scaled image information prior to generating the video signature.

9. A method as defined in claim 1, wherein the compressed video information includes at least one MPEG frame.

10. A method as defined in claim 1, wherein the image component centroid information includes normalized centroid data.

11. A method as defined in claim 1, wherein the image component centroid information includes centroid information associated with a plurality of image components.

12. A method as defined in claim 1, wherein the plurality of image components includes image components associated with a color model.

13. A method as defined in claim 1, wherein generating the video signature using the image component centroid information includes generating a set of image component centroids associated with a plurality of image components.

14. A method as defined in claim 1, wherein generating the video signature using the image component centroid information includes generating a set of image component centroids associated with a plurality of areas within an image associated with the compressed video information.

15. A method as defined in claim 1, further comprising inverting at least some of the compressed image information in response to a determination that the at least some of the compressed image information corresponds to relatively dark foreground information on a relatively light background.

16. A method as defined in claim 1, further comprising determining that at least a portion of the compressed video information is substantially uniform and generating the video signature using a constant associated with an image component value instead of the image centroid information.

17. A method as defined in claim 16, wherein the constant is one of an average and a trend value associated with a plurality of images.

18. A system for generating a video signature, comprising:

a memory; and

a processor coupled to the memory and programmed to;

receive compressed video information;

select a frame from the compressed video information based on a number or proportion of intra-coded macro blocks within the frame;

calculate image component centroid information based on the selected frame; and

generate the video signature using the image component centroid information.

19. A system as defined in claim 18, wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

20. A system as defined in claim 18, wherein the processor is programmed to extract scaled image information from the frame and to use the scaled image information to calculate the image component centroid information.

21. A system as defined in claim 20, wherein the processor is programmed to extract the scaled image information from the frame by extracting only intra-coded macro blocks from the frame.

22. A system as defined in claim 21, wherein the processor is programmed to extract the scaled image information by extracting only a portion of each of the intra-coded macro blocks.

23. A system as defined in claim 22, wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

24. A system as defined in claim 20, wherein the processor is programmed to convert the scaled image information to spatial domain information and to use the spatial domain information to calculate the image component centroid information.

25. A system as defined in claim 20, wherein the processor is programmed to weight the scaled image information prior to generating the video signature.

26. A system as defined in claim 18, wherein the compressed video information includes at least one MPEG frame.

27. A system as defined in claim 18, wherein the image component centroid information includes normalized centroid data.

28. A system as defined in claim 18, wherein the image component centroid information includes centroid information associated with a plurality of image components.

29. A system as defined in claim 28, wherein the plurality of image components includes image components associated with a color model.

30. A system as defined in claim 18, wherein the processor is programmed to generate the video signature using the image component centroid information by generating a set of image component centroids associated with a plurality of image components.

31. A system as defined in claim 18, wherein the processor is programmed to generate the video signature using the image component centroid information by generating a set of image component centroids associated with a plurality of areas within an image associated with the compressed video information.

32. A system as defined in claim 18, wherein the processor is programmed to invert at least some of the compressed image information in response to a determination that the at least some of the compressed image information corresponds to relatively dark foreground information on a relatively light background.

33. A system as defined in claim 18, wherein the processor is programmed to determine that at least a portion of the compressed video information is substantially uniform and generate the video signature using a constant associated with an image component value instead of the image centroid information.

34. A system as defined in claim 33, wherein the constant is one of an average and a trend value associated with a plurality of images.

35. A machine readable medium having instructions stored thereon that, when executed, cause a machine to:

receive compressed video information;

select a frame from the compressed video information based on a number or proportion of intra-coded macro blocks within the frame;

calculate image component centroid information based on the selected frame; and

generating a video signature using the image component centroid information.

36. A machine readable medium as defined in claim 35, wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

37. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to extract scaled image information from the frame and use the scaled image information to calculate the image component centroid information.

38. A machine readable medium as defined in claim 37 having instructions stored thereon that, when executed, cause the machine to extract the scaled image information from the frame by extracting only intra-coded macro blocks from the frame.

39. A machine readable medium as defined in claim 38 having instructions stored thereon that, when executed, cause the machine to extract the scaled image information by extracting only a portion of each of the intra-coded macro blocks.

40. A machine readable medium as defined in claim 39, wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

41. A machine readable medium as defined in claim 37 having instructions stored thereon that, when executed, cause the machine to convert the scaled image information to spatial domain information and use the spatial domain information to calculate the image component centroid information.

42. A machine readable medium as defined in claim 37 having instructions stored thereon that, when executed, cause the machine to weight the scaled image information prior to generating the video signature.

43. A machine readable medium as defined in claim 35, wherein the compressed video information includes at least one MPEG frame.

44. A machine readable medium as defined in claim 35, wherein the image component centroid information includes normalized centroid data.

45. A machine readable medium as defined in claim 35, wherein the image component centroid information includes centroid information associated with a plurality of image components.

46. A machine readable medium as defined in claim 45, wherein the plurality of image components includes image components associated with a color model.

47. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to generate the video signature using the image component centroid information by generating a set of image component centroids associated with a plurality of image components.

48. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to generate the video signature using the image component centroid information by generating a set of image component centroids associated with a plurality of areas within an image associated with the compressed video information.

49. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to invert at least some of the compressed image information in response to a determination that the at least some of the compressed image information corresponds to relatively dark foreground information on a relatively light background.

50. A machine readable medium as defined in claim 35 having instructions stored thereon that, when executed, cause the machine to determine that at least a portion of the compressed video information is substantially uniform and generate the video signature using a constant associated with an image component value instead of the image centroid information.

51. A machine readable medium as defined in claim 50, wherein the constant is one of an average and a trend value associated with a plurality of images.