Digital video signature apparatus and methods for use with video program identification systems

• US 8,683,503 B2
• Filed: 08/17/2011
• Issued: 03/25/2014
• Est. Priority Date: 09/12/2003
• Status: Active Grant

• Current Assignee: Nielsen Media Research, Inc. (Nielsen Holdings plc)
• Original Assignee: Nielsen Company (US) LLC (RR Donnelley & Sons Company)
• Inventors: Deng, Kevin
• Primary Examiner(s): Lonsberry, Hunter B
• Application Number:
  US13/211,906
• Publication Number:
  US 20110302597A1
• Time in Patent Office: 951 Days
• Field of Search: 725/19, 725/20, 725/33
• US Class Current: 725/19
• CPC Class Codes: G06F 16/7847 using low-level visual features of the video content
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04H 20/14 for monitoring programmes
• CPC Class Codes: H04H 2201/90 characterised by the use of signatures
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 17/004 for digital television systems
• CPC Class Codes: H04N 19/467 characterised by the embedded information being invisible, e.g. watermarking
• CPC Class Codes: H04N 19/61 in combination with predictive coding
• CPC Class Codes: H04N 21/2547 Third Party Billing, e.g. billing of advertiser
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/8352 involving content or source identification data, e.g. Unique Material Identifier [UMID]
• CPC Class Codes: H04N 7/173 with two-way working, e.g. subscriber sending a programme selection signal

Abstract

Digital video signature apparatus and methods for use with video program identification systems are disclosed. The example apparatus and methods generate a signature associated with a video program. An example system includes a frame scanner to scan video frames associated with the video program. The frame scanner is to select a video frame based on a number of intra-coded macro blocks within the video frame. The example system also includes an intra-coded macro block extractor to extract intra-coded macro blocks from the video frame and a scaled image extractor to extract a scaled image from the intra-coded macro blocks. A signature generator is also included in the example system to calculate a plurality of centroids associated with video frame based on the scaled image and to form the signature based on the plurality of centroids.

Claims

1. A system to generate a signature associated with a video program, the system comprising:

a frame scanner to scan video frames associated with the video program, the frame scanner to select a video frame based on a number of intra-coded macro blocks within the video frame;

a scaled image extractor to extract a scaled image from intra-coded macro blocks extracted from the video frame; and

a signature generator to calculate a plurality of centroids associated with video frame based on the scaled image and to form the signature based on the plurality of centroids.

2. A system as defined in claim 1, wherein the frame scanner is to selectively send substantially intra-coded video frames to the intra-coded macro block extractor.

3. A system as defined in claim 1, wherein the video program includes one of a television commercial and a television show.

4. A system as defined in claim 1, wherein the video frame is compressed according to a digital video compression standard.

5. A system as defined in claim 4, wherein the digital video compression standard is based on the MPEG standard.

6. A system as defined in claim 1, wherein the plurality of centroids are associated with a plurality of image components.

7. A system as defined in claim 6, wherein the plurality of image components are associated with a color model.

8. A system as defined in claim 1, wherein the plurality of centroids are associated with a plurality of areas within the video frame.

9. A system as defined in claim 1, wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

10. A system as defined in claim 1, wherein the scaled image extractor is to extract only a portion of each of the intra-coded macro blocks.

11. A system as defined in claim 10, wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

12. A system as defined in claim 1, wherein the scaled image extractor is to convert the scaled image information to spatial domain information and the signature generator is to use the spatial domain information to calculate the image component centroid information.

13. A system as defined in claim 1, wherein the signature generator is to weight the scaled image information prior to generating the video signature.

14. A method to generate a signature associated with a video program, the method comprising:

scanning video frames associated with the video program;

selecting a video frame based on a number of intra-coded macro blocks within the video frame;

extracting intra-coded macro blocks from the video frame;

extracting a scaled image from the intra-coded macro blocks;

calculating a plurality of centroids associated with video frame based on the scaled image; and

forming the signature based on the plurality of centroids.

15. A method as defined in claim 14, wherein the video program includes one of a television commercial and a television show.

16. A method as defined in claim 14, wherein the video frame is compressed according to a digital video compression standard.

17. A method as defined in claim 16, wherein the digital video compression standard is based on the MPEG standard.

18. A method as defined in claim 14, wherein the plurality of centroids are associated with a plurality of image components.

19. A method as defined in claim 18, wherein the plurality of image components are associated with a color model.

20. A method as defined in claim 14, wherein the plurality of centroids are associated with a plurality of areas within the video frame.

21. A method as defined in claim 14, wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

22. A method as defined in claim 14, wherein extracting the scaled image comprises extracting only a portion of each of the intra-coded macro blocks.

23. A method as defined in claim 22, wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

24. A method as defined in claim 14 further comprising converting the scaled image information to spatial domain information and using the spatial domain information to calculate the image component centroid information.

25. A method as defined in claim 14 further comprising weighting the scaled image information prior to generating the video signature.

26. A machine readable medium having instructions stored thereon that, when executed, cause a machine to at least:

scan video frames associated with a video program;

select a video frame based on a number of intra-coded macro blocks within the video frame;

extract intra-coded macro blocks from the video frame;

extract a scaled image from the intra-coded macro blocks;

calculate a plurality of centroids associated with video frame based on the scaled image; and

form a signature based on the plurality of centroids.

27. A machine readable instruction as defined in claim 26, wherein the video program includes one of a television commercial and a television show.

28. A machine readable instruction as defined in claim 26, wherein the video frame is compressed according to a digital video compression standard.

29. A machine readable instruction as defined in claim 26, wherein the digital video compression standard is based on the MPEG standard.

30. A machine readable instruction as defined in claim 26, wherein the plurality of centroids are associated with a plurality of image components.

31. A machine readable instruction as defined in claim 30, wherein the plurality of image components are associated with a color model.

32. A machine readable instruction as defined in claim 26, wherein the plurality of centroids are associated with a plurality of areas within the video frame.

33. A machine readable instruction as defined in claim 26, wherein the number or proportion of intra-coded macro blocks within the frame is a substantial portion of all macro blocks within the frame.

34. A machine readable instruction as defined in claim 26, wherein the machine is to extract only a portion of each of the intra-coded macro blocks.

35. A machine readable instruction as defined in claim 34, wherein the portion of each of the intra-coded macro blocks includes only DC coefficients.

36. A machine readable instruction as defined in claim 26 wherein the machine is further caused to convert the scaled image information to spatial domain information and using the spatial domain information to calculate the image component centroid information.

37. A machine readable instruction as defined in claim 26 wherein the machine is further caused to weight the scaled image information prior to generating the video signature.