Acting on known video entities detected utilizing fingerprinting

• US 20060195860A1
• Filed: 02/25/2005
• Published: 08/31/2006
• Est. Priority Date: 02/25/2005
• Status: Abandoned Application

• Current Assignee: Video Identification Discoveries LLC
• Original Assignee: Video Identification Discoveries LLC
• Inventors: Eldering, Charles A., Konig, Richard, Ryder, Douglas J.
• Application Number:
  US11/067,196
• Publication Number:
  US 20060195860A1
• Time in Patent Office: Days
• US Class Current: 725/19
• CPC Class Codes: G06F 16/785 using colour or luminescence
• CPC Class Codes: G06V 20/40 in video content extracting overlay text G06V20/62; video retrieval G06F16/70; processing of video elementary streams in video servers H04N21/234; processing of video elementary streams in video clients H04N21/44
• CPC Class Codes: H04H 20/10 Arrangements for replacing or switching information during the broadcast or the distribution
• CPC Class Codes: H04H 60/37 for identifying segments of broadcast information, e.g. scenes or extracting programme ID
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 21/4334 Recording operations recording of a television signal H04N5/76; arrangements for recording or accumulating broadcast information or broadcast-related information H04H60/27
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/454 Content or additional data filtering, e.g. blocking advertisements
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 5/782 on tape
• CPC Class Codes: H04N 7/163 by receiver means only

Abstract

In general, in one aspect, the disclosure describes a method for detecting and acting on a known video entity within a video stream. The method includes receiving a video stream and continually creating statistical parameterized representations for windows of the video stream. The statistical parameterized representation windows are continually compared to windows of a plurality of fingerprints. Each of the plurality of fingerprints includes associated statistical parameterized representations of a known video entity. A known video entity in the video stream is detected when a particular fingerprint of the plurality of fingerprints has at least a threshold level of similarity with the video stream.

Claims

1. A method for detecting and acting on a known video entity within a video stream, the method comprising:

receiving a video stream;

continually creating statistical parameterized representations for windows of the video stream;

continually comparing the statistical parameterized representation windows to windows of a plurality of fingerprints associated with known video entities, wherein each of the at least one fingerprint includes statistical parameterized representations of the known video entities; and

detecting a known video entity in the video stream when a particular fingerprint of the plurality of fingerprints has at least a threshold level of similarity with the video stream.

2. The method of claim 1, wherein the known video entities include program scenes.

3. The method of claim 2, further comprising bookmarking the video stream when a known program scene is detected in the video stream.

4. The method of claim 3, further comprising archiving and indexing the video stream.

5. The method of claim 3, further comprising using the bookmarks as chapters indicating different scenes.

6. The method of claim 1, wherein the known video entities include at least some subset of programs and program titles.

7. The method of claim 6, further comprising recording the video stream when a known program is detected and the known program is a program of interest.

8. The method of claim 7, further comprising archiving and indexing the programs of interest.

9. The method of claim 1, wherein the known video segments include at least some subset of advertisements, advertisement intros, channel idents and sponsorship messages.

10. The method of claim 9, wherein said detecting includes detecting an advertisement break when a fingerprint associated with at least some subset of an advertisement, an advertisement intro, a channel ident and a sponsorship message has at least a threshold level of similarity with the video stream.

11. The method of claim 10, further comprising discontinuing recording of the video stream when the advertisement break is detected in the video stream and the video stream is currently being recorded.

12. The method of claim 11, wherein the known video segments include at least some subset of advertisement outros, channel idents, sponsorship messages, programming and programming titles.

13. The method of claim 12, wherein said detecting includes detecting a return to programming from the advertisement break when a fingerprint associated with at least some subset of an advertisement outro, a channel ident, a sponsorship message, programming and a program title has at least a threshold level of similarity with the video stream.

14. The method of claim 13, further comprising restarting recording of the video stream when the return to programming is detected in the video stream.

15. The method of claim 13, wherein said restarting includes restarting the recording of the video stream after a predefined amount of time has passed if the return to programming has not been detected.

16. The method of claim 1, wherein said creating includes creating statistical parameterized representations for less than an entire image.

17. The method of claim 1, wherein the statistical parameterized representations include at least some subset of color coherence vectors, color histograms, and evenly or randomly highly subsampled representations of an image.

18. The method of claim 1, wherein said comparing only proceeds to a next window for a subset of the plurality of fingerprints that do not meet or exceed a maximum level of dissimilarity.

19. A system for detecting and acting on a known video entity within a video stream, the system comprising:

a receiver to receive a video stream;

memory for storing a plurality of fingerprints, wherein each of the plurality of fingerprints includes associated statistical parameterized representations of a known video entity; and

a processor to

continually create statistical parameterized representations for windows of the video stream;

continually compare the statistical parameterized representation windows to windows of the plurality of fingerprints, and

detect a known video entity in the video stream when a particular fingerprint of the plurality of fingerprints has at least a threshold level of similarity with the video stream.

20. The system of claim 19, wherein the known video entities include at least some subset of programs, program titles, scenes, advertisements, advertisement intros, advertisement outros, channel idents and sponsorship messages.

21. The system of claim 19, wherein said processor further bookmarks the video stream when a known program scene is detected in the video stream.

22. The system of claim 19, wherein said processor further records the video stream when a known program is detected and the known program is a program of interest.

23. The system of claim 19, wherein said processor further discontinues recording of the video stream when an advertisement break is detected in the video stream and the video stream is currently being recorded.

24. The system of claim 23, wherein said processor further restarts recording of the video stream when a return to programming is detected in the video stream.

25. The system of claim 23, wherein said processor further restarts the recording of the video stream after a predefined amount of time has passed if a return to programming has not been detected.

26. The system of claim 19, wherein said processor further archives and indexes recorded programs and bookmarks.

27. The system of claim 19, wherein the statistical parameterized representations include at least some subset of color coherence vectors, color histograms, and evenly or randomly highly subsampled representations of an image.

28. A computer program embodied on a computer readable medium for detecting a known scene within a video stream, when enabled by a computer readable instruction the computer program:

continually creates statistical parameterized representations for windows of a received video stream;

continually compares the statistical parameterized representation windows to windows of a plurality of fingerprints, wherein each of the plurality of fingerprints includes associated statistical parameterized representations of a known video entity; and

detects a known video entity in the video stream when a particular fingerprint of the plurality of fingerprints has at least a threshold level of similarity with the video stream.

29. The computer program of claim 28, wherein said computer program further bookmarks the video stream when a known program scene is detected in the video stream.

30. The computer program of claim 28, wherein said computer program further records the video stream when a known program is detected and the known program is a program of interest.

31. The computer program of claim 28, wherein said computer program further discontinues recording of the video stream when an advertisement break is detected in the video stream and the video stream is currently being recorded.

32. The system of claim 31, wherein said processor computer program restarts recording of the video stream when a return to programming is detected in the video stream.