Recognizing a pattern in a video segment to identify the video segment

• US 6,577,346 B1
• Filed: 01/24/2000
• Issued: 06/10/2003
• Est. Priority Date: 01/24/2000
• Status: Expired due to Term

• Current Assignee: Zhigu Holdings Limited
• Original Assignee: WebTV Networks Inc. (Microsoft Corporation)
• Inventors: Perlman, Stephen G.
• Primary Examiner(s): Miller, John
• Assistant Examiner(s): Tran, Trang U.
• Application Number:
  US09/490,885
• Time in Patent Office: 1,233 Days
• Field of Search: H04/N 1.100, H04/N.700, 348/460, 348/907, 386/1, 386/46, 358/908, 725/19
• US Class Current: 348/460
• CPC Class Codes: H04H 60/59 of video recognising characters or patterns in general G06F18/00, G06V20/00
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 7/163 by receiver means only
• CPC Class Codes: Y10S 358/908 Pause control, i.e. "commercial killers"

Abstract

A method and system are described for identifying video segments (e.g., commercials or television programs) without using any identification data that may or may not be provided in the non-displayed overscan portion or the vertical blanking interval of the video signal. Instead, the video segment is identified by recognizing patterns in the viewable portion of the video image data and/or in the video sound data. If the pattern is unique to a specific video segment, that video segment is identified by, for example, looking up the pattern in a table correlating patterns with video segment identifications. Any number of functions may be performed using this identification.

Claims

1. In a management device associated with a display device that can display video images, a method for identifying a video segment as being a particular known commercial such that the management device can provide a viewer with access to additional information associated with the particular known commercial, the method comprising the steps of:

receiving video data representing the video segment, the video data including video image data;

analyzing a pixel intensity of one or more frames of the video image data with discrete cosine analysis to automatically identify a pattern associated with the video segment;

comparing the identified pattern against a database of known patterns representative of individual video segments that are known to be commercials;

matching the identified pattern with a particular known pattern included in the database of known patterns so as to identify the video segment as being a particular known commercial; and

in response to identifying the video segment as being the particular known commercial, modifying an image displayed on the display device so as to provide the viewer with access to additional information associated with the particular known commercial.

2. A method according to claim 1, further comprising, prior to the step of receiving the video data representing the video segment, the step of constructing the database of known patterns by receiving at the management device data representing the particular known pattern from a remote entity.

3. A method according to claim 2, wherein the remote entity is operated by a party associated with the commercial.

4. A method according to claim 1, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the viewable video image data within the video segment.

5. A method according to claim 1, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the video sound data within the video segment.

6. A method according to claim 1, further comprising the following steps:

providing the viewable video image data over a video link to the display device; and

providing the video sound data over a sound link to a speaker device.

18. A method according to claim 1, wherein the additional information corresponds to a product associated with the particular known commercial.

19. A method according to claim 1, wherein the step of modifying the image comprises the step of displaying an icon on the display device that enables the viewer to access the Internet and obtain the additional information.

7. In a management device associated with a display device that can display video images, a method for identifying a video segment as being a commercial, the method comprising the steps of:

receiving video data representing the video segment, the video data including both video image data and associated video sound data;

analyzing a waveform associated with at least one of the video image data and the video sound data to automatically identify a pattern associated with the video segment by performing the steps of;

normalizing the amplitude of the waveform;

detecting successive maximum and minimum points of the normalized amplitude; and

quantifying the successive maximum and minimum points;

comparing the identified pattern against a database of known patterns representative of individual video segments that are known to be commercials; and

matching the identified pattern with a particular known pattern included in the database of known patterns so as to identify the video segment as being a particular known commercial.

8. A method according to claim 7, further comprising, prior to the step of receiving the video data representing the video segment, the step of constructing the database of known patterns by receiving at the management device data representing the particular known pattern from a remote entity.

9. A method according to claim 7, wherein the remote entity is operated by a party associated with the commercial.

10. A method according to claim 7, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the viewable video image data within the video segment.

11. A method according to claim 7, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the video sound data within the video segment.

12. In a management device associated with a display device that can display video images, a method for identifying a video segment as being a commercial, the method comprising the steps of:

receiving video data representing the video segment, the video data including both video image data and associated video sound data;

analyzing a waveform associated with at least one of the video image data and the video sound data to automatically identify a pattern associated with the video segment by performing the steps of;

normalizing the waveform;

detecting successive maximum and minimum points of the normalized waveform; and

determining a timing between the successive maximum and minimum points;

comparing the identified pattern against a database of known patterns representative of individual video segments that are known to be commercials; and

matching the identified pattern with a particular known pattern included in the database of known patterns so as to identify the video segment as being a particular known commercial.

13. A method according to claim 12, further comprising, prior to the step of receiving the video data representing the video segment, the step of constructing the database of known patterns by receiving at the management device data representing the particular known pattern from a remote entity.

14. A method according to claim 12, wherein the remote entity is operated by a party associated with the commercial.

15. A method according to claim 12, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the viewable video image data within the video segment.

16. A method according to claim 12, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the video sound data within the video segment.

17. In a management device associated with a display device that can display video images, a method for identifying a video segment as being a commercial, the method comprising the steps of:

receiving video data representing the video segment, the video data including both video image data and associated video sound data;

analyzing a waveform associated with at least one of the video image data and the video sound data to automatically identify a pattern associated with the video segment by performing the steps of;

normalizing the amplitude of the waveform;

detecting successive maximum and minimum points of the normalized amplitude;

quantifying the successive maximum and minimum points; and

determining a timing between the successive maximum and minimum points;

comparing the identified pattern against a database of known patterns representative of individual video segments that are known to be commercials; and

matching the identified pattern with a particular known pattern included in the database of known patterns so as to identify the video segment as being a particular known commercial.

20. A method according to claim 17, further comprising, prior to the step of receiving the video data representing the video segment, the step of constructing the database of known patterns by receiving at the management device data representing the particular known pattern from a remote entity.

21. A method according to claim 17, wherein the remote entity is operated by a party associated with the commercial.

22. A method according to claim 17, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the viewable video image data within the video segment.

23. A method according to claim 17, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the video sound data within the video segment.

24. A computer program product for use in a management device associated with a display device that can display video images, the computer program product including computer-readable media for implementing a method for identifying a video segment as being a commercial, the method comprising:

receiving video data representing the video segment, the video data including both video image data and associated video sound data;

analyzing a waveform associated with at least one of the video image data and the video sound data to automatically identify a pattern associated with the video segment by performing the steps of;

normalizing the amplitude of the waveform;

detecting successive maximum and minimum points of the normalized amplitude; and

quantifying the successive maximum and minimum points;

comparing the identified pattern against a database of known patterns representative of individual video segments that are known to be commercials; and

matching the identified pattern with a particular known pattern included in the database of known patterns so as to identify the video segment as being a particular known commercial.

25. A computer program product according to claim 24, further comprising, prior to the step of receiving the video data representing the video segment, the step of constructing the database of known patterns by receiving at the management device data representing the particular known pattern from a remote entity.

26. A computer program product according to claim 24, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the viewable video image data within the video segment.

27. A computer program product according to claim 24, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the video sound data within the video segment.

28. A computer program product for use in a management device associated with a display device that can display video images, the computer program product including computer-readable media for implementing a method for identifying a video segment as being a commercial, the method comprising:

receiving video data representing the video segment, the video data including both video image data and associated video sound data;

analyzing a waveform associated with at least one of the video image data and the video sound data to automatically identify a pattern associated with the video segment by performing the steps of;

normalizing the waveform;

detecting successive maximum and minimum points of the normalized waveform; and

determining a timing between the successive maximum and minimum points;

comparing the identified pattern against a database of known patterns representative of individual video segments that are known to be commercials; and

matching the identified pattern with a particular known pattern included in the database of known patterns so as to identify the video segment as being a particular known commercial.

29. A computer program product according to claim 28, further comprising, prior to the step of receiving the video data representing the video segment, the step of constructing the database of known patterns by receiving at the management device data representing the particular known pattern from a remote entity.

30. A computer program product according to claim 28, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the viewable video image data within the video segment.

31. A computer program product according to claim 28, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the video sound data within the video segment.

32. A computer program product for use in a management device associated with a display device that can display video images, the computer program product including computer-readable media for implementing a method for identifying a video segment as being a commercial, the method comprising:

receiving video data representing the video segment, the video data including both video image data and associated video sound data;

analyzing a waveform associated with at least one of the video image data and the video sound data to automatically identify a pattern associated with the video segment by performing the steps of;

normalizing the amplitude of the waveform;

detecting successive maximum and minimum points of the normalized amplitude;

quantifying the successive maximum and minimum points; and

determining a timing between the successive maximum and minimum points;

comparing the identified pattern against a database of known patterns representative of individual video segments that are known to be commercials; and

matching the identified pattern with a particular known pattern included in the database of known patterns so as to identify the video segment as being a particular known commercial.

33. A computer program product according to claim 32, further comprising, prior to the step of receiving the video data representing the video segment, the step of constructing the database of known patterns by receiving at the management device data representing the particular known pattern from a remote entity.

34. A computer program product according to claim 32, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the viewable video image data within the video segment.

35. A computer program product according to claim 32, wherein the step of analyzing a waveform is performed to automatically identify a pattern of the video sound data within the video segment.