Method and system for logo identification based on automatic content recognition

• US 9,137,568 B2
• Filed: 12/28/2012
• Issued: 09/15/2015
• Est. Priority Date: 02/07/2012
• Status: Active Grant

• Current Assignee: Turner Broadcasting System Incorporated (Warner Bros. Discovery, Inc.)
• Original Assignee: Turner Broadcasting System Incorporated (Warner Bros. Discovery, Inc.)
• Inventors: Sinha, Nishith Kumar, Loheide, Donald Jude, Giles, Matthew Paul
• Primary Examiner(s): Flynn, Nathan
• Assistant Examiner(s): Castro, Alfonso
• Application Number:
  US13/730,422
• Publication Number:
  US 20130212609A1
• Time in Patent Office: 991 Days
• US Class Current: 1/1
• CPC Class Codes: G06F 16/24558 Binary matching operations
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/441 Acquiring end-user identification , e.g. using personal code sent by the remote control or by inserting a card
• CPC Class Codes: H04N 21/442 Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/4784 receiving rewards
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

A method and system for logo identification based on automatic content recognition (ACR) are described in which a connected television (TV) or other end-user device may be provided with instructions to fingerprint certain regions in a video frame to identify the source of the content being displayed. Such instructions may be provided when, for example, fingerprint matching is able to identify content that is provided by multiple sources but is unable to identify the particular source of the content. In those instances, one or more additional locations may be determined for taking fingerprints in the video frame. These locations correspond to region of the video frame in which a graphical item that represents the network television station is typically displayed. A profile with these locations is generated and sent to the connected TV to take additional fingerprints to enable the identification of the network television station providing content.

Claims

1. A method, comprising:

in a device that is operable to handle operations for automatic content recognition, the device being operable to;

receive multiple sequences of video fingerprints that are generated from identical segments of a video feed utilizing a plurality of different fingerprint technologies; and

time assignment of event identifiers to the multiple sequences of video fingerprints that are generated from the identical segments of the video feed such that same event identifiers are assigned to each of the multiple sequences of video fingerprints that are generated from the identical segments of the video feed by the different video fingerprint technologies utilizing a common reference clock;

generating one or more signals that provide instructions to;

determine one or more locations in a video frame to take fingerprints, wherein the one or more locations correspond to a determined portion of the video frame in which a graphical item that represents a network television station is displayed;

generate a profile comprising the determined one or more locations; and

send the generated profile for communication to an end-user device, wherein the end-user device is operable to utilize the profile to take fingerprints of content provided by the network television station.

2. The method of claim 1, wherein the graphical item comprises one or more of a logo, a symbol, a sign, a watermark, and text that represent the network television station.

3. The method of claim 1, wherein the generated one or more signals provide instructions to:

generate an indication that the determined one or more locations are to be automatically utilized by the end-user device to take fingerprints when one or more fingerprints previously taken by the end-user device match fingerprints that correspond to content provided by the network television station; and

send the generated indication for communication to the end-user device.

4. The method of claim 1, comprising:

receiving an indication that one or more fingerprints previously taken by the end-user device match fingerprints that correspond to content provided by the network television station; and

in response to the received indication, the generated one or more signals provide instructions to generate the profile.

5. The method of claim 1, comprising:

generating one or more additional signals that provide instructions to;

generate additional profiles at a determined rate, wherein;

each additional profile comprises one or more locations in a video frame to take fingerprints; and

the one or more locations of each additional profile corresponds to a determined portion of the video frame in which a graphical item that represents the network television station is displayed; and

send the generated additional profiles for communication to the end-user device.

6. The method of claim 5, wherein the determined rate is approximately one profile every five seconds.

7. The method of claim 1, comprising:

receiving an indication that the content provided by the network television station is provided concurrently by other network television stations; and

in response to the received indication, the generated one or more signals provide instructions to generate the profile.

8. The method of claim 1, comprising:

receiving an indication that one or more fingerprints previously taken by the end-user device match fingerprints that correspond to content provided by the network television station and also match content provided by one or more additional network television stations; and

in response to the received indication, the generated one or more signals provide instructions to generate the profile.

9. The method of claim 1, wherein the profile comprises a plurality of locations in the video frame to take fingerprints that correspond to a portion of the video frame that is different from the determined portion of the video frame in which the graphical item is displayed.

10. The method of claim 9, wherein the plurality of locations comprise from about 16 locations to about 36 locations.

11. The method according to claim 1, wherein the video feed comprises a live feed.

12. The method according to claim 1, wherein the video feed comprises previously ingested content.

13. A system, comprising:

a device that is operable to handle operations for automatic content recognition, the device being operable to;

receive multiple sequences of video fingerprints that are generated from identical segments of a video feed utilizing a plurality of different fingerprint technologies; and

time assignment of event identifiers to the multiple sequences of video fingerprints that are generated from the identical segments of the video feed same video content but with different fingerprint technologies such that same event identifiers are assigned to different sets each of the multiple sequences of video fingerprints that are generated from the identical segments of the video feed by the different video fingerprint technologies utilizing a common reference clock; and

generate one or more signals that provide instructions to;

determine one or more locations in a video frame to take fingerprints, wherein the one or more locations correspond to a determined portion of the video frame in which a graphical item that represents a network television station is displayed;

generate a profile comprising the determined one or more locations; and

send the generated profile for communication to an end-user device, wherein the end-user device is operable to utilize the profile to take fingerprints of content provided by the network television station.

14. The system of claim 13, wherein the graphical item comprises one or more of a logo, a symbol, a sign, a watermark, and text that represent the network television station.

15. The system of claim 13, wherein the generated one or more signals provide instructions to:

generate an indication that the determined one or more locations are to be automatically utilized by the end-user device to take fingerprints when one or more fingerprints previously taken by the end-user device match fingerprints that correspond to content provided by the network television station; and

send the generated indication for communication to the end-user device.

16. The system of claim 13, wherein device is operable to:

receive an indication that one or more fingerprints previously taken by the end-user device match fingerprints that correspond to content provided by the network television station; and

in response to the received indication, the generated one or more signals provide instructions to generate the profile.

17. The system of claim 13, wherein the device is operable to:

generate one or more additional signals that provide instructions to;

generate additional profiles at a determined rate, wherein;

each additional profile comprises one or more locations in a video frame to take fingerprints; and

the one or more locations of each additional profile corresponds to a determined portion of the video frame in which a graphical item that represents the network television station is displayed; and

send the generated additional profiles for communication to the end-user device.

18. The system of claim 17, wherein the determined rate is approximately one profile every five seconds.

19. The system of claim 13, wherein the device is operable to:

receive an indication that the content provided by the network television station is provided concurrently by other network television stations; and

in response to the received indication, the generated one or more signals provide instructions to generate the profile.

20. The system of claim 13, wherein the device is operable to:

receive an indication that one or more fingerprints previously taken by the end-user device match fingerprints that correspond to content provided by the network television station and also match content provided by one or more additional network television stations; and

in response to the received indication, the generated one or more signals provide instructions to generate the profile.

21. The system of claim 13, wherein the profile comprises a plurality of locations in the video frame to take fingerprints that correspond to a portion of the video frame that is different from the determined portion of the video frame in which the graphical item is displayed.

22. The system according to claim 13, wherein the video feed comprises a live feed.

23. The system according to claim 13, wherein the video feed comprises previously ingested content.

24. A system, comprising:

a broadcast automatic content recognition (ACR) system that is operable to time assignment of event identifiers to multiple sequences of video fingerprints that are generated from the same video content but with different fingerprint technologies such that same event identifiers are assigned to different sets of video fingerprints that are generated by the different video fingerprint technologies, the broadcast ACR system being operable to;

receive an indication that one or more fingerprints previously taken by an end-user device match fingerprints that correspond to content provided by a network television station; and

in response to the received indication, generate one or more instructions to;

generate a profile comprising one or more locations in a video frame that correspond to a determined portion of the video frame in which a graphical item that represents the network television station is displayed; and

send the generated profile for communication to the end-user device, wherein the end-user device is operable to utilize the profile to take fingerprints of content provided by the network television station;

receive a query from a vendor ACR system for an updated fingerprint profile; and

send the updated fingerprint profile from the broadcast ACR system to the vendor ACR system, wherein the vendor ACR system sends the updated fingerprint profile to the end-user device.

25. A non-transitory computer-readable medium for a device that handles operations for automatic content recognition, the device being operable to:

receive multiple sequences of video fingerprints that are generated from identical segments of a video feed utilizing a plurality of different fingerprint technologies; and

time assignment of event identifiers to the multiple sequences of video fingerprints that are generated from the identical segments of the video feed such that same event identifiers are assigned to each of the multiple sequences of video fingerprints that are generated from the identical segments of the video feed by the different video fingerprint technologies utilizing a common reference clock; and

the device comprising code for;

generating one or more signals that provide instructions to;

determine one or more locations in a video frame to take fingerprints, wherein the one or more locations correspond to a determined portion of the video frame in which a graphical item that represents a network television station is displayed;

generate a profile comprising the determined one or more locations; and

send the generated profile for communication to an end-user device, wherein the end-user device is operable to utilize the profile to take fingerprints of content provided by the network television station.

26. A system, comprising:

a broadcast automatic content recognition (ACR) system that is operable to;

receive multiple sequences of video fingerprints that are generated from identical segments of a video feed utilizing a plurality of different fingerprint technologies; and

time assignment of event identifiers to the multiple sequences of video fingerprints that are generated from the identical segments of the video feed such that same event identifiers are assigned to each of the multiple sequences of video fingerprints that are generated from the identical segments of the video feed by the different video fingerprint technologies utilizing a common reference clock, the broadcast ACR system being operable to;

receive an indication that one or more fingerprints previously taken by an end-user device match fingerprints that correspond to content provided by a network television station; and

in response to the received indication, generate one or more instructions to;

generate a profile comprising one or more locations in a video frame that correspond to a determined portion of the video frame in which a graphical item that represents the network television station is displayed; and

send the generated profile for communication to the end-user device, wherein the end-user device is operable to utilize the profile to take fingerprints of content provided by the network television station;

receive a query from a vendor ACR system for an updated fingerprint profile; and

send the updated fingerprint profile from the broadcast ACR system to the vendor ACR system, wherein the vendor ACR system sends the updated fingerprint profile to the end-user device.