Method and system for utilizing automatic content recognition for content tracking

• US 8,997,133 B2
• Filed: 12/28/2012
• Issued: 03/31/2015
• Est. Priority Date: 02/07/2012
• Status: Active Grant

• Current Assignee: Turner Broadcasting System Incorporated (Warner Bros. Discovery, Inc.)
• Original Assignee: Turner Broadcasting System Incorporated (Warner Bros. Discovery, Inc.)
• Inventors: Sinha, Nishith Kumar, Loheide, Donald Jude, Giles, Matthew Paul
• Primary Examiner(s): FLYNN, RANDY A
• Application Number:
  US13/730,593
• Publication Number:
  US 20130205317A1
• Time in Patent Office: 823 Days
• Field of Search: 725/9, 725/14, 725 19- 20, 725/32, 725 34- 36
• US Class Current: 725/14
• CPC Class Codes: G06F 16/24558 Binary matching operations
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/441 Acquiring end-user identification , e.g. using personal code sent by the remote control or by inserting a card
• CPC Class Codes: H04N 21/442 Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/4784 receiving rewards
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

An automatic content recognition (ACR) enabled (ACR-enabled) connected TV device may be operable to collect viewing data, utilizing ACR. The viewing data may comprise viewer interaction information and/or content presentation information associated with the ACR-enabled connected TV device and/or a paired device. The ACR-enabled connected TV device may store the collected viewing data in the ACR-enabled connected TV device. The stored viewing data may be communicated to one or more network providers, by the ACR-enabled connected TV device, for determining customized services for the ACR-enabled connected TV device. The viewing data may be used to determine how to manage advertisements associated with the ACR-enabled connected TV device and/or at a network level associated with the one or more network providers. The viewing data may be used to determine user profiles. The viewing data may also be used to determine programming and/or advertisements targeted to the ACR-enabled connected TV device.

Claims

1. A method, comprising:

in an automatic content recognition (ACR) enabled (ACR-enabled) connected TV device, wherein;

said ACR-enabled connected TV device comprises an ACR module that communicates with an ACR system that is external to said ACR-enabled connected TV device, and said ACR system supports different video fingerprint technologies from multiple vendors;

said ACR module providing fingerprints to said ACR system for matching;

said ACR module receiving information and/or content from said ACR system based on said matching;

said ACR system assigns same interactive event identifiers to different sets of video and audio fingerprints that are generated by said different video and audio fingerprint technologies from said multiple vendors based on timing of said assignment of said interactive event identifiers; and

said interactive event identifiers are utilized in said ACR-enabled connected TV device to trigger events;

collecting, utilizing ACR, viewing data, wherein;

said viewing data comprise viewer interaction information and/or content presentation information associated with said ACR-enabled connected TV device and/or a paired device; and

said ACR-enabled connected TV device is paired with said paired device utilizing a companion application running on said paired device;

storing said collected viewing data in said ACR-enabled connected TV device; and

communicating said stored viewing data to one or more network providers for determining customized services for said ACR-enabled connected TV device and/or said paired device.

2. The method according to claim 1, wherein said stored viewing data is used to determine how to manage advertisements that are associated with said ACR-enabled connected TV device.

3. The method according to claim 1, wherein said stored viewing data is used to determine how to manage advertisements at a network level associated with said one or more network providers.

4. The method according to claim 1, wherein said stored viewing data is used to determine information for one or more user profiles that are associated with said ACR-enabled connected TV device.

5. The method according to claim 1, wherein said stored viewing data is used to determine programming targeted to said ACR-enabled connected TV device.

6. The method according to claim 1, wherein said stored viewing data is used to determine advertisements targeted to said ACR-enabled connected TV device.

7. The method according to claim 1, wherein said stored viewing data comprises commercial break information indicating that, when a commercial break lasts longer than a particular time duration, said commercial break is not viewed or watched, and based on said commercial break information, one or more commercial breaks, which last said particular time duration or last shorter than said particular time duration, are determined to be targeted to said ACR-enabled connected TV device.

8. The method according to claim 1, wherein said stored viewing data comprises interactive advertisement information indicating how often presented interactive advertisements are actually being interacted, and based on said interactive advertisement information, one or more particular interactive advertisements are determined to be targeted to said ACR-enabled connected TV device.

9. The method according to claim 1, wherein said stored viewing data is used to determine particular items in advertisement overlays which are tied to a certain show that is targeted to said ACR-enabled connected TV device.

10. The method according to claim 1, comprising communicating said stored viewing data to one or more advertisers for determining which advertisement(s) are effective.

11. A system, comprising:

an automatic content recognition (ACR) enabled (ACR-enabled) connected TV device, wherein;

said ACR-enabled connected TV device comprises an ACR module that communicates with an ACR system that is external to said ACR-enabled connected TV device, and said ACR system supports different video fingerprint technologies from multiple vendors;

said ACR module providing fingerprints to said ACR system for matching;

said ACR module receiving information and/or content from said ACR system based on said matching;

said ACR system assigns same interactive event identifiers to different sets of video and audio fingerprints that are generated by said different video and audio fingerprint technologies from said multiple vendors based on timing of said assignment of said interactive event identifiers; and

said interactive event identifiers are utilized in said ACR-enabled connected TV device to trigger events;

said ACR-enabled connected TV device being operable to;

collect, utilizing ACR, viewing data, wherein;

said viewing data comprise viewer interaction information and/or content presentation information associated with said ACR-enabled connected TV device and/or a paired device; and

said ACR-enabled connected TV device is paired with said paired device utilizing a companion application running on said paired device;

store said collected viewing data in said ACR-enabled connected TV device; and

communicate said stored viewing data to one or more network providers for determining customized services for said ACR-enabled connected TV device and/or said paired device.

12. The system according to claim 11, wherein said stored viewing data is used to determine how to manage advertisements that are associated with said ACR-enabled connected TV device.

13. The system according to claim 11, wherein said stored viewing data is used to determine how to manage advertisements at a network level associated with said one or more network providers.

14. The system according to claim 11, wherein said stored viewing data is used to determine information for one or more user profiles that are associated with said ACR-enabled connected TV device.

15. The system according to claim 11, wherein said stored viewing data is used to determine programming targeted to said ACR-enabled connected TV device.

16. The system according to claim 11, wherein said stored viewing data is used to determine advertisements targeted to said ACR-enabled connected TV device.

17. The system according to claim 11, wherein said stored viewing data comprises commercial break information indicating that, when a commercial break lasts longer than a particular time duration, said commercial break is not viewed or watched, and based on said commercial break information, one or more commercial breaks, which last said particular time duration or last shorter than said particular time duration, are determined to be targeted to said ACR-enabled connected TV device.

18. The system according to claim 11, wherein said stored viewing data comprises interactive advertisement information indicating how often presented interactive advertisements are actually being interacted, and based on said interactive advertisement information, one or more particular interactive advertisements are determined to be targeted to said ACR-enabled connected TV device.

19. The system according to claim 11, wherein:

said stored viewing data is used to determine particular items in advertisement overlays which are tied to a certain show that is targeted to said ACR-enabled connected TV device; and

said ACR-enabled connected TV device is operable to communicate said stored viewing data to one or more advertisers for determining which advertisement(s) are effective.

20. A system comprising:

an automatic content recognition (ACR) enabled (ACR-enabled) connected TV device, wherein;

said ACR-enabled connected TV device comprises an ACR module that communicates with an ACR system that is external to said ACR-enabled connected TV device, and said ACR system comprises an abstraction layer that supports different video fingerprint technologies from multiple vendors;

said ACR module providing fingerprints to said ACR system for matching;

said ACR module receiving information and/or content from said ACR system based on said matching;

said abstraction layer enables said ACR system to assign same interactive event identifiers to different sets of video and audio fingerprints that are generated by said different video and audio fingerprint technologies from said multiple vendors based on timing of said assignment of said interactive event identifiers; and

said interactive event identifiers are utilized in said ACR-enabled connected TV device to trigger events;

said ACR-enabled connected TV device being operable to;

collect, utilizing ACR, viewing data, wherein;

said viewing data comprise viewer interaction information and/or content presentation information associated with said ACR-enabled connected TV device and/or a paired device; and

said ACR-enabled connected TV device is paired with said paired device utilizing a companion application running on said paired device;

store said collected viewing data in said ACR-enabled connected TV device; and

communicate said stored viewing data to one or more network providers for determining customized services for said ACR-enabled connected TV device and/or said paired device.