Method and system for contextual advertisement replacement utilizing automatic content recognition

• US 9,654,842 B2
• Filed: 03/08/2016
• Issued: 05/16/2017
• Est. Priority Date: 02/07/2012
• Status: Active Grant

• Current Assignee: Turner Broadcasting System Incorporated (Warner Bros. Discovery, Inc.)
• Original Assignee: Turner Broadcasting System Incorporated (Warner Bros. Discovery, Inc.)
• Inventors: Giles, Matthew Paul, Sinha, Nishith Kumar, Loheide, Donald Jude
• Primary Examiner(s): Kumar, Pankaj
• Assistant Examiner(s): BROWN, RUEBEN M
• Application Number:
  US15/064,565
• Publication Number:
  US 20160192032A1
• Time in Patent Office: 434 Days
• Field of Search: 725 19, 725 20, 725 34, 725 35
• CPC Class Codes: G06F 16/24558 Binary matching operations
• CPC Class Codes: G06F 3/0484 for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
• CPC Class Codes: G06T 1/0021 Image watermarking
• CPC Class Codes: H04N 21/00 Selective content distribution, e.g. interactive television or video on demand [VOD] real-time bi-directional transmission of motion video data H04N7/14 ; broadcast or conference over packet switching networks H04L12/18
• CPC Class Codes: H04N 21/251 Learning process for intelligent management, e.g. learning user preferences for recommending movies details of learning user preferences for the retrieval of video data in a video database G06F16/739; computer systems using learning methods G06N3/08
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/4147 PVR [Personal Video Recorder] H04N5/76 takes precedence ; arrangements for broadcast with accumulation-type receivers H04H20/40
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/432 Content retrieval operation from a local storage medium, e.g. hard-disk details of retrieval of video data and associated meta data in video databases G06F16/739
• CPC Class Codes: H04N 21/435 Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/441 Acquiring end-user identification , e.g. using personal code sent by the remote control or by inserting a card
• CPC Class Codes: H04N 21/442 Monitoring of processes or resources, e.g. detecting the failure of a recording device, monitoring the downstream bandwidth, the number of times a movie has been viewed, the storage space available from the internal hard disk arrangements for monitoring broadcast services or broadcast-related services H04H60/29; arrangements for identifying or recognising characteristics with a direct linkage to broadcast information H04H60/35; monitoring of user activities for profile generation for accessing a video database G06F16/739; monitoring in wireless networks H04W24/00
• CPC Class Codes: H04N 21/4532 involving end-user characteristics, e.g. viewer profile, preferences monitoring of user activities for profile generation for accessing a video database G06F16/739; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/4667 Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/478 Supplemental services, e.g. displaying phone caller identification, shopping application
• CPC Class Codes: H04N 21/4784 receiving rewards
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

An automatic content recognition (ACR)-enabled connected TV device may be operable to identify, utilizing ACR, viewer interaction and/or viewer information. The ACR-enabled connected TV device may present, utilizing the ACR, a variant of an advertisement in a next ad pod during presentation of content, based on the identified viewer interaction and/or the identified viewer information. The viewer information may comprise customized preferences profile, default preferences setting, viewing habits, time of day and/or location. The viewer information may also comprise objects and/or events captured by an associated camera. When an identified stored episode of a show is presented via DVR playback, the ACR-enabled connected TV device may present, in a next ad pod, a new version of an advertisement, where the new version of the advertisement may be associated with a new episode of the show and presentation of the new version may result in a C3 rating credit.

Claims

1. A method, comprising:

in an automatic content recognition (ACR)-enabled connected TV device, wherein;

said ACR-enabled connected TV device comprises an ACR module that communicates with an ACR system that is external to said automatic content recognition ACR-enabled connected TV device;

said ACR module providing fingerprints to said ACR system for matching; and

said ACR module receiving information and/or content from the ACR system based on said matching;

identifying by said ACR module, utilizing ACR, viewer interaction and/or viewer information associated with said ACR-enabled connected TV device;

presenting by said ACR module, utilizing said ACR, based on said identified viewer interaction and/or said identified viewer information, a variant of an advertisement associated with a sponsor in a next ad pod during presentation of content, and when said ACR-enabled connected TV device is paired with a paired device utilizing a companion application running on said paired device, said variant of said advertisement is also presented on said paired device;

identifying by said ACR module, utilizing said ACR, that an episode of a show stored in a DVR associated with said ACR-enabled connected TV device has passed a C3 rating time window, said episode stored in said DVR has not been played back for viewing, and said advertisement associated with said sponsor was placed in said next ad pod in said episode;

detecting by said ACR module, utilizing said ACR, a pause during presentation of a new episode of said show, wherein a new version of said advertisement is associated with said new episode, and presentation of said new version of said advertisement results in a C3 rating credit for said show;

presenting by said ACR module, utilizing said ACR, an option overlay offering viewing of said episode stored in said DVR via a DVR playback, based on said identification and said detection;

identifying by said ACR module, utilizing said ACR, said viewer interaction with said option overlay for choosing viewing of said stored episode; and

when said stored episode of said show is presented via said DVR playback based on said identified viewer interaction, presenting by said ACR module, utilizing said ACR, in said next ad pod said new version of said advertisement associated with said sponsor, wherein said presentation of said new version of said advertisement results in said C3 rating credit for said show, and said new episode is recorded in said DVR for later viewing.

2. The method according to claim 1, comprising:

detecting by said ACR module, utilizing said ACR, a particular scene in said presented content or in an ad spot associated with said sponsor;

presenting by said ACR module, utilizing said ACR, based on said detection, a selection overlay for viewer selection of said variant of said advertisement in said next ad pod;

Identifying by said ACR module, utilizing said ACR, said viewer interaction with said selection overlay for selecting said variant of said advertisement;

presenting by said ACR module, utilizing said ACR, a confirmation overlay which confirms said selection of said variant of said advertisement;

presenting by said ACR module, utilizing said ACR, an information overlay before said next ad pod, said information overlay indicates that said variant of said advertisement is to be presented in said next ad pod; and

presenting by said ACR module, utilizing said ACR, based on said viewer selection, said selected variant of said advertisement associated with said sponsor in said next ad pod.

3. The method according to claim 1, comprising:

during a first ad pod, presenting by said ACR module, utilizing said ACR, a polling overlay related to said advertisement associated with said sponsor for viewer responses;

identifying by said ACR module, utilizing said ACR, said viewer interaction with said polling overlay for providing said viewer responses; and

presenting by said ACR module, based on one or more outcomes of said polling, utilizing said ACR, said variant of said advertisement associated with said sponsor in said next ad pod.

4. The method according to claim 1, wherein said viewer information comprises customized preferences profile or default preferences setting associated with said ACR-enabled connected TV device.

5. The method according to claim 1, wherein said viewer information comprises viewing habits associated with said ACR-enabled connected TV device.

6. The method according to claim 1, wherein said viewer information comprises time of day associated with said ACR-enabled connected TV device.

7. The method according to claim 1, wherein said viewer information comprises location associated with said ACR-enabled connected TV device.

8. The method according to claim 1, wherein said viewer information comprises objects and/or events captured by a camera in or associated with said ACR-enabled connected TV device and/or a camera in or associated with said paired device.

9. The method according to claim 1, comprising:

identifying, utilizing said ACR, that an episode of a second show stored in said DVR associated with said ACR-enabled connected TV device has passed a second C3 rating time window, and said advertisement associated with said sponsor was placed in said next ad pod in said episode; and

when said stored episode of said second show is presented via said DVR playback after said second C3 rating time window, presenting based on said identification, utilizing said ACR, in said next ad pod a new version of said second advertisement associated with said sponsor, wherein said new version of said second advertisement is associated with a new episode of said second show, and said presentation of said new version of said second advertisement results in a second C3 rating credit for said second show.

10. A system, comprising:

an automatic content recognition (ACR)-enabled connected TV device, wherein;

said ACR-enabled connected TV device comprises an ACR module that communicates with an ACR system that is external to said automatic content recognition ACR-enabled connected TV device;

said ACR module provides fingerprints to said ACR system for matching;

said ACR module receives information and/or content from the ACR system based on said matching;

said ACR-enabled connected TV device is operable to;

identify by said ACR module, utilizing ACR, viewer interaction and/or viewer information associated with said ACR-enabled connected TV device;

present by said ACR module, utilizing said ACR, based on said identified viewer interaction and/or said identified viewer information, a variant of an advertisement associated with a sponsor in a next ad pod during presentation of content, and when said ACR-enabled connected TV device is paired with a paired device utilizing a companion application that runs on said paired device, said variant of said advertisement is also presented on said paired device;

identify by said ACR module, utilizing said ACR, that an episode of a show stored in a DVR associated with said ACR-enabled connected TV device has passed a C3 rating time window, said episode stored in said DVR has not been played back for viewing, and said advertisement associated with said sponsor was placed in said next ad pod in said episode;

detect by said ACR module, utilizing said ACR, a pause during presentation of a new episode of said show, and a new version of said advertisement is associated with said new episode, and presentation of said new version of said advertisement results in a C3 rating credit for said show;

present by said ACR module, utilizing said ACR, an option overlay that offers viewing of said episode stored in said DVR via a DVR playback, based on said identification and said detection;

identify by said ACR module, utilizing said ACR, said viewer interaction with said option overlay to choose viewing of said stored episode; and

when said stored episode of said show is presented via said DVR playback based on said identified viewer interaction, present by said ACR module, utilizing said ACR, in said next ad pod said new version of said advertisement associated with said sponsor, wherein said presentation of said new version of said advertisement results in said C3 rating credit for said show, and said new episode is recorded in said DVR for later viewing.

11. The system according to claim 10, wherein said ACR-enabled connected TV device is operable to:

detect by said ACR module, utilizing said ACR, a particular scene in said presented content or in an ad spot associated with said sponsor;

present by said ACR module, utilizing said ACR, based on said detection, a selection overlay for viewer selection of said variant of said advertisement in said next ad pod;

Identify by said ACR module, utilizing said ACR, said viewer interaction with said selection overlay to select said variant of said advertisement;

present by said ACR module, utilizing said ACR, a confirmation overlay which confirms said selection of said variant of said advertisement;

present by said ACR module, utilizing said ACR, an information overlay before said next ad pod, said information overlay indicates that said variant of said advertisement is to be presented in said next ad pod; and

present by said ACR module, utilizing said ACR, based on said viewer selection, said selected variant of said advertisement associated with said sponsor in said next ad pod.

12. The system according to claim 10, wherein said ACR-enabled connected TV device is operable to:

during a first ad pod, present by said ACR module, utilizing said ACR, a polling overlay related to said advertisement associated with said sponsor for viewer responses;

identify, utilizing said ACR by said ACR module, said viewer interaction with said polling overlay to provide said viewer responses; and

present by said ACR module, based on one or more outcomes of said polling, utilizing said ACR, said variant of said advertisement associated with said sponsor in said next ad pod.

13. The system according to claim 10, wherein said viewer information comprises customized preferences profile or default preferences setting associated with said ACR-enabled connected TV device.

14. The system according to claim 10, wherein said viewer information comprises viewing habits associated with said ACR-enabled connected TV device.

15. The system according to claim 10, wherein said viewer information comprises time of day associated with said ACR-enabled connected TV device.

16. The system according to claim 10, wherein said viewer information comprises location associated with said ACR-enabled connected TV device.

17. The system according to claim 10, wherein said viewer information comprises objects and/or events captured by a camera in or associated with said ACR-enabled connected TV device and/or a camera in or associated with said paired device.

18. The system according to claim 10, wherein said ACR-enabled connected TV device is operable to:

identify, by said ACR, that an episode of a second show stored in said DVR associated with said ACR-enabled connected TV device has passed a second C3 rating time window, and said advertisement associated with said sponsor was placed in said next ad pod in said episode; and

when said stored episode of said second show is presented via said DVR playback after said second C3 rating time window, present based on said identification, by said ACR, in said next ad pod a new version of said second advertisement associated with said sponsor, wherein said new version of said second advertisement is associated with a new episode of said second show, and said presentation of said new version of said second advertisement results in a second C3 rating credit for said second show.

19. A non-transitory computer-readable medium having stored thereon, a computer program having at least one code section for processing data in a data processing system, the at least one code section being executable by a computer to cause the computer to execute operations, comprising:

in an automatic content recognition (ACR)-enabled connected TV device, wherein;

said ACR-enabled connected TV device comprises an ACR module that communicates with an ACR system that is external to said automatic content recognition ACR-enabled connected TV device;

said ACR module providing fingerprints to said ACR system for matching; and

said ACR module receiving information and/or content from the ACR system based on said matching;

identifying by said ACR module, utilizing ACR, viewer interaction and/or viewer information associated with said ACR-enabled connected TV device;

presenting by said ACR module, utilizing said ACR, based on said identified viewer interaction and/or said identified viewer information, a variant of an advertisement associated with a sponsor in a next ad pod during presentation of content, and when said ACR-enabled connected TV device is paired with a paired device utilizing a companion application running on said paired device, said variant of said advertisement is also presented on said paired device;

identifying by said ACR module, utilizing said ACR, that an episode of a show stored in a DVR associated with said ACR-enabled connected TV device has passed a C3 rating time window, said episode stored in said DVR has not been played back for viewing, and said advertisement associated with said sponsor was placed in said next ad pod in said episode;

detecting by said ACR module, utilizing said ACR, a pause during presentation of a new episode of said show, wherein a new version of said advertisement is associated with said new episode, and presentation of said new version of said advertisement results in a C3 rating credit for said show;

presenting by said ACR module, utilizing said ACR, an option overlay offering viewing of said episode stored in said DVR via a DVR playback, based on said identification and said detection;

identifying by said ACR module, utilizing said ACR, said viewer interaction with said option overlay for choosing viewing of said stored episode; and

when said stored episode of said show is presented via said DVR playback based on said identified viewer interaction, presenting by said ACR module, utilizing said ACR, in said next ad pod said new version of said advertisement associated with said sponsor, wherein said presentation of said new version of said advertisement results in said C3 rating credit for said show, and said new episode is recorded in said DVR for later viewing.

20. The non-transitory computer-readable medium according to claim 19, the at least one code section being executable by the computer to cause the computer to execute operations, comprising:

detecting by said ACR module, utilizing said ACR, a particular scene in said presented content or in an ad spot associated with said sponsor;

presenting by said ACR module, utilizing said ACR, based on said detection, a selection overlay for viewer selection of said variant of said advertisement in said next ad pod;

Identifying by said ACR module, utilizing said ACR, said viewer interaction with said selection overlay for selecting said variant of said advertisement;

presenting by said ACR module, utilizing said ACR, a confirmation overlay which confirms said selection of said variant of said advertisement;

presenting by said ACR module, utilizing said ACR, an information overlay before said next ad pod, said information overlay indicates that said variant of said advertisement is to be presented in said next ad pod; and

presenting by said ACR module, utilizing said ACR, based on said viewer selection, said selected variant of said advertisement associated with said sponsor in said next ad pod.