Method and system for detection of television advertisements using broadcasting channel characteristics

• US 9,894,412 B2
• Filed: 03/09/2017
• Issued: 02/13/2018
• Est. Priority Date: 03/09/2016
• Status: Active Grant

• Current Assignee: SilverEdge Technologies Pvt. Ltd.
• Original Assignee: SilverEdge Technologies Pvt. Ltd.
• Inventors: Mitra, Debasish, Chawla, Hitesh
• Primary Examiner(s): MONTOYA, OSCHTA I
• Application Number:
  US15/454,701
• Publication Number:
  US 20170264951A1
• Time in Patent Office: 341 Days
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/233 Processing of audio elementary streams monitoring, identification or recognition of audio in broadcast systems H04H60/58
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

A system and method for detecting one or more advertisements broadcasted on a channel in real time includes a step of receiving a live feed, with the live feed being associated with a media content broadcast on the channel in real time. The method also includes a step of deriving one or more characteristics associated with one or more properties associated with the channel. The method also includes a step of analyzing the one or more characteristics associated with the one or more properties. There is also a step of matching the derived one or more characteristics associated with the one or more properties with the stored one or more characteristics associated with the one or more properties. The method also includes a step of detecting the one or more advertisements broadcasted on the channel in real time.

Claims

1. A computer-implemented method for detecting one or more advertisements broadcasted on a channel in real time, the computer-implemented method comprising:

receiving, at an advertisement detection system with a processor, a live feed associated with a media content broadcasted on the channel in real time;

deriving, at the advertisement detection system with the processor, one or more characteristics associated with one or more properties associated with the channel in real time, wherein the one or more characteristics comprises a first set of characteristics associated with a logo of the channel and a second set of characteristics associated with a content rating certification associated with the media content broadcasted on the channel and wherein the one or more characteristics being derived by performing a scale invariant feature transform for each of one or more prominent frames;

analyzing, at the advertisement detection system with the processor, the one or more characteristics associated with the one or more properties associated with the channel in real time, the one or more characteristics being analyzed for noticing a change in the one or more characteristics associated with the one or more properties of the channel in first one or more pre-defined regions and second one or more pre-defined regions and wherein each prominent frame of the one or more prominent frames being analyzed sequentially for noticing the change in the one or more characteristics;

matching, at the advertisement detection system with the processor, the one or more characteristics associated with the one or more properties derived in the real time with stored one or more characteristics associated with the one or more properties, wherein the matching being done between each prominent video frame with a subsequent prominent video frame, wherein the matching being done at the first one or more pre-defined regions and the second one or more pre-defined regions on each of the one or more prominent frames; and

detecting, at the advertisement detection system with the processor, the one or more advertisements broadcasted on the channel in the real time, wherein the one or more advertisements being detected based on a result of the matching, wherein the detection of the one or more advertisements being positive when a change in the one or more characteristics of the one or more properties being noticed, wherein the detection being positive when a pre-determined number of characteristics of the one or more characteristics of the one or more properties derived in the real time match with a corresponding stored pre-determined number of characteristics of the stored one or more characteristics of the one or more properties and wherein the detection being positive based on occurrence of event in the first one or more pre-defined regions and the second one or more pre-defined regions;

generating, at the advertisement detection system with the processor, a set of digital signature values corresponding to an extracted first set of video fingerprints, wherein the generating of each digital signature value of the set of digital signature values being done by;

dividing each prominent frame of one or more prominent frames into a pre-defined number of blocks, wherein each block of the pre-defined number of blocks having a pre-defined number of pixels;

grayscaling each block of each prominent frame of the one or more prominent frames;

calculating a first bit value and a second bit value for each block of the prominent frame, wherein the first bit value and the second bit value being calculated from comparing a mean and a variance for the pre-defined number of pixels in each block of the prominent frame with a corresponding mean and variance for a master frame in a master database; and

obtaining a 32 bit digital signature value corresponding to each prominent frame, wherein the 32 bit digital signature value being obtained by sequentially arranging the first bit value and the second bit value for each block of the pre-defined number of blocks of the prominent frame.

2. The computer-implemented method as recited in claim 1, further comprising, extracting, at the advertisement detection system with the processor, a first set of audio fingerprints and a first set of video fingerprints corresponding to the media content broadcasted on the channel, wherein the first set of audio fingerprints and the first set of video fingerprints being extracted sequentially in real time, wherein the extraction of the first set of video fingerprints being done by sequentially extracting one or more prominent fingerprints corresponding to one or more prominent frames of a pre-defined number of frames present in the media content for a pre-defined interval of broadcast.

3. The computer-implemented method as recited in claim 1, wherein the first bit value and the second bit value being assigned a binary 0 when the mean and the variance for each block of the prominent frame being less than the corresponding mean and variance of each master frame and wherein the first bit value and the second bit value being assigned a binary 1 when the mean and the variance for each block of the prominent frame being greater than the corresponding mean and variance of each master frame.

4. The computer-implemented method as recited in claim 1, wherein the one or more properties associated with the channel comprises a logo associated with the channel and a content rating certification associated with the media content broadcasted on the channel.

5. The computer-implemented method as recited in claim 1, wherein the first set of characteristics comprises one or more features associated with the logo, wherein the one or more features comprises a position of the logo, a shape of the logo, one or more colors associated with the logo, a size of the logo, a brightness level associated with the logo, one or more characters in the logo and one or more curves associated with the logo, wherein the second set of characteristics associated with the content rating certification comprises a type of rating certificate allotted to the media content and a position associated with a display of the rating certificate and wherein the type of rating certificate comprises at least one of an adult rating, a restricted rating, universal adult rating, parental guidance rating and a strong parental guidance rating.

6. The computer-implemented method as recited in claim 1, further comprising determining, at the advertisement detection system with the processor, the first one or more pre-defined regions associated with a display of the logo associated with the channel and the second one or more pre-defined regions associated with a display of the content rating certification associated with the media content broadcasted on the channel.

7. The computer-implemented method as recited in claim 1, further comprising storing, at the advertisement detection system with the processor, the one or more characteristics associated with the one or more properties associated with the channel, the first set of audio fingerprints, the first set of video fingerprints and the set of digital signature values corresponding to the extracted first set of video fingerprints and wherein the storing being done in a first database and a second database.

8. The computer-implemented method as recited in claim 1, wherein the event in the first one or more pre-defined regions being at least one of fading of one or more colors associated with the logo, change in position of the logo, change in size of the logo, change in shape of the logo, disappearance of the logo, decrease in brightness level of the logo, increase in the brightness level of the logo and change in one or more curves in the logo and wherein the event in the second one or more pre-defined regions being at least one of detection of appearance of a rating certificate, change in position of the rating certificate and a change in type of the rating certificate.

9. The computer-implemented method as recited in claim 1, wherein the detection of the one or more advertisements being done based on at least one of a logo associated with the channel and a content rating certification of the media content broadcasted on the channel and wherein the detection being done based on the content rating certification when the logo associated with the channel being small and transparent.

10. The computer-implemented method as recited in claim 1, wherein the detection of the one or more advertisements being done based on logo associated with the channel and a content rating certification of the media content broadcasted on the channel simultaneously.

11. The computer-implemented method as recited in claim 1, further comprising, updating, at the advertisement detection system with the processor, a derived one or more characteristics of the one or more properties associated with the channel, the first set of video fingerprints and the set of digital signature values for a detected one or more advertisements in a master database.

12. A computer system comprising:

one or more processors; and

a memory coupled to the one or more processors, the memory for storing instructions which, when executed by the one or more processors, cause the one or more processors to perform a method for detecting one or more advertisements broadcasted on a channel in real time, the method comprising;

receiving, at an advertisement detection system, a live feed associated with a media content broadcasted on the channel in real time;

deriving, at the advertisement detection system, one or more characteristics associated with one or more properties associated with the channel in real time, wherein the one or more characteristics comprises a first set of characteristics associated with a logo of the channel and a second set of characteristics associated with a content rating certification associated with the media content broadcasted on the channel and wherein the one or more characteristics being derived by performing a scale invariant feature transform for each of one or more prominent frames;

analyzing, at the advertisement detection system, the one or more characteristics associated with the one or more properties associated with the channel in real time, the one or more characteristics being analyzed for noticing a change in the one or more characteristics associated with the one or more properties of the channel in first one or more pre-defined regions and second one or more pre-defined regions and wherein each prominent frame of the one or more prominent frames being analyzed sequentially for noticing the change in the one or more characteristics;

matching, at the advertisement detection system, the one or more characteristics associated with the one or more properties derived in the real time with stored one or more characteristics associated with the one or more properties, wherein the matching being done between each prominent video frame with a subsequent prominent video frame, wherein the matching being done at the first one or more pre-defined regions and the second one or more pre-defined regions on each of the one or more prominent frames; and

detecting, at the advertisement detection system, the one or more advertisements broadcasted on the channel in the real time, wherein the one or more advertisements being detected based on a result of the matching, wherein the detection of the one or more advertisements being positive when a change in the one or more characteristics of the one or more properties being noticed, wherein the detection being positive when a pre-determined number of characteristics of the one or more characteristics of the one or more properties derived in the real time match with a corresponding stored pre-determined number of characteristics of the stored one or more characteristics of the one or more properties and wherein the detection being positive based on occurrence of event in the first one or more pre-defined regions and the second one or more pre-defined regions;

generating, at the advertisement detection system, a set of digital signature values corresponding to an extracted first set of video fingerprints, wherein the generating of each digital signature value of the set of digital signature values being done by;

dividing each prominent frame of one or more prominent frames into a pre-defined number of blocks, wherein each block of the pre-defined number of blocks having a pre-defined number of pixels;

grayscaling each block of each prominent frame of the one or more prominent frames;

calculating a first bit value and a second bit value for each block of the prominent frame, wherein the first bit value and the second bit value being calculated from comparing a mean and a variance for the pre-defined number of pixels in each block of the prominent frame with a corresponding mean and variance for a master frame in a master database; and

obtaining a 32 bit digital signature value corresponding to each prominent frame, wherein the 32 bit digital signature value being obtained by sequentially arranging the first bit value and the second bit value for each block of the pre-defined number of blocks of the prominent frame.

13. The computer system as recited in claim 12, further comprising determining, at the advertisement detection system, the first one or more pre-defined regions associated with a display of a logo associated with the channel and the second one or more pre-defined regions associated with a display of a content rating certification associated with the media content broadcasted on the channel.

14. The computer system as recited in claim 12, wherein the first bit value and the second bit value being assigned a binary 0 when the mean and the variance for each block of the prominent frame being less the corresponding mean and variance of each master frame and wherein the first bit value and the second bit value being assigned a binary 1 when the mean and the variance for each block of the prominent frame being greater than the corresponding mean and variance of each master frame.

15. The computer system as recited in claim 12, wherein the detection of the one or more advertisements being done based on at least one of a logo associated with the channel and a content rating certification of the media content broadcasted on the channel and wherein the detection being done based on the content rating certification when the logo associated with the channel being small and transparent.

16. The computer system as recited in claim 12, wherein the detection of the one or more advertisements being done based on a logo associated with the channel and a content rating certification of the media content broadcasted on the channel simultaneously.

17. A non-transitory computer-readable storage medium encoding computer executable

instructions that, when executed by at least one processor, performs a method for detecting one or more advertisements broadcasted on a channel in real time, the method comprising:

receiving, at a computing device, a live feed associated with a media content broadcasted on the channel in real time;

deriving, at the computing device, one or more characteristics associated with one or more properties associated with the channel in real time, wherein the one or more characteristics comprises a first set of characteristics associated with a logo of the channel and a second set of characteristics associated with a content rating certification associated with the media content broadcasted on the channel and wherein the one or more characteristics being derived by performing a scale invariant feature transform for each of one or more prominent frames;

analyzing, at the computing device, the one or more characteristics associated with the one or more properties associated with the channel in real time, the one or more characteristics being analyzed for noticing a change in the one or more characteristics associated with the one or more properties of the channel in first one or more pre-defined regions and second one or more pre-defined regions and wherein each prominent frame of the one or more prominent frames being analyzed sequentially for noticing the change in the one or more characteristics;

matching, at the computing device, the one or more characteristics associated with the one or more properties derived in the real time with stored one or more characteristics associated with the one or more properties, wherein the matching being done between each prominent video frame with a subsequent prominent video frame, wherein the matching being done at the first one or more pre-defined regions and the second one or more pre-defined regions on each of the one or more prominent frames; and

detecting, at the computing device, the one or more advertisements broadcasted on the channel in the real time, wherein the one or more advertisements being detected based on a result of the matching, wherein the detection of the one or more advertisements being positive when a change in the one or more characteristics of the one or more properties being noticed, wherein the detection being positive when a pre-determined number of characteristics of the one or more characteristics of the one or more properties derived in the real time match with a corresponding stored pre-determined number of characteristics of the stored one or more characteristics of the one or more properties and wherein the detection being positive based on occurrence of event in the first one or more pre-defined regions and the second one or more pre-defined regions;

generating, at the advertisement detection system with the processor, a set of digital signature values corresponding to an extracted first set of video fingerprints, wherein the generating of each digital signature value of the set of digital signature values being done by;

dividing each prominent frame of one or more prominent frames into a pre-defined number of blocks, wherein each block of the pre-defined number of blocks having a pre-defined number of pixels;

grayscaling each block of each prominent frame of the one or more prominent frames;

calculating a first bit value and a second bit value for each block of the prominent frame, wherein the first bit value and the second bit value being calculated from comparing a mean and a variance for the pre-defined number of pixels in each block of the prominent frame with a corresponding mean and variance for a master frame in a master database; and

obtaining a 32 bit digital signature value corresponding to each prominent frame, wherein the 32 bit digital signature value being obtained by sequentially arranging the first bit value and the second bit value for each block of the pre-defined number of blocks of the prominent frame.

18. The computer-readable storage medium as recited in claim 17, further comprising determining, at the computing device, the first one or more pre-defined regions associated with a display of a logo associated with the channel and the second one or more pre-defined regions associated with a display of a content rating certification associated with the media content broadcasted on the channel.