DEVICE AND METHOD FOR INSERTING ADVERTISEMENT BY USING FRAME CLUSTERING

• US 20160142792A1
• Filed: 12/10/2014
• Published: 05/19/2016
• Est. Priority Date: 01/24/2014
• Status: Active Grant

• Current Assignee: Eleven Street Co., Ltd., SK Planet Co., Ltd. (SK Telecom Co., Ltd.)
• Original Assignee: SK Planet Co., Ltd. (SK Telecom Co., Ltd.)
• Inventors: LEE, Su-Bin, SHIN, Hyoung-Chul, HAN, Ju-Hyeun, JEON, Byoung-Ki
• Granted Patent: US 10,904,638 B2
• Time in Patent Office: Days
• US Class Current: 1/1
• CPC Class Codes: G06F 18/22 Matching criteria, e.g. proximity measures
• CPC Class Codes: G06F 18/23 Clustering techniques
• CPC Class Codes: G06T 7/20 Analysis of motion motion estimation for coding, decoding, compressing or decompressing digital video signals H04N19/43, H04N19/51
• CPC Class Codes: G06T 7/60 Analysis of geometric attributes
• CPC Class Codes: G06V 20/46 Extracting features or characteristics from the video content, e.g. video fingerprints, representative shots or key frames
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: G11B 27/28 by using information signals recorded by the same method as the main recording G11B27/22 takes precedence
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/235 Processing of additional data, e.g. scrambling of additional data or processing content descriptors
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/854 Content authoring

Abstract

The present invention is directed to a device and method for inserting an advertisement using frame clustering. According to the present invention, when an advertisement insertion region is set in at least one of the frames of a video, advertisement insertion target frames including advertisement insertion regions are searched for and clustered, and an advertisement is inserted for all the clustered frames in a uniform manner, thereby enabling the natural insertion of the advertisement.

Claims

1. A device for inserting an advertisement, comprising:

a frame search unit configured to, when an advertisement insertion region is set in at least one of frames of a video, search for advertisement insertion target frames including advertisement insertion regions;

a clustering unit configured to group the advertisement insertion target frames, select any one of the advertisement insertion target frames as a reference frame, compare an advertisement insertion region in the reference frame with advertisement insertion regions in advertisement insertion target frames other than the reference frame, calculate a value of a difference with the reference frame as a clustering factor, and perform clustering; and

an advertisement insertion unit configured to, when an advertisement is inserted into at least one of the clustered frames, insert the advertisement for all the clustered frames in a uniform manner.

2. The device of claim 1, wherein the clustering unit comprises:

a scene structure analysis unit configured to acquire any one or more of a location, size, rotation and perspective of the advertisement insertion region and analyze a scene structure;

a camera motion analysis unit configured to acquire any one or more of a focus and shaking of the advertisement insertion region and analyze a camera motion of the advertisement insertion region; and

a clustering factor calculation unit configured to select a frame in which the advertisement insertion region has been set as the reference frame, compare an advertisement insertion region in the reference frame with advertisement insertion regions in advertisement insertion target frames other than the reference frame, and calculate a value of a difference with the reference frame as the clustering factor.

3. The device of claim 2, wherein the clustering factor calculation unit compares the scene structure with the camera motion in the reference frame and scene structures and camera motions in the advertisement insertion target frames other than the reference frame.

4. The device of claim 3, wherein the clustering factor calculation unit determines global movement between successive frames with respect to the clustered frames, and calculates the clustering factor based on a result of the determination of the global movement.

5. The device of claim 4, wherein the clustering unit extracts only portions including the advertisement insertion regions from the respective advertisement insertion target frames, and clusters the extracted portions.

6. The device of claim 5, wherein the clustering unit clusters frames successive from the reference frame.

7. The device of claim 6, wherein the frame search unit determines global movement of the successive frames, and searches for the advertisement insertion target frames based on a result of the determination of the global movement.

8. The device of claim 7, wherein the frame search unit predicts the location of the advertisement insertion region in any one or more of previous and subsequent frames using the result of the determination of the global movement, and searches for the advertisement insertion target frames.

9-19. -19. (canceled)

20. A device for inserting an advertisement, comprising:

a candidate region determination unit configured to determine a candidate region into which a virtual indirect advertisement will be inserted in video image content;

an advertisement insertion unit configured to process the virtual indirect advertisement and insert the processed virtual indirect advertisement into the candidate region;

an exposure measurement unit configured to measure an exposure level of the virtual indirect advertisement based on exposure characteristics in which the virtual indirect advertisement is exposed in the video image content; and

an information provision unit configured to provide insertion region guide information including the exposure level of the virtual indirect advertisement to a user.

21. The device of claim 20, wherein the information provision unit determines whether the exposure level of the virtual indirect advertisement exceeds a preset reference exposure level, and provides the insertion region guide information including the exposure level of the virtual indirect advertisement to the user if the exposure level of the virtual indirect advertisement exceeds the preset reference exposure level.

22. The device of claim 21, wherein the information provision unit displays any one or more of a candidate region into which the virtual indirect advertisement has been inserted and a candidate region which is present before insertion of the virtual indirect advertisement.

23. The device of claim 22, wherein the device for inserting an advertisement, further comprising:

an advertising expense calculation unit configured to calculate the advertising expenses of the virtual indirect advertisement based on the exposure level.

24. The device of claim 20, wherein the advertisement insertion unit comprising:

an advertisement selection unit configured to select the virtual indirect advertisement which will be inserted into the candidate region;

an advertisement processing unit configured to process the virtual indirect advertisement based on a preliminary processing characteristic so that the virtual indirect advertisement can be inserted into the candidate region; and

a processed advertisement insertion unit configured to insert the processed virtual indirect advertisement into the candidate region.

25. The device of claim 20, wherein the exposure characteristics include a real-time characteristic which is measured in real time while the virtual indirect advertisement is being exposed in the video image content, and the preliminary processing characteristic.

26. The device of claim 20, wherein the exposure measurement unit includes a size measurement unit configured to measure the exposure level in proportion to the ratio of the size of the exposed region of the virtual indirect advertisement which is exposed in the video image content to the size of the overall screen.

27. The device of claim 20, the exposure measurement unit includes a time measurement unit configured to measure the exposure level in proportion to the time for which the virtual indirect advertisement is exposed in the video image content.

28. The device of claim 20, the exposure measurement unit includes a deformation measurement unit configured to measure the exposure level in inverse proportion to the difference between the angle at which the virtual indirect advertisement is exposed in the video image content and a preset reference angle.

29. A device for inserting an advertisement, comprising:

an advertisement selection unit configured to select a virtual indirect advertisement which will be inserted into video image content;

an inpainting region generation unit configured to generate an inpainting region and a non-inpainting region by comparing the virtual indirect advertisement with an existing advertisement included in the video image content;

an inpainting unit configured to perform inpainting on only the inpainting region; and

an advertisement insertion unit configured to insert the virtual indirect advertisement into the video image content after the inpainting of the inpainting region.

30. The device of claim 29, wherein the inpainting region generation unit generates a target region including a region of the existing advertisement, and generates the inpainting region and the non-inpainting region by dividing the target region.

31. The device of claim 30, wherein the inpainting region is a region of the target region which does not overlap a region of the virtual indirect advertisement;

and

the non-inpainting region is a region of the target region which overlaps the region of the virtual indirect advertisement.