Dynamic media placement in video feed

• US 10,674,207 B1
• Filed: 01/08/2019
• Issued: 06/02/2020
• Est. Priority Date: 12/20/2018
• Status: Active Grant

• Current Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Original Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Inventors: Vidal, Richard, Mathon, Edouard, Souche, Christian
• Primary Examiner(s): Fogg, Cynthia M
• Application Number:
  US16/242,891
• Publication Number:
  US 20200204859A1
• Time in Patent Office: 511 Days
• Field of Search: 725 14
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/234 Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/2343 involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements video transcoding H04N19/40; media packet handling at the source H04L65/762
• CPC Class Codes: H04N 21/258 Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data arrangements for services using the result on the distributing side of broadcast systems H04H60/66; profiles in network data switching protocols H04L67/30
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/4223 Cameras H04N23/00 takes precedence
• CPC Class Codes: H04N 21/44 Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
• CPC Class Codes: H04N 21/44016 involving splicing one content stream with another content stream, e.g. for substituting a video clip
• CPC Class Codes: H04N 21/44209 Monitoring of downstream path of the transmission network originating from a server, e.g. bandwidth variations of a wireless network arrangements for maintenance or administration in data switching networks involving bandwidth and capacity management H04L41/0896
• CPC Class Codes: H04N 21/472 End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content end-user interfaces for retrieving video data from a database G06F16/739; network services for supporting unicast streaming H04L65/612
• CPC Class Codes: H04N 21/81 Monomedia components thereof
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02

Abstract

A system for placement of media object in a video feed comprises a receiver to receive the video feed, a tracker to receive a camera tracking data regarding movement of a camera capturing the video feed, a detector to detect a placeholder within the video feed where the media object may be placed and detect an attribute, such as size and position of the placeholder, and a media obtainer to obtain information regarding the media object, the media object having a placement attribute corresponding to the placeholder. The system also comprises an aligner to adjust the placement attribute of the media object with the attribute of the placeholder for positioning the media object within the placeholder, and a content generator to generate a content indicative of the media object embedded within the placeholder of the video feed.

Claims

1. A system comprising:

a receiver to receive a video feed comprising multiple video objects;

a tracker, coupled to the receiver, to receive a camera tracking data, the camera tracking data indicative of a change in position and size of at least one video object in the video feed;

a detector in communication with the receiver and the tracker, the detector to,

detect a placeholder in the video feed based on a position of corners of the placeholder, wherein the placeholder is an area within the video feed for placement of a media object;

track a movement of the placeholder based on a comparison of coordinates of the placeholder in multiple frames of the video feed;

highlight at least one zone of the tracked placeholder;

apply an alpha mask for an occlusion within the video feed; and

detect an attribute of the placeholder in the video feed, the attribute including at least one of a position, an orientation, a size of the placeholder;

a media obtainer, in communication with the receiver and the detector, to obtain information regarding the media object, the media object having a placement attribute corresponding to the placeholder in the video feed, wherein the placement attribute is indicative of a characteristic of the media object compatible with the placeholder;

an aligner in communication with the receiver, the tracker and the detector, the aligner to adjust the placement attribute of the media object with the attribute of the placeholder for positioning the media object within the placeholder, wherein the placement attribute of the media object is adjusted with the attribute of the placeholder based on the at least one highlighted zone of the placeholder; and

a content generator in communication with the receiver, the detector, the media obtainer, and the aligner to generate a content indicative of the media object embedded within the placeholder of the video feed.

2. The system as claimed in claim 1, wherein the content generator is further to integrate a content enhancement effect to the media object embedded in the video feed, wherein the content enhancement effect includes at least one of a blur effect, a sharpness effect, a saturation effect, a brightness effect, a hue effect, and a contrast effect.

3. The system as claimed in claim 1, wherein the detector is further to monitor changes in the attribute of the placeholder in the video feed based on the camera tracking data.

4. The system as claimed in claim 3, wherein the aligner applies the changes to the placement attribute of the media object based on a transformation matrix.

5. The system as claimed in claim 1, wherein the detector detects the placeholder based on edge coordinates of the placeholder.

6. The system as claimed in claim 1, wherein the detector is to further track and detect the occlusion over an area within the video feed based on chroma keying.

7. The system as claimed in claim 1, wherein the media object is an advertisement.

8. The system as claimed in claim 1, wherein the video feed is a live video feed.

9. A method comprising:

receiving a video feed comprising multiple video objects;

receiving a camera tracking data, the camera tracking data indicative of a change in position and size of at least one video object in the video feed;

detecting a placeholder in the video feed based on a position of corners of the placeholder, wherein the placeholder is an area within the video feed for placement of a media object;

tracking a movement of the placeholder based on a comparison of coordinates of the placeholder in multiple frames of the video feed;

highlighting at least one zone of the tracked placeholder;

applying an alpha mask for an occlusion within the video feed;

detecting an attribute of the placeholder in the video feed, the attribute including at least one of a position, an orientation, a size of the placeholder;

obtaining information regarding the media object, the media object having a placement attribute corresponding to the placeholder in the video feed, wherein the placement attribute is indicative of a characteristic of the media object compatible with the placeholder;

adjusting the placement attribute of the media object with the attribute of the placeholder for positioning the media object within the placeholder, wherein the placement attribute of the media object is adjusted with the attribute of the placeholder based on the at least one highlighted zone of the placeholder; and

generating a content indicative of the media object embedded within the placeholder of the video feed.

10. The method as claimed in claim 9 comprising integrating a content enhancement effect to the media object embedded in the video feed, wherein the content enhancement effect includes at least one of a blur effect, a sharpness effect, a saturation effect, a brightness effect, a hue effect, and a contrast effect.

11. The method as claimed in claim 9, comprising monitoring changes in the attribute of the placeholder in the video feed based on the camera tracking data.

12. The method as claimed in claim 9 comprising applying the changes to the placement attribute of the media object based on a transformation matrix.

13. The method as claimed in claim 9, wherein the placeholder is detected based on edge coordinates.

14. The method as claimed in claim 9 further comprising detecting the occlusion over an area within the video feed based on chroma keying.

15. The method as claimed in claim 9, wherein the media object is an advertisement.

16. The method as claimed in claim 9, wherein the video feed is a live video feed.

17. A non-transitory computer readable medium comprising instructions executable by a processor to:

receive a video feed comprising multiple video objects;

receive a camera tracking data, the camera tracking data indicative of a change in position and size of at least one video object in the video feed;

detect a placeholder in the video feed based on a position of corners of the placeholder, wherein the placeholder is an area within the video feed for placement of a media object;

track a movement of the placeholder based on a comparison of coordinates of the placeholder in multiple frames of the video feed;

highlight at least one zone of the tracked placeholder;

apply an alpha mask for an occlusion within the video feed;

detect an attribute of the placeholder in the video feed, the attribute including at least one of a position, an orientation, a size of the placeholder;

obtain information regarding the media object, the media object having a placement attribute corresponding to the placeholder in the video feed, wherein the placement attribute is indicative of a characteristic of the media object compatible with the placeholder;

adjust the placement attribute of the media object with the attribute of the placeholder for positioning the media object within the placeholder, wherein the placement attribute of the media object is adjusted with the attribute of the placeholder based on the at least one highlighted zone of the placeholder; and

generate a content indicative of the media object embedded within the placeholder of the video feed.

18. The non-transitory computer readable medium as claimed in claim 17 comprising instructions to integrate a content enhancement effect to the media object embedded in the video feed, wherein the content enhancement effect includes at least one of a blur effect, a sharpness effect, a saturation effect, a brightness effect, a hue effect, and a contrast effect.

19. The non-transitory computer readable medium as claimed in claim 17 comprising instructions to monitor changes in the attribute of the placeholder in the video feed based on the camera tracking data.

20. The non-transitory computer readable medium as claimed in claim 17 comprising instructions to apply the changes to the placement attribute of the media object based on a transformation matrix.