Dynamic content rendering in media

• US 10,674,184 B2
• Filed: 01/24/2019
• Issued: 06/02/2020
• Est. Priority Date: 04/25/2017
• Status: Active Grant

• Current Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Original Assignee: Accenture Global Solutions Limited (Accenture PLC)
• Inventors: Souche, Christian, Mathon, Edouard, Naressi, Alexandre
• Primary Examiner(s): Tran, Hai V
• Assistant Examiner(s): Li, Susan X
• Application Number:
  US16/256,957
• Publication Number:
  US 20190174157A1
• Time in Patent Office: 495 Days
• CPC Class Codes: G06Q 30/02 Marketing; Price estimation or determination; Fundraising
• CPC Class Codes: G06Q 30/0241 Advertisements
• CPC Class Codes: G06Q 30/0277 Online advertisement
• CPC Class Codes: G06T 11/60 Editing figures and text; Combining figures or text
• CPC Class Codes: G06T 15/205 Image-based rendering
• CPC Class Codes: G06T 19/20 Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
• CPC Class Codes: G06T 7/10 Segmentation; Edge detection motion-based segmentation G06T7/215
• CPC Class Codes: G06T 7/13 Edge detection
• CPC Class Codes: G06T 7/75 involving models
• CPC Class Codes: H04N 21/23412 for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
• CPC Class Codes: H04N 21/23418 involving operations for analysing video streams, e.g. detecting features or characteristics television picture signal circuitry for scene change detection H04N5/147; filtering for image enhancement G06T5/00; methods or arrangements for recognising scenes G06V20/00; arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/23424 involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
• CPC Class Codes: H04N 21/25825 involving client display capabilities, e.g. screen resolution of a mobile phone optimising the visualisation of content during browsing in the Internet G06F16/9577; processing of terminal status or physical abilities in wireless networks H04W8/22; authentication in wireless network security H04W12/06
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/44008 involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream arrangements characterised by components specially adapted for monitoring, identification or recognition of video in broadcast systems H04H60/59
• CPC Class Codes: H04N 21/47205 for manipulating displayed content, e.g. interacting with MPEG-4 objects, editing locally
• CPC Class Codes: H04N 21/812 involving advertisement data advertising per se G06Q30/02
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics

Abstract

A system for rendering media having content displayed comprises a receiving unit to receive media, a scanner to detect an object in the media for placing a placeholder, a checker to provide the placeholder to a user for feedback and receive the feedback. The system also includes a template generator to generate a template indicating the placeholder in the media. The system also includes a rendering unit in communication with the template generator to render, upon receiving a request for watching the media, the media having content to display to the user, based on at least one of a storage space and a processing capacity.

Claims

1. A system including a processor and memory, the system comprising:

a receiving unit to receive media, wherein the media includes one of an image and a video;

a scanner in communication with the receiving unit to;

detect an object in the media for placing a placeholder, based on at least one of a semantic segmentation technique and an edge detection technique; and

determine a position of the placeholder to be placed in the object of the media based on the detection of the object;

a checker, in communication with the scanner, the checker to;

provide the placeholder being positioned in the media to a user for feedback; and

receive the feedback of the user for the placeholder, wherein the feedback is indicative of one of an approval, a rejection, and a pending status of the placeholder;

a template generator in communication with the scanner and the checker to generate a template indicating the placeholder in the media, wherein the template includes details pertaining to the media and details pertaining to the approved placeholder responsive to the feedback including the approval; and

a rendering unit in communication with the template generator to;

when the media is the video, detect and classify frames of the video into frames with placeholders and frames without placeholders, based on the details pertaining to the media and the approved placeholder indicated in the template; and

render, upon receiving a request for watching the media, the media with additional content to display to the user, based on at least one of a storage space and a processing capacity, wherein the rendering includes;

when a remote player for playing the media allows the media to be played in two or more pieces;

providing portions of the media having the frames without the placeholders, and

rendering portions of the media having the frames with the placeholders while the portions of the media having the frames without the placeholders are being simultaneously watched; and

when the remote player allows the media to be played in one piece;

rendering portions of the media having the frames with the placeholders, and

providing the media having the frames without the placeholders and the frames with the placeholders, when the rendering is finished.

2. The system of claim 1, wherein the rendering unit to further,

detect, when the media is the video, a position of the placeholder in the media, based on the details pertaining to the placeholder indicated in the template;

cut portions of the media having the placeholder, from the media, based on the detection of the position of the placeholder in the media;

crop the portions of the media having the placeholder after cutting the portions from the media; and

render, upon receiving a request for watching the media, the cropped portions of the media having the placeholder to the user, wherein the rendering includes;

when a remote player for playing the media allows the media to be played in two or more pieces;

providing portions of the media without the placeholder, and

rendering the cropped portions of the media having the placeholder while the portions of the media without the placeholders are being simultaneously watched, based on the details pertaining to the placeholder indicated in the template; and

when the remote player allows the media to be played in one piece;

rendering portions of the media with the placeholders, and

providing the media having the portions without the placeholder and the portions with the placeholder, when the rendering is finished.

3. The system of claim 1, wherein the rendering unit is further to:

abort the rendering of a portion of the media having the frames with the placeholders, if the rendering is not finished till the time the remote player reaches the portion of the media; and

provide the portions of the media having the frames without the placeholders, after the abortion.

4. The system of claim 1, wherein the scanner is to further track, when the media is the video, the placeholder in different frames of the video, based on a comparison of coordinates of the placeholder in the different frames.

5. The system of claim 1, wherein in order to provide the placeholder to the user for the feedback, the checker to highlight, for the user, at least one zone for placing the additional content on a frame of the media, in a form of a semi-transparent rectangle.

6. The system of claim 1, wherein for providing the placeholder to the user for the feedback, the checker is to insert the additional content in at least one zone of a frame of the media.

7. The system of claim 1 further comprising a dynamic integrator in communication with the template generator, the dynamic integrator to insert the additional content in the placeholder of the media indicated in the template, wherein dimensions of the additional content correspond to dimensions of the placeholder.

8. The system of claim 7, wherein the additional content is an advertisement and the receiving unit is to further receive the advertisement to be inserted in the placeholder of the media from an advertisement network.

9. The system of claim 1, wherein the details pertaining to the media includes at least one of a name, a description, a location of the media on a storage server, and metadata.

10. The system of claim 1, wherein the details pertaining to the placeholder include at least one of a position of the placeholder, dimensions of the placeholder, and a frame of the placeholder.

11. The system of claim 1 further comprising:

an instruction receiving unit in communication with the checker, the instruction receiving unit to receive, when the placeholder is approved, instructions from the user for adding special effects to the placeholder, wherein the special effects include at least one of a color correction, a contrast, a brightness, a saturation, and a blur;

a machine learner in communication with the scanner, the checker, and the instruction receiving unit, the machine learner to monitor, for predefined time intervals, the detection of the object, the determination of the position of the placeholder, the feedback of the user for the placeholder, and selection of the special effects for the placeholder; and

the scanner in communication with the machine learner and the receiving unit, the scanner to further;

detect another object in the media or at least another media;

determine a position of another placeholder to be placed in the another object based on the detection of the another object; and

suggest special effects for addition to the other placeholder, based on the monitoring.

12. The system of claim 11, wherein the instruction receiving unit is to:

replace the placeholder with a neutral image on the media, wherein the neutral image is indicative of the content without the special effects; and

change an appearance of the neutral image, based on selection of one of more of the special effects.

13. A system including a processor and memory, the system comprising:

a receiving unit to receive media, wherein the media includes one of an image and a video;

a scanner in communication with the receiving unit, the scanner to;

detect an object in the media for placing a placeholder, based on at least one of a semantic segmentation technique, and an edge detection technique; and

determine a position of the placeholder to be placed in the object of the media, based on the detection of the object;

a checker, in communication with the scanner, the checker to;

provide the placeholder being positioned in the media to a user for feedback; and

receive the feedback of the user for the placeholder, wherein the feedback is indicative of one of an approval, a rejection, and a pending status of the placeholder;

a template generator in communication with the scanner and the checker, the template generator to generate a template indicating the placeholder in the media, wherein the template includes details pertaining to the media and details pertaining to the approved placeholder responsive to the feedback including the approval; and

a rendering unit in communication with the template generator, the rendering unit to;

receive information pertaining to a specification of a remote machine being used to watch the media;

determine whether the remote machine is compatible to render the media, based on the specification of the remote machine;

provide the media, additional content, and the template to the remote machine; and

integrate the additional content with portions of the media having the placeholder as determined based on the template, while portions of the media without the placeholder are being played by the remote machine.

14. The system of claim 13, wherein the rendering unit is further to:

abort rendering of a portion of the media having frames with the placeholder, if the rendering is not finished till the time the remote player reaches the portion; and

provide a portion of the media having frames without the placeholder after the abortion.

15. The system of claim 13, wherein the scanner is to further track, when the media is the video, the placeholder in different frames of the video, based on a comparison of coordinates of the placeholder in the different frames.

16. A method comprising:

receiving, by a processor, media including one of an image and a video;

detecting, by the processor, an object in the media for placing a placeholder, based on at least one of a semantic segmentation technique and an edge detection technique; and

determining, by the processor, a position of the placeholder to be placed in the object of the media, based on the detection of the object;

providing, by the processor, the placeholder being positioned in the media to a user, for feedback;

receiving, by the processor, the feedback of the user for the placeholder, wherein the feedback is indicative of one of an approval, a rejection, and a pending status of the placeholder;

generating, by the processor, a template indicating the placeholder in the media, wherein the template includes details pertaining to the media and details pertaining to the approved placeholder responsive to the feedback including the approval;

inserting, by the processor, additional content in the placeholder of the media indicated in the template, wherein dimensions of the additional content correspond to dimensions of the placeholder;

when the media is the video, detecting and classifying, by the processor, frames of the video into frames with placeholders and frames without placeholders, based on the details of the media and the approved placeholder indicated in the template; and

rendering, by the processor, upon receiving a request for watching the media, the media having the additional content displayed therein, based on at least one of a storage capacity and a processing power, wherein the rendering includes;

in response to determining that a remote player for playing the media allows the media to be played in two or more pieces,

providing portions of the media having the frames without the placeholders, and

rendering portions of the media having the frames with the placeholders while the portions of the media having the frames without the placeholders are being simultaneously watched; and

in response to determining that the remote player allows the media to be played in one piece,

rendering portions of the media having the frames with the placeholders, and

providing the media having the frames without the placeholders and the frames with the placeholders, when the rendering is finished.

17. The method of claim 16 further comprising:

detecting, by the processor, when the media is the video, a position of the placeholder in the media, based on the details pertaining to the placeholder indicated in the template;

cutting by the processor, portions of the media having the placeholder, from the media, based on the detection of the position of the placeholder in the media;

cropping, by the processor, the portions of the media having the placeholder after cutting the portions from the media; and

rendering, by the processor, upon receiving a request for watching the media, the cropped portions of the media having the placeholder to the user, wherein the rendering includes;

in response to determining that the remote player for playing the media allows portions of the media without the placeholder,

providing portions of the media without the placeholder, and

rendering the cropped portions of the media having the placeholder while the portions of the media without the placeholders are being simultaneously watched, based on the details pertaining to the placeholder indicated in the template; and

when the remote player allows the media to be played in one piece,

rendering portions of the media with the placeholders, and

providing the media having the portions without the placeholder and the portions with the placeholder, when the rendering is finished.

18. The method of claim 16 further comprising:

receiving, by the processor, information pertaining to specification of a remote machine being used to watch the media;

determining, by the processor, whether the remote machine is compatible to render the media, based on the specification of the remote machine;

providing, by the processor, the media, the additional content, and the template to the remote machine; and

integrating, by the processor, the additional content with each frame of the media, based on the template, while portions of the media without the placeholder are already being played by the remote machine.