Automatic generation of video from structured content

• US 9,997,198 B2
• Filed: 01/19/2017
• Issued: 06/12/2018
• Est. Priority Date: 07/06/2006
• Status: Active Grant

• Current Assignee: Sundaysky Incorporated
• Original Assignee: Sundaysky Incorporated
• Inventors: Axen, Yaniv, Weller, Shmuel
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US15/409,695
• Publication Number:
  US 20170133055A1
• Time in Patent Office: 509 Days
• Field of Search: 386262, 386281, 386261, 386278, 386290
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/32 on separate auxiliary tracks of the same or an auxiliary record carrier
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 7/17327 with deferred transmission or handling of upstream communications
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

Apparatus for generation of playable media from structured data, comprises a structured data reading unit for reading in of content of a first structure, a transformation unit for transforming said content into a second structure, said transformation comprising incorporating media play instructions, and a rendering unit for rendering content from the second structure using said media play instructions to generate playable media from the content.

Claims

1. A system comprising:

a structured data reading unit comprising at least one processor, the structured data reading unit configured to;

access first structured data, the first structured data comprising a first assembly of first media elements and the first assembly being specific to a first subject;

a transformation unit comprising at least one processor, the transformation unit configured to;

access one or more rules that control generation of customized videos;

automatically generate, based on the one or more rules that control generation of customized videos, a first renderable script for a first customized video for the first subject that includes at least one of the first media elements and first media play instructions;

a video rendering unit comprising at least one processor, the video rendering unit configured to;

render a first customized video for the first subject based on the first renderable script automatically generated by the transformation unit; and

a feedback unit comprising at least one processor, the feedback unit configured to;

receive feedback related to level of user interest in the first customized video, and

analyze the received feedback to identify user preferences for customized videos that are automatically generated,

wherein the transformation unit is configured to store, in electronic storage, a modified version of the one or more rules that control generation of customized videos, the modified version having been modified to optimize the one or more rules based on results of the analysis of the received feedback,

wherein the structured data reading unit is configured to access second structured data after modification of the one or more rules, the second structured data comprising a second assembly of second media elements and the second assembly being specific to a second subject,

wherein the transformation unit is configured to;

access the modified version of the one or more rules that control generation of customized videos, and

automatically generate, based on the modified version of the one or more rules that control generation of customized videos, a second renderable script for a second customized video for the second subject that includes at least one of the second media elements and second media play instructions that are different than the first media play instructions, and

wherein the video rendering unit is configured to render a second customized video for the second subject based on the second renderable script automatically generated by the transformation unit.

2. The system of claim 1, wherein the feedback unit is configured to receive feedback related to level of user interest in the first customized video by receiving feedback related to how long the first customized video for the first subject was played.

3. The system of claim 1, wherein the feedback unit is configured to receive feedback related to level of user interest in the first customized video by receiving feedback indicating whether or not the first customized video was played completely.

4. The system of claim 1, wherein the feedback unit is configured to receive feedback related to level of user interest in the first customized video by receiving feedback indicating levels of interest in different versions of the first customized video, and analyze the received feedback to identify user preferences for customized videos that are automatically generated by identifying which of the different versions of the first customized video are preferred.

5. The system of claim 1, wherein the feedback unit is configured to analyze the received feedback to identify user preferences for customized videos that are automatically generated by identifying which features of the first customized video are preferred and wherein the transformation unit is configured to store, in electronic storage, a modified version of the one or more rules that selects features of the first customized video identified as being preferred.

6. The system of claim 1, wherein the transformation unit is configured to store, in electronic storage, the modified version of the one or more rules to optimize the one or more rules in a dynamic way that follows trends in user interest.

7. The system of claim 1, wherein the feedback unit is configured to receive feedback related to level of user interest in the first customized video by receiving user inputs and the transformation unit is configured to store, in electronic storage, the modified version of the one or more rules by learning from the received user inputs.

8. The system of claim 1, wherein the video rendering unit is configured to:

render a batch of customized videos based on a batch of renderable scripts automatically generated by the transformation unit for multiple subjects, each of the customized videos in the batch being a playable video, the customized videos in the batch including dynamic portions customized for the multiple subjects based on media elements used to customize dynamic parts of customized documents for the multiple subjects.

9. The system of claim 1, wherein the first renderable script comprises time information, stage direction, camera direction, and content playing information.

10. The system of claim 1, wherein to render the first customized video for the first subject, the video rendering unit is configured to render a first customized video for the first subject that includes scene changes including cut and fade, camera instructions including pan and zoom, and filler material to link between scenes according to a storyboard.

11. The system of claim 1, wherein the first media elements comprise an image and wherein the first renderable script comprises instructions to combine information with the image.

12. The system of claim 1, wherein the video rendering unit comprises a synthesis engine configured to composite a scene of the first customized video, frame by frame.

13. The system of claim 1, wherein to automatically generate the first renderable script, the transformation unit is further configured to apply a timing framework which defines timing of play.

14. The system of claim 1, wherein the transformation unit is further configured to access additional media elements that comprise a virtual narrator, background music, and captions and generate the first renderable script for the first customized video by integrating the first media elements with the virtual narrator, background music, and captions.

15. A method comprising:

accessing first structured data, the first structured data comprising a first assembly of first media elements and the first assembly being specific to a first subject;

accessing one or more rules that control generation of customized videos;

automatically generating, based on the one or more rules that control generation of customized videos, a first renderable script for a first customized video for the first subject that includes at least one of the first media elements and first media play instructions;

rendering a first customized video for the first subject based on the first renderable script automatically generated;

receiving feedback related to level of user interest in the first customized video;

analyzing the received feedback to identify user preferences for customized videos that are automatically generated;

storing, in electronic storage, a modified version of the one or more rules that control generation of customized videos, the modified version having been modified to optimize the one or more rules based on results of the analysis of the received feedback;

accessing second structured data after modification of the one or more rules, the second structured data comprising a second assembly of second media elements and the second assembly being specific to a second subject;

accessing the modified version of the one or more rules that control generation of customized videos;

automatically generating, based on the modified version of the one or more rules that control generation of customized videos, a second renderable script for a second customized video for the second subject that includes at least one of the second media elements and second media play instructions that are different than the first media play instructions; and

rendering a second customized video for the second subject based on the second renderable script automatically generated.

16. The method of claim 15, wherein receiving feedback related to level of user interest in the first customized video comprises receiving feedback related to how long the first customized video for the first subject was played.

17. The method of claim 15, wherein receiving feedback related to level of user interest in the first customized video comprises receiving feedback indicating whether or not the first customized video was played completely.

18. The method of claim 15, wherein receiving feedback related to level of user interest in the first customized video comprises receiving feedback indicating levels of interest in different versions of the first customized video, and wherein analyzing the received feedback to identify user preferences for customized videos that are automatically generated comprises identifying which of the different versions of the first customized video are preferred.

19. The method of claim 15, wherein analyzing the received feedback to identify user preferences for customized videos that are automatically generated comprises identifying which features of the first customized video are preferred and wherein storing, in electronic storage, the modified version of the one or more rules comprises storing, in electronic storage, a modified version of the one or more rules that selects features of the first customized video identified as being preferred.

20. The method of claim 15, wherein storing, in electronic storage, the modified version of the one or more rules comprises storing, in electronic storage, the modified version of the one or more rules to optimize the one or more rules in a dynamic way that follows trends in user interest.

21. The method of claim 15, wherein receiving feedback related to level of user interest in the first customized video comprises receiving user inputs and wherein storing, in electronic storage, the modified version of the one or more rules comprises storing, in electronic storage, the modified version of the one or more rules by learning from the received user inputs.

22. The method of claim 15, the method further comprising rendering a batch of customized videos based on a batch of renderable scripts automatically generated for multiple subjects, each of the customized videos in the batch being a playable video, the customized videos in the batch including dynamic portions customized for the multiple subjects based on media elements used to customize dynamic parts of customized documents for the multiple subjects.

23. The method of claim 15, wherein the first renderable script comprises time information, stage direction, camera direction, and content playing information.

24. The method of claim 15, wherein rendering a first customized video for the first subject comprises rendering a first customized video for the first subject that includes scene changes including cut and fade, camera instructions including pan and zoom, and filler material to link between scenes according to a storyboard.

25. The method of claim 15, wherein the first media elements comprise an image and wherein the first renderable script comprises instructions to combine information with the image.

26. The method of claim 15, the method further comprising compositing a scene of the first customized video, frame by frame.

27. The method of claim 15, wherein automatically generating the first renderable script comprises applying a timing framework which defines timing of play.

28. The method of claim 15, the method further comprising accessing additional media elements that comprise a virtual narrator, background music, and captions and generating the first renderable script for the first customized video by integrating the first media elements with the virtual narrator, background music, and captions.

29. A system comprising:

a structured data reading unit comprising at least one processor, the structured data reading unit configured to;

access first structured data, the first structured data comprising a first assembly of first media elements and the first assembly being specific to a first subject;

means for;

accessing one or more rules that control generation of customized videos; and

for

automatically generating, based on the one or more rules that control generation of customized videos, a first renderable script for a first customized video for the first subject that includes at least one of the first media elements and first media play instructions;

a video rendering unit comprising at least one processor, the video rendering unit configured to;

render a first customized video for the first subject based on the first renderable script automatically generated;

a feedback unit comprising at least one processor, the feedback unit configured to;

receive feedback related to level of user interest in the first customized video, and

analyze the received feedback to identify user preferences for customized videos that are automatically generated,

wherein the system is configured to store, in electronic storage, a modified version of the one or more rules that control generation of customized videos, the modified version having been modified to optimize the one or more rules based on results of the analysis of the received feedback,

wherein the structured data reading unit is configured to access second structured data after modification of the one or more rules, the second structured data comprising a second assembly of second media elements and the second assembly being specific to a second subject, and

means for;

accessing the modified version of the one or more rules that control generation of customized videos, and

automatically generating, based on the modified version of the one or more rules that control generation of customized videos, a second renderable script for a second customized video for the second subject that includes at least one of the second media elements and second media play instructions that are different than the first media play instructions,

wherein the video rendering unit is configured to render a second customized video for the second subject based on the second renderable script automatically generated.

30. A system comprising:

a structured data reading unit comprising at least one processor, the structured data reading unit configured to;

access first structured data, the first structured data comprising a first assembly of first media elements and the first assembly being specific to a first subject;

a transformation unit comprising at least one processor, the transformation unit configured to;

access one or more rules that control generation of customized videos; and

automatically generate, based on the one or more rules that control generation of customized videos, a first renderable script for a first customized video for the first subject that includes at least one of the first media elements and first media play instructions;

means for;

rendering a first customized video for the first subject based on the first renderable script automatically generated by the transformation unit;

a feedback unit comprising at least one processor, the feedback unit configured to;

receive feedback related to level of user interest in the first customized video, and

analyze the received feedback to identify user preferences for customized videos that are automatically generated,

wherein the transformation unit is configured to store, in electronic storage, a modified version of the one or more rules that control generation of customized videos, the modified version having been modified to optimize the one or more rules based on results of the analysis of the received feedback,

wherein the structured data reading unit is configured to access second structured data after modification of the one or more rules, the second structured data comprising a second assembly of second media elements and the second assembly being specific to a second subject,

wherein the transformation unit is configured to;

access the modified version of the one or more rules that control generation of customized videos, and

automatically generate, based on the modified version of the one or more rules that control generation of customized videos, a second renderable script for a second customized video for the second subject that includes at least one of the second media elements and second media play instructions that are different than the first media play instructions, and

means for;

rendering a second customized video for the second subject based on the second renderable script automatically generated by the transformation unit.