Automatic generation of video from structured content

• US 9,633,695 B2
• Filed: 10/13/2016
• Issued: 04/25/2017
• Est. Priority Date: 07/06/2006
• Status: Active Grant

• Current Assignee: Sundaysky Incorporated
• Original Assignee: Sundaysky Incorporated
• Inventors: Axen, Yaniv, Weller, Shmuel
• Primary Examiner(s): Chevalier, Robert
• Application Number:
  US15/292,295
• Publication Number:
  US 20170032822A1
• Time in Patent Office: 194 Days
• Field of Search: 386278, 386281, 386282, 386287, 386290
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/32 on separate auxiliary tracks of the same or an auxiliary record carrier
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 7/17327 with deferred transmission or handling of upstream communications
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

Apparatus for generation of playable media from structured data, comprises a structured data reading unit for reading in of content of a first structure, a transformation unit for transforming said content into a second structure, said transformation comprising incorporating media play instructions, and a rendering unit for rendering content from the second structure using said media play instructions to generate playable media from the content.

Claims

1. A system comprising:

a data reading unit comprising at least one processor, the data reading unit configured to;

access user data managed by a content management system of a company, the user data being specific to a user and being a source of content for a personal user webpage that is specific to the user and that the company makes accessible to the user;

a transformation unit comprising at least one processor, the transformation unit configured to;

access a template; and

process the accessed user data in accordance with one or more rules that control generation of a personalized video for the user by automatically generating, using the accessed template, a renderable script for the personalized video that integrates media play instructions with the accessed user data that serves as a source of content for the personal user webpage that the company makes accessible to the user; and

a video rendering unit comprising at least one processor, the video rendering unit configured to;

render the personalized video for the user based on the renderable script automatically generated by the transformation unit, the personalized video including the accessed user data that is displayed in the personal user webpage upon access by the user.

2. The system of claim 1, wherein the video rendering unit is configured to:

render a batch of personalized videos based on a batch of renderable scripts automatically generated by the transformation unit for multiple users.

3. The system of claim 1, wherein the data unit is further configured to receive an indication that some of the user data has been updated;

and

wherein the data reading unit is configured to access the user data in response to receiving the indication that some of the user data has been updated.

4. The system of claim 1, wherein the data unit is further configured to receive an indication that the personal user webpage has been requested;

and

wherein the data reading unit is configured to access the user data in response to receiving the indication that the personal user webpage has been requested.

5. The system of claim 1, wherein the renderable script comprises time information, stage direction, camera direction, and content playing information.

6. The system of claim 1, wherein to render the personalized video for the user, the video rendering unit is configured to render a personalized video for the user that includes scene changes including cut and fade, camera instructions including pan and zoom, and filler material to link between scenes according to a storyboard.

7. The system of claim 1, wherein the user data comprises text and wherein the transformation unit comprises a text-to-speech engine to render the text as speech in the personalized video.

8. The system of claim 1, wherein the user data comprises an image and wherein the renderable script comprises instructions to combine information with the image.

9. The system of claim 1, wherein the video rendering unit comprises a synthesis engine configured to composite a scene of the personalized video, frame by frame.

10. The system of claim 1, wherein to process the accessed user data in accordance with one or more rules, the transformation unit is further configured to apply a timing framework which defines timing of play.

11. The system of claim 1, wherein the template comprises media play commands with filler or enhancement instructions for providing additional play to link between different media elements.

12. The system of claim 1, wherein the transformation unit is further configured to access additional media elements that comprise a virtual narrator, background music, and captions and generate the renderable script for the personalized video by integrating the accessed user data with the virtual narrator, background music, and captions.

13. The system of claim 1, wherein the template defines building blocks of a video scene and wherein the transformation unit is further configured to generate the renderable script for the personalized video by selecting a subset of the building blocks based on the accessed user data and integrating the subset of the building blocks with the accessed user data.

14. The system of claim 1, further comprising a feedback unit comprising at least one processor, the feedback unit configured to:

receive feedback related to level of user interest in the personalized video, and

analyze the received feedback to identify user preferences for personalized videos that are automatically generated.

15. A method comprising:

accessing user data managed by a content management system of a company, the user data being specific to a user and being a source of content for a personal user webpage that is specific to the user and that the company makes accessible to the user;

accessing a template;

processing the accessed user data in accordance with one or more rules that control generation of a personalized video for the user by automatically generating, using the accessed template, a renderable script for the personalized video that integrates media play instructions with the accessed user data that serves as a source of content for the personal user webpage that the company makes accessible to the user; and

rendering the personalized video for the user based on the renderable script automatically generated, the personalized video including the accessed user data that is displayed in the personal user webpage upon access by the user.

16. The method of claim 15, the method further comprising rendering a batch of personalized videos based on a batch of renderable scripts automatically generated for multiple users.

17. The method of claim 15, the method further comprising:

receiving an indication that some of the user data has been updated; and

accessing the user data in response to receiving the indication that some of the user data has been updated.

18. The method of claim 15, the method further comprising:

receiving an indication that the personal user webpage has been requested; and

accessing the user data in response to receiving the indication that the personal user webpage has been requested.

19. The method of claim 15, wherein the renderable script comprises time information, stage direction, camera direction, and content playing information.

20. The method of claim 15, wherein rendering the personalized video comprises rendering a personalized video for the user that includes scene changes including cut and fade, camera instructions including pan and zoom, and filler material to link between scenes according to a storyboard.

21. The method of claim 15, wherein the user data comprises text;

and

the method further comprises rendering the text as speech in the personalized video.

22. The method of claim 15, wherein the user data comprises an image and wherein the renderable script comprises instructions to combine information with the image.

23. The method of claim 15, wherein rendering the personalized video comprises compositing a scene of the personalized video, frame by frame.

24. The method of claim 15, wherein processing the accessed user data in accordance with one or more rules comprises applying a timing framework which defines timing of play.

25. The method of claim 15, wherein the template comprises media play commands with filler or enhancement instructions for providing additional play to link between different user data.

26. The method of claim 15, wherein the method further comprising accessing media elements that comprise a virtual narrator, background music, and captions, wherein automatically generating the renderable script for the personalized video comprises integrating the accessed user data with the virtual narrator, background music, and captions.

27. The method of claim 15, wherein the template defines building blocks of a video scene and wherein generating the renderable script for the personalized video comprises selecting a subset of the building blocks based on the accessed user data and integrating the subset of the building blocks with the accessed user data.

28. The method of claim 15, the method further comprising:

receiving feedback related to level of user interest in the personalized video, and

analyzing the received feedback to identify user preferences for personalized videos that are automatically generated.

29. A system comprising:

a data reading unit comprising at least one processor, the data reading unit configured to;

access user data managed by a content management system of a company, the user data being specific to a user and being a source of content for a personal user webpage that is specific to the user and that the company makes accessible to the user;

means for;

accessing a template; and

for

processing the accessed user data in accordance with one or more rules that control generation of a personalized video for the user by automatically generating, using the accessed template, a renderable script for the personalized video that integrates media play instructions with the accessed user data that serves as a source of content for the personal user webpage that the company makes accessible to the user; and

a video rendering unit comprising at least one processor, the video rendering unit configured to;

render the personalized video for the user based on the renderable script automatically generated, the personalized video including the accessed user data that is displayed in the personal user webpage upon access by the user.

30. A system comprising:

a data reading unit comprising at least one processor, the data reading unit configured to;

access user data managed by a content management system of a company, the user data being specific to a user and being a source of content for a personal user webpage that is specific to the user and that the company makes accessible to the user;

a transformation unit comprising at least one processor, the transformation unit configured to;

access a template; and

process the accessed user data in accordance with one or more rules that control generation of a personalized video for the user by automatically generating, using the accessed template, a renderable script for the personalized video that integrates media play instructions with the accessed user data that serves as a source of content for the personal user webpage that the company makes accessible to the user; and

means for;

rendering the personalized video for the user based on the renderable script automatically generated by the transformation unit, the personalized video including the accessed user data that is displayed in the personal user webpage upon access by the user.