Automatic generation of video from structured content

• US 9,711,179 B2
• Filed: 10/05/2014
• Issued: 07/18/2017
• Est. Priority Date: 07/06/2006
• Status: Active Grant

• Current Assignee: Sundaysky Incorporated
• Original Assignee: Sundaysky Incorporated
• Inventors: Axen, Yaniv, Weller, Shmuel
• Primary Examiner(s): Tran, Thai
• Assistant Examiner(s): HUNTER, MISHAWN N
• Application Number:
  US14/506,657
• Publication Number:
  US 20150023651A1
• Time in Patent Office: 1,017 Days
• Field of Search: 386278, 386280
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/32 on separate auxiliary tracks of the same or an auxiliary record carrier
• CPC Class Codes: G11B 27/322 used signal is digitally coded
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/25866 Management of end-user data customer care in data networks H04L41/5077
• CPC Class Codes: H04N 21/25891 being end-user preferences retrieval of video data in a video database based on user preferences G06F16/739; arrangements for recognizing users' preferences H04H60/46; user profiles in network data switching protocols H04L67/306; processing of user preferences or user profiles in wireless networks H04W8/18
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/4668 for recommending content, e.g. movies
• CPC Class Codes: H04N 21/4782 Web browsing , e.g. WebTV
• CPC Class Codes: H04N 21/6543 for forcing some client operations, e.g. recording remote booting in general G06F9/4416
• CPC Class Codes: H04N 21/6582 Data stored in the client, e.g. viewing habits, hardware capabilities, credit card number arrangements where receivers interact with the broadcast H04H20/38
• CPC Class Codes: H04N 21/8153 comprising still images, e.g. texture, background image
• CPC Class Codes: H04N 21/816 involving special video data, e.g 3D video
• CPC Class Codes: H04N 21/8173 End-user applications, e.g. Web browser, game
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80
• CPC Class Codes: H04N 5/85 on discs or drums
• CPC Class Codes: H04N 7/17327 with deferred transmission or handling of upstream communications
• CPC Class Codes: H04N 9/8227 the additional signal being at least another television signal
• CPC Class Codes: H04N 9/8233 the additional signal being a character code signal

Abstract

Device for providing a playable sequence in renderable manner comprises: a providing unit for providing defined functions, said functions for applying playable effects to objects, a time unit for adding time boundaries to said functions, to provide time bounded functions, an ordering unit for ordering said time bounded functions into a sequence, and a translation unit for applying translations to said objects in accordance with said effects.

Claims

1. Method for providing a playable sequence whose play is modifiable, the sequence with the modification being provided in renderable manner, the method comprising:

providing defined functions, said functions for applying playable effects to modify play of playable objects, said playable objects being part of an underlying object-orientated model, the defined functions being provided as markup;

adding time boundaries to said defined functions, to provide time bounded functions,

ordering said time bounded defined functions into a sequence with said objects, and arranging said sequence as a time graph to define playing within said sequence of said objects as such and objects as modified by said functions at different times respectively, and

applying translations to said objects using said ordered time-bounded defined functions, thereby to modify play of said objects in accordance with said effects, the method using said time boundaries and said ordering to combine a timeline synchronization framework with said underlying object-orientated model, and further comprising resolving said time graph simultaneously with setting up a layered model for effects within an execution frame.

2. The method of claim 1, wherein said playable sequence is a continuous playable video sequence comprising frames.

3. The method of claim 2, further comprising rendering to form the continuous playable video sequence as a continuous linear sequence of said playable objects.

4. The method of claim 1, comprising setting up a layered model for layering said time bounded defined functions to define interrelationships between said functions.

5. The method of claim 1, wherein at least one of said objects is an actor in a scene.

6. The method of claim 1, comprising providing a single effect to a plurality of objects, thereby to generate a compound effect.

7. The method of claim 1, wherein said sequence comprises multiple code blocks to be executed simultaneously within a timeline.

8. The method of claim 7, configured to associate each of said multiple code blocks with a respective execution frame, and to associate each execution frame with a respective time graph.

9. The method of claim 1, wherein said sequence comprises multiple code blocks associated with said objects and said time-bound functions, said code blocks each arranged within a respective time graph, at least some of said code blocks being executable simultaneously, said playable media thus comprising a plurality of time graphs forming said sequence, the method comprising rendering said sequence in an order defined by said time graphs within said sequence, thereby to provide said defining of play of said objects in accordance with said effects.

10. Method for generation of playable video from existing media elements in a flat or non-playable source, the playable video being provided as a sequence in renderable manner, the method comprising:

providing defined functions, said functions for applying playable effects to define play of objects of said existing media elements, the defined functions being provided as markup;

adding time boundaries to said defined functions, to provide time bounded functions,

ordering said time bounded defined functions into a sequence, and

applying translations to said objects using said ordered time-bounded defined functions, characterized in that said sequence comprises multiple code blocks associated with said objects and said time-bound functions, said code blocks each arranged within a respective time graph, at least some of said code blocks being executable simultaneously, said playable media thus comprising a plurality of time graphs forming said sequence, the method comprising rendering said sequence in an order defined by said time graphs within said sequence, thereby to provide said defining of play of said objects in accordance with said effects.

11. Device for generation of playable video media from existing media elements in a flat or non-playable source, the playable video media being provided as a sequence in renderable manner, the device comprising:

a providing unit for providing defined functions, said functions for applying playable effects to define play of objects of said existing media elements, said defined functions being provided as markup,

a time unit for adding time boundaries to said defined functions, to provide time bounded functions,

an ordering unit for ordering said defined time bounded functions into said sequence, and

a translation unit for applying translations to said objects as required by said playable effects, characterized in that said sequence comprises multiple code blocks associated with said objects and said time bound functions, said code blocks each arranged within a respective time graph and at least some of said code blocks executable simultaneously, said playable video media thus comprising a plurality of time graphs within said sequence, and said device being configured to render said sequence in an order defined by said time graphs within said sequence, thereby to provide said defining of play of said objects.

12. The device of claim 11, wherein at least one of said objects is an actor in a scene, or wherein said ordering unit comprises a layered model for layering said time bounded defined functions to define interrelationships between said functions, or wherein said providing unit is configured to provide a single effect to a plurality of objects, thereby to generate a compound effect, or wherein said sequence comprises multiple code blocks to be executed simultaneously within a timeline.

13. The device of claim 11, wherein at least some of said multiple code blocks are executable simultaneously within a respective time graph, the device configured to associate each of said multiple code blocks with a respective one of said time graphs, said time graphs being directed graphs comprising vertices and edges, said vertices representing pieces of information that appear in the respective code block, and said edges representing dependencies between pieces of information.

14. The device of claim 13, wherein said time graph comprises nodes and said nodes comprise invocation objects for invoking methods for said rendering.

15. The device of claim 14, wherein said ordering comprises resolving said time graph.

16. The device of claim 15, wherein said ordering unit is configured such that said resolving said time graph is carried out simultaneously with setting up a layered model for effects within said execution frame.

17. The device of claim 15, wherein there is further provided a high level execution frame, and resolving a time graph of said high level execution frame follows resolving of time graphs of lower level execution frames.

18. The device of claim 14, wherein said ordering unit is configured to use a tree structure to define said ordering.