Interactive video generation

• US 9,972,358 B2
• Filed: 10/22/2015
• Issued: 05/15/2018
• Est. Priority Date: 10/22/2014
• Status: Active Grant

• Current Assignee: Huawei Technologies Co., Ltd. (Huawei Investment & Holding Co., Ltd.)
• Original Assignee: Futurewei Technologies Incorporated (Huawei Investment & Holding Co., Ltd.)
• Inventors: Wu, Zonghuan, Kalender, Murat, Kansin, Can, Cirakman, Ozgun, Eren, Mustafa Tolga, Tirkaz, Caglar, Gultekin, Gunay, Kutluk, Sezer
• Primary Examiner(s): Chowdhury, Nigar
• Application Number:
  US14/920,523
• Publication Number:
  US 20160118083A1
• Time in Patent Office: 936 Days
• Field of Search: 386 28-284
• CPC Class Codes: G11B 27/031 Electronic editing of digitised analogue information signals, e.g. audio or video signals
• CPC Class Codes: G11B 27/034 on discs G11B27/036, G11B27/038 take precedence
• CPC Class Codes: G11B 27/34 Indicating arrangements indicating means incorporated in magazine or cassette G11B23/046 and G11B23/0875; indicating measured values in general G01D
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/854 Content authoring
• CPC Class Codes: H04N 21/8543 using a description language, e.g. Multimedia and Hypermedia information coding Expert Group [MHEG], eXtensible Markup Language [XML] information retrieval of semistructured data, the underlying structure being taken into account, e.g. mark-up language structure data G06F16/80

Abstract

Various videolization solutions are provided. A method for generating video is provided according to an example. The method includes obtaining one or more data portions and generating a customizable video using the one or more data portions and using one or more video generation templates; determining one or more selectable objects in the customizable video using one or more object definitions; receiving an indication indicating a user selection of at least one selectable object corresponding to an object definition; obtaining additional data portions related to the at least one selectable object corresponding to the indication; and regenerating the customizable video using the additional data portions and the one or more data portions corresponding to the indication.

Claims

1. A method for generating video, comprising:

obtaining one or more data portions and generating a customizable video using the one or more data portions and using one or more video generation templates;

defining in the one or more video generation templates, for one or more of the data portions, respective entrance and exit times and one or more respective actions wherein each of the actions is associated with a respective time step;

generating one or more object definitions for each identified selectable object in the customizable video;

identifying one or more selectable objects in the data portions using the one or more object definitions and the one or more video generation templates;

receiving an indication of user selection of one or more of the selectable objects;

obtaining additional data portions related to the selected selectable objects; and

regenerating the customizable video using the one or more data portions and the additional data portions corresponding to the selected selectable objects and using the one or more video generation templates.

2. The method of claim 1, wherein the identifying the one or more selectable objects further comprises:

extracting media element features from the one or more data portions;

labeling various levels of the media element features with the one or more object definitions;

labeling a media element feature of the various levels of the media element features as a selectable object.

3. The method of claim 1, wherein the one or more object definitions are obtained in an extensible markup language (XML) file in the indication.

4. The method of claim 1, wherein the one or more object definitions further comprise results of an analysis based on the one or more of the selectable object, wherein the analysis is made in at least one of natural language processing, morphological analysis, semantic analysis, video analysis, audio analysis or sentiment analysis;

and the selectable object comprises at least one of a text, image, an audio item or a video item.

5. The method of claim 1, further comprising:

generating a video description file based on the indication; and

compiling the object definitions into the video description file using the video description file.

6. The method of claim 1, further comprising:

updating the customizable video according to a scheduling input.

7. The method of claim 1, the method further comprising regenerating the customizable video during presentation of the customizable video.

8. The method of claim 1, wherein the indication is received during a playback of the customizable video.

9. The method of claim 1, further comprising:

identifying more selectable objects using more object definitions after regenerating the customizable video.

10. The method of claim 1, further comprising:

determining the data portions comprise the one or more selectable objects according to a construct in the video generation template.

11. A video processing device, comprising:

a memory storing instructions; and

a processor coupled to the memory, with the processor reading and executing the instructions to;

obtain one or more data portions and generate a customizable video using the one or more data portions and using one or more video generation templates;

define in the one or more video generation templates, for one or more of the data portions, respective entrance and exit times and one or more respective actions wherein each of the actions is associated with a respective time step;

generate one or more object definition for each identified selectable object in the customizable video;

identify one or more selectable objects in the customizable video using the one or more object definitions and the one or more video generation templates;

receive an indication of user selection of one or more of the selectable objects;

obtain additional data portions related to the selected selectable objects; and

regenerate the customizable video using the one or more data portions and the additional data portions corresponding to the selected selectable objects and using the one or more video generation templates.

12. The device of claim 11, wherein to identify the one or more selectable objects further comprises:

to extract media element features from the one or more data portions;

to label various levels of the media element features with the one or more object definitions;

to label a media element feature of the various levels of the media element features as a selectable object.

13. The device of claim 11, wherein one or more object definitions are obtained in an extensible markup language (XML) file in the indication.

14. The device of claim 11, wherein the one or more object definitions further comprise results of an analysis, wherein the analysis is performed based on the one or more of the selectable object and comprises at least one of natural language processing, morphological analysis, semantic analysis, video analysis, audio analysis, sentiment analysis, or combinations thereof, and wherein the selectable object comprises at least one of a text, image, an audio item, a video item, or combinations thereof.

15. The device of claim 11, further comprising:

generating a video description file based on the indication; and

compiling the object definitions into the video description file using the video description file.

16. The device of claim 11, further comprising to update the customizable video according to a scheduling input.

17. The device of claim 11, further comprising to regenerate the customizable video during presentation of the customizable video.

18. The device of claim 11, wherein the indication is received during a playback of the customizable video.

19. The device of claim 11, further comprising to identify more selectable objects using more object definitions after the customizable video is regenerated.

20. The device of claim 11, further comprising determining the data portions comprise the one or more selectable objects according to a construct in the video generation template.