Explanatory animation generation

• US 10,216,824 B2
• Filed: 12/05/2013
• Issued: 02/26/2019
• Est. Priority Date: 05/15/2012
• Status: Active Grant

• Current Assignee: SAP SE
• Original Assignee: SAP SE
• Inventors: Werner, Horst
• Primary Examiner(s): Alam, Shahid A
• Assistant Examiner(s): Sultana, Nargis
• Application Number:
  US14/097,494
• Publication Number:
  US 20140095500A1
• Time in Patent Office: 1,909 Days
• Field of Search: 707736, 707913
• CPC Class Codes: G06F 16/284 Relational databases
• CPC Class Codes: G06F 16/288 Entity relationship models
• CPC Class Codes: G06F 16/40 of multimedia data, e.g. slideshows comprising image and additional audio data retrieval of still image data G06F16/50; retrieval of audio data G06F16/60; retrieval of video data G06F16/70

Abstract

Various embodiments included herein include at least one of systems, methods, and software for explanatory animation generation. Some embodiments include receiving data representative of at least two data items, each data item to be presented as a node. Relationships between these data items are discovered in an interrelated dataset and the relationship is illustrated as a set of sequential nodes on a canvas. A text-script descriptive of each of the nodes is then generated. Finally, such embodiments include generating a visualization with a synchronized voiceover based on the sequence nodes and the text-script, the visualization including each node with a synchronized voiceover of each node.

Claims

1. A method comprising:

presenting a user interface, the user interface comprising a canvas portion within which data items are received and presented as nodes and a sequence portion;

receiving, within the canvas portion, data representative of at least two data items stored in a data storage system, each data item to be presented as a node displayed at the canvas portion, wherein the receiving comprises;

receiving an indication that a first representation of a first data item of the at least two data items is selected and dragged to the canvas portion; and

receiving an indication that a second representation of a second data item of the at least two data items is selected and dragged to the canvas portion;

discovering, in the data storage system, a relationship between the at least two data items, wherein the discovering comprises;

identifying at least one other data item involved in the relationship, the at least one other data item to be presented as a node displayed at the canvas portion;

identifying a shortest path of relation between the at least two data items; and

deriving a visualization sequence from a relationship between nodes of the at least two data items and the node of the at least one other data item, wherein the visualization sequence includes the shortest path;

generating a text-script descriptive of each of a number of nodes of the visualization sequence;

generating, at the canvas portion, a visualization with a synchronized voiceover based on the visualization sequence and the text-script, the visualization comprising a first node for the first data item, a second node for the second data item, and a third node for a third data item of the at least one other data item, each node with a synchronized voiceover, the visualization also graphically indicating a relationship between at least two of the first node, the second node, and the third node;

displaying at the sequence portion a representation of the first node, the second node, and the third node in an order according to the visualization sequence; and

storing the visualization on a data storage device.

2. The method of claim 1, wherein the generated visualization includes data consumable by a multimedia renderer.

3. The method of claim 2, wherein the synchronized voiceover includes text associated with each node consumable by a text-to-speech engine of the multimedia renderer.

4. The method of claim 1, wherein generating the visualization with the synchronized voiceover based on the visualization sequence and the text-script includes, for each node:

identifying a template based on at least one of data of interest to be presented, a default configuration, and an association of data underlying the node to a template;

generating audio voiceover data based on text-script data associated with the respective node; and

copying, into a data set of the visualization, data of the identified template, data of the data item the node is to represent, and the audio voiceover data.

5. A non-transitory computer-readable storage medium, with instructions stored thereon, which when executed by at least one processor of a computer cause the computer to perform operations comprising:

presenting a user interface comprising a canvas portion within which data items are received and presented as nodes and a sequence portion;

receiving, within the canvas portion, data representative of at least two data items stored in a data storage system, each data item to be presented as a node displayed at the canvas portion, wherein the receiving comprises;

receiving an indication that a first representation of a first data item of the at least two data items is selected and dragged to the canvas portion; and

receiving an indication that a second representation of a second data item of the at least two data items is selected and dragged to the canvas portion;

discovering, in the data storage system, a relationship between the at least two data items, wherein the discovering comprises;

identifying a shortest path of relation between the at least two data items; and

identifying at least one other data item involved in the relationship, the at least one other data item to be presented as a node displayed at the canvas portion; and

deriving a visualization sequence from a relationship between nodes of the at least two data items and the node of the at least one other data item, wherein the visualization sequence includes the shortest path;

generating a text-script descriptive of each of a number of nodes of the visualization sequence;

generating, at the canvas portion, a visualization with a synchronized voiceover based on the visualization sequence and the text-script, the visualization comprising a first node for the first data item, a second node for the second data item, and a third node for a third data item of the at least one other data item, each node with a synchronized voiceover, the visualization also graphically indicating a relationship between at least two of the first node, the second node, and the third node;

displaying at the sequence portion a representation of the first node, the second node, and the third node in an order according to the visualization sequence; and

storing the visualization on a data storage device.

6. The non-transitory computer-readable storage medium of claim 5, wherein the generated visualization is renderable within the canvas portion.

7. The non-transitory computer-readable storage medium of claim 5, wherein generating the visualization with the synchronized voiceover based on the visualization sequence and the text-script includes, for each node:

identifying a template based on at least one of data of interest to be presented, a default configuration, and an association of data underlying the node to a template;

generating audio voiceover data based on text-script data associated with the respective node; and

copying, into a data set of the visualization, data of the identified template, data of the data item the node is to represent, and the audio voiceover data.

8. A system comprising:

at least one processor, at least one memory device, at least one video output device, and at least one network interface device;

a user interface application stored on the at least one memory device and executable by the at least one processor to perform operations comprising;

presenting a user interface comprising a canvas portion and a sequence portion, wherein data items are received as input and presented as nodes of visualization output within the canvas portion, and wherein the user interface is presented via that at least one visual output device;

receiving, at the canvas portion, data representative of at least two data items stored in a data storage system accessible via the at least one network interface device, each data item to be included as a node in a visualization, wherein the receiving comprises;

receiving an indication that a first representation of a first data item of the at least two data items is selected and dragged to the canvas portion; and

receiving an indication that a second representation of a second data item of the at least two data items is selected and dragged to the canvas portion;

receiving command input to generate a visualization and pass the data representative of the at least two data items to a visualization generator;

the visualization generator stored on the at least one memory device and executable by the at least one processor to perform operations comprising;

discovering, in the data storage system accessible via the at least one network interface device, a relationship between the at least two data items wherein the discovering comprises;

identifying at least one other data item involved in the relationship, the at least one other data item to be presented as a node;

identifying a shortest path of relation between the at least two data items; and

deriving a visualization sequence from a relationship between nodes of the at least two data items and the at least one other data item, wherein the visualization sequence includes the shortest path;

generating a text-script descriptive of each of a number of nodes of the visualization sequence;

generating, at the canvas portion, a visualization with a synchronized voiceover based on the visualization sequence and the text-script, the visualization comprising a first node for the first data item, a second node for the second data item, and a third node for a third data item of the at least one other data item, each node with a synchronized voiceover of each node, the visualization also graphically indicating a relationship between at least two of the first node, the second node, and the third node;

displaying at the sequence portion a representation of the first node, the second node, and the third node in an order according to the visualization sequence; and

storing the visualization on the at least one memory device.

9. The system of claim 8, wherein the generated visualization includes data consumable by a multimedia renderer.

10. The system of claim 9, wherein the synchronized voiceover includes text associated with each node consumable by a text-to-speech engine of the multimedia renderer.