Environment for designing a dynamic multimedia content presentation

• US 10,191,628 B1
• Filed: 05/14/2015
• Issued: 01/29/2019
• Est. Priority Date: 11/25/2014
• Status: Active Grant

• Current Assignee: Emmi Solutions, LLC (Wolters Kluwer Nv)
• Original Assignee: Emmi Solutions, LLC (Wolters Kluwer Nv)
• Inventors: Blew, Gregory A.
• Primary Examiner(s): Bycer, Eric J.
• Application Number:
  US14/712,590
• Time in Patent Office: 1,356 Days
• CPC Class Codes: G06F 16/4393 Multimedia presentations, e.g. slide shows, multimedia albums
• CPC Class Codes: G06F 3/0481 based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
• CPC Class Codes: G06F 3/0482 Interaction with lists of selectable items, e.g. menus
• CPC Class Codes: G06F 3/04842 Selection of displayed objects or displayed text elements G06F3/0482 takes precedence
• CPC Class Codes: G06F 3/04847 Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
• CPC Class Codes: G06F 3/0487 using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
• CPC Class Codes: G06F 3/167 Audio in a user interface, e.g. using voice commands for navigating, audio feedback
• CPC Class Codes: G06F 8/34 Graphical or visual programming
• CPC Class Codes: G16H 10/60 for patient-specific data, e.g. for electronic patient records
• CPC Class Codes: G16H 15/00 ICT specially adapted for medical reports, e.g. generation or transmission thereof
• CPC Class Codes: G16H 40/67 for remote operation
• CPC Class Codes: G16H 50/20 for computer-aided diagnosis, e.g. based on medical expert systems
• CPC Class Codes: H04L 67/01 Protocols
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04N 1/00198 Creation of a soft photo presentation, e.g. digital slide-show

Abstract

According to an embodiment, when authoring an IMP, a designer may utilize an authoring tool to edit the visual and audio content associated with particular nodes. Further, in an embodiment, a designer may utilize an authoring tool to manipulate blocks corresponding to nodes of the IMP. For example, the authoring tool may include a library of stencils that the designer can utilize to create blocks corresponding to nodes of the IMP. In an embodiment, a designer may link the blocks to create a flow or tree establishing an ordered relationship between the blocks. A set of rules and/or facts may be generated based on the blocks and the designed flow. During IMP presentation, a rules engine may operate to activate nodes of the IMP based on the generated rules and/or facts.

Claims

1. A system for facilitating authoring of an interactive multimedia pack, the system comprising:

(a) a controller configured to transmit to a display device display data representing a plurality of interfaces to be simultaneously displayed for defining a flow between a plurality of pages of an interactive multimedia presentation (“

IMP”

) that each include a plurality of content assets visual or audible in nature and for selecting the plurality of content assets for each of the pages, the plurality of interfaces including;

(i) a first one or more interfaces that a user may interact with to select content assets to be presented when pages of the IMP are presented, and (ii) a second interface that a user may interact with to define the flow between the plurality of pages of the IMP;

(b) one or more input devices coupled to the controller, wherein the controller is configured to receive from the one or more input devices;

(i) first input data representing a plurality of content assets selected using the first one or more interfaces, and (ii) second input data representing a flow-definition made using the second interface, the flow-definition including a first flow from a first page to a second page representing a first version of a portion of the IMP, a second flow from the first page to a third page representing a second version of the portion of the IMP, and one or more conditions to be evaluated at run-time by a rules engine for selecting a flow from the first flow and the second flow based, at least in part, on the type of communication channel utilized to present the IMP;

(c) one or more memory devices coupled to the controller, the one or more memory devices storing;

(i) first page data generated by the controller and representing the first page of the IMP, the first page data referencing the selected content asset;

(ii) a record of rules generated by the controller according to the flow-definition represented by the second input data, the record of rules including the one or more conditions for selecting a flow from the first flow and the second flow;

(d) one or more servers coupled to the one or more memory devices, the one or more servers configured to;

(i) analyze the first page data to identify the selected content asset referenced by the first page data and to transmit to a client device the selected content asset for presentation by the client device of the first page;

(ii) evaluate the one or more conditions included in the record of rules stored at the one or more memory devices;

(iii) when the evaluation of the one or more conditions produces a first result;

analyze second page data representing the second page to identify, and to transmit to the client device for presentation, content assets referenced by the second page data so that the client device can present the second page after the first page has been presented; and

(iv) when the evaluation of the one or more conditions produces a second result;

analyze third page data representing the third page to identify, and to transmit to the client device for presentation, content assets referenced by the third page data so that the client device can present the third page after the first page has been presented.

2. The system of claim 1, wherein the selected content asset represented by the first input data is an audio content asset;

wherein the client device presents the first page by way of an interactive voice response presentation that includes a presentation of the audio content asset by way of a speaker of the client device.

3. The system of claim 1, wherein the selected content asset represented by the first input data is a visual content asset;

wherein the client device presents the first page by way of a presentation that includes a presentation of the visual content asset by way of a screen of the client device.

4. The system of claim 3, wherein the visual content asset is an animation;

wherein the first input data represents, for each of a plurality of points in time, a selection made via the first one or more interfaces of;

an image and a screen position for the selected image;

wherein the selected images and screen positions for the plurality of points in time define the animation.

5. The system of claim 4, wherein the first one or more interfaces includes a timeline tool;

wherein the selection made via the first one or more interfaces of the selected images and screen positions is made using the timeline tool.

6. The system of claim 1, wherein the first one or more interfaces includes visual interface and an audio interface that a user may interact with to select a content asset to be presented when the page of the IMP is presented;

wherein the controller is further configured to receive third input data;

wherein the selected content asset represented by the first input data is an audio content asset selected via the audio interface;

wherein the selected content asset represented by the third input data is a visual content asset selected via the visual interface;

wherein both the visual content asset and the audio content asset are transmitted to the client device for presentation of the first page.

7. The system of claim 6, wherein the controller is further configured to:

when the first input data is received by the controller before the third input data is received by the controller;

identify, from the received first input data, the first page as the page for which the selected visual content asset represented by the third input data has been selected.

8. The system of claim 6, wherein the controller is further configured to:

when the third input data is received by the controller before the first input data is received by the controller;

identify, from the received third input data, the first page as the page for which the audio content asset represented by the first input data has been selected.

9. The system of claim 1, wherein the controller is further configured to:

receive input data representing a selection of a visual representation displayed via the second interface; and

identify the first page as the page associated with the selected visual representation;

wherein the controller causes the first one or more interfaces to be displayed so that one or more content assets may be selected for the identified first page.

10. The system of claim 1, wherein the selected content asset is a visual content asset;

wherein the controller is further configured to transmit display data to the display device so that when received at the display device, the display device automatically performs one or more of the following;

(i) displays via a third interface a design area for the identified first page so that an audio content asset can be selected for the first page via the third interface;

or

(ii) displays via the second interface a design area for the IMP so that a flow can be defined between a visual representation of the first page and one or more visual representations of one or more other pages.

11. The system of claim 1, wherein the selected content asset is an audio content asset;

wherein the controller is further configured to transmit display data to the display device so that when received at the display device, the display device automatically performs one or more of the following;

(i) displays via a third interface a design area for the identified first page so that a visual content asset can be selected for the first page via the third interface; and

(ii) displays via the second interface a design area for the IMP, and displaying within the design area for the IMP a visual representation of the identified first page so that a flow can be defined between the visual representation of the first page and one or more visual representations of one or more other pages.

12. The system of claim 1, wherein the selected content asset represents text,

wherein presentation by the client device of the first page includes presentation of the text represented by the selected content asset via:

(i) an electronic mail system, or (ii) a text messaging system.

13. The system of claim 12, wherein the first input data representing the selected content asset is audio data received via a microphone, wherein the received audio is converted to the text.

14. The system of claim 12, wherein the first input data representing the selected content asset is keystroke data received via a keyboard, wherein the text is identified from the received keystroke data.

15. The system of claim 1, wherein the selected content asset is an audio content asset and wherein the first one or more interfaces includes a text entry area;

wherein the controller is further configured to;

(i) receive from the one or more input devices data representing text (“

text data”

) that has been entered in the text entry area;

(ii) convert the text data to audio data representing speech of the text; and

(iii) store, at one or more memory devices, the audio data as the audio content asset.

16. The system of claim 1, wherein the display data transmitted by the controller causes the display device to display the plurality of interfaces via simultaneous display of the first one or more interfaces and the second interface such that they are each part of a single display.

17. The system of claim 1, wherein the first one or more interfaces comprises:

a design area and a library area;

wherein the first input data further represents a selection of a visual content asset from the library area;

wherein the controller is further configured to cause the display device to display in the design area the visual content asset that has been selected from the library area.

18. The system of claim 1, wherein the display data transmitted by the controller causes the display device to display the second interface so that one or more visual representations of pages of the IMP are displayed, wherein a user may define connections between the visual representations of pages;

wherein the received second input data includes;

(i) data representing creation of a connection between a first visual representation of the first page and a second visual representation of the second page;

(ii) data representing creation of a connection between the first visual representation of the first page and a third visual representation of the third page; and

(iii) data representing a definition of the one or more conditions to be evaluated for selecting the second page as the next page after the first page or the third page as the next page after the first page.

19. A method comprising:

(a) simultaneously displaying, at a display device, a plurality of interfaces for defining a flow between a plurality of pages of an interactive multimedia presentation (“

IMP”

) that each include a plurality of content assets visual or audible in nature and for selecting the plurality of content assets for each of the pages,

wherein displaying the plurality of interfaces includes;

(i) displaying a first one or more interfaces that a user may interact with to select content assets to be presented when a page of the IMP is presented, and (ii) displaying a second interface that a user may interact with to define a flow between one or more pages of the IMP;

(b) receiving at a controller and from one or more input devices;

(i) first input data representing a content asset selected using the displayed first one or more interfaces, and (ii) second input data representing a flow-definition made using the second interface, the flow-definition including a first flow from a first page to a second page representing a first version of a portion of the IMP, a second flow from the first page to a third page representing a second version of the portion of the IMP, and one or more conditions to be evaluated at run-time by a rules engine for selecting a flow from the first flow and the second flow based, at least in part, on the type of communication channel utilized to present the IMP;

(c) generating by the controller;

(i) first page data representing the first page of the IMP, said first page data referencing the selected content asset, and (ii) a record of rules including the one or more conditions for selecting a flow from the first flow and the second flow, said record of rules generated based on the flow-definition represented by the third input data;

(d) after receiving a signal indicating that a client device will present the IMP;

(i) analyzing the first page data to identify the selected content asset referenced by the first page data and transmitting to the client device the selected content asset for presentation by the client device of the first page;

(ii) evaluating the one or more conditions included in the record of rules;

(iii) when the evaluation of the one or more conditions produces a first result;

analyzing second page data representing the second page to identify, and to transmit to the client device for presentation, one or more content assets referenced by the second page data so that the client device can present the second page after the first page has been presented, and

(iv) when the evaluation of the one or more conditions produces a second result;

analyzing third page data representing the third page to identify, and to transmit to the client device for presentation, one or more content assets referenced by the third page data so that the client device can present the third page after the first page has been presented.

20. The method of claim 19, wherein the selected content asset represented by the first input data is an audio content asset;

wherein the client device presents the first page by way of an interactive voice response presentation that includes a presentation of the audio content asset by way of a speaker of the client device.

21. The method of claim 19, wherein the selected content asset represented by the first input data is a visual content asset;

wherein the client device presents the first page by way of a presentation that includes a presentation of the visual content asset by way of a screen of the client device.

22. The method of claim 21, wherein the visual content asset is text;

wherein the client device presents the first page by way of a presentation that includes presenting the text by way of (i) an electronic mail system, or (ii) a text messaging system.

23. The method of claim 19, wherein displaying the plurality of interfaces further includes:

displaying a third interface that a user may interact with to select a content asset to be presented when the page of the IMP is presented;

the method further including;

receiving at the controller third input data representing a content asset selected using the displayed third interface;

wherein the selected content asset represented by the first input data is an audio content asset;

wherein the selected content asset represented by the third input data is a visual content asset;

the method further including analyzing the first page data to identify the audio content asset and the visual content asset referenced by the first page data and transmitting to the client device the audio content asset and the visual content asset for presentation by the client device of the first page.

24. The method of claim 23, wherein the first input data is received by the controller before the third input data is received by the controller;

and

wherein the method further comprises;

identifying, from the received first input data, the first page as the page for which the visual content asset represented by the third input data has been selected.

25. The method of claim 24, wherein the selected content asset is a visual content asset;

the method further comprising one or more of the following;

(i) automatically displaying via a third interface a design area for the identified first page so that an audio content asset can be selected for the first page via the third interface;

or

(ii) automatically displaying via the second interface a visual representation of the identified first page so that a flow can be defined between the visual representation of the first page and one or more visual representations of one or more other pages.

26. The method of claim 24, wherein the selected content asset is an audio content asset;

the method further comprising one or more of the following;

(i) automatically displaying via a third interface a design area for the identified first page so that a visual content asset can be selected for the first page via the third interface;

or

(ii) automatically displaying via the second interface a design area for the IMP, and displaying within the design area for the IMP a visual representation of the identified first page so that a flow can be defined between the visual representation of the first page and one or more visual representations of one or more other pages.

27. The method of claim 19, wherein the selected content asset is an audio content asset;

wherein displaying the first one or more interfaces comprises displaying a text entry area;

wherein receiving first input data representing the selection via the first one or more interfaces of the content asset for the first page comprises;

(i) receiving data representing text (“

text data”

) entered in the text entry area;

(ii) converting the text data to audio data representing speech of the text; and

(iii) storing, at one or more memory devices, the audio data as the audio content asset.

28. The method of claim 19, wherein displaying the plurality of interfaces comprises:

simultaneously displaying the first one or more interfaces and the second interface such that they are each part of a single display.

29. The method of claim 19, wherein receiving from the one or more input devices:

(i) first input data, and (ii) second input data comprises;

receiving the second input data before receiving the first input data.

30. The method of claim 19, wherein the selected content asset is a visual content asset;

wherein displaying the first one or more interfaces comprises displaying a design area and a library area;

wherein receiving the first input data comprises;

receiving a selection of the visual content asset from the library area; and

wherein the method further comprises displaying in the design area the visual content asset that has been selected from the library area.

31. The method of claim 19, wherein displaying the second interface comprises:

displaying one or more visual representations of pages of the IMP, wherein a user may define connections between the visual representations of pages; and

wherein receiving the second input data representing the definition, made via the second interface, of the flow between the one or more pages of the IMP further includes;

(i) receiving data representing creation of a connection between a first visual representation of the first page and a second visual representation of the second page;

(ii) receiving data representing creation of a connection between the first visual representation of the first page and a third visual representation of the third page; and

(iii) receiving data representing a definition of the one or more conditions to be evaluated for selecting the second page as the next page or the third page as the next page.