Rendering and interacting with transmedia content data

• US 10,331,726 B2
• Filed: 09/26/2016
• Issued: 06/25/2019
• Est. Priority Date: 09/26/2016
• Status: Active Grant

• Current Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Original Assignee: Disney Enterprises Incorporated (The Walt Disney Company)
• Inventors: Laeuchli, Rebekkah, Grosse, Max, Cabral, Maria, Gross, Markus, Schriber, Sasha, Simo, Isa
• Primary Examiner(s): Uddin, Mohammed R
• Application Number:
  US15/276,506
• Publication Number:
  US 20180089201A1
• Time in Patent Office: 1,002 Days
• Field of Search: 707725, 707797, 707798, 707805
• CPC Class Codes: G06F 16/2246 Trees, e.g. B+trees
• CPC Class Codes: G06F 16/285 Clustering or classification
• CPC Class Codes: G06F 16/444 Spatial browsing, e.g. 2D maps, 3D or virtual spaces
• CPC Class Codes: G06F 16/9558 Details of hyperlinks; Management of linked annotations
• CPC Class Codes: G06F 2203/04806 Zoom, i.e. interaction techniques or interactors for controlling the zooming operation
• CPC Class Codes: G06F 3/0488 using a touch-screen or digitiser, e.g. input of commands through traced gestures
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces
• CPC Class Codes: H04N 21/26258 for generating a list of items to be played back in a given order, e.g. playlist, or scheduling item distribution according to such list retrieval of multimedia data based on playlists G06F16/40
• CPC Class Codes: H04N 21/8541 involving branching, e.g. to different story endings
• CPC Class Codes: H04N 21/8545 for generating interactive applications

Abstract

A method is provided for rendering a representation of and interacting with transmedia content on an electronic device. Transmedia content data is received at the electronic device. The transmedia content data comprises: a plurality of transmedia content data items; linking data which define time-ordered content links between the plurality of transmedia content data items, whereby the plurality of transmedia content data items are arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween; a visualization model of the transmedia content data; and a hierarchical structure of the linked transmedia content subsets and clusters of linked transmedia content subsets. A representation of the transmedia content data is rendered at the electronic device by processing the visualization model of the transmedia content data and the hierarchical structure to map some or all of the transmedia content at a first level of the hierarchical structure onto the representation of the transmedia content.

Claims

1. A computer-implemented method for rendering a representation of and interacting with transmedia content on an electronic device, the method comprising the following steps:

receiving transmedia content data at the electronic device, the transmedia content data comprising;

a plurality of transmedia content data items;

linking data which define time-ordered content links between the plurality of transmedia content data items, the plurality of transmedia content data items being arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween;

a visualization model of the transmedia content data; and

a hierarchical structure of the linked transmedia content subsets presented as a visual metaphor, wherein the hierarchical structure is arranged in memory with elements of a lowest level of the hierarchical structure being transmedia content data items, elements of a second-lowest level being linked transmedia content subsets describing time ordered links between the transmedia content data items of child elements, and elements of a third-lowest level being clusters of sufficiently similar linked transmedia content subsets and clusters of linked transmedia content subsets; and

rendering, at the electronic device, a first representation of the transmedia content data by processing the visualization model of the transmedia content data and the hierarchical structure to map some or all of the transmedia content at a first level of the hierarchical structure onto the representation of the transmedia content, wherein layout data for the visualization model is generated such that;

at a first level, grouped clusters of transmedia content subsets are represented as a three-dimensional object,

at a second level, each cluster of linked transmedia content subsets is represented as an area on a surface of the three dimensional object,

at a third level, each linked transmedia content subset is represented by a sub-area within an area of a parent tree element on a surface of a planet, and

at a fourth level, each transmedia content data item is represented by a point within the sub-area of the parent tree element on the surface of the three dimensional object.

2. The method of claim 1, wherein the hierarchical structure is a hierarchical tree structure comprising one or more branched time-ordered content links at one or more of the transmedia content items.

3. The method of claim 1, further comprising the following steps:

receiving, via a user input interface of the electronic device, an input command indicative of a zoom request to zoom into an element of the hierarchical structure displayed in the representation; and

rendering, at the electronic device, a second representation by processing the visualization model and the hierarchical structure, in which some or all child elements of the zoomed element of the hierarchical structure are displayed.

4. The method of claim 3, wherein the user input interface is a touch screen display, and wherein the user input is one of:

a gesture, a swipe, a tap, a press, and a hold.

5. The method of claim 3, wherein the user input interface is a pointing device, and wherein the user input is one of:

a scroll or one or more clicks.

6. The method of claim 3, wherein the method further comprises the step of rendering a smooth transition between the first representation and the second representation or a third representation.

7. The method of claim 3, wherein in the first representation one or the first, second or third levels of the layout data are displayed, and wherein in the second representation, a lower level of the layout data is displayed.

8. The method of claim 1, further comprising the following steps:

receiving, via a user input interface of the electronic device, an input command indicative of a zoom request to zoom out of a current element of the hierarchical structure displayed in the representation; and

rendering, at the electronic device, a third representation by processing the visualization model and the hierarchical structure, wherein some or all of the elements at a higher level of the hierarchical structure are displayed in the third representation.

9. The method of claim 8, wherein in the first representation one or the second, third or fourth levels of the layout data are displayed, and wherein in the third representation, a higher level of the layout data is displayed.

10. The method of claim 1, wherein the transmedia content data items relate to narrative elements of the transmedia content data items.

11. The method of claim 10 wherein the time-ordered content links define a narrative order of the transmedia content data items.

12. The method of claim 1, wherein each time-ordered content link defines a directional link from a first transmedia content data item to a second transmedia content data item of the plurality of transmedia content data items.

13. The method of claim 12, wherein the first transmedia content data item has a plurality of outgoing time-ordered content links.

14. The method of claim 12, wherein the second transmedia content data item has a plurality of incoming time-ordered content links.

15. The method of claim 12, wherein the memory is further configured to store a plurality of subset entry points for a plurality of transmedia content subsets.

16. The method of claim 15, wherein each subset entry point is a flag indicating a transmedia content data item that has at least one outgoing time-ordered link and no incoming time-ordered links.

17. The method of claim 16, wherein each linked transmedia content subset defines a linear path, wherein a linear path comprises a subset entry point, one or more transmedia content data items and one or more time ordered links between the subset entry point and the transmedia content data items.

18. The method of claim 17, wherein two or more transmedia content subsets share one or more subset entry points, one or more transmedia content data items and/or one or more time ordered content links.

19. The method of claim 15, wherein, at the lowest level representation of the transmedia content model, one or more subset entry points are displayed.

20. The method of claim 19, further comprising the steps of:

receiving, via a user input interface of the electronic device, an input command indicative of a selection of a subset entry point; and

rendering, at the electronic device, a representation of the one or more linked transmedia content subsets of which the subset entry point is a member.

21. The method of claim 1, further comprising the steps of:

receiving a transmedia content data update, wherein the transmedia content data update contains delta updates with respect to the previously received transmedia content data; and

rendering, at the electronic device, an updated representation of the transmedia content data by processing the transmedia content data update.

22. The method of claim 21, further comprising the steps of:

interpolating a state of the transmedia content data based on previously received transmedia content data and/or transmedia content data updates to generate interpolated transmedia content data; and

rendering, at the electronic device, an interpolated representation of the transmedia content data by processing the interpolated transmedia content data.

23. The method of claim 1, wherein the visualization model is a three-dimensional model representing the transmedia content data items, linked transmedia content subsets and clusters of linked transmedia content subsets in the hierarchical structure.

24. The method of claim 23, wherein the representation of the transmedia content data is a two-dimensional representation of a part of the three-dimensional model.

25. The method of claim 1, wherein each transmedia content data item is a story element.

26. The method of claim 1, further comprising rendering and outputting a chat window containing message data items alongside the first representation, a second representation or a third representation.

27. The method of claim 26, wherein the message data items displayed in the chat window are associated with the level of the hierarchical structure that is displayed in a current currently output representation.

28. The method of claim 27, wherein the message data items that are displayed in the chat window changes when the current output representation changes.

29. A computer-implemented method for sorting and processing a plurality of transmedia content data items, the plurality of transmedia content data items being arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different time-ordered content links therebetween, the method comprising the following steps:

calculating similarity between linked transmedia content subsets;

generating a hierarchical structure of linked transmedia content subsets and clusters of linked transmedia content subsets based on the calculated similarity;

for each linked transmedia content subset and each cluster of transmedia content subsets in the hierarchical structure, generating visual characteristics based on the characteristics of the linked transmedia content subset or cluster of linked transmedia content subsets presented as a visual metaphor, wherein the hierarchical structure is arranged in memory with elements of a lowest level of the hierarchical structure being transmedia content data items, elements of a second-lowest level being linked transmedia content subsets describing time ordered links between the transmedia content data items of child elements, and elements of a third-lowest level being clusters of sufficiently similar linked transmedia content subsets;

generating a visualization model of the transmedia content based on the hierarchical structure and the visual characteristics;

transmitting, to an electronic device, transmedia content data comprising;

the plurality of transmedia content data items,

linking data which define the time-ordered content links between the plurality of transmedia content data items,

the visualization model, wherein layout data for the visualization model is generated such that;

at a first level, grouped clusters of transmedia content subsets are represented as a three-dimensional object,

at a second level, each cluster of linked transmedia content subsets is represented as an area on a surface of the three dimensional object,

at a third level, each linked transmedia content subset is represented by a sub-area within an area of a parent tree element on a surface of a planet, and

at a fourth level, each transmedia content data item is represented by a point within the sub-area of the parent tree element on the surface of the three dimensional object, and

the hierarchical structure.

30. The method of claim 29, wherein the hierarchical structure is a hierarchical tree structure comprising one or more branched time-ordered content links at one or more of the transmedia content items.

31. The method of claim 29, wherein the visualization model comprises a three-dimensional model on which the elements of the hierarchical structure are organized.

32. The method of claim 29 wherein the step of generating a visualization model comprises generating a layout of a three-dimensional model based on characteristics of the transmedia content data items, linked transmedia content subsets and clusters of linked transmedia content subsets in the hierarchical structure.

33. The method of claim 29, further comprising the following steps:

updating the hierarchical structure, visual characteristics and transmedia content model based on changes to one or more of the transmedia content data items and/or one or more of the linked transmedia content subsets;

generating a delta update based on updated structure, transmedia content model, transmedia content data items and/or linked transmedia content subsets; and

transmitting the delta update to the electronic device.

34. An electronic device comprising a memory and processing circuitry, wherein the processing circuitry is configured to perform the steps of:

receiving transmedia content data at the electronic device, the transmedia content data comprising;

a plurality of transmedia content data items;

linking data which define time-ordered content links between the plurality of transmedia content data items, the plurality of transmedia content data items being arranged into linked transmedia content subsets comprising different groups of the transmedia content data items and different content links therebetween;

a visualization model of the transmedia content data; and

a hierarchical structure of the linked transmedia content subsets presented as a visual metaphor, wherein the hierarchical structure is arranged in memory with elements of a lowest level of the hierarchical structure being transmedia content data items, elements of a second-lowest level being linked transmedia content subsets describing time ordered links between the transmedia content data items of child elements, and elements of a third-lowest level being clusters of sufficiently similar linked transmedia content subsets and clusters of linked transmedia content subsets; and

rendering, at the electronic device, a first representation of the transmedia content data by processing the visualization model of the transmedia content data and the hierarchical structure to map some or all of the transmedia content at a first level of the hierarchical structure onto the representation of the transmedia content, wherein layout data for the visualization model is generated such that;

at a first level, grouped clusters of transmedia content subsets are represented as a three-dimensional object,

at a second level, each cluster of linked transmedia content subsets is represented as an area on a surface of the three dimensional object,

at a third level, each linked transmedia content subset is represented by a sub-area within an area of a parent tree element on the surface of a planet, and

at a fourth level, each transmedia content data item is represented by a point within the sub-area of the parent tree element on the surface of the three dimensional object.