INTERACTIVE MULTIMODAL DISPLAY PLATFORM

• US 20170315790A1
• Filed: 01/05/2015
• Published: 11/02/2017
• Est. Priority Date: 01/03/2014
• Status: Active Grant

• Current Assignee: Shadowbox Inc.
• Original Assignee: White Knight Investment Limited (Takeshi Minadani)
• Inventors: Samatov, Jack, Samatov, Lotch
• Granted Patent: US 10,289,390 B2
• Time in Patent Office: Days
• CPC Class Codes: G06F 8/38 for implementing user interfaces
• CPC Class Codes: G06F 8/60 Software deployment
• CPC Class Codes: G06F 8/61 Installation
• CPC Class Codes: G06F 9/451 Execution arrangements for user interfaces

Abstract

An interactive multimodal display platform comprising a rich Internet application (RIA) built on a cross-platform runtime system that allows a user to combine, connect and customize Web-based applications and local, user-created content for display in a multi-view Presentation. Users can open for a quick view any number of files in different formats from their desktops. The multi-view Presentation may include one or more Acts, with each Act containing up to sixteen Pods in the form of a rotatable three-dimensional cube, with each Pod displaying any file type as selected by the user. All Pods may be interactive with all other Pods within a single Act, and any change to a Pod can trigger corresponding changes in other Pods. After the user has created a customized Act, the Act may be saved as a Rich Interactive Content (RIC) desktop file or saved to the cloud and shared with other users.

Claims

1. A method of displaying multimodal content in a multi-view presentation, the method comprising:

establishing connections between a plurality of Web-based files and/or locally-based user-created data files;

selecting a plurality of display files from the plurality of Web-based applications and/or locally-based user-created data files for display together to an end user;

generating a Pod for each selected display file using a template designed for each Pod type;

generating an Act that contains at least one Pod selected by the end user;

connecting all Pods within the Act with all other Pods; and

placing the Act in a Presentation accessible to the end user for editing and display.

2. The method of displaying multimodal content of claim 1, further comprising the steps of:

generating an Act by dragging and dropping files from a desktop computer into the Act;

generating an Act by dragging and dropping regular text with an address or a Web URL into the Act;

generating an Act by dragging and dropping a text file into the Act; and

generating an Act by performing a search across the plurality of Web-based files and/or locally-based user-created data files.

3. The method of displaying multimodal content of claim 2, further comprising the steps of:

accessing a Presentation;

selecting an Act in the Presentation; and

displaying the Act in the form of a three-dimensional (3D) cube with each face of the cube displaying an Act containing at least one Pod.

4. The method of displaying multimodal content of claim 3, where the step of displaying the Act further comprises the step of displaying the Act in a flat two-dimensional (2D) view.

5. The method of displaying multimodal content of claim 4, where the step of editing a Pod of the Act further comprises the steps of:

deleting the Pod from an Act;

moving the Pod within an Act;

moving the Pod from an Act to another Act;

changing the Pod from one Pod type to another Pod type; and

changing the display content of the Pod.

6. The method of displaying multimodal content of claim 1, further comprising the step of communicating between Pods of discrepant types of an Act by exchanging data between the Pods in Extensible Markup Language (XML) or JavaScript Object Notation (JSON) format.

7. The method of displaying multimodal content of claim 3, where the Pod type is selected from a group consisting of a Single Media Pod, a Photo Viewer Pod, a Video Player Pod, a Web Browser Pod, a PowerPoint Pod, a Flash Animation (SWF) Pod, a Chart Pod, an HDFS Viewer Pod, a PDF Pod, a Live Video Streaming Pod, a GoogleMaps Pod, and an Audio Player Pod.

8. An interactive multimodal display platform for providing customizable multi-view presentations to an end user, the interactive multimodal display platform comprising:

a Rich Internet Application (RIA) configured to connect with Web-based applications and locally-based user-created data and display content from the Web-based applications and locally-based user-created data in a single, interactive customizable multi-view display; and

a cross-platform runtime system configured to support the RIA by interfacing between the RIA and the Web-based applications and locally-based user-created data.

9. The interactive multimodal display platform of claim 8, where the cross-platform runtime system comprises Adobe Integrated Runtime (also known as Adobe AIR®

) source code.

10. The interactive multimodal display platform of claim 9, where the RIA is further configured to provide an end user with the capability to:

select a plurality of files from the Web-based applications and/or the locally-based user-created data files;

generate an Act containing at least one Pod selected by the end user, where the at least one Pod contains content from a file of the selected plurality of files; and

display the Act in the single, interactive multi-view display.

11. The interactive multimodal display platform of claim 10, where the display of the Act in the single, interactive multi-view display takes the form of a three-dimensional (3D) cube with each face of the cube displaying an Act containing a file of a Pod.

12. The interactive multimodal display platform of claim 11, where the RIA is further configured to provide an end user with the capability to:

delete a Pod from an Act;

move a Pod within an Act;

move the Pod from an Act to another Act;

change the Pod from one Pod type to another Pod type; and

change the content of the Pod.

13. The interactive multimodal display platform of claim 8, where the RIA is further configured to connect all Pods within an Act with all other Pods of the Act.

14. A method of displaying results of a single-topic search in a multi-view presentation, the method comprising:

establishing connections between a plurality of Web-based data and/or locally-based user-created data files;

simultaneously searching the plurality of Web-based data and/or locally-based user-created data files with the single-topic;

generating an Act that contains a Pod for each single result of the search;

searching local files along with Web search engines with the single-topic;

generating an Act with search results contextually assembled from relative data sets;

connecting all Pods within the Act with all other Pods regardless of their type or source;

placing the Act in a Presentation accessible to an end user for editing and displaying the search results of the search; and

displaying the results of the search in a multi-view presentation.

15. The method of displaying results of a single-topic search of claim 14, where the step of displaying the results of the search further comprises displaying each of the search results in its own window within the multi-view presentation.

16. The method of displaying results of single-topic search of claim 14, further including the steps of:

modifying the search results by dragging and dropping more content from a desktop computer or a Web URL;

customizing, saving, and sharing the search results;

retrieving relative content from the new content added into the search results; and

displaying the results of the new search in a multi-view presentation.

17. The method of displaying results of single-topic search of claim 14, further including the steps of:

reading metadata from media files;

putting a pushpin on a map representing a location; and

connecting locations with location-based data of any Web source if added into an Act with a map showing a location.