Layered interactive video platform for interactive video experiences

• US 9,837,124 B2
• Filed: 06/30/2015
• Issued: 12/05/2017
• Est. Priority Date: 06/30/2015
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: Wolfkill, Kiki, Saretto, Cesare John, Chosich, Daniel J., Hau, Tony, Callens, Adam S., Lemon, Sandra Jolly, McKay, Duncan James, Roberts, Jesse Paul, Gerhardt, Michael Raymond
• Primary Examiner(s): Dang, Hung
• Assistant Examiner(s): Wendmagegn, Girumsew
• Application Number:
  US14/788,262
• Publication Number:
  US 20170004861A1
• Time in Patent Office: 889 Days
• Field of Search: 386278
• CPC Class Codes: G11B 27/036 Insert-editing
• CPC Class Codes: H04N 21/2181 comprising remotely distributed storage units, e.g. when movies are replicated over a plurality of video servers distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS], H04L67/1097
• CPC Class Codes: H04N 21/2187 Live feed
• CPC Class Codes: H04N 21/2353 specifically adapted to content descriptors, e.g. coding, compressing or processing of metadata
• CPC Class Codes: H04N 21/2665 Gathering content from different sources, e.g. Internet and satellite
• CPC Class Codes: H04N 21/2668 Creating a channel for a dedicated end-user group, e.g. insertion of targeted commercials based on end-user profiles information retrieval from the Internet by querying with filtering and personalisation G06F16/9535; arrangements for replacing or switching information during the broadcast H04H20/10; push services over packet-switching network H04L12/1859; adaptation of message content in packet-switching networks H04L51/063
• CPC Class Codes: H04N 21/43074 of additional data with content streams on the same device, e.g. of EPG data or interactive icon with a TV program
• CPC Class Codes: H04N 21/4622 Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet web site content organization and management for information retrieval from the Internet G06F16/958; transmission by internet of broadcast information H04H60/82; stock exchange data over packet-switching network H04L12/1804; push services including data channel over packet-switching network H04L12/1859
• CPC Class Codes: H04N 21/4722 for requesting additional data associated with the content
• CPC Class Codes: H04N 21/4788 communicating with other users, e.g. chatting arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104
• CPC Class Codes: H04N 21/8146 involving graphical data, e.g. 3D object, 2D graphics
• CPC Class Codes: H04N 21/854 Content authoring
• CPC Class Codes: H04N 21/8545 for generating interactive applications
• CPC Class Codes: H04N 21/8547 involving timestamps for synchronizing content
• CPC Class Codes: H04N 5/9305 involving the mixing of the reproduced video signal with a non-recorded signal, e.g. a text signal

Abstract

In various embodiments, methods and systems for generating interactive videos based on a layered interactive video platform are provided. An interactive graphics track is received using a layered video platform that supports interactive graphics tracks functionality on interactivity content editor components, content management components, and interactivity components on end-user media devices. The interactive graphics track comprises interactivity instructions that initialize cloud-based interactivity services. An interactivity content editor component can be used to generate interactive graphics tracks and develop interactivity instructions for composing the interactive graphics elements. Composing the interactive graphics elements is based on executing the interactivity instructions that define features of the interactive graphics elements. Composing the interactive graphics elements comprises accessing cloud-based interactivity services corresponding to the interactivity instructions. The interactive graphics tracks can be maintained separately from the video content. The interactive graphics elements are supported using the cloud-based interactivity services and layered over the video content.

Claims

1. A system for generating interactive videos based on layered interactive video platforms, the system comprising:

an interactivity content editor component configured for;

accessing video content;

generating interactivity instructions based on a layered interactive video platform, wherein the layered video platform supports communicating interactive graphics tracks between interactive content editor components, cloud interactivity components, and client interactivity components, wherein the interactivity instructions initialize integrated cloud-based interactivity services based on interactive graphics elements in interactive graphics tracks;

generating an interactive graphics track, wherein the interactive graphics track comprises the interactive graphics elements, the interactive graphic elements programmatically defined for dynamic composition based on interactivity instructions that define features of the interactive graphics elements; and

communicating the interactive graphics track;

a content management component configured for;

communicating interactivity content to an integrated development environment for generating an interactive graphics tracks, wherein interactivity content comprises cloud-based interactivity services resources that support interactive functionality;

receiving the interactive graphics track having interactivity instructions that initialize integrated cloud-based interactivity services; and

communicating the interactive graphics track such that the interactive graphics elements are composed based on executing the interactivity instructions; and

an interactivity component configured for;

receiving the interactive graphics track comprising interactivity instructions that initialize integrated cloud-based interactivity services, wherein the interactive graphics track is one of a plurality of interactive graphics tracks for the video content, wherein specific functionality associated with the video content is embedded in a corresponding interactive graphics track classified for the specific functionality;

composing interactive graphics elements based on executing the interactivity instructions that define features of the interactive graphics elements, wherein composing the interactive graphics elements comprises accessing cloud-based interactivity services corresponding to the interactivity instructions; and

layering over the video content the interactive graphics elements supported using the cloud-based interactivity services.

2. The system of claim 1, wherein accessing the video content comprises identifying interactivity metadata, wherein the interactive graphics track comprises interactivity instructions that define placeholders associated with interactivity metadata such that upon retrieving interactivity metadata the interactivity instructions are executed based on the retrieved interactivity metadata, wherein the interactivity metadata corresponds to metadata of the video content.

3. The system of claim 1, wherein the interactive content editor component is further configured for:

accessing the integrated development environment comprising comprehensive facilities for generating an interactive graphics track, wherein generating the interactive graphics track comprises referencing from an interactivity services component, one or more of the following;

a cloud-based interactivity service resource that is programmatically defined in the interactivity instructions, wherein a corresponding cloud-based interactivity service is initialized when the interactive instructions are executed, the cloud-based interactivity service is associated with interactive graphics elements;

a display prioritization resource that programmatically prioritizes specific layers and input focus of interactive graphics elements; and

an interactivity instructions template resource that programmatically defines pre-built features that are associated with customizable cloud-based interactivity services and interactive graphic elements.

4. The system of claim 3, wherein the interactive content editor component is configured for providing an interface for:

identifying metadata associated with the video content;

constructing the interactive graphics elements corresponding to the cloud-based interactivity services, the display prioritization resource and the interactivity instructions templates based on the metadata; and

generating the interactive graphics track based on the interactive graphic elements.

5. The system of claim 3, wherein the cloud-based interactivity services resource is a localization service resource that adapts interactive graphics tracks based on interactivity instructions to generate localized interactive graphical elements.

6. The system of claim 1, wherein interactive graphics tracks and cloud-based interactivity services are implemented based on an interactivity context comprising user input, active video content, and corresponding metadata.

7. The system of claim 1, wherein the interactive graphics track comprises interactive graphical elements that correspond to functionality of social networking services, wherein performing interactive operations that correspond to the functionality is based on receiving input directed at the functionality of the social networking service.

8. A computer-implemented method for generating interactive videos based on layered interactive video platforms, the method comprising:

communicating interactivity content to an integrated development environment for generating an interactive graphics tracks for video content, wherein interactivity content comprises cloud-based interactivity services resources that support interactive functionality, wherein the cloud-based interactivity services comprise a collection of cloud-based interactivity applications that are dynamically integrated into the video content using interactive graphics elements;

receiving an interactive graphics track having interactivity instructions that initialize integrated cloud-based interactivity services, wherein the interactive graphics track is one of a plurality of interactive graphics tracks for the video content, wherein specific functionality associated with the video content is embedded in a corresponding interactive graphics track classified for the specific functionality, wherein the interactive graphics track is received using a layered video platform that supports communicating interactive graphics tracks between interactive content editor components, cloud interactivity components, and client interactivity components, wherein the interactive graphics track is generated based on accessing the integrated development environment comprising comprehensive facilities for generating the interactive graphics track; and

communicating the interactive graphics track independently of the video content such that interactive graphics elements are composed based on executing the interactivity instructions that define features of the interactive graphics elements, wherein composing the interactive graphics elements comprises accessing cloud-based interactivity services corresponding to the interactivity instructions.

9. The method of claim 8, wherein the video content is a live broadcast that is associated with the interactivity instructions in near real-time, wherein the live broadcast video track and the interactive graphics track are communicated to a plurality of different types media devices for composition and display or wherein the video content is pre-recorded video content, and wherein the pre-recorded video content and the interactive graphics track are stored in a content management component and communicated in parallel upon receiving a request from a media device.

10. The method of claim 8, wherein the interactive graphics track comprises interactivity instructions that define placeholders associated with interactivity metadata such that upon retrieving interactivity metadata the interactivity instructions are executed based on the retrieved interactivity metadata, wherein the interactivity metadata corresponds to metadata of the video content.

11. The method of claim 8, wherein the interactive graphics track is associated with a secondary video track, wherein the secondary video track is a branching video track or a picture-in-picture interactivity graphics element that when triggered, based on the interactivity instructions, operates with the interactive graphics track to provide interactive functionality.

12. The method of claim 8, wherein the specific functionality is selected from one of the following:

social media functionality, static widget functionality, storyline functionality, and dynamic widget functionality.

13. One or more computer storage media having computer-executable instructions embodied thereon that, when executed by one or more processors, cause the one or more processors to perform a method of generating interactive videos based on layered interactive video platforms, the method comprising

receiving an interactive graphics track comprising interactivity instructions for video content, the interactivity instructions initialize integrated cloud-based interactivity services, wherein the interactive graphics track is one of a plurality of interactive graphics tracks for the video content, wherein specific functionality associated with the video content is embedded in a corresponding interactive graphics track classified for the specific functionality, wherein the interactive graphics track is received using a layered video platform that supports communicating interactive graphics tracks between interactive content editor components, cloud interactivity components, and client interactivity components;

composing interactive graphics elements based on executing the interactivity instructions that define features of the interactive graphics elements, wherein composing the interactive graphics elements comprises accessing cloud-based interactivity services corresponding to the interactivity instructions; and

layering over the video content the interactive graphics elements supported using the cloud-based interactivity services.

14. The media of claim 13, wherein composing the interactive graphics elements comprises:

referencing the metadata of the corresponding video content in the interactive graphics track;

using the metadata, identifying video content elements that are associated with interactive graphics elements; and

providing the video content elements and the interactive graphics elements to implement the features defined for the interactive graphics elements.

15. The media of claim 13, wherein the interactivity instructions embedded in the interactive graphics track support initializing the cloud-based interactivity services that operate to exchange data and commands between a media device and cloud interactivity components for the cloud-based interactive applications.

16. The media of claim 13, wherein the layered interactive platform is implemented using presentation layer components for communications to support the layered interactive platform functionality.

17. The media of claim 13, further comprising:

receiving an input associated with an interactive graphics element;

referencing a feature defined for the interactive graphics element, wherein the feature is associated with interactivity instructions; and

implementing the feature of the interactive graphics element based at least in part on the interactivity instructions.

18. The media of claim 17, wherein implementing the feature further comprises launching a cloud-based interactivity service application at a media device, wherein launching the cloud-based interactivity service application is indicated in the interactivity instructions, wherein the cloud-based interactivity service application is a social networking service, wherein launching the social networking service comprises accessing one or more external resources.

19. The media of claim 13, wherein the interactive graphics track comprises interactivity instructions that define placeholders associated with interactivity metadata such that upon retrieving interactivity metadata the interactivity instructions are executed based on the retrieved interactivity metadata, wherein the interactivity metadata corresponds to metadata of the video content.

20. The media of claim 13, wherein the specific functionality is selected from one of the following:

social media functionality, static widget functionality, storyline functionality, and dynamic widget functionality.