Media streams from containers processed by hosted code

• US 10,244,022 B2
• Filed: 07/22/2014
• Issued: 03/26/2019
• Est. Priority Date: 05/12/2008
• Status: Active Grant

• Current Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Original Assignee: Microsoft Technology Licensing LLC (Microsoft Corporation)
• Inventors: George, Sam J, Khouzam, Gilles, Harsh, Michael R, Virdi, Gurpratap, Gossman, John, Hillberg, Michael John, Schechler, Greg D, Karlov, Donald D, Musayev, Eldar A, Zhang, Wenbo, Smimov, Serge, Schliemann, Federico, Olson, Lawrence Wayne, Johar, Akshay
• Primary Examiner(s): Arani, Taghi
• Assistant Examiner(s): Lane, Gregory
• Application Number:
  US14/338,321
• Publication Number:
  US 20140337433A1
• Time in Patent Office: 1,708 Days
• Field of Search: 726 21, 434350
• CPC Class Codes: G06F 16/44 Browsing; Visualisation therefor
• CPC Class Codes: G06F 9/54 Interprogram communication
• CPC Class Codes: H04L 65/60 Network streaming of media packets

Abstract

Described is a technology by which code, such as an untrusted web application hosted in a browser, provides content through an interface for playback by an application environment, such as an application environment running in a browser plug-in. Content may be in the form of elementary video, audio and/or script streams. The content is in a container that is unpackaged by the application code, whereby the content may be packaged in any format that the application understands, and/or or come from any source from which the application can download the container. An application environment component such as a platform-level media element receives information from an application that informs the application environment that the application is to provide media stream data for playback. The application environment requests media stream data (e.g., samples) from the application, receives them as processed by the application, and provides the requested media stream data for playback.

Claims

1. In a computing environment, a method comprising:

receiving information from untrusted application-level code that informs an application environment that the untrusted application-level code is to provide processed media stream data for playback, the untrusted application-level code being code that communicates through application programming interface calls to a platform level;

requesting at least some of the processed media stream data from the untrusted application-level code;

receiving, by the platform level, the at least some of the processed media stream data from the untrusted application-level code as processed by the untrusted application-level code from a container associated with the untrusted application-level code, the container having a format that is not supported by the platform level; and

providing the received processed media stream data to a media pipeline for playback at the platform level.

2. The method of claim 1, wherein the untrusted application-level code comprises an application level component, and wherein receiving the information comprises receiving an application program interface (API) call from the application level component to the platform level.

3. The method of claim 1, wherein receiving the information comprises receiving a communication from the untrusted application-level code that informs the application environment of media stream data availability.

4. The method of claim 1 further comprising:

repeatedly requesting at least some other media stream data from the untrusted application-level code until detecting an event.

5. The method of claim 1 further comprising:

repeatedly requesting at least some other media stream data from the untrusted application-level code until information is received from the untrusted application-level code that informs the application environment that the media stream data is exhausted.

6. The method of claim 1 further comprising:

repeatedly requesting at least some other media stream data from the untrusted application-level code until information is received from the untrusted application-level code that informs the application environment of a seek operation.

7. The method of claim 1 further comprising:

communicating information from the untrusted application-level code to the application environment that informs the application environment of an error encountered by the untrusted application-level code.

8. The method of claim 1 further comprising:

communicating information from the application environment to the untrusted application-level code that informs the untrusted application-level code of an error encountered by the application environment.

9. The method of claim 1 further comprising:

communicating information between the application environment and the untrusted application-level code indicating that a license for playing protected media data is required.

10. The method of claim 1 further comprising:

communicating information between the application environment and the untrusted application-level code indicating that a license for playing protected media data is required; and

communicating information from the untrusted application-level code to the application environment that provides the license for playing the protected media data, including any needed decryption data.

11. In a computing environment, a system comprising:

at least one processor;

a memory, communicatively coupled to the at least one processor;

an application environment including a platform level implemented at least in part on the at least one processor; and

an application programming interface set configured to couple untrusted application-level code to the platform level, the untrusted application-level code configured to process a content container, including unpacking content from the container to provide at least some of the content to the platform level via communication with the application environment through application programming interface calls, the container having a format that is not supported by the platform level.

12. The system of claim 11 wherein the content comprises media arranged as stream data, and wherein the untrusted application-level code instantiates a media stream source component from an instance of an abstract class.

13. The system of claim 11 wherein the content comprises media arranged as stream data, and wherein the platform level comprises a media element.

14. The system of claim 11 wherein the content comprises media arranged as stream data, and wherein the platform level requests samples of media from the untrusted application-level code.

15. The system of claim 11 wherein the untrusted application-level code downloads the container.

19. The system of claim 11, wherein the application programming interface communicates information between the application environment and the untrusted application-level code indicating that a license for playing protected media data is required.

16. A computer-readable storage device having computer-executable instructions stored thereon, which in response to execution by a computer, cause the computer to perform operations comprising:

enabling untrusted code to download and unpack a container comprising media content in a format understood by the untrusted code, the untrusted code being code that communicates through application programming interface calls to a platform level, the container having a format that is not supported by the platform level;

sending, from the platform level, a request for samples of the media content through a set of application programming interfaces to the untrusted code;

receiving, by the platform level, the samples of the media content from the untrusted code in response to the request; and

providing the samples of the media content to a media pipeline for playback.

17. The computer-readable storage device of claim 16 having further computer-executable instructions comprising:

communicating with the untrusted code, including receiving a notification of a desired seek operation, stop operation, pause operation, resume operation or an error, and in response, requesting that the untrusted code perform an action corresponding to the received notification.

18. The computer-readable storage device of claim 16 having further computer-executable instructions comprising:

requesting that the untrusted code open media prior to requesting the samples, receiving information from the untrusted code after receiving at least one sample that indicates that no further samples are available, and requesting that the untrusted code close the media.

20. The computer-readable storage device of claim 16 having further computer-executable instructions comprising:

communicating information from the untrusted code to an application environment that provides a license for playing protected media content, including any needed decryption data.