Real-time network transport protocol interface method and apparatus
First Claim
1. A multimedia-enabled device having a multimedia framework including an integration layer and a higher-level OpenMAX application layer, the integration layer of the multimedia framework comprising:
- a plurality of OpenMAX-compliant predefined media processing components having an input/output interface configurable based on the type and format of media content delivered to the multimedia-enabled device during a streaming media session which is established responsive to the OpenMAX application layer requesting delivery of the media content in a real-time network transport protocol format, the predefined media processing components operable to provide predefined media processing functions to the OpenMAX application layer via the integration layer for enabling playback of the media content; and
an OpenMAX-compliant streaming media management component operable to;
provide an interface between the integration layer and the OpenMAX application layer so that the OpenMAX application layer has access to the predefined media processing components;
establish and manage the streaming media session;
configure one or more content pipes used during the streaming media session to access packets received by one or more sockets, the packets being encapsulated according to a real-time network transport protocol;
map the one or more content pipes to the one or more sockets; and
provide a common boundary between the content pipes and the predefined media processing components for seamlessly handling the media content delivered to the electronic device in the real-time network transport protocol format, including processing of packets retrieved from the one or more content pipes such that the media content is provided to corresponding ones of the predefined media processing components in accordance with their configured input/output interfaces;
wherein the streaming media management component comprises a first processing component operable to;
configure the one or more content pipes based on the type and format of the media content and the real-time network transport protocol used to deliver the media content;
convert synchronization information delivered to the multimedia-enabled device and timestamps extracted from the packets to new timestamp information compatible with the corresponding ones of the predefined media processing components; and
extract data from the packets in proper order with the new timestamp information; and
wherein the streaming media management component comprises a second processing component operable to;
convert the extracted data to coded media frame data based on the type and format of the media content and the real-time network transport protocol used to transmit the media content; and
output the coded media frame data in a format compatible with the configured input/output interfaces of the corresponding ones of the predefined media processing components.
2 Assignments
0 Petitions
Accused Products
Abstract
An electronic device has a multimedia framework including an integration layer and a higher-level application layer. The integration layer includes predefined media processing components having an input/output interface configurable based on the type and format of media content delivered to the device during a streaming media session and that provide predefined media processing functions to the application layer for enabling playback of the media content. A streaming media management component included in the integration layer establishes and manages the streaming media session and configures one or more content pipes used during the streaming media session to access packets received by one or more sockets. The component also maps the content pipes to the sockets and processes packets retrieved from the one or more content pipes such that the media content is provided to corresponding ones of the predefined media processing components in accordance with their configured input/output interfaces.
-
Citations
21 Claims
-
1. A multimedia-enabled device having a multimedia framework including an integration layer and a higher-level OpenMAX application layer, the integration layer of the multimedia framework comprising:
-
a plurality of OpenMAX-compliant predefined media processing components having an input/output interface configurable based on the type and format of media content delivered to the multimedia-enabled device during a streaming media session which is established responsive to the OpenMAX application layer requesting delivery of the media content in a real-time network transport protocol format, the predefined media processing components operable to provide predefined media processing functions to the OpenMAX application layer via the integration layer for enabling playback of the media content; and an OpenMAX-compliant streaming media management component operable to; provide an interface between the integration layer and the OpenMAX application layer so that the OpenMAX application layer has access to the predefined media processing components; establish and manage the streaming media session; configure one or more content pipes used during the streaming media session to access packets received by one or more sockets, the packets being encapsulated according to a real-time network transport protocol; map the one or more content pipes to the one or more sockets; and provide a common boundary between the content pipes and the predefined media processing components for seamlessly handling the media content delivered to the electronic device in the real-time network transport protocol format, including processing of packets retrieved from the one or more content pipes such that the media content is provided to corresponding ones of the predefined media processing components in accordance with their configured input/output interfaces; wherein the streaming media management component comprises a first processing component operable to; configure the one or more content pipes based on the type and format of the media content and the real-time network transport protocol used to deliver the media content; convert synchronization information delivered to the multimedia-enabled device and timestamps extracted from the packets to new timestamp information compatible with the corresponding ones of the predefined media processing components; and extract data from the packets in proper order with the new timestamp information; and wherein the streaming media management component comprises a second processing component operable to; convert the extracted data to coded media frame data based on the type and format of the media content and the real-time network transport protocol used to transmit the media content; and output the coded media frame data in a format compatible with the configured input/output interfaces of the corresponding ones of the predefined media processing components. - View Dependent Claims (2, 3, 4, 5, 6, 7, 8, 9, 10, 11)
-
-
12. In a multimedia-enabled device having a multimedia framework including an integration layer and a higher-level OpenMAX application layer, the integration layer of the multimedia framework having a plurality of OpenMAX-compliant predefined media processing components with input/output interfaces configurable based on the type and format of media content delivered to the multimedia-enabled device during a streaming media session which is established responsive to the OpenMAX application layer requesting delivery of the media content in a real-time network transport protocol format, the predefined media processing components operable to provide predefined media processing functions to the OpenMAX application layer for enabling playback of the media content, the method comprising, within the integration layer:
-
providing an interface between the integration layer and the OpenMAX application layer so that the OpenMAX application layer has access to the predefined media processing components; establishing and managing the streaming media session; configuring one or more content pipes used during the streaming media session to access packets received by one or more sockets based on the type and format of the media content and a real-time network transport protocol used to deliver the media content; mapping the one or more content pipes to the one or more sockets; providing a common boundary between the content pipes and the predefined media processing components for seamlessly handling the media content delivered to the multimedia-enabled device in the real-time network transport protocol format, including processing packets extracted from the one or more content pipes such that the media content is provided to corresponding ones of the predefined media processing components in accordance with their configured input/output interfaces; converting synchronization information delivered to the multimedia-enabled device and timestamps extracted from the packets to new timestamp information compatible with the corresponding ones of the predefined media processing components; converting the packets to coded media frame data based on the type and format of the media content and the real-time network transport protocol used to transmit the media content; and providing the coded media frame data in a format compatible with the configured input/output interfaces of the corresponding ones of the predefined media processing components. - View Dependent Claims (13, 14, 15, 16, 17, 18, 19, 20, 21)
-
Specification