System, method and engine for playing SMIL based multimedia contents

• US 8,019,894 B2
• Filed: 04/25/2006
• Issued: 09/13/2011
• Est. Priority Date: 04/27/2005
• Status: Expired due to Fees

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Lin, Jian, Zhou, Yu Chen, Zhang, Rong Sheng
• Primary Examiner(s): Vaughn, Jr.; William C
• Assistant Examiner(s): Ibrahim; Mohamed
• Application Number:
  US11/912,409
• Publication Number:
  US 20080250130A1
• Time in Patent Office: 1,967 Days
• Field of Search: 709/225, 709231-235, 709/246
• US Class Current: 709/246
• CPC Class Codes: H04L 65/1101 Session protocols
• CPC Class Codes: H04L 65/765 intermediate

Abstract

A system for playing SMIL based multimedia contents, comprising: a plurality of SMIL engines for analyzing and interpreting SMIL documents, as well as communicating with and controlling SMIL sub engines, remote media proxies, or local media playing devices; a plurality of remote media proxies for receiving instructions from the upper level SMIL engines, starting or stopping providing media objects to the remote media playing devices, sending back events, and providing basic user interaction capabilities, wherein said a plurality of SMIL engines, a plurality of remote media proxies, and local and remote media playing devices construct a tree-link structure, of which the root node is a SMIL engine, the branch nodes are SMIL engines and remote media proxies, and the leaf nodes are local and remote media playing devices. The corresponding SMIL engines and methods are also provided. The present invention enables the playing of SMIL based multimedia contents on a set of PvC devices, which can be dynamically configured as a new multimedia terminal on demand.

Claims

1. A system for playing SMIL based multimedia content, wherein said system comprises:

a plurality of SMIL engines constructed in a hierarchical structure comprising a root SMIL engine and a set of child SMIL engines, each having the root SMIL engine as a parent, wherein each of the SMIL engines executes within a separate computing device, wherein each of the plurality SMIL engines are able to analyze and interpret SMIL documents or parts of a SMIL document, wherein said root engine is configured to analyze and decompose a SMIL document into a plurality of sub SMIL documents having an aggregate functionality of the SMIL document, wherein each of the sub SMIL documents are distributed among the set of child SMIL engines, wherein each of the child SMIL engines is configured to interpret the received sub SMIL documents and manage timing and events as specified within the sub SMIL documents, wherein each of the child SMIL engines directly controls a media playing device, wherein a plurality of media playing devices controlled by the child SMIL engines aggregately interact in accordance with the SMIL document that was analyzed and decomposed by the root SMIL engine, wherein the root SMIL engine comprises;

a media device registry for registering one or more media devices controlled by said root SMIL engine;

a SMIL parser for, based on the analysis of the SMIL document and acquired information on media interaction capabilities of the controlled media devices, generating a set of SMIL models, distributing the set of SMIL models to different ones of the child SMIL engines;

a SMIL interpreter for interpreting and executing the playing logic of the SMIL document, triggering child SMIL engines to play the media contents and controlling interaction with a user; and

a remote event proxy for maintaining a mapping table that contains the relationships for the SMIL models distributed to the child SMIL engines.

2. The system according to claim 1, wherein the media devices controlled by said root SMIL engine comprises:

child SMIL engines, which support a subset of SMIL defined media interaction capabilities and register respective media interaction capabilities and location information in said media device registry when the system starts up.

3. The system according to claim 1, wherein at least a portion of the SMIL models comprises a time container that contains multimedia contents distributed to one of the child SMIL engines and a media object distributed to a remote media proxy;

and said SMIL model is a time container executable on a SMIL interpreter of one of the child SMIL engines.

4. The system according to claim 1, wherein each media playing device controlled by a child SMIL engine comprises:

a media playing controller for driving a media player according to the triggering mechanism of said controlling child SMIL engine, and acquiring media contents to be played; and

a media player for playing media contents.

5. The system according to claim 1, wherein said remote proxy is responsive for timing events, document object model events, user interaction events, and internal events related to the SMIL document.

6. The system according to claim 1, wherein each media playing devices is a pervasive computing device.

7. The system of claim 1, wherein each of the sub SMIL documents are able to be handled using fewer computing resource than an amount of computing resource that would be required to handle the SMIL document.

8. The system of claim 1, wherein an SMIL interpreter of each child SMIL engine is configured to interpret playing logic of the sub SMIL document, to invoke playing of media content to one of the media playing devices that the child SMIL engine controls, and to control interactions with a user of the media playing device that the child SMIL engine controls.

9. The system of claim 1, further comprising:

a mapping table, which contains the timing relationships between the sub SMIL documents in accordance with the SMIL document, which is used to maintain timing relationships among the child SMIL engines in accordance with the SMIL document.

10. A system for playing SMIL based multimedia contents, comprising:

a plurality of SMIL engines for analyzing and interpreting SMIL documents, as well as communicating with and controlling next level SMIL engines, remote media proxies, or local media playing devices;

a plurality of remote media proxies for receiving instructions from upper level SMIL engines, starting or stopping providing media objects to the remote media playing devices, sending back events, and providing basic user interaction capabilities, wherein

said a plurality of SMIL engines, a plurality of remote media proxies, and local and remote media playing devices construct a tree-link structure, of which the root node is a SMIL engine, the branch nodes are SMIL engines and remote media proxies, and the leaf nodes are local media playing devices and remote media playing devices, wherein each of said remote media proxies determines which media objects to be provided according to the capabilities of the remote media playing devices;

if a remote media playing device cannot access any media server, the provided media object contains media contents to be played; and

if the remote playing device can access a media server, the provided media object contains the address of the media server for acquiring media contents.

11. The system according to claim 10, wherein said local media playing devices and remote media playing devices are pervasive computing devices.

12. A method for playing SMIL based multimedia content comprising the following steps:

analyzing, with a SMIL engine, a SMIL document and acquiring information on the media interaction capabilities of the media devices controlled by said SMIL engine;

based on the acquired information on the media interaction capabilities, with said SMIL engine, generating intermediate SMIL models, distributing the intermediate SMIL models to next level SMIL engines and/or remote media proxies and generating corresponding local proxy objects; and

/or generating internal SMIL models to be deployed on a local SMIL interpreter;

updating a mapping table, which records the relationships between said local proxy objects and the intermediate SMIL models distributed to the next level SMIL engine and the remote media proxies;

proceeding with above-mentioned steps recursively till the last level SMIL engines with the next level SMIL engines;

interpreting respectively the received intermediate SMIL models and generating internal SMIL models with each said SMIL engine; and

starting up the remote media playing devices and/or local media playing devices to play media contents according to time and events, wherein said starting up remote media playing devices to play media contents comprises;

the remote media proxies determine whether it is needed to acquire media contents to be played according to the capabilities of the controlled remote media playing devices;

if so, the media contents to be played are acquired by the remote media proxies and provided to the remote media playing devices for playing;

if not, corresponding media links or descriptors are provided to the remote media playing devices, which acquire and play media contents to be played.

13. The method according to claim 12, wherein the media devices controlled by said SMIL engine comprises:

next level SMIL engines, remote media proxies, and local media playing devices, all of which support a subset of SMIL defined media interaction capabilities.

14. The method according to claim 12, wherein said intermediate SMIL model comprises a time container that contains multimedia contents distributed to a next level SMIL engine, and a media object distributed to a remote media proxy;

said internal SMIL model is a time container executable locally, comprising the control logic of the present level SMIL model and the media object distributed to a local media playing device.

15. The method according to claim 12, wherein said events comprise:

timing events, document object model events, user interaction events, and internal events.

16. The method according to claim 12, wherein said step for starting up local media playing devices to play media contents comprises:

the local media playing devices acquire media contents from corresponding media servers based on the definitions of the received media objects and play the media contents.

17. The method according to claim 12, wherein said local media playing devices and remote media playing devices are pervasive computing devices.