Flexible and scalable software system architecture for implementing multimedia applications

• US 9,026,983 B2
• Filed: 03/15/2013
• Issued: 05/05/2015
• Est. Priority Date: 03/15/2013
• Status: Active Grant

• Current Assignee: Ittiam Systems Pte Ltd
• Original Assignee: Ittiam Systems Pte Ltd
• Inventors: Gupta, Puneet, Prabhakar, Sheela, Nataraj, Nitin, Iyenggar, Ashwin
• Primary Examiner(s): Das, Chameli
• Application Number:
  US13/831,966
• Publication Number:
  US 20140282351A1
• Time in Patent Office: 781 Days
• Field of Search: None
• US Class Current: 717/100
• CPC Class Codes: G06F 8/00 Arrangements for software engineering testing or debugging G06F11/36; administrative, planning or organisation aspects of software project management G06Q10/06
• CPC Class Codes: G06F 8/30 Creation or generation of source code

Abstract

A flexible and scalable software system architecture for implementing multimedia applications is disclosed. In one embodiment, the flexible and scalable software system architecture includes a platform abstraction layer (PAL), a device policy manager (DPM), a media engine, a library of commons (LoC) module, system management toolsets (SMT), one or more application services, an application control unit (ACU) and a user interface transaction layer (UITL). Further, the media engine is communicatively coupled between the PAL and the ACU, the LoC module is communicatively coupled to the ACU, the DPM, the media engine, the SMT, the PAL and the UITL, the DPM is communicatively coupled to the PAL, the ACU and the media engine, the ACU is coupled between media engine and the UITL, and the SMT is communicatively coupled to the ACU, the DPM, the media engine, the LoC module, the PAL and the UITL.

Claims

1. A multimedia system comprising:

a processor; and

memory operatively coupled to the processor, wherein the memory comprises a flexible and scalable software system architecture for building multimedia applications, the flexible and scalable software system architecture comprising;

a platform abstraction layer (PAL) operatively coupled to an operating system (OS) and a board support package (BSP) for ensuring platform portability and ease of software integration across platforms;

a device policy manager (DPM) for allowing simultaneous access of physical devices and peripherals to different applications and/or users within a single application;

a media engine for providing media related processing, handling, protocol compliance and signaling functionality;

a library of commons (LoC) module for providing common functions needed by other modules in one centralized place;

system management toolsets (SMT) for providing functionalities related to resource monitoring, exception and event management, logging and collecting statistics from the other modules;

one or more application services for providing a highlevel functionality that integrate features or functionality from one or more of the media engine, the DPM, the SMT, and the PAL into a logically integrated usage by an end user;

an application control unit (ACU) for providing a standard framework to control, interface and configure the one or more application services; and

a user interface transaction layer (UITL) for abstracting the usage of different types of user interfaces to access the functionality provided by the media engine, wherein the media engine is coupled between the PAL and the ACU, wherein the LoC module is coupled to the ACU, the DPM, the media engine, the SMT, the PAL and the UITL, wherein the DPM is coupled to the PAL, the ACU and the media engine, wherein the ACU is coupled between media engine and the UITL, and wherein the SMT is coupled to the ACU, the DPM, the media engine, the LoC module, the PAL and the UITL, wherein a subset of elements are selected from the flexible and scalable software system architecture to build the multimedia applications.

2. The architecture of claim 1, wherein the media engine comprises:

a network protocol stack (NPS) for encompassing all network protocols and stacks needed for implementing standard compliant networking protocols for a networked multimedia system;

media processing component libraries (MPCLs) for encompassing all media processing algorithms to be used by the other modules in the flexible and scalable software system;

a media subsystem (MSS) to realize source-to-sink flow of media data by integrating one or more algorithms from the MPCLs, the DPM and the NPS; and

signaling subsystem (SSS) for implementing state machines for media sessions and session management for interacting with a local or remote networked devices to/from which the flexible and scalable software system streams media or interacts with.

3. The architecture of claim 2, wherein the MSS comprises:

a media pipelines array (MPA) for realizing preset source-to-sink flow of media data, wherein each of the preset source-to-sink flow of media data is referred to as a media pipeline; and

a pipeline framework for providing standardized mechanisms and interfaces to implement media processing elements within each media pipeline.

4. The architecture of claim 1, wherein the SMT comprises:

a logging framework for allowing the modules in the flexible and scalable software system architecture to log traces for diagnostic and informational purposes;

an exception and event manager (EEM) for providing a standardized framework for the modules in the flexible and scalable software system architecture to identify, report, log and handle exceptions and events;

a statistics collection module (SCM) for providing a standardized framework to the modules in the flexible and scalable software system architecture for collecting and reporting statistics related to their operations;

a resource monitor (RMon) for tracking of resource utilization across all processes and threads that are running as part of the flexible and scalable software system architecture; and

a health monitor that interacts with the SCM, the EEM and the RMon to gather information on the current operational status of the modules in the flexible and scalable software system and assesses the overall health of the flexible and scalable software system based on pre-defined rules.

5. The architecture of claim 1, wherein the ACU comprises:

an application services manager (ASM) for monitoring, interfacing and managing co-existence of all application services as per a defined set of rules of a system framework;

a configuration manager (CM) for managing a user configuration for all application features and ensures that all software entities are synchronized with a centralized configuration pool;

a command dispatcher (DP) for ensuring user actions from a user interface are routed to an associated application service; and

an event handler (EH) for managing exceptions or events that are not handled by lower entities in the flexible and scalable software system.

6. A multimedia device, comprising:

a processor; and

memory operatively coupled to the processor, wherein the memory having disposed in it a flexible and scalable system software architecture for building a multimedia application, the flexible and scalable system software architecture comprises;

a platform abstraction layer (PAL) operatively coupled to an operating system (OS) and a board support package (BSP) for ensuring platform portability and ease of software integration across platforms;

a device policy manager (DPM) for allowing simultaneous access of physical devices and peripherals to different applications and/or users within a single application;

a media engine for providing media related processing, handling, protocol compliance and signaling functionality;

a library of commons (LoC) module for providing common functions needed by other modules in one centralized place;

system management toolsets (SMT) for providing functionalities related to resource monitoring, exception, and event management, logging and collecting statistics from the other modules;

one or more application services for providing a highlevel functionality that integrate features or functionality from one or more of the media engine, the DPM, the SMT, and the PAL into a logically integrated usage by an end user;

an application control unit (ACU) for providing a standard framework to control, interface and configure the one or more application services; and

a user interface transaction layer (UITL) for abstracting the usage of different types of user interfaces to access the functionality provided by the media engine, wherein the media engine is coupled between the PAL and the ACU, wherein the LoC module is coupled to the ACU, the DPM, the media engine, the SMT, the PAL and the UITL, wherein the DPM is coupled to the PAL, the ACU and the media engine, wherein the ACU is coupled between media engine and the UITL, and wherein the SMT is coupled to the ACU, the DPM, the media engine, the LoC module, the PAL and the UITL, wherein a subset of elements are selected from the flexible and scalable software system architecture to build the multimedia application.

7. The multimedia device of claim 6, wherein the media engine comprises:

a network protocol stack (NPS) for encompassing all network protocols and stacks needed for implementing standard compliant networking protocols for a networked multimedia system;

media processing component libraries (MPCLs) for encompassing all media processing algorithms to be used by the other modules in the flexible and scalable software system;

a media subsystem (MSS) to realize source-to-sink flow of media data implemented by integrating one or more algorithms from the MPCLs, the DPM and the NPS; and

signaling subsystem (SSS) for implementing state machines for media sessions and session management for interacting with a local or remote networked devices to/from which the flexible and scalable software system streams media or interacts with.

8. The multimedia device of claim 7, wherein the MSS comprises:

a media pipelines array (MPA) for realizing preset source-to-sink flow of media data, wherein each of the preset source-to-sink flow of media data is referred to as a media pipeline; and

a pipeline framework for providing standardized mechanisms and interfaces to implement media processing elements within each media pipeline.

9. The multimedia device of claim 6, wherein the SMT comprises:

a logging framework for allowing the modules in the flexible and scalable software system architecture to log traces for diagnostic and informational purposes;

an exception and event manager (EEM) for providing a standardized framework for the modules in the flexible and scalable software system architecture to identify, report, log and handle exceptions and events;

a statistics collection module (SCM) for providing a standardized framework to the modules in the flexible and scalable software system architecture for collecting and reporting statistics related to their operations;

a resource monitor (RMon) for tracking of resource utilization across all processes and threads that are running as part of the flexible and scalable software system architecture; and

a health monitor that interacts with the SCM, the EEM and the RMon to gather information on the current operational status of the modules in the flexible and scalable software system, and assesses the overall health of the flexible and scalable software system based on pre-defined rules.

10. The multimedia device of claim 6, wherein the ACU comprises:

an application services manager (ASM) for monitoring, interfacing and managing co-existence of all application services as per a defined set of rules of a system framework;

a configuration manager (CM) for managing a user configuration for all application features and ensures that all software entities are synchronized with a centralized configuration pool;

a command dispatcher (DP) for ensuring user actions from a user interface are routed to an associated application service; and

an event handler (EH) for managing exceptions or events that are not handled by lower entities in the flexible and scalable software system.