Distributed meta data management middleware

• US 7,567,956 B2
• Filed: 02/15/2006
• Issued: 07/28/2009
• Est. Priority Date: 02/15/2006
• Status: Expired due to Fees

• Current Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Original Assignee: Panasonic Corporation (Panasonic Holdings Corporation)
• Inventors: Ozdemir, Hasan Timucin, Lee, Kuo Chu, Yu, Juan, Liu, Lipin
• Primary Examiner(s): Vital; Pierre M
• Assistant Examiner(s): Vo; Truong V
• Application Number:
  US11/354,774
• Publication Number:
  US 20070198478A1
• Time in Patent Office: 1,259 Days
• Field of Search: None
• US Class Current: 1/1
• CPC Class Codes: G06F 16/256 in federated or virtual databases
• CPC Class Codes: Y10S 707/99933 Query processing, i.e. searching
• CPC Class Codes: Y10S 707/99945 Object-oriented database structure processing

Abstract

A meta data management system for use with a surveillance system includes a user interface that allows users to define rules to manage meta data from distributed devices. An application programming interface provides an application access to system data and control information. A mechanism allows the application to transparently and seamlessly integrate with different types of databases by transparently allocating and searching the data that are physically distributed at different devices.

Claims

1. A metadata management system comprising:

a surveillance application;

a plurality of distributed devices, wherein each of the plurality of distributed devices provides surveillance contents and provides metadata associated the surveillance contents through a respective different data communication protocol including a predetermined markup language format, wherein each of the plurality of distributed devices is associated with a first rule specific to that device and a device driver for data communication through the respective different data communication protocol with that device;

a plurality of distributed databases that have at least two data storage formats and that each selectively store and manage metadata provided by the plurality of distributed devices;

a metadata management proxy, embodied as computer executable instructions on a memory of a computing device, that is remote from the plurality of databases and in data communication with at least one of the plurality of distributed devices;

a middleware metadata management mechanism that is embodied as computer executable instructions on a memory of a computing device and that directs data communication between the metadata management proxy and the plurality of databases, wherein the metadata management mechanism is further associated with a second rule and communicates through a metadata management communication protocol, wherein the second rule defines conditions of surveillance concerns and data storage formats both for storing metadata to each of the plurality of databases, wherein the metadata management mechanism has at least two distributed entities that communicate with each other through the metadata management communication protocol; and

a configuration server that stores a) the first rule and the device driver associated with each of the plurality of distributed devices and b) the second rule, wherein the configuration server further allows users to dynamically update of the first rules, the device drivers, and second rule;

wherein the metadata management proxy a) dynamically loads the first rule and the device driver both associated with the at least one device from the configuration server, b) receives the metadata from each of the at least one device utilizing the device driver and through the associated respective data communication protocol both associated with the at least one device, c) parses the received metadata to generate an event, and d) triggers an action, of the surveillance application, in response to that event in accordance with the first rule specific to that device;

wherein the metadata management proxy further selectively sends the metadata, for each of the at least one device, to the metadata management mechanism through the metadata management communication protocol;

wherein the metadata management mechanism dynamically loads the second rule from the configuration server and selects at least one from the plurality of distributed databases and at least one of the data storage formats for storing the received metadata based on if the received metadata satisfy the defined conditions of surveillance concerns for at least one of the plurality of databases in the second rule.

2. The system of claim 1, wherein the metadata management proxy is implemented as a rule engine having device drivers, condition evaluators, and action interpreters.

3. The system of claim 2, wherein said rule engine dynamically loads the first rules from the configuration server and runs the first rules to accept different types of messages and invoke different actions based on the results of condition evaluators without stop and restart of distributed search applications or a machine.

4. The system of claim 2, wherein one or more of the device drivers collects data from multiple ones of the distributed devices by using device specific communication protocols, parses the data, and generates one or more events, wherein the device drivers are formatted as XML files and are managed as XML files in the configuration server.

5. The system of claim 4, wherein one or more of the condition evaluators can evaluate and check a defined condition associated with one of the events to trigger execution of an associated action interpreter.

6. The system of claim 1, wherein said the metadata management mechanism is implemented as a library that handles at least one of system information, video information, control information, or authentication information.

7. The system of claim 6, wherein the library has a communication component that can implement P2P communication protocol to provide a distributed communication environment for distributed data access functionality.

8. The system of claim 6, wherein the library has a rule engine which executes the rules.

9. The system of claim 6, wherein the library has a query manager that can generate a unique query identification, execute queries, maintain query data source sessions, and aggregate query results from distributed data sources.

10. The system of claim 6, wherein the library has a cache manager that manages a metadata object in-memory from a data source using one or more management policies for fast search and event correlation.

11. The system of claim 6, wherein the library has a schema manager that can record and maintain a peer group'"'"'s schemas to support a query manager in performing a distributed search.

12. The system of claim 1, wherein said the metadata management mechanism includes a rule engine that can receive an event, evaluate a condition associated with the event, and perform an action according to a result of evaluation of the condition.

13. The system of claim 12, wherein the rule engine has a generic event handler that can read a rule specifying how many event handlers exist and a configuration for each event handler, load a template for each event handler, and fill all properties into the template from the configuration.

14. The system of claim 13, wherein the generic event handler can let each event handler handle the event, and each event handler feeds the event to a rule execution engine.

15. The system of claim 1, wherein said metadata management mechanism includes a query manager that is created as a single instance and shared by multiple applications.

16. The system of claim 15, wherein the query manager stores active query sessions information, database adaptors, and collections information configured in a schema manager configuration file and the query manager gets a timeout configuration parameter for each session, and authenticates a query application.

17. The system of claim 1, wherein said metadata management system is operable to advertise its resources to a peer group into which it is configured.

18. The system of claim 17, wherein when the application creates a data source schema, a schema manager of said system sends the data source schema information to the peer group.

19. The system of claim 17, wherein if the application issues a query from said meta data management system, said system can send the query to other metadata management systems in its peer group.

20. The system of claim 19, wherein said metadata management system can wait for query results from the other meta data management systems in its peer group, aggregate the results, and send the results to the application.

21. The system of claim 17, wherein if said metadata management system receives a query from another metadata management system in one of its peer groups, it can check its schema information to identify one or more additional metadata management systems in another of its peer groups, and can relay the query to the additional metadata management systems.

22. The system of claim 21, wherein said metadata management system can wait for query results from the still other metadata management systems, aggregate the results, and send the results to the other meta data management system form which it received the query.

23. The system of claim 17, wherein said metadata management system has a schema manager that can manage peer group schemas to support distributed search.

24. The system of claim 23, wherein the schema manager maintains a Hash table to support concurrent addition, deletion, update, and query of schema information correlated with peer information.

25. The system of claim 1, wherein said the metadata management mechanism includes one or more database adaptors that map an XML request to a local query format of metadata repository management and translate results to an XML format.

26. The metadata management system of claim 1, wherein the metadata management proxy further employs a first rule engine for converting the received metadata from each of the at least one device to the predetermined markup language format in accordance with the first rule specific to that device;

wherein the first rule engine dynamically loads the device driver of that device and further includes a condition evaluator and an action interpreter;

wherein the first rule engine selectively accepts messages from that device in accordance with the first rule of that device via the device driver of that device, wherein the messages contain the metadata of that device;

wherein the condition evaluator evaluates the messages and invokes at least one of a plurality of actions in accordance with the first rule of that device for converting the metadata in the messages to the predetermined markup language format;

wherein the action interpreter executes the invoked actions to selectively send the metadata received from that device to the metadata management mechanism.

27. The metadata management system of claim 1, wherein the metadata management mechanism further employs a second rule engine for selectively storing the received metadata, from the metadata management proxy, in a selected data format to one of the plurality of databases in accordance with the second rule;

wherein the second rule engine receives an event defined in the second rule and associated with the received metadata, evaluates a condition associated with the event in accordance with the second rule, and performs an action defined in the second rule according to a result of evaluation of the condition to selectively store the received metadata, from the metadata management proxy, in the selected data format to one of the plurality of databases;

wherein the second rule further defines correlation actions that correlate metadata from different devices of the plurality of distributed devices to perform target tracking.

28. The metadata management system of claim 27, wherein the second rule engine further has a generic event handler that selectively reads the second rule specifying how many event handlers exist and a configuration for each event handler, loads a template for each event handler, and fills all properties into the template from the configuration.

29. The metadata management system of claim 1, wherein the metadata management mechanism has a plurality of database adaptors including an XML file adaptor, a relational database adaptor, and an object database adaptor that interface with different types of databases of the plurality of databases, each adaptor maps a data request from a markup language format to a data scheme used by one of the plurality of databases.

30. The metadata management system of claim 1, wherein a) the first rule and the device driver associated with each of the plurality of devices and b) the second rule are stored in a markup language format.

31. The metadata management system of claim 1, wherein the middleware metadata management mechanism has an application programming interface providing an application access to metadata management functions the metadata management mechanism including transparently allocating and searching the metadata that are physically distributed at the plurality of distributed databases.

32. The metadata management system of claim 1, wherein the at least two distributed entities of the middleware metadata management mechanism are grouped into a plurality of peer groups and each control at least one of the plurality of distributed databases, wherein the respective distributed entities in each of the peer groups advertise resources hosted on the databases controlled by the respective distributed entities to each other.

33. The metadata management system of claim 32, wherein each of the at least two distributed entities of the middleware metadata management mechanism is associated with a data source schema that describes the metadata stored in the databases controlled by that entity, wherein any given entity of the at least two distributed entities each has a respective schema manager that locally maintains copies of each of the data source schemas associated with the other entities in the same peer group of the given entity, wherein the schema manager of the given entity searches its locally maintained data source schemas to locate data source schemas therein similar to the data source schema associated with the given entity and sends a received query request, for locating metadata stored in the plurality of distributed databases, to the entities associated with the located data source schemas.

34. The metadata management system of claim 33, wherein the schema manager of the given entity locally maintains, in a Hash table, the copies of each of the data source schemas associated with the other entities in the same peer group of the given entity.

35. A metadata management system for managing surveillance contents and metadata associated the surveillance contents provided by a plurality of distributed devices and stored in a plurality of distributed databases, the system comprising:

a metadata management proxy embodied as computer executable instructions on a memory of a computing device and in data communication with at least one of the plurality of distributed devices;

a middleware metadata management mechanism that is embodied as computer executable instructions on a memory of a computing device and that directs data communication between the metadata management proxy and the plurality of distributed databases, wherein the metadata management mechanism is further associated with a second rule, wherein the second rule defines conditions of surveillance concerns and data storage formats both for storing metadata to each of the plurality of databases, wherein the metadata management mechanism has an application programming interface providing an application access to metadata management functions the metadata management mechanism including transparently allocating and searching the metadata that are physically distributed at the plurality of distributed databases; and

a configuration server that stores a) a first rule and a device driver associated with each of the plurality of distributed devices and b) the second rule, wherein the configuration server further allows users to dynamically update of the first rules, the device drivers, and second rule;

wherein the metadata management proxy receives the metadata from each of the at least one device, dynamically loads the first rule specific to that device from the configuration server, and converts the received metadata to a predetermined markup language format in accordance with the first rule specific to that device;

wherein the metadata management proxy further selectively sends the converted metadata, for each of the at least one device and in the predetermined markup language format, to the metadata management mechanism in accordance with the first rule specific to that device;

wherein the metadata management mechanism dynamically loads the second rule from the configuration server and selects at least one from the plurality of distributed databases and at least one of the data storage formats for storing the received metadata based on if the received metadata satisfy the defined conditions of surveillance concerns for at least one of the plurality of databases in the second rule.