Network-based dynamic data management

• US 9,462,040 B2
• Filed: 12/07/2011
• Issued: 10/04/2016
• Est. Priority Date: 12/07/2011
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Addepalli, Sateesh K., Sudhaakar, Raghuram S., Vasseur, Jean-Philippe, Bonomi, Flavio
• Primary Examiner(s): Hutton, Nan
• Application Number:
  US13/313,817
• Publication Number:
  US 20130151563A1
• Time in Patent Office: 1,763 Days
• Field of Search: 707/827, 707/E17.095
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2477 Temporal data queries
• CPC Class Codes: G06F 16/787 using geographical or spatial information, e.g. location
• CPC Class Codes: H04L 65/1073 Registration or de-registration
• CPC Class Codes: H04L 67/10 in which an application is distributed across nodes in the network software deployment G06F8/60; multiprogramming arrangements G06F9/46
• CPC Class Codes: H04L 67/52 specially adapted for the location of the user terminal

Abstract

In one embodiment, a router operating in a hierarchically routed computer network may receive collected data from one or more hierarchically lower devices in the network (e.g., hierarchically lower sensors or routers). The collected data may then be converted to aggregated metadata according to a dynamic schema, and the aggregated metadata is stored at the router. The aggregated metadata may also be transmitted to one or more hierarchically higher routers in the network. Queries may then be served by the router based on the aggregated metadata, accordingly.

Claims

1. A method, comprising:

operating a router in a hierarchically routed computer network;

receiving collected data at the router from one or more hierarchically lower devices in the network;

applying a data reduction technique on the collected data to provide aggregated metadata according to a dynamic schema associated with the router, wherein the collected data is reduced to meaningful information for the router based on the dynamic schema associated with the router;

storing the aggregated metadata at the router;

transmitting the aggregated metadata to one or more hierarchically higher routers in the network, wherein as the aggregated meta data travels from one hierarchical layer to a next higher hierarchical layer, the aggregated metadata becomes more filtered and less data is stored;

receiving one or more queries to be served based on the aggregated metadata; and

serving the one or more queries by the router based on the aggregated metadata,

wherein the dynamic schema is continuously updated by the router based on new data types being discovered by the router, wherein updating the dynamic schema includes;

detecting a particular behavior based on the collected data,

in response, updating the dynamic schema for hierarchically lower routers based on the detected behavior, and

transmitting the updated dynamic schema to the hierarchically lower routers.

2. The method as in claim 1, wherein the collected data is hierarchically lower aggregated metadata from one or more hierarchically lower routers in the network.

3. The method as in claim 2, wherein the data reduction technique is at least one of statistical models, regression models, fusion models, Complex Event processing (CEP) models, or statistical filters.

4. The method as in claim 1, wherein the collected data is hierarchically lower raw sensor data from one or more hierarchically lower sensors in the network.

5. The method as in claim 1, further comprising:

determining the dynamic schema based on receiving a new collected data type at the router.

6. The method as in claim 1, further comprising:

determining the dynamic schema based on receiving a new query type at the router.

7. The method as in claim 1, wherein the dynamic schema is time-limited.

8. The method as in claim 1, further comprising:

determining that the dynamic schema does not define a conversion for particular collected data; and

, in response,

storing the particular collected data as raw data.

9. The method as in claim 8, further comprising:

transmitting the raw data to one or more hierarchically higher routers in the network; and

receiving an updated dynamic schema in response to the raw data.

10. The method as in claim 1, further comprising:

receiving a registration request from a plurality of hierarchically lower sensors; and

activating a subset of the hierarchically lower sensors.

11. The method as in claim 10, further comprising:

determining which hierarchically lower sensors to activate based on specific capability of the sensors.

12. The method as in claim 1, further comprising:

providing an interface into the router, the interface configured to receive user-defined queries and user-defined schema.

13. The method as in claim 1, wherein the contents of the collected data differ from the contents of the aggregated data.

14. An apparatus, comprising:

one or more network interfaces to communicate within a hierarchically routed computer network;

a processor coupled to the network interfaces and adapted to execute one or more processes; and

a memory configured to store a process executable by the processor, the process when executed operable to;

receive collected data from one or more hierarchically lower devices in the network;

apply a data reduction technique on the collected data to provide aggregated metadata according to a dynamic schema associated with the apparatus, wherein the collected data is reduced to meaningful information for the router based on the dynamic schema associated with the apparatus;

store the aggregated metadata;

transmit the aggregated metadata to one or more hierarchically higher routers in the network, wherein as the aggregated meta data travels from one hierarchical layer to a next higher hierarchical layer, the aggregated metadata becomes more filtered and less data is stored;

receive one or more queries to be served based on the aggregated metadata; and

serve the one or more queries based on the aggregated metadata,

wherein the dynamic schema is continuously updated based on new data types being discovered by the apparatus, wherein updating the dynamic schema includes;

detecting a particular behavior based on the collected data,

in response, updating the dynamic schema for hierarchically lower routers based on the detected behavior, and

transmitting the updated dynamic schema to the hierarchically lower routers.

15. The apparatus as in claim 14, wherein the collected data is one of either hierarchically lower aggregated metadata from one or more hierarchically lower routers in the network or hierarchically lower raw sensor data from one or more hierarchically lower sensors in the network.

16. The apparatus as in claim 14, wherein the process when executed is further operable to:

determine the dynamic schema based on receiving a new collected data type.

17. The apparatus as in claim 14, wherein the process when executed is further operable to:

determine the dynamic schema based on receiving a new query type.

18. The apparatus as in claim 14, wherein the process when executed is further operable to:

determine that the dynamic schema does not define a conversion for particular collected data; and

, in response,

store the particular collected data as raw data.

19. The apparatus as in claim 18, wherein the process when executed is further operable to:

transmit the raw data to one or more hierarchically higher routers in the network; and

receive an updated dynamic schema in response to the raw data.

20. The apparatus as in claim 14, wherein the process when executed is further operable to:

receive a registration request from a plurality of hierarchically lower sensors; and

activate a subset of the hierarchically lower sensors.

21. A tangible, non-transitory, computer-readable media having software encoded thereon, the software when executed by a processor operable to:

operate a router in a hierarchically routed computer network;

receive collected data at the router from one or more hierarchically lower devices in the network;

apply a data reduction technique on the collected data to provide aggregated metadata according to a dynamic schema associated with the router, wherein the collected data is reduced to meaningful information for the router based on the dynamic schema, associated with the router;

store the aggregated metadata at the router;

transmit the aggregated metadata to one or more hierarchically higher routers in the network, wherein as the aggregated meta data travels from one hierarchical layer to a next higher hierarchical layer, the aggregated metadata becomes more filtered and less data is stored;

receive one or more queries to be served based on the aggregated metadata; and

serve the one or more queries by the router based on the aggregated metadata,

wherein the dynamic schema is continuously updated by the router based on new data types being discovered by the router, wherein updating the dynamic schema includes;

detecting a particular behavior based on the collected data,

in response, updating the dynamic schema for hierarchically lower routers based on the detected behavior, and

transmitting the updated dynamic schema to the hierarchically lower routers.