Indexing sensor data

• US 9,275,093 B2
• Filed: 01/28/2011
• Issued: 03/01/2016
• Est. Priority Date: 01/28/2011
• Status: Active Grant

• Current Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Original Assignee: Cisco Technology, Inc. (Cisco Systems, Inc.)
• Inventors: Pandey, Manoj Kumar, Banka, Tarun, Dutta, Debojyoti, Sen, Mainak, Balakrishnan, Raja Suresh Krishna
• Primary Examiner(s): KUDDUS, DANIEL A
• Application Number:
  US13/016,945
• Publication Number:
  US 20120197898A1
• Time in Patent Office: 1,859 Days
• Field of Search: 707/741, 707/957, 707/959, 707/795
• US Class Current: 1/1
• CPC Class Codes: G06F 16/2264 Multidimensional index structures
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
• CPC Class Codes: H04L 67/51 Discovery or management thereof, e.g. service location protocol [SLP] or web services
• CPC Class Codes: H04W 28/065 using assembly or disassembly of packets
• CPC Class Codes: H04W 84/18 Self-organising networks, e.g. ad-hoc networks or sensor networks

Abstract

In particular embodiments, a method includes, from an indexer in a sensor network, accessing a set of sensor data that includes sensor data aggregated together from sensors in the sensor network, one or more time stamps for the sensor data, and metadata for the sensor data identifying one or more pre-determined attributes of the sensor data. The method includes, at the indexer, generating an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data. One or more first ones of the dimensions of the multi-dimensional array include time, and one or more second ones of the dimensions of the multi-dimensional array include one or more of the pre-determined sensor-data attributes. The method includes, from the indexer, communicating the index of the set of sensor data for use in responding to one or more queries of the set of sensor data along with a plurality of other sets of sensor data.

Claims

1. A method comprising, by one or more computer systems:

from an indexer in a sensor network, accessing a set of sensor data that comprises;

a plurality of sensor data aggregated together from a plurality of sensors in the sensor network;

one or more time stamps for the sensor data; and

metadata for the sensor data identifying one or more pre-determined attributes of the sensor data;

at the indexer,

generating an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data, one or more first ones of the dimensions of the multi-dimensional array comprising time and one or more second ones of the dimensions of the multi-dimensional array comprising one or more of the pre-determined sensor-data attributes;

classifying the sensor data;

based on the classification, generating keywords for the sensor data using the metadata;

forming a keyword frequency distribution by combining the keywords for different time windows; and

summarizing the sensor data by eigenvalues of an array associated with the sensor data in a keyword space and generating, using the eigenvalues, a set of searchable sensor data that represents the sensor data and has a smaller size than the sensor data; and

from the indexer, communicating the index of the set of sensor data in response to one or more queries of the set of sensor data along with a plurality of other sets of sensor data, and

wherein generating the index comprises inputting the sensor data to a state machine with programmable rule criteria that is configured to drop sensor data that fail to meet the rule criteria as programmed.

2. The method of claim 1, wherein aggregation of the sensor data comprised:

deduplicating the sensor data;

validating the sensor data to block malicious data from reaching the indexer;

formatting the sensor data for processing of the sensor data at the indexer;

generating the metadata for the sensor; and

generating the time-stamps for the sensor data.

3. The method of claim 1, wherein the metadata comprises one or more identifiers designating one or more data types of the sensor data.

4. The method of claim 1, wherein the sensor data comprises one or more streams of real-time streaming sensor data.

5. The method of claim 4, wherein generating the index comprises representing each of the streams as a time-series of data for indexing.

6. One or more computer-readable non-transitory storage media embodying software that is configured when executed to:

access a set of sensor data that comprises;

a plurality of sensor data aggregated together from a plurality of sensors in the sensor network;

one or more time stamps for the sensor data; and

metadata for the sensor data identifying one or more pre-determined attributes of the sensor data;

generate an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data, one or more first ones of the dimensions of the multi-dimensional array comprising time and one or more second ones of the dimensions of the multi-dimensional array comprising one or more of the pre-determined sensor-data attributes;

classify the sensor data;

based on the classification, generate keywords for the sensor data using the metadata;

form a keyword frequency distribution by combining the keywords for different time windows;

summarize the sensor data by eigenvalues of an array associated with the sensor data in a keyword space and generate, using the eigenvalues, a set of searchable sensor data that represents the sensor data and has a smaller size than the sensor data;

communicate the index of the set of sensor data in response to one or more queries of the set of sensor data along with a plurality of other sets of sensor data, and

wherein generating the index comprises inputting the sensor data to a state machine with programmable rule criteria that is configured to drop sensor data that fail to meet the rule criteria as programmed.

7. The media of claim 6, wherein aggregation of the sensor data comprised:

deduplicating the sensor data;

validating the sensor data to block malicious data from reaching the indexer;

formatting the sensor data for processing of the sensor data at the indexer;

generating the metadata for the sensor; and

generating the time-stamps for the sensor data.

8. The media of claim 6, wherein the metadata comprises one or more identifiers designating one or more data types of the sensor data.

9. The media of claim 6, wherein the sensor data comprises one or more streams of real-time streaming sensor data.

10. The media of claim 9, wherein generating the index comprises representing each of the streams as a time-series of data for indexing.

11. An apparatus comprising:

one or more communication interfaces;

one or more memory devices containing one or more instructions for execution by one or more processing devices; and

the processing devices, configured when executing the instructions to;

access a set of sensor data that comprises;

a plurality of sensor data aggregated together from a plurality of sensors in the sensor network;

one or more time stamps for the sensor data; and

metadata for the sensor data identifying one or more pre-determined attributes of the sensor data;

generate an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data, one or more first ones of the dimensions of the multi-dimensional array comprising time and one or more second ones of the dimensions of the multi-dimensional array comprising one or more of the pre-determined sensor-data attributes;

classify the sensor data;

based on the classification,

forming a keyword frequency distribution by combining the keywords for different time windows;

summarizing the sensor data by eigenvalues of an array associated with the sensor data in a keyword space and generating, using the eigenvalues, a set of searchable sensor data that represents the sensor data and has a smaller size than the sensor data; and

communicate the index of the set of sensor data in response to one or more queries of the set of sensor data along with a plurality of other sets of sensor data, and

wherein generating the index comprises inputting the sensor data to a state machine with programmable rule criteria that is configured to drop sensor data that fail to meet the rule criteria as programmed.

12. The apparatus of claim 11, wherein the aggregation of the sensor data comprised:

deduplicating the sensor data;

validating the sensor data to block malicious data from reaching the indexer;

formatting the sensor data for processing of the sensor data at the indexer;

generating the metadata for the sensor; and

generating the time-stamps for the sensor data.

13. The apparatus of claim 11, wherein the metadata comprises one or more identifiers designating one or more data types of the sensor data.

14. The apparatus of claim 11, wherein the sensor data comprises one or more streams of real-time streaming sensor data.

15. The apparatus of claim 14, wherein generating the index comprises representing each of the streams as a time-series of data for indexing.

16. A system comprising, by one or more computer systems:

means for accessing a set of sensor data that comprises;

a plurality of sensor data aggregated together from a plurality of sensors in the sensor network;

one or more time stamps for the sensor data; and

metadata for the sensor data identifying one or more pre-determined attributes of the sensor data;

means, including a processor, for generating an index of the set of sensor data according to a multi-dimensional array configured for querying of the set of sensor data along with a plurality of other sets of sensor data, one or more first ones of the dimensions of the multi-dimensional array comprising time and one or more second ones of the dimensions of the multi-dimensional array comprising one or more of the pre-determined sensor-data attributes;

means for classifying the sensor data;

means for, based on the classification, generating keywords for the sensor data using the metadata;

means for forming a keyword frequency distribution by combining the keywords for different time windows;

means for summarizing the sensor data by eigenvalues of an array associated with the sensor data in a keyword space and generating, using the eigenvalues, a set of searchable sensor data that represents the sensor data and has a smaller size than the sensor data;

means for communicating the index of the set of sensor data in response to one or more queries of the set of sensor data along with a plurality of other sets of sensor data, and

wherein generating the index comprises inputting the sensor data to a state machine with programmable rule criteria that is configured to drop sensor data that fail to meet the rule criteria as programmed.

17. The system of claim 16, wherein the aggregation of the sensor data comprised:

deduplicating the sensor data;

validating the sensor data to block malicious data from reaching the indexer;

formatting the sensor data for processing of the sensor data at the indexer;

generating the metadata for the sensor; and

generating the time-stamps for the sensor data.

18. The system of claim 16, wherein the metadata comprises one or more identifiers designating one or more data types of the sensor data.

19. The system of claim 16, wherein the sensor data comprises one or more streams of real-time streaming sensor data.

20. The system of claim 19, wherein generating the index comprises representing each of the streams as a time-series of data for indexing.