Data hub architecture to provide actionable data from remote sensor feeds

• US 10,078,671 B2
• Filed: 02/26/2015
• Issued: 09/18/2018
• Est. Priority Date: 02/26/2015
• Status: Active Grant

• Current Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Original Assignee: Red Hat, Inc. (International Business Machines Corporation)
• Inventors: Elia{hacek over (s)}, Filip, Nguyen, Filip
• Primary Examiner(s): Chen, Te Y
• Assistant Examiner(s): Chen, Susan
• Application Number:
  US14/633,065
• Publication Number:
  US 20160253394A1
• Time in Patent Office: 1,300 Days
• CPC Class Codes: H04L 67/12 specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks

Abstract

Systems and methods are provided for data hub architecture to provide actionable data from remote sensor feeds. An exemplary method includes receiving, by a master hub of a plurality of data hubs, a request to access at least one first sensor in a first location and at least one second sensor in a second location from a data client, wherein the master hub is closest to the data client of the plurality of data hubs on a network, determining a first data hub that is closest to the at least one first sensor on the network, and determining a second data hub that is closest to the at least one second sensor on the network. The method further includes querying the first data hub and the second data hub for data and communicating the data to the data client.

Claims

1. A method comprising:

receiving, by at least one hardware processor of a master hub selected by a data client based on a first shortest signal pathway between the master hub and the data client, a specification of a plurality of data sensors;

determining a plurality of data hubs associated with the plurality of sensors on a network, wherein each of the plurality of data hubs is associated with one of the plurality of data sensors for retrieving data from the one of the plurality of data sensors;

receiving, by the at least one hardware processor of the master hub of the plurality of data hubs, a request to access at least one first sensor in a first location of the plurality of sensors and at least one second sensor in a second location of the plurality of sensors from a data client;

determining, by the at least one hardware processor of the master hub, a first data hub of the plurality of data hubs based on a second shortest signal pathway between the first data hub and the at least one first sensor on the network;

determining, by the at least one hardware processor of the master hub, a second data hub of the plurality of data hubs based on a third shortest signal pathway between the second data hub and the at least one second sensor on the network;

querying, by the at least one hardware processor of the master hub, the first data hub for first data from the at least one first sensor;

receiving, by the master hub from the first data hub, the first data comprising first datum and first metadata for the first datum comprising at least one first timestamp;

querying, by the at least one hardware processor of the master hub, the second data hub for second data from the at least one first sensor;

receiving, by the master hub from the second data hub, the second data comprising second datum and second metadata for the second datum comprising at least one second timestamp;

determining, by the master hub, a time difference between the first data and the second data using the at least one first timestamp and the at least one second timestamp;

synchronizing, by the master hub, the first data with the second data using the at least one first timestamp and the at least one second timestamp; and

communicating, by the at least one hardware processor of the master hub, the first data and the second data to the data client based on the synchronizing, wherein the first data and the second data are output in a synchronized data output based on the at least one first timestamp and the at least one second timestamp.

2. The method of claim 1, wherein prior to the querying, by the master hub, the first data hub and the second data hub, the method further comprises:

determining, by the master hub, a first time delay between the master hub and the first data hub; and

determining, by the master hub, a second time delay between the master hub and the second data hub.

3. The method of claim 2, wherein the first time delay comprises a first amount of time to receive, by the master hub, a first data signal from the first data hub, and wherein the second time delay comprises a second amount of time to receive, by the master hub, a second data signal from the second data hub.

4. The method of claim 3, wherein the determining, by the master hub, the first time delay comprises pinging the first data hub by the master hub to determine the first amount of time, and wherein the determining, by the master hub, the second time delay comprises pinging the second data hub by the master hub to determine the second amount of time.

5. The method of claim 4, wherein determining the first time delay and the second time delay.

6. The method of claim 5, wherein the first data hub comprises a first federated database system to retrieve the first data from the at least one first sensor, and wherein the second data hub comprises a second federated database system to retrieve the second data from the at least one second sensor.

7. The method of claim 6, wherein the first data hub fills a first materialized view for the synchronized data output with the first data from the at least one first sensor, wherein the first materialized comprises at least a first data column comprising the first data and a first timestamp column comprising the at least one first timestamp for each of the first datum in the first data, wherein the at least one first timestamp comprises at least one first time that the each of the first datum in the first data is collected by the at least one first sensor, and

wherein the second data hub fills a second materialized view for the synchronized data output with the second data from the at least one second sensor, wherein the second materialized comprises at least a second data column comprising the second data and a second timestamp column comprising the at least one second timestamp for each of the second datum in the second data, wherein the at least one second timestamp comprises at least one second time that the each of the second datum in the second data is collected by the at least one second sensor.

8. The method of claim 7, wherein the master hub uses the time difference to synchronize the querying, by the master hub, the first data hub for the first data and the querying, by the master hub, the second data hub for the second data so that the at least one first timestamp and the at least one second timestamp match.

9. The method of claim 8, wherein the master hub comprises a master federated database system to retrieve the first data from the first data hub and the second data from the second data hub, wherein prior to the communicating, by the master hub, the first data and the second data to the data client, the method further comprises:

receiving, by the master hub, the first data from the first data hub;

receiving, by the master hub, the second data from the second data hub; and

sorting, by the master hub, the first data and the second data according to the at least one first timestamp and the at least one second timestamp,

and wherein the communicating, by the master hub, the first data and the second data to the data client comprises streaming the first data and the second data to the data client in the synchronized data output using the sorting, by the master hub, the first data and the second data.

10. The method of claim 9, wherein the master hub uses a select union query for the querying, by the master hub, the first data hub for the first data, the querying, by the master hub, the second data hub for the second data, and the sorting, by the master hub, the first data and the second data.

11. A system comprising:

a master hub, comprising at least one first hardware processor, of a plurality of data hubs selected by a data client based on a first shortest signal pathway on a network between the master hub and the data client that receives a specification of a plurality of data sensors, determines the plurality of data hubs associated with the plurality of sensors, wherein each of the plurality of data hubs is associated with one of the plurality of data sensors for retrieving data from the one of the plurality of data sensors, and receives a request to access at least one first sensor in a first location of the plurality of sensors and at least one second sensor in a second location of the plurality of sensors from the data client;

a first data hub, comprising at least one second hardware processor, of the plurality of data hubs selected by the master hub based on a second shortest signal pathway between the first data hub and the at least one first sensor on the network and retrieves first data from the at least one first sensor;

a second data hub, comprising at least one third hardware processor, of the plurality of data hubs selected by the master hub based on a third shortest signal pathway between the second data hub and the at least one second sensor on the network and retrieves second data from the at least one second sensor,

wherein the master hub queries the first data hub for the first data, receives the first data comprising first datum and first metadata for the first datum comprising at least one first timestamp from the first data hub, queries the second data hub for the second data, receives the second data comprising second datum and second metadata for the second datum comprising at least one second timestamp from the second data hub, determines a time difference between the first data and the second data using the at least one first timestamp and the at least one second timestamp, synchronizes the first data with the second data using the at least one first timestamp and the at least one second timestamp, and communicates the first data and the second data to the data client based on synchronizing the first data and the second data, wherein the first data and the second data are output in a synchronized data output based on the at least one first timestamp and the at least one second timestamp.

12. The system of claim 11, wherein prior to the master hub querying the first data hub and the second data hub, the master hub further determines a first time delay between the master hub and the first data hub and determines a second time delay between the master hub and the second data hub.

13. The system of claim 12, wherein the first time delay comprises a first amount of time for the master hub to receive a first data signal from the first data hub, and wherein the second time delay comprises a second amount of time for the master hub to receive a second data signal from the second data hub.

14. The system of claim 13, wherein the master hub determines the first time delay by pinging the first data hub by the master hub to determine the first amount of time, and wherein the master hub determines the second time delay by pinging the second data hub by the master hub to determine the second amount of time.

15. The system of claim 14, wherein the master hub further determines the time difference using the first time delay and the second time delay.

16. The system of claim 15, wherein the first data hub comprises a first federated database system to retrieve the first data from the at least one first sensor, and wherein the second data hub comprises a second federated database system to retrieve the second data from the at least one second sensor.

17. The system of claim 16, wherein the first data hub fills a first materialized view for the synchronized data output with the first data from the at least one first sensor, wherein the first materialized comprises at least a first data column comprising the first data and a first timestamp column comprising the at least one first timestamp for each of the first datum in the first data, wherein the at least one first timestamp comprises at least one first time that the each of the first datum in the first data is collected by the at least one first sensor, and

wherein the second data hub fills a second materialized view for the synchronized data output with the second data from the at least one second sensor, wherein the second materialized comprises at least a second data column comprising the second data and a second timestamp column comprising the at least one second timestamp for each of the second datum in the second data, wherein the at least one second timestamp comprises at least one second time that the each of the second datum in the second data is collected by the at least one second sensor.

18. The system of claim 17, wherein the master hub uses the time difference to synchronize the querying, by the master hub, the first data hub for the first data and the querying, by the master hub, the second data hub for the second data so that the at least one first timestamp and the at least one second timestamp match.

19. The system of claim 18, wherein the master hub comprises a master federated database system to retrieve the first data from the first data hub and the second data from the second data hub, wherein prior to the master hub communicating the first data and the second data to the data client, the master hub further receives the first data from the first data hub, receives the second data from the second data hub, sorts the first data and the second data according to the at least one first timestamp and the at least one second timestamp, wherein the master hub communicates the first data and the second data to the data client by streaming the first data and the second data to the data client in the synchronized data output using the sorting, by the master hub, the first data and the second data.

20. A non-transitory machine-readable medium comprising a plurality of machine-readable instructions which when executed by one or more processors of an application server cause the application server to perform a method comprising:

receiving, by at least one hardware processor of a master hub selected by a data client based on a first shortest signal pathway between the master hub and the data client, a specification of a plurality of data sensors;

determining a plurality of data hubs associated with the plurality of sensors on a network, wherein each of the plurality of data hubs is associated with one of the plurality of data sensors for retrieving data from the one of the plurality of data sensors;

receiving, by the at least one hardware processor of the master hub of a plurality of data hubs, a request to access at least one first sensor in a first location of the plurality of sensors and at least one second sensor in a second location of the plurality of sensors from the data client;

determining, by the at least one hardware processor of the master hub, a first data hub of the plurality of data hubs based on a second shortest signal pathway between the first data hub and the at least one first sensor on the network;

determining, by the at least one hardware processor of the master hub, a second data hub of the plurality of data hubs that is closest to the at least one second sensor on the network;

querying, by the at least one hardware processor of the master hub, the first data hub for first data from the at least one first sensor;

receiving, by the master hub from the first data hub, the first data comprising first datum and first metadata for the first datum comprising at least one first timestamp;

querying, by the at least one hardware processor of the master hub, the second data hub for second data from the at least one first sensor;

receiving, by the master hub from the second data hub, the second data comprising second datum and second metadata for the second datum comprising at least one second timestamp;

determining, by the master hub, a time difference between the first data and the second data using the at least one first timestamp and the at least one second timestamp;

synchronizing, by the master hub, the first data with the second data using the at least one first timestamp and the at least one second timestamp; and

communicating, by the at least one hardware processor of the master hub, the first data and the second data to the data client based on the synchronizing, wherein the first data and the second data are output in a synchronized data output based on the at least one first timestamp and the at least one second timestamp.