Aggregation and analytics for application-specific optimization based on multiple data sources

• US 9,952,353 B2
• Filed: 09/13/2014
• Issued: 04/24/2018
• Est. Priority Date: 09/13/2014
• Status: Active Grant

• Current Assignee: International Business Machines Corporation
• Original Assignee: International Business Machines Corporation
• Inventors: Eickelman, Hans-Jurgen, Liu, Ying, Osiecki, Thomas H., Villa Real, Lucas Correia
• Primary Examiner(s): Lu, Kuen S
• Application Number:
  US14/485,669
• Publication Number:
  US 20160078112A1
• Time in Patent Office: 1,319 Days
• Field of Search: 715602
• CPC Class Codes: G01W 1/14 Rainfall or precipitation gauges measuring volume in general G01F
• CPC Class Codes: G06F 16/244 Grouping and aggregation
• CPC Class Codes: G06F 16/248 Presentation of query results
• CPC Class Codes: G06F 16/254 Extract, transform and load [ETL] procedures, e.g. ETL data flows in data warehouses
• CPC Class Codes: G06G 7/50 for distribution networks, e.g. for fluids G06G7/62 takes precedence
• CPC Class Codes: Y02A 10/40 Controlling or monitoring, e.g. of flood or hurricane; Forecasting, e.g. risk assessment or mapping

Abstract

Aggregating and transforming data, and performing analytics thereupon, for application-specific optimization based on multiple data sources. The data is preferably ingressed automatically, and may originate from various public and/or private data sources. Data transformation preferably aligns the data aggregated from the various sources, to thereby allow meaningful referencing. Complex and non-aligned data can therefore be consolidated, such that it is readily digestible by simulation (or other) software. In an embodiment, risk of flooding for a supply chain is computed from the aggregated and transformed data, using data analytics based on physical computation for flood risk assessment, allowing the supply chain to be optimized with regard to threat of flooding and/or actual flooding. In another embodiment, risk of wild fire may be assessed. Other types of risk may also be assessed.

Claims

1. A system for aggregating and transforming data from multiple sources, the system comprising:

a computer comprising a processor; and

instructions which are executable, using the processor, to perform functions comprising;

determining a location of interest for natural disaster risk analysis;

determining a plurality of sources of data that describe a physical environment of the location;

automatically ingressing, from selected ones of the plurality of sources, the data that describes the physical environment, wherein the ingressed data from at least a first of the selected ones comprises topography data pertaining to the location, the topography data formatted as a plurality of grid cells;

programmatically transforming the ingressed data into data maps that are aligned to one another to allow referencing therebetween, further comprising;

programmatically performing a watershed delineation process to determine, from the ingressed topography data, a watershed area for each of at least one watershed pertaining to the location; and

programmatically removing, from the ingressed topography data, particular ones of the grid cells which do not include any of the at least one determined watershed area and which therefore do not directly contribute to precipitation run-off that can potentially reach the location of interest;

evaluating risk of natural disaster pertaining to the location by using the aligned data maps as input to an evaluator selected from the group consisting of a simulation model and an analytic process; and

comparing output of the evaluator to a first threshold and setting a risk of natural disaster to a highest level if the output exceeds the first threshold, and otherwise comparing the output of the evaluator to a second threshold and setting the risk of natural disaster to an intermediate level if the output exceeds the second threshold.

2. The system according to claim 1, wherein:

the programmatically transforming further comprises aligning the topography data from the first of the selected ones and a second of the selected ones to have an identical number of pixels and to match an identical geo-location of a reference topography data prior to performing the watershed delineation process.

3. The system according to claim 1, wherein:

the evaluating comprises;

programmatically determining, from the topography data, canopy interception information pertaining to the location; and

using the canopy interception information when determining the risk by determining an impact of physical canopy present at the location of interest on an amount of rainfall that reaches a ground surface at the location.

4. The system according to claim 1, wherein the location pertains to a supply chain and the evaluating risk evaluates a risk of flooding for the supply chain.

5. The system according to claim 1, wherein the evaluating risk evaluates a risk of wildfire for the location.

6. A computer program product for aggregating and transforming data from multiple sources, the computer program product comprising:

a computer-readable storage medium having computer readable program code

embodied therein, the computer-readable program code configured for;

determining a location of interest for natural disaster risk analysis;

determining a plurality of sources of data that describe a physical environment of the location;

automatically ingressing, from selected ones of the plurality of sources, the data that describes the physical environment wherein the ingressed data from at least a first of the selected ones comprises topography data pertaining to the location, the topography data formatted as a plurality of grid cells;

programmatically transforming the ingressed data into data maps that are aligned to one another to allow referencing therebetween, further comprising;

programmatically performing a watershed delineation process to determine, from the ingressed topography data, a watershed area for each of at least one watershed pertaining to the location; and

programmatically removing, from the ingressed topography data, particular ones of the grid cells which do not include any of the at least one determined watershed area and which therefore do not directly contribute to precipitation run-off that can potentially reach the location of interest;

evaluating risk of natural disaster pertaining to the location by using the aligned data maps as input to an evaluator selected from the group consisting of a simulation model and an analytic process; and

comparing output of the evaluator to a first threshold and setting a risk of natural disaster to a highest level if the output exceeds the first threshold, and otherwise comparing the output of the evaluator to a second threshold and setting the risk of natural disaster to an intermediate level if the output exceeds the second threshold.

7. The computer program product according to claim 6, wherein:

the programmatically transforming comprises aligning the topography data from the first of the selected ones and a second of the selected ones to have an identical number of pixels and to match an identical geo-location of a reference topography data prior to performing the watershed delineation process.

8. The computer program product according to claim 6, wherein:

the evaluating comprises;

programmatically determining, from the topography data, canopy interception information pertaining to the location; and

using the canopy interception information when determining the risk by determining an impact of physical canopy present at the location of interest on an amount of rainfall that reaches a ground surface at the location.

9. The computer program product according to claim 6, wherein the location pertains to a supply chain and the evaluating risk evaluates a risk of flooding for the supply chain.

10. The computer program product according to claim 6, wherein the evaluating risk evaluates a risk of wildfire for the location.

11. A system for aggregating and transforming data from multiple sources, the system comprising:

a computer comprising a processor; and

instructions which are executable, using the processor, to perform functions comprising;

determining a location of interest for natural disaster risk analysis;

determining a plurality of sources of data that describe a physical environment of the location;

automatically ingressing, from selected ones of the plurality of sources, the data that describes the physical environment, wherein the ingressed data from at least a first of the selected ones and a second of the selected ones comprises topography data pertaining to the location;

programmatically transforming the ingressed data into data maps that are aligned to one another to allow referencing therebetween, further comprising aligning the topography data from the first of the selected ones and the second of the selected ones to have an identical number of pixels and to match an identical geo-location of a reference topography data;

evaluating risk of natural disaster pertaining to the location by using the aligned data maps as input to an evaluator selected from the group consisting of a simulation model and an analytic process, further comprising;

programmatically determining, from the topography data, canopy interception information pertaining to the location; and

using the canopy interception information when determining the risk by determining an impact of physical canopy present at the location of interest on an amount of rainfall that reaches a ground surface at the location; and

comparing output of the evaluator to a first threshold and setting a risk of natural disaster to a highest level if the output exceeds the first threshold, and otherwise comparing the output of the evaluator to a second threshold and setting the risk of natural disaster to an intermediate level if the output exceeds the second threshold.

12. The system according to claim 11, wherein the location pertains to a supply chain and the evaluating risk evaluates a risk of flooding for the supply chain.

13. The system according to claim 11, wherein the evaluating risk evaluates a risk of wildfire for the location.