MARKOV DECISION PROCESS-BASED SUPPORT TOOL FOR RESERVOIR DEVELOPMENT PLANNING

• US 20100325075A1
• Filed: 01/30/2009
• Published: 12/23/2010
• Est. Priority Date: 04/18/2008
• Status: Active Grant

• Current Assignee: Kevin C. Furman, Vikas Goel
• Original Assignee: Kevin C. Furman, Vikas Goel
• Inventors: Goel, Vikas, Furman, Kevin C.
• Granted Patent: US 8,775,347 B2
• Time in Patent Office: Days
• US Class Current: 706/46
• CPC Class Codes: G01V 99/00 Subject matter not provided for in other groups of this subclass
• CPC Class Codes: G06Q 10/04 Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem" market predictions or forecasting for commercial activities G06Q30/0202
• CPC Class Codes: G06Q 10/06 Resources, workflows, human or project management; Enterprise or organisation planning; Enterprise or organisation modelling

Abstract

A Markov decision process-based support tool for reservoir development planning can comprise a source of input data, an optimization model, a high fidelity model for simulating the reservoir, and one or more solution routines interfacing with the optimization model. The optimization model can consider unknown parameters having uncertainties directly within the optimization model. The model incorporates the flexibility that a decision-maker has in the real world and allows the decision-maker to adjust the decisions based on new information. The model can systematically address uncertain data, for example comprehensively or even taking all uncertain data into account. Accordingly, the optimization model can provide flexible or robust solutions that remain feasible over an uncertainty space. Once the reservoir model is optimized, final development plans may be generated.

Claims

1. A method for reservoir development planning, comprising the steps of:

receiving data relevant to reservoir development;

processing the received data via a computer-implemented Markov decision process-based model; and

generating a reservoir development plan in response to processing the received data via the computer-implemented Markov decision process-based model.

2. The method of claim 1, wherein the generating step comprises generating the reservoir development plan according to an uncertainty space associated with the received data.

3. The method of claim 1, wherein the computer-implemented Markov decision process-based model comprises optimizing at least some aspect of the reservoir development plan based on the received data and an uncertainty space.

4. The method of claim 1, wherein the step of receiving data comprises receiving known data parameters and uncertain data parameters, and

wherein processing the received data via the computer-implemented Markov decision process-based model comprises processing the data with a Markov decision process-based model that incorporates the uncertain data parameters.

5. The method of claim 1, wherein an uncertainty space is associated with the received data, and

wherein processing the received data via the computer-implemented Markov decision process-based model comprises considering the uncertainty space in entirety.

6. The method of claim 1, wherein the Markov decision process-based model comprises

a plurality of stages, each state representing a discrete step in time;

a plurality of states in each stage, each state representing a potential state of the reservoir development plan; and

a plurality of transition probabilities, each transition probability representing an uncertainty in the data, each transition probability being determined by the current state of the reservoir development plan and a decision to be taken,

wherein a future state is determined from the transition probability.

7. The method of claim 1, wherein a decision-maker is allowed to undertake one or more corrective decisions at each of the plurality of stages within the Markov decision process-based model.

8. A method for reservoir development planning, comprising the steps of:

receiving data relevant to reservoir development planning, wherein uncertainty is associated with the data;

processing the received data with a computer-based optimization model that incorporates uncertainty;

producing at least some portion of a reservoir development plan in response to processing the received data with the computer-based optimization model that incorporates the uncertainty; and

undertaking one or more corrective decisions as the uncertainty unfolds over time.

9. The method of claim 8, wherein the computer-based optimization model is a Markov decision process-based model.

10. The method of claim 9, wherein incorporating the uncertainty in the Markov decision process-based model comprises capturing tradeoffs across a plurality of realizations of the uncertainty.

11. The method of claim 8, wherein the step of producing at least some portion of the reservoir development plan in response to processing the received data with the computer-based optimization model that incorporates the uncertainty comprises

achieving feasibility of an optimization problem across an entire uncertainty space.

12. The method of claim 8, wherein the step of producing at least some portion of the reservoir development plan in response to processing the received data with the computer-based optimization model that incorporates the uncertainty comprises

systemically processing uncertain data within the Markov decision process-based model.

13. A method for decision support regarding development of petroleum resources, comprising the steps of:

receiving a plurality of data elements regarding a decision about developing a petroleum reservoir, wherein a respective characterization of uncertainty is associated with each of the data elements; and

outputting a recommendation for the decision in response to processing each of the data elements and each of the respective characterizations of uncertainty with a computer-based Markov decision process-based model.

14. The method of claim 13, wherein the Markov decision process-based model incorporates each of the respective characterizations of uncertainty.

15. The method of claim 13, wherein processing each of the data elements and each of the respective characterizations of uncertainty with the computer-based Markov decision process-based model comprises covering an uncertainty space.

16. A computer-based method of optimizing development planning for a reservoir, comprising:

providing input data that comprises uncertainty;

generating a first simulation of the reservoir using a high fidelity model for reservoir or surface facility behavior utilizing the input data, wherein the first simulation generates first high fidelity output data;

generating a low fidelity model for reservoir or surface facility behavior using the input data and the first high fidelity output data, wherein the low fidelity model generates a prediction;

optimizing a reservoir development planning model utilizing the input data and the low fidelity model for reservoir or surface facility behavior, wherein the reservoir development planning model generates reservoir development planning output data, wherein the reservoir development planning model comprises a Markov decision process-based model;

performing a second simulation of the reservoir using the high fidelity model for reservoir or surface facility behavior utilizing the input data and the reservoir development planning output data, wherein the second simulation generates second high fidelity output data;

comparing the second high fidelity output data with the prediction of the low fidelity model;

repeating the steps comprising generating a low fidelity model for reservoir or surface facility behavior, optimizing a reservoir development planning model, performing a second simulation of the reservoir using the high fidelity model for reservoir or surface facility behavior, and comparing the second high fidelity output data with the prediction of the low fidelity model until the second high fidelity output data is substantially consistent with the prediction of the low fidelity model.

17. The method of claim 16, further comprising:

generating a development plan in response to the second high fidelity output data being substantially consistent with the prediction of the low fidelity model.

18. The method of claim 16, wherein a solution routine, interfacing with the Markov decision process-based model, assists the Markov decision process-based model to optimize development planning for the reservoir.

19. The method of claim 16, wherein the Markov decision process-based model comprises a solution routine for assisting with optimizing development planning for the reservoir.

20. A method of producing hydrocarbons from a subterranean reservoir, comprising:

generating a reservoir development planning system based on input data;

optimizing the reservoir development planning system according to an uncertainty space, wherein the reservoir development planning system is optimized using a Markov decision process-based model; and

producing hydrocarbons from the reservoir according to output from the optimized reservoir development planning system.

21. The method of claim 20, wherein the input data comprises deterministic components and nondeterministic components, and

wherein the step of optimizing the reservoir development planning system according to the uncertainty space comprises

considering each of the nondeterministic components with the Markov decision process-based model.

22. The method of claim 20, wherein the Markov decision process-based model incorporates uncertainty of the input data.

23. The method of claim 20, wherein the uncertainty space specifies inherent uncertainty of the input data.

24. The method of claim 20, wherein the reservoir development planning system comprises:

a Markov decision process-based model comprising a low fidelity reservoir model; and

a high fidelity reservoir model,

wherein the high fidelity model accepts one or more parameter input data from the Markov decision process-based model and provides one or more reservoir or surface facility property input data to the Markov decision process-based model.

25. The method of claim 20, wherein optimizing the reservoir development planning system comprises:

simulating operation of the reservoir using a high fidelity model; and

simulating operation of the reservoir using a low fidelity model.