Risk and Uncertainty Management Best Practices and Misapplications for Cost and Schedule Estimates SPE 97269

Similar documents
Project Management Certificate Program

Use of the Risk Driver Method in Monte Carlo Simulation of a Project Schedule

Project Risk Management. Prof. Dr. Daning Hu Department of Informatics University of Zurich

Integrated Cost Schedule Risk Analysis Using the Risk Driver Approach

Risk Management Process-02. Lecture 06 By: Kanchan Damithendra

Risk Assessment of the Niagara Tunnel Project

Information Technology Project Management, Sixth Edition

Event Risk Assessment Tool (ERAT) Version 2.0. Activity Being Assessed: RARE LIKELY ALMOST CERTAIN

TONY MILSOM Specialist Risk Engineering KPC

Integrated Cost Schedule Risk Analysis Using the Risk Driver Approach

Fraud Risk Management

RISK MANAGEMENT. Budgeting, d) Timing, e) Risk Categories,(RBS) f) 4. EEF. Definitions of risk probability and impact, g) 5. OPA

INSE 6230 Total Quality Project Management

Project Risk Management

IDENTIFYING AND QUANTIFYING RISKS AND UNCERTAINTIES IN DEVELOPING AN OFFSHORE OILFIELD UNDER VARYING OIL PRICE REGIMES

The Basics of Risk Management

Event Risk Assessment Tool (ERAT) Version 1.0 RARE. UNLIKELY Could occur at some time. POSSIBLE Might occur at some time LIKELY ALMOST CERTAIN

Risk Video #1. Video 1 Recap

DRILLING WELL REVIEWS

(RISK.03) Integrated Cost and Schedule Risk Analysis: A Draft AACE Recommended Practice. Dr. David T. Hulett

Risk Management Framework. Group Risk Management Version 2

Risk Management Plan for the <Project Name> Prepared by: Title: Address: Phone: Last revised:

Project Risk Management

Project Cost Risk Analysis: The Risk Driver Approach Prioritizing Project Risks and Evaluating Risk Responses

Overview of Standards for Fire Risk Assessment

Investor Presentation August PKD (NYSE) Rig 273 Alaska

PROJECT RISK MANAGEMENT: CONTEXT, TOOLS AND REAL WORLD APPLICATIONS. Mairav Mintz, PE, CCM Sagar Khadka, DRMP, FAACE

Risk Management Policy and Framework

L U N D S U N I V E R S I T E T. Projektledning och Projektmetodik

A Second Runway for Gatwick Appendix. A21 Programme Risk Management

SECTION II.7 MANAGING PROJECT RISKS

MINI GUIDE. Project risk analysis and management

KNPC Risk Approach for Projects Economic Evaluation

RISK REGISTER POLICY AND PROCEDURE

client user GUIDE 2011

LCS International, Inc. PMP Review. Chapter 6 Risk Planning. Presented by David J. Lanners, MBA, PMP

Crowe, Dana, et al "EvaluatingProduct Risks" Design For Reliability Edited by Crowe, Dana et al Boca Raton: CRC Press LLC,2001

How to Consider Risk Demystifying Monte Carlo Risk Analysis

A SIMPLE METHOD OF RISK/HAZARD ASSESSMENT IN DREDGING

The Impact of Gulf of Mexico-Deepwater Permit Delays on US Oil and Natural Gas Production, Investment, and Government Revenue

Harnessing Uncertainty for Orebody Modelling and Strategic Mine Planning

Fundamentals of Project Risk Management

Job Safety Analysis Preparation And Risk Assessment

Project Theft Management,

EFFECTIVE TECHNIQUES IN RISK MANAGEMENT. Joseph W. Mayo, PMP, RMP, CRISC September 27, 2011

QUANTITATIVE AND QUALITATIVE RISK ASSESSMENTS A HIGHLY NEGLECTED METHODOLOGY

Risk Management Guideline July, 2017

Helmerich & Payne, Inc.

FNCE 4030 Fall 2012 Roberto Caccia, Ph.D. Midterm_2a (2-Nov-2012) Your name:

Enercom Oil & Gas Conference August 16, Marshall Dodson Senior Vice President & Chief Financial Officer

Table of Contents Advantages Disadvantages/Limitations Sources of additional information. Standards, textbooks & web-sites.

RISK ASSESSMENT AND RISK MODELLING IN GEOTHERMAL DRILLING. Lilian Aketch Okwiri

NTEGRATEDCOSTANDSCHEDULE

Cost Risk Assessment Building Success and Avoiding Surprises Ken L. Smith, PE, CVS

Unit 9: Risk Management (PMBOK Guide, Chapter 11)

Making Decisions in the Face of Risk and Uncertainty

RISK ANALYSIS AND CONTINGENCY DETERMINATION USING EXPECTED VALUE TCM Framework: 7.6 Risk Management

RISK MANAGEMENT ON USACE CIVIL WORKS PROJECTS

Download slides on SEO Südwest

Scouting Ireland Risk Management Framework

Recent Developments in Production Forecasting and Optimisation Methods

RISK MANAGEMENT PROFESSIONAL. 1 Powered by POeT Solvers Limited

Presented to: Eastern Idaho Chapter Project Management Institute. Presented by: Carl Lovell, PMP Contract and Technical Integration.

Project Selection Risk

Chapter 9. Risk Analysis and Real Options

Jeremy Thigpen, President and Chief Executive Officer. Scotia Howard Weil New Orleans March 2016

Integrated Cost-Schedule Risk Analysis Improves Cost Contingency Calculation ICEAA 2017 Workshop Portland OR June 6 9, 2017

Risk Management Framework. Metallica Minerals Ltd

For the PMP Exam using PMBOK Guide 5 th Edition. PMI, PMP, PMBOK Guide are registered trade marks of Project Management Institute, Inc.

Chapter 7 Risk Analysis, Real Options, and Capital Budgeting

The basics of verification. Richard Nott Lloyd s Register EMEA

Collective Defined Contribution Plan Contest Model Overview

Risk Assessment Mitigation Phase Risk Mitigation Plan Lessons Learned (RAMP B) November 30, 2016

HAZARD IDENTIFICATION AND ASSESSMENT

ENTERPRISE RISK MANAGEMENT (ERM) GOVERNANCE POLICY PEDERNALES ELECTRIC COOPERATIVE, INC.

Project Management for the Professional Professional Part 3 - Risk Analysis. Michael Bevis, JD CPPO, CPSM, PMP

Multi-stage Interventions to Promote Persistent Plug-load Energy Savings in Office Buildings

28 July May October 2016

SCAF Workshop Integrated Cost and Schedule Risk Analysis. Tuesday 15th November 2016 The BAWA Centre, Filton, Bristol

Master Class: Construction Health and Safety: ISO 31000, Risk and Hazard Management - Standards

Resource Planning with Uncertainty for NorthWestern Energy

Cleveland Technical Presentation September 19, 2014

Practical steps to reduce Serious Injuries & Fatalities (SIFs)

RISK AND OPPORTUNITY ASSESSMENT GUIDE RISK CRITERIA

Quantitative Risk Analysis with Microsoft Project

Federal Transit Administration United States Department of Transportation Washington, DC 20590

Risk & uncertainty management in the context of auction models how to increase success

Dilemmas in risk assessment

Control of Well or Operators Extra Expense Insurance. Paddy Miller Aon Limited, Energy

PIONEER OIL AND GAS TERMS OF PURCHASE COLEMAN LEASE WASATCH AND DUCHESNE COUNTIES, UTAH

Solvency Assessment and Management: Stress Testing Task Group Discussion Document 96 (v 3) General Stress Testing Guidance for Insurance Companies

Kidsafe NSW Risk Management Plan. August 2014

Procedure for Address Business Risk and Opportunities

Risk Management Framework

A Stochastic Approach for Pavement Condition Projections and Budget Needs for the MTC Pavement Management System

National University of Singapore Dept. of Finance and Accounting. FIN 3120A: Topics in Finance: Fixed Income Securities Lecturer: Anand Srinivasan

The data contained in this presentation that are not historical facts are forward looking statements within the meaning of the Private Securities

Poor Man s Approach to Monte Carlo

Anticipated Well Cost Guidelines (Third Edition)

Preparing and assessing an agriculture index insurance product proposal, Kampala, 25 th May, 2017

Transcription:

Risk and Uncertainty Management Best Practices and Misapplications for Cost and Schedule Estimates SPE 97269 John de Wardt, DE WARDT AND CO INC Susan Peterson, J Murtha and Assoc s James Murtha, J Murtha and Assoc s SPE 97269; J de Wardt, S Peterson & J Murtha 1

We have an important message for engineers and managers Risk and uncertainty management is a powerful tool that improves project outcome The two stages are qualitative and quantitative: Managing risk and uncertainty Understanding project outcome ranges Misunderstandings and misapplications are losing huge performance opportunities Our recommendations will ensure correct application with improved project outcomes SPE 97269; J de Wardt, S Peterson & J Murtha 2

N Sea development well in active faulting area Drilling problems threatened project economics trouble costs approached 35% and occasionally 50% 1 in 3 wells failed to reach objectives extended drilling time delayed production Operator / supplier team risk / uncertainty management very challenging ERD well 25% below historic cost slot recovery in 18 vs 29 days drilled well 30% ahead of past performance repeated performance overcame failed wells

Deepwater GOM SPE 97269; J de Wardt, S Peterson & J Murtha 4

Start by developing the Qualitative process as the first phase Identification is a critical & continuous process Group of people representing full cross section Brainstorming meetings, interviews or similar Assessment Develop a risk / uncertainty matrix that is relevant to the project Rank the risks to identify those that are project critical Develop mitigation plans Design / re-plan to reduce or remove Contingency plan to offset Management Build and maintain a log (register) SPE 97269; J de Wardt, S Peterson & J Murtha 5

Impact An example of an assessment matrix HSE Schedule Capital cost Operating cost Functionality Production Reputation Fatality or serious permanent injury 1 w eek $ 1 mill Loss of >50% PI Reduction 50% Prosecution Possible loss of operating license 25 25 50 75 100 Serious injury 1 day $100,000 Loss of 10 to 50% PI Reduction 25% Regulator involvement 10 10 20 30 40 Lost Time Incident 6 hours $25,000 Loss of <10% PI Reduction 10% Complaints from local community 5 5 10 15 20 First Aid 1 hour $5,000 Little impact Little impact Little impact 1 1 2 3 4 1 2 3 4 Probability / Frequency > 5 years 1 year 6 months < 14 days < 5% 5-25% 25-50% > 50% SPE 97269; J de Wardt, S Peterson & J Murtha 6

Key headings in the Qualitative Risk Log Risk identifier Project phase Risk event Risk cause Estimate of risk probability (from the matrix) Estimate of risk impact Identification of type of impact (safety, cost (opex / capex), schedule, functionality) Risk ownership Mitigation actions Plan it out, develop contingency Cost / benefit of mitigation Timing of mitigation SPE 97269; J de Wardt, S Peterson & J Murtha 7

Key headings in the Qualitative Risk Log Risk identifier Project phase Risk event Risk cause Estimate of risk probability (from the matrix) Estimate of risk impact Identification of type of impact (safety, cost (opex / capex), schedule, functionality) Risk ownership Mitigation actions Plan it out, develop contingency Cost / benefit of mitigation Timing of mitigation SPE 97269; J de Wardt, S Peterson & J Murtha 8

Risk or Uncertainty Impact type Impact rating Probability rating Risk rating Risk ID Project sub group Project phase Description of event Description of cause 1 Proj Specification NAPIMS approval later than scheduled Delays beyond expected duration Risk Schedule 25 3 75 2 Poorly understood process requirement Uncertainty of process rate and stream conditions is interpreted as chnages in design parameter Uncertainty Functionality 10 4 40 Resources assigned late, insufficient resources 3 Work not completed according to schedule assigned Risk Schedule 25 4 100 4 Subsurface Proj Specification Gas volumes are larger than base case used in FEED Oron production Uncertainty Functionality 5 1 5 5 Subsurface Proj Specification Gas volumes are larger than base case used in FEED Additional upside production Uncertainty Functionality 5 2 10 Proj Current structures unable to take additional 6 Facilities Specification loads of risers, etc Structures inadequate for additional use Risk Capital cost 10 2 20 7 Facilities Proj Specification Loss of oil production Shut down required for interfacing the CPU 2 to current production Risk Production 10 3 30 8 Facilities Proj Specification Insuffiicient reserves to meet sales contract Non associated gas less than expected 0 10 0 SPE 97269; J de Wardt, S Peterson & J Murtha 9

Risk or Uncertainty Impact type Impact rating Probability rating Risk rating Risk ID Project sub group Project phase Description of event Description of cause 1 Proj Specification NAPIMS approval later than scheduled Delays beyond expected duration Risk Schedule 25 3 75 2 Poorly understood process requirement Uncertainty of process rate and stream conditions is interpreted as chnages in design parameter Uncertainty Functionality 10 4 40 Resources assigned late, insufficient resources 3 Work not completed according to schedule assigned Risk Schedule 25 4 100 4 Subsurface Proj Specification Gas volumes are larger than base case used in FEED Oron production Uncertainty Functionality 5 1 5 5 Subsurface Proj Specification Gas volumes are larger than base case used in FEED Additional upside production Uncertainty Functionality 5 2 10 Proj Current structures unable to take additional 6 Facilities Specification loads of risers, etc Structures inadequate for additional use Risk Capital cost 10 2 20 7 Facilities Proj Specification Loss of oil production Shut down required for interfacing the CPU 2 to current production Risk Production 10 3 30 8 Facilities Proj Specification Insuffiicient reserves to meet sales contract Non associated gas less than expected 0 10 0 Risk identifier Project phase Risk event Risk cause Estimate of risk probability (from the matrix) Estimate of risk impact Identification of type of impact (safety, cost (opex / capex), schedule, functionality) Risk ownership Mitigation actions Plan it out, develop contingency Cost / benefit of mitigation Timing of mitigation SPE 97269; J de Wardt, S Peterson & J Murtha 10

Misunderstandings and misapplications in the qualitative process Single person compiles the register and leaves many risks unidentified Risk events are overlooked because they are trivialized ( That never happens ) Register is not linked to quantitative analysis Register is built but insufficient action to mitigate Complex computer programs act like black boxes open, visible spreadsheets work very well SPE 97269; J de Wardt, S Peterson & J Murtha 11

Transition from Qualitative to Quantitative analysis Qualitative analysis prioritizes risks and uncertainties for action Quantitative analysis evaluates the risks and uncertainties using the following methods: Deterministic Decision trees Stochastic Monte Carlo simulation SPE 97269; J de Wardt, S Peterson & J Murtha 12

Risk and Uncertainty Management Misunderstandings in Cost and Schedule Estimating That it is possible to have enough information and/or data to do a deterministic analysis, yet not enough to do uncertainty and risk analysis. SPE 97269; J de Wardt, S Peterson & J Murtha 13

Risk and Uncertainty Management Misunderstandings in Cost and Schedule Estimating That it is possible to have enough information and/or data to do a deterministic analysis, yet not enough to do uncertainty and risk analysis. Uncertainty and risk analysis are only useful once the program or project is underway and well-defined. SPE 97269; J de Wardt, S Peterson & J Murtha 14

Risk and Uncertainty Management Misunderstandings in Cost and Schedule Estimating There must be an agreed deterministic estimate prior to creating a probabilistic estimate. SPE 97269; J de Wardt, S Peterson & J Murtha 15

Risk and Uncertainty Management Misunderstandings in Cost and Schedule Estimating There must be an agreed deterministic estimate prior to creating a probabilistic estimate. The deterministic estimate has some statistical relevance. SPE 97269; J de Wardt, S Peterson & J Murtha 16

Risk and Uncertainty Management Misunderstandings in Cost and Schedule Estimating Risk and uncertainty analysis will lead to more accurate estimates. SPE 97269; J de Wardt, S Peterson & J Murtha 17

Risk and Uncertainty Management Misunderstandings in Cost and Schedule Estimating Risk and uncertainty analysis will lead to more accurate estimates. All risks can, or should, be explicitly listed. SPE 97269; J de Wardt, S Peterson & J Murtha 18

Additional items in Risk Register for Quantitative Model Relation to other risks Mitigation success probability Cost / benefit of mitigation Timing of mitigation SPE 97269; J de Wardt, S Peterson & J Murtha 19

Risk Register Link to Quantitative Model No Risk Description L M H Likelihood Cost Impact Grade Change Related Risks Mitigation Strategy Owner Mitigation P(Success) Mitigation Cost Ratio Date Reported Date Closed 1 2 3 4 5 6 Related Risks (correlation and mutual exclusivity) 7 8 9 10 11 12 13 14 15 SPE 97269; J de Wardt, S Peterson & J Murtha 20

Risk Register Link to Quantitative Model No Risk Description L M H Likelihood Cost Impact Grade Change Related Risks Mitigation Strategy Owner Mitigation P(Success) Mitigation Cost Ratio Date Reported Date Closed 1 2 3 4 5 6 7 Mitigation probability of success 8 9 10 11 12 13 14 15 SPE 97269; J de Wardt, S Peterson & J Murtha 21

Risk Register Link to Quantitative Model No Risk Description L M H Likelihood Cost Impact Grade Change Related Risks Mitigation Strategy Owner Mitigation P(Success) Mitigation Cost Ratio Date Reported Date Closed 1 2 3 4 5 6 7 8 Mitigation Cost Ratio (cost of mitigation to risk cost) 9 10 11 12 13 14 15 SPE 97269; J de Wardt, S Peterson & J Murtha 22

Misapplications in the quantitative analysis Risk register not linked to the quantitative risk and uncertainty model. Distributions assigned to all the inputs, just because we can. SPE 97269; J de Wardt, S Peterson & J Murtha 23

Distributions on every entry Operation Min time Avg time max time Min NPT Avg NPT Max Npt Avg NPT hrs hrs hrs hrs hrs hrs hrs Mobilize Rig Job Move Equipment 1.00 2.00 3.00 2.00 0.10 0.30 0.75 0.30 Transit Rig 8.00 12.00 24.00 12.00 0.80 1.80 6.00 1.80 Inspect Area 0.50 1.00 2.00 1.00 0.05 0.15 0.50 0.15 Safety Meeting 0.25 0.50 0.75 0.50 0.03 0.08 0.19 0.08 Position Rig 1.00 2.00 3.00 2.00 0.10 0.30 0.75 0.30 Rig Up Land Rig 4.00 8.00 12.00 8.00 0.40 1.20 3.00 1.20 Rig Up Surface Equipment 2.00 4.00 6.00 4.00 0.20 0.60 1.50 0.60 Pick Up And Make Up Tubular 1.00 2.00 3.00 2.00 0.10 0.30 0.75 0.30 Drill Wellbore Job Drive Conductor Safety Meeting 0.25 0.50 0.75 0.50 0.03 0.08 0.19 0.08 Assemble Equipment 1.00 2.00 3.00 2.00 0.10 0.30 0.75 0.30 Drive Conductor 4.30 5.74 7.17 5.74 0.43 0.86 1.79 0.86 Disassemble Equipment 0.50 2.00 2.00 2.00 0.05 0.30 0.50 0.30 Drillout Safety Meeting 0.25 0.50 0.75 0.50 0.01 0.05 0.11 0.05 Pick Up And Make Up Bha 2.00 3.00 4.00 3.00 0.10 0.30 0.60 0.30 Run In Hole 0.09 0.12 0.16 0.12 0.00 0.01 0.02 0.01 Circulate 0.25 0.50 0.63 0.50 0.01 0.05 0.09 0.05 Drill Shoe Track 0.50 1.00 2.00 1.00 0.03 0.10 0.30 0.10 Drill Surface Drill Rotary 1.86 2.48 3.10 2.48 0.09 0.25 0.47 0.25 Circulate 0.63 0.78 0.94 0.78 0.03 0.08 0.14 0.08 Short Trip 0.17 0.26 0.35 0.26 0.01 0.03 0.05 0.03 Circulate 0.63 0.78 0.94 0.78 0.03 0.08 0.14 0.08 Pull Out Of Hole 0.16 0.21 0.32 0.21 0.01 0.02 0.05 0.02 Pull Out And Lay Down BHA 2.00 3.00 4.00 3.00 0.10 0.30 0.60 0.30 Run Surface Clear Rig Floor 0.30 0.50 1.00 0.50 0.02 0.05 0.15 0.05 Assemble Equipment 0.30 0.50 1.00 0.50 0.02 0.05 0.15 0.05 Safety Meeting 0.25 0.50 0.75 0.50 0.01 0.05 0.11 0.05 Pick Up And Make Up Tubular 0.50 1.00 2.00 1.00 0.03 0.10 0.30 0.10 Run Tubular 0.74 0.98 1.23 0.98 0.04 0.10 0.18 0.10 Circulate 0.06 0.11 0.17 0.11 0.00 0.01 0.03 0.01 Cement Surface Rig Up Surface Equipment 0.50 1.00 2.00 1.00 0.03 0.10 0.30 0.10 Safety Meeting 0.30 0.50 0.75 0.50 0.02 0.05 0.11 0.05 Test Equipment 0.30 0.50 1.00 0.50 0.02 0.05 0.15 0.05 Circulate 0.09 0.11 0.14 0.11 0.00 0.01 0.02 0.01 Pump Spacer 0.09 0.12 0.15 0.12 0.00 0.01 0.02 0.01 Mix And Pump Slurry 0.27 0.35 0.44 0.35 0.01 0.04 0.07 0.04 Displace Slurry 0.09 0.11 0.14 0.11 0.00 0.01 0.02 0.01 Rig Down Surface Equipment 0.50 1.00 2.00 1.00 0.03 0.10 0.30 0.10 Planned Wait 3.00 5.00 8.00 5.00 0.15 0.50 1.20 0.50 Install BOP Safety Meeting 0.25 0.50 0.75 0.50 0.03 0.08 0.19 0.08 Inspect Area 0.25 0.50 0.75 0.50 0.03 0.08 0.19 0.08 Inspect Equipment 0.25 0.50 0.75 0.50 0.03 0.08 0.19 0.08 Install Blow Out Preventer 4.00 8.00 12.00 8.00 0.40 1.20 3.00 1.20 Test BOP Stack 2.00 4.00 6.00 4.00 0.20 0.60 1.50 0.60 Drillout Safety Meeting 0.25 0.50 0.75 0.50 0.01 0.05 0.11 0.05 Pick Up And Make Up Bha 2.00 3.00 4.00 3.00 0.10 0.30 0.60 0.30 Run In Hole 0.16 0.21 0.26 0.21 0.01 0.02 0.04 0.02 Circulate 0.63 0.78 0.94 0.78 0.03 0.08 0.14 0.08 Drill Shoe Track 0.50 1.00 2.00 1.00 0.03 0.10 0.30 0.10 Conduct FIT or LOT Rig Up Surface Equipment 0.25 0.50 0.75 0.50 0.01 0.05 0.11 0.05 Safety Meeting 0.25 0.50 0.75 0.50 0.01 0.05 0.11 0.05 Test Equipment 0.25 0.50 0.75 0.50 0.01 0.05 0.11 0.05 Circulate 0.63 0.78 0.94 0.78 0.03 0.08 0.14 0.08 Perform LOT 0.25 0.50 0.75 0.50 0.01 0.05 0.11 0.05 Rig Down Surface Equipment 0.25 0.50 0.75 0.50 0.01 0.05 0.11 0.05 Drill Intermediate Drill Rotary 75.91 101.22 126.52 101.22 3.80 10.12 18.98 10.12 Circulate 0.82 1.03 1.23 1.03 0.04 0.10 0.18 0.10 Short Trip 3.57 5.35 7.13 5.35 0.18 0.53 1.07 0.53 Circulate 0.82 1.03 1.23 1.03 0.04 0.10 0.18 0.10 Pull Out Of Hole 2.91 3.88 4.85 3.88 0.15 0.39 0.73 0.39 Pull Out And Lay Down Bha 2.00 3.00 4.00 3.00 0.10 0.30 0.60 0.30 SPE 97269; J de Wardt, S Peterson & J Murtha 24

SPE 97269; J de Wardt, S Peterson & J Murtha 25

SPE 97269; J de Wardt, S Peterson & J Murtha 26

Misapplications in the quantitative analysis Risk register not linked to the quantitative risk and uncertainty model. Distributions assigned to all the inputs, just because we can. Models not used for decision-making. SPE 97269; J de Wardt, S Peterson & J Murtha 27

Use Models for Technology Decision-Making. Comparison Of Well Cost Using WBM to OBM 1 5% 95% 0.8 WBM, M ean = 11.2 M M $ OBM, M ean = 11.1 M M $ 0.6 0.4 0.2 0 9.5 11 12.5 14 Well Cost [MM$] SPE 97269; J de Wardt, S Peterson & J Murtha 28

Well 1 Summary 39% of cases require a ST BO loca 90% 10% 85% of cases involve 2X Completions 15% of cases involve only 1X Completion OK POOR RE-B loca BO locb OK 60% 40% 10% 90% POOR OK POOR 2X COMP. (no ST) 40% 40% 20% RE-B loca BO locc P = 0.54 RE-A locok-1 OK OK RE-B locb 80% 20% POOR 60% OK 40% POOR 90% 10% OK POOR 2X COMP. (1 ST) 2X COMP. (1 ST) 1X COMP. (1 ST) 1X COMP. (no ST) 2X COMP. (1 ST) 1X COMP. (1 ST) P = 0.01 P = 0.14 P = 0.12 P = 0.03 P = 0.07 P = 0.05 P = 0.04 SPE 97269; J de Wardt, S Peterson & J Murtha 29

Misapplications in the quantitative analysis Risk register not linked to the quantitative risk and uncertainty model. Distributions assigned to all the inputs, just because we can. Models not used for decision-making. Abandoning uncertainty and risk analysis because the desired deterministic estimate falls at an embarrassing point in (or off) the probabilistic distribution. SPE 97269; J de Wardt, S Peterson & J Murtha 30

Misapplications in the quantitative analysis Risk register not linked to the quantitative risk and uncertainty model. Distributions assigned to all the inputs, just because we can. Models not used for decision-making. Abandoning uncertainty and risk analysis because the desired deterministic estimate falls at an embarrassing point in (or off) the probabilistic distribution. Cost and schedule risk isolated from production and market risk. SPE 97269; J de Wardt, S Peterson & J Murtha 31

Cumulative Probability Use Models for Bid Evaluations. Including Production and Schedule Risk! Bidder Comparison, Buy After 1 Year Option 1 10% 90% 0.8 0.6 0.4 0.2 Bidder1 Bidder2 Bidder3 Bidder4 0-200 -100 0 100 200 300 NPV (MM$) SPE 97269; J de Wardt, S Peterson & J Murtha 32

Conclusions Best practice projects out perform the norm Correct application enables re-design, replanning and contingencies for improved performance Quantitative analysis enables significantly improved decision making Realistic cost and schedule estimates can only be generated through correct probabilistic analysis Correct understanding of qualitative and quantitative analysis is linked to company performance through project delivery SPE 97269; J de Wardt, S Peterson & J Murtha 33