Assessing Modularity-in-Use in Engineering Systems. 2d Lt Charles Wilson, Draper Fellow, MIT Dr. Brenan McCarragher, Draper

Similar documents
Advanced Financial Modeling. Unit 2

Prioritization of Climate Change Adaptation Options. The Role of Cost-Benefit Analysis. Session 8: Conducting CBA Step 7

Uncertainty in Economic Analysis

California Department of Transportation(Caltrans)

Project Risk Management. Prof. Dr. Daning Hu Department of Informatics University of Zurich

STOCHASTIC COST ESTIMATION AND RISK ANALYSIS IN MANAGING SOFTWARE PROJECTS

Project Management for the Professional Professional Part 3 - Risk Analysis. Michael Bevis, JD CPPO, CPSM, PMP

Project Theft Management,

Decision Support Models 2012/2013

STOCHASTIC COST ESTIMATION AND RISK ANALYSIS IN MANAGING SOFTWARE PROJECTS

Alpha, Beta, and Now Gamma

Adaptation Assessment: Economic Analysis of Adaptation Measures

Cost Risk and Uncertainty Analysis

Value at Risk Ch.12. PAK Study Manual

Using Monte Carlo Analysis in Ecological Risk Assessments

METHODOLOGY For Risk Assessment and Management of PPP Projects

Optimizing the Incremental Delivery of Software Features under Uncertainty

Luke and Jen Smith. MONTE CARLO ANALYSIS November 24, 2014

How to Consider Risk Demystifying Monte Carlo Risk Analysis

Analytical Finance 1 Seminar Monte-Carlo application for Value-at-Risk on a portfolio of Options, Futures and Equities

NATIONWIDE ASSET ALLOCATION INVESTMENT PROCESS

MONETIZING RISKS A PRIORITIZATION & OPTIMIZATION SOLUTION JASON DE STIGTER, P.E. 13 October 2014

SSC - Appendix A35. South Staffordshire Water PR19. Monte Carlo modelling of ODI RoRE. Issue 3 Final 29/08/18. South Staffordshire Water

Fiduciary Insights. COMPREHENSIVE ASSET LIABILITY MANAGEMENT: A CALM Aproach to Investing Healthcare System Assets

Fundamentals of Project Risk Management

Probabilistic Benefit Cost Ratio A Case Study

Overview. We will discuss the nature of market risk and appropriate measures

A Model to Quantify the Return On Information Assurance

Integrated Cost-Schedule Risk Analysis Improves Cost Contingency Calculation ICEAA 2017 Workshop Portland OR June 6 9, 2017

Supply Chain Resilience Evaluation And Mitigation

Overview of Asset/Liability Process. City of Jacksonville Police & Fire Pension Fund

A Framework for Valuing, Optimizing and Understanding Managerial Flexibility

Understanding the Principles of Investment Planning Stochastic Modelling/Tactical & Strategic Asset Allocation

Risk Video #1. Video 1 Recap

RISK BASED LIFE CYCLE COST ANALYSIS FOR PROJECT LEVEL PAVEMENT MANAGEMENT. Eric Perrone, Dick Clark, Quinn Ness, Xin Chen, Ph.D, Stuart Hudson, P.E.

Excavation and haulage of rocks

Optimization: Stochastic Optmization

Chapter 10 Inventory Theory

AIRCURRENTS: PORTFOLIO OPTIMIZATION FOR REINSURERS

The Risky Business of. Risk Management

Relative Total Shareholder Return Plans: Valuation 103 How Design Decisions Impact the Cost of Relative Total Shareholder Return Awards

SAMPLE. CPM SCHEDULE RISK MODELING AND ANALYSIS: SPECIAL CONSIDERATIONS TCM Framework: 7.6 Risk Management

Notes for CHEE 332 Report

Modeling credit risk in an in-house Monte Carlo simulation

RISK MANAGEMENT. Budgeting, d) Timing, e) Risk Categories,(RBS) f) 4. EEF. Definitions of risk probability and impact, g) 5. OPA

Assessing the Impact of Confidence Levels in Funding and Budgeting NASA Science Missions

Monte Carlo Introduction

Presented to: Eastern Idaho Chapter Project Management Institute. Presented by: Carl Lovell, PMP Contract and Technical Integration.

Retirement Capital & What-If? John and Mary Sample

Quantitative and Qualitative Disclosures about Market Risk.

Financial Engineering and Structured Products

Backtesting and Optimizing Commodity Hedging Strategies

Cost Containment through Offsets in the Cap-and-Trade Program under California s Global Warming Solutions Act 1 July 2011

INTEREST RATE RISK MAKING YOUR MODEL UNDERSTANDABLE AND RELEVANT

SCAF Workshop Integrated Cost and Schedule Risk Analysis. Tuesday 15th November 2016 The BAWA Centre, Filton, Bristol

Comparison of Estimation For Conditional Value at Risk

New Research on How to Choose Portfolio Return Assumptions

Review of the Federal Transit Administration s Transit Economic Requirements Model. Contents

WRMP19 Water Resource Zone Problem Characterisation for Selection of Appropriate Planning Horizon and Assessment Method Statement

CA. Sonali Jagath Prasad ACA, ACMA, CGMA, B.Com.

Monitoring Accrual and Events in a Time-to-Event Endpoint Trial. BASS November 2, 2015 Jeff Palmer

Managing the Uncertainty: An Approach to Private Equity Modeling

An Integrated Risk Management Model for Japanese Non-Life Insurers. Sompo Japan Insurance Inc. Mizuho DL Financial Technology 25 February 2005

RBC retirement income planning process

Presented by Kristina Narvaez President & CEO ERM Strategies, LLC

Cost Risk Assessment Building Success and Avoiding Surprises Ken L. Smith, PE, CVS

EARNED VALUE MANAGEMENT AND RISK MANAGEMENT : A PRACTICAL SYNERGY INTRODUCTION

Acritical aspect of any capital budgeting decision. Using Excel to Perform Monte Carlo Simulations TECHNOLOGY

Week 1 Quantitative Analysis of Financial Markets Distributions B

Project Management Certificate Program

Optimal Withdrawal Strategy for Retirement Income Portfolios

Credit Portfolio Simulation with MATLAB

Project Risk Management

Asset Allocation in a non-normal Framework using PortfolioChoice A New Approach to Portfolio Selection

The ALM & Market Risk Management

MCDA for budgeting, prioritisation and resource allocation. Professor Larry Phillips London School of Economics and Facilitations Limited

MANAGEMENT SCIENCE doi /mnsc ec pp. ec1 ec5

SENSITIVITY ANALYSIS IN CAPITAL BUDGETING USING CRYSTAL BALL. Petter Gokstad 1

Growth-indexed bonds and Debt distribution: Theoretical benefits and Practical limits

9. Integrated Resource Plan and Risk Analysis

ASC Topic 718 Accounting Valuation Report. Company ABC, Inc.

Market Risk Management Framework. July 28, 2012

From Financial Risk Management. Full book available for purchase here.

OBAA OBJECTIVES-BASED ASSET ALLOCATION TRULY EFFECTIVE ASSET ALLOCATION FOR INSURANCE COMPANIES DOES YOUR PORTFOLIO SUPPORT YOUR BUSINESS OBJECTIVES?

Optimizing Modular Expansions in an Industrial Setting Using Real Options

Review of Expected Operations

An Approach for Integrating Valuable Flexibility During Conceptual Design of Networks

Better decision making under uncertain conditions using Monte Carlo Simulation

Short & Long Run impact of volatility on the effect monetary shocks

CO-INVESTMENTS. Overview. Introduction. Sample

Getting Beyond Ordinary MANAGING PLAN COSTS IN AUTOMATIC PROGRAMS

The Common Risk Model for Dams (CRM-D), developed

Risk Factors as Building Blocks for Portfolio Diversification: The Chemistry of Asset Allocation

Measuring Retirement Plan Effectiveness

Business Auditing - Enterprise Risk Management. October, 2018

Guidelines Guidelines on stress tests scenarios under Article 28 of the MMF Regulation

Life-Cycle Cost Analysis: A Practitioner s Approach

Rebalancing the Simon Fraser University s Academic Pension Plan s Balanced Fund: A Case Study

RISK MANAGEMENT ON USACE CIVIL WORKS PROJECTS

Transcription:

Assessing Modularity-in-Use in Engineering Systems 2d Lt Charles Wilson, Draper Fellow, MIT Dr. Brenan McCarragher, Draper

Modularity-in-Use Modularity-in-Use allows the user to reconfigure the system Distinct from Modularity-in- Design and Modularity-in- Manufacturing which benefit designers and producers Benefits to the user Flexibility Maintainability Future cost savings Increased lifespan Potential disadvantages Higher initial cost Reduced initial performance Modular Products. Clockwise from top left: John Deere Tractor, Izzy Modular Office Furniture, Arleigh Burke Class Destroyer, Craftsman Modular Power Tool Set. 2

System Flexibility Modularity-in-use provides system flexibility Flexibility increases system lifespan environment changes but system remains useful As time progresses environmental uncertainty increases Evolving threats New deployment environments Changing use cases decreases in rigid systems as environment changes Relationship between flexibility and system lifespan. Credit: J.H. Saleh et al. (2002). Challenge: assessing the value of increased flexibility due to Modularity-in-Use 3

Risk Reduction Risk: the possibility of a future performance gap quantified by future performance variance or probability of meeting required performance threshold. Rigid system has high future performance risk Flexible system has low future performance risk but initial performance tradeoff Lower future performance risk results in longer lifespan Difference in performance over time in rigid vs flexible system. Credit: Saleh et al. (2009). 4

Flexibility Assessment Process Identify Environment / Use Parameters Elements beyond control Potentially probabilistic Define System Architecture Elements within designer s control May change with modular reconfiguration Model System Measure one or more Key Parameters Modeled modular system reconfigures Repeat for All Design Options Metric e.g. P(kill) Simulate Future Uncertainty Monte Carlo simulation Future environment / use parameters probabilistic Model of modular system adapts with changing parameters to maximize performance Measure Flexibility Future performance risk quantified by negative performance variance Assess differences in mean design performance & negative performance risk Examine performance in specific futures Assessing future performance risk reduction due to system flexibility under uncertainty 5

Flexibility Measurement Risk quantified by performance variance Calculate probability system will meet performance threshold Distribution average represents expected value of performance Example scenario: rigid system has higher average performance but greater variance Example performance threshold: 76 Modular system has 72% probability of meeting or exceeding threshold Threshold Threshold 28% 72% Rigid system has 67% probability 5% lower than modular system despite higher average performance 33% 67% Test performance under specific future scenarios Two Hypothetical Systems Compared: example tradeoff between expected performance and variance. 6

Modularity-in-Use Case Study Objective: provide decision maker greater insight into how each design performs in uncertain future Product: modular water bottles with solid food storage containers Model: Multi-Attribute Decision Matrix Use Parameters: user s weights of product attributes Liquid capacity Solid Capacity Weight Pill Tray Cost Metric: single utility score Four products evaluated Small, medium, and large rigid bottles Modular bottle Small Medium Large Modular 7

Case Study Model Identify Environment / Use Parameters Elements beyond control Potentially probabilistic Define System Architecture Elements within designer s control May change with modular reconfiguration Environment / Use Parameters defined as user s perceived importance of product attributes System Architecture defined by physical attributes of the product Model System Measure one or more Key Parameters Modeled modular system reconfigures Utility score calculated based on attribute weights and raw attribute data Relationships between attribute weights, raw data, and utility defined a priori Attributes, relative weight, and relationships between each attribute and utility normalized from 0 to 10. 8

Simulation of Uncertainty Weights defined by uniform random variables 30,000 future scenarios simulated Modular product reconfigured in each trial to maximize utility data collected Specific future scenarios evaluated Product Mean Threshold P Small 4.80 34% Medium 4.40 20% Large 4.01 14% Modular 6.22 90% Threshold: 5 Simulation output. The modular product dominates in terms of both mean performance and probability of meeting the performance threshold 9

Weight Sensitivity Analysis User can compare performance under different future scenarios Modular product dominated on average Small product may still be desirable if Cost and Weight become relatively more important in the future Choose the Small product if this is a concern Modular vs. Small - When is Modular Better? Cost 0 0 10 20 30 40 50 60 70 80 90 100 0 1 1 1 1 1 1 1 1 1 1 1 10 1 1 1 1 1 1 1 1 1 1 1 20 1 1 1 1 1 1 1 1 1 1 1 30 1 1 1 1 1 1 1 1 1 1 1 40 1 1 1 1 1 1 1 1 1 1 1 50 1 1 1 1 1 1 1 1 1 1 0 60 1 1 1 1 1 1 1 1 1 0 0 70 1 1 1 1 1 1 1 1 0 0 0 80 1 1 1 1 1 1 1 0 0 0 0 90 1 1 1 1 1 1 0 0 0 0 0 100 1 1 1 1 1 0 0 0 0 0 0 Analysis conducted by altering Cost and Weight attribute weights while holding others constant. The Small product outperforms the Modular product when both are relatively more important. 10

Summary Benefits of modularity can be assessed by measuring performance risk risk measured through simulation of system performance under uncertainty Minimizing performance risk results in longer system lifespan Better equipped force Future cost savings Lower performance risk in modular system Longer system lifespan Flexibility granted by Modularity-in-Use can be assessed by measuring future performance risk to the user Higher average performance in rigid system but higher performance risk Shorter system lifespan 11