PROGRAMMATIC RISK MANAGEMENT PLAN

Similar documents
Programmatic Risk Management in Space Projects

SECTION II.7 MANAGING PROJECT RISKS

Risk Management Plan for the <Project Name> Prepared by: Title: Address: Phone: Last revised:

Integrated Cost Schedule Risk Analysis Using the Risk Driver Approach

INTERNATIONAL ASSOCIATION OF INSURANCE SUPERVISORS

RISK MANAGEMENT. Budgeting, d) Timing, e) Risk Categories,(RBS) f) 4. EEF. Definitions of risk probability and impact, g) 5. OPA

Integrated Cost Schedule Risk Analysis Using the Risk Driver Approach

Fundamentals of Project Risk Management

INTERNATIONAL ASSOCIATION OF INSURANCE SUPERVISORS

STOCHASTIC COST ESTIMATION AND RISK ANALYSIS IN MANAGING SOFTWARE PROJECTS

Presented to: Eastern Idaho Chapter Project Management Institute. Presented by: Carl Lovell, PMP Contract and Technical Integration.

Decommissioning Basis of Estimate Template

MINI GUIDE. Project risk analysis and management

APPENDIX 1. Transport for the North. Risk Management Strategy

Common Safety Methods CSM

Learning Le cy Document

STOCHASTIC COST ESTIMATION AND RISK ANALYSIS IN MANAGING SOFTWARE PROJECTS

SPECIAL TENDER CONDITIONS FOR THE

Risk Management Plan for the Ocean Observatories Initiative

Planning Construction Procurement. A guide to risk and value management

Risk Management. Webinar - July 2017

Risk Management User Guide. Prepared By: Neville Turbit Version Feb /01/2009 Risk Management User Guide Page 1 of 36

Risk Management. Seminar June Compiled by: Raaghieb Najjaar, Yaeesh Yasseen & Rashied Small

EARNED VALUE MANAGEMENT AND RISK MANAGEMENT : A PRACTICAL SYNERGY INTRODUCTION

Nagement. Revenue Scotland. Risk Management Framework. Revised [ ]February Table of Contents Nagement... 0

Project Theft Management,

Project Risk Management

Advanced Operational Risk Modelling

Project Risk Management. Prof. Dr. Daning Hu Department of Informatics University of Zurich

Unit 9: Risk Management (PMBOK Guide, Chapter 11)

Managing Project Risk DHY

European Railway Agency Recommendation on the 1 st set of Common Safety Methods (ERA-REC SAF)

Cost Risk Assessment Building Success and Avoiding Surprises Ken L. Smith, PE, CVS

Chapter-8 Risk Management

12 GeV CEBAF Upgrade. Risk Management Plan

Master Class: Construction Health and Safety: ISO 31000, Risk and Hazard Management - Standards

Version: th November 2010 RISK MANAGEMENT POLICY

Risk Management at Central Bank of Nepal

Crowe, Dana, et al "EvaluatingProduct Risks" Design For Reliability Edited by Crowe, Dana et al Boca Raton: CRC Press LLC,2001

FRAMEWORK FOR SUPERVISORY INFORMATION

Understanding the Results of an Integrated Cost/Schedule Risk Analysis James Johnson, NASA HQ Darren Elliott, Tecolote Research Inc.

LONG INTERNATIONAL. Rod C. Carter, CCP, PSP and Richard J. Long, P.E.

Use of the Risk Driver Method in Monte Carlo Simulation of a Project Schedule

Risk Management Policy and Procedures.

Cost Risk and Uncertainty Analysis

RISK MANAGEMENT GUIDE FOR DOD ACQUISITION

Kidsafe NSW Risk Management Plan. August 2014

Information Technology Project Management, Sixth Edition

The PRINCE2 Practitioner Examination. Sample Paper TR. Answers and rationales

Nagement. Revenue Scotland. Risk Management Framework

RISK MANAGEMENT STANDARDS FOR P5M

Offshore & Marine Projects and Risks Management

A Second Runway for Gatwick Appendix. A21 Programme Risk Management

February 2010 Office of the Deputy Assistant Secretary of the Army for Cost & Economics (ODASA-CE)

PRINCE2-PRINCE2-Foundation.150q

PILLAR 3 DISCLOSURES MERCER UK AUGUST 2016

Braindumps.PRINCE2-Foundation.150.QA

Risk Analysis Risk Management

Conceptualisation Stage Continued

Risk Management Strategy

ADVANCED QUANTITATIVE SCHEDULE RISK ANALYSIS

C-Beta Cost and Schedule Review Closeout

M_o_R (2011) Foundation EN exam prep questions

INTEGRATING RISK AND EARNED VALUE MANAGEMENT

CMP for Special Regs and Safety Issues. 1. INTRODUCTION Purpose Scope Submissions to Australian Sailing:...

Risk Management Strategy January NHS Education for Scotland RISK MANAGEMENT STRATEGY

Reactive and Proactive Maintenance The Best Mix

Risk Management Policy & Procedures. Premier Ltd.

RISK EVALUATIONS FOR THE CLASSIFICATION OF MARINE-RELATED FACILITIES

RISK MITIGATION IN FAST TRACKING PROJECTS

Presentation on. Risk Assessment. ICAI Seminar on Internal Audit

PRINCE2. Number: PRINCE2 Passing Score: 800 Time Limit: 120 min File Version:

Risk Video #1. Video 1 Recap

INSTITUTE OF BANKERS OF SRI LANKA

TRUST COMPANY BUSINESS

Report by the Comptroller and. SesSIon July Reducing Costs in HM Revenue & Customs

Scouting Ireland Risk Management Framework

LCS International, Inc. PMP Review. Chapter 6 Risk Planning. Presented by David J. Lanners, MBA, PMP

Risk Management Plan

RISK ANALYSIS GUIDE FOR PRIVATE INITIATIVE PROJECTS

Richard J. Long, P.E. and Rod C. Carter, CCP, PSP

Project Risk Management with

A Study on Risk Analysis in Construction Project

ACTUARIAL ADVICE TO A LIFE INSURANCE COMPANY OR FRIENDLY SOCIETY

Project Risk Management

Change Impact: Disruption and Loss of Productivity A Model for Securing Price and Schedule Adjustment

Measurable value creation through an advanced approach to ERM

A Project Management Guide for Researchers

Managing Projects. Part r. with. focusing on Project Risk Management. Pierre Bonnal EN ENGINEERING DEPARTMENT 1.0. version

Risk Management Strategy

Classification Based on Performance Criteria Determined from Risk Assessment Methodology

Table of Contents Advantages Disadvantages/Limitations Sources of additional information. Standards, textbooks & web-sites.

Integrated Earned Value Management and Risk Management Approach in Construction Projects

For the PMP Exam using PMBOK Guide 5 th Edition. PMI, PMP, PMBOK Guide are registered trade marks of Project Management Institute, Inc.

EZ Way Lunch & Learn Webinar Series Presented by Equitable Safety Group. Making Cents. The Business Case for Safe Patient Handling November 13, 2008

LIFE CYCLE ASSET MANAGEMENT. Project Management Overview. Good Practice Guide GPG-FM-001. March 1996

NEGOTIATION REVIEW. Negotiating Risk By Roger Greenfield. thegappartnership.com

D6.2 Risk Assessment Plan

CONTINGENCY. Filed: EB Exhibit D2 Tab 2 Schedule 7 Page 1 of 10

MONITORING THE COUNCIL S INVESTMENTS

Transcription:

Issue: 1 Rev.: 2 Date: 15 Dec 99 PROGRAMMATIC RISK MANAGEMENT PLAN 11 10 12 1 2 9 3 8 7 6 5 4 Directorate of Manned Spaceflight and Microgravity

Issue:1 Rev.: 2 Programmatic Risk Management Plan Date: 15 Dec 1999 Page: ii Document Change Record Issue / Revision Date Section Number Change Description 1 / 0 02 Aug 99 First issue 1 / 1 11 Oct 99 Chapter 5 Working Set for Interview attachments included 1 / 2 15 Dec 99 All chapters Document refinement Further copies of this document may be obtained via Mr R. Tosellini MSM/HCA, (ext. 3352)

Issue:1 Rev.: 2 Programmatic Risk Management Plan Date: 15 Dec 1999 Page: iii TABLE OF CONTENT 1. INTRODUCTION 1 2. OBJECTIVES 1 3. PROGRAMMATIC RISK IMPLEMENTATION PLAN 2 3.1 OVERALL CYCLE 2 3.2 ORGANISATION AND RESPONSIBILITY 4 3.3 DEFINITION OF PROGRAMME/PROJECT RISK MANAGEMENT POLICY 5 3.4 RISK ASSESSMENT 7 3.4.1 RISK IDENTIFICATION 7 3.4.2 RISK ANALYSIS 10 3.4.3 RISK PRIORITISATION 13 3.4.4 CONTINGENCY ANALYSIS 14 3.5 RISK MANAGEMENT 16 3.6 RISK MONITOR AND REPORT 18 4. ATTACHMENTS 4.1 WORKING SET FOR INTERVIEWS 19 4.2 PROGRAMMATIC RISK ASSESSMENT REGISTER 21 4.3 RISK PRIORITISATION AND AVOIDANCE/MITIGATION PLANS 22 STATUS TABLE

1. INTRODUCTION This document provides for promotion, understanding and use of a simplified but structured and systematic approach to Risk Management and defines the scope for implementing Risk Management in the MSM Directorate. It is meant to be a practical procedure whose main aim is to provide guidance through all steps of risk assessment and management both at project and programme level. This document, which is tailored to the needs of MSM Directorate, is consistent with the ECSS Standard, Risk Management (ECSS-M-00-03), set forth in a co-operative effort by the European Space Agency, national space agencies and European industry associations for the purpose of developing and maintaining common standards. The substantial distinction between this document and the ECSS is that the former covers also the analysis of contingency. The plan will be reviewed and updated regularly to reflect changes and improvements to the risk management process. 2. OBJECTIVES Risk Management is an integral part of Project Management. It is applied as a means to avoid, anticipate, mitigate, control risks and to allocate optimally programme/project resources where they are needed to ensure success of the programme. Programmatic Risk is defined as an event of any nature (technical, organisational, political, economical, etc.) which may create an undesired impact on the cost and schedule baseline of a programme/project. Opportunity is defined as an event of any nature that may allow achieving the programme objectives by an amount of resources allocated lower then originally planned. The scope of Risk Management is devoted to risks that correspond to manageable parameters. Therefore, risks of catastrophic and exceptional nature (e.g. launch failures) which are typically of very low probability and very high impact are deliberately not included as they should be covered by insurance. The approach pursued in this document is to combine the many separate project risks and manage the overall programme risk. Indeed, the sum of the contingencies set aside by each project tends to be higher then the contingencies needed to offset the overall programme. The implementation of this approach would permit the optimisation of the allocation of the contingency set aside to offset programme risk. In addition, the selection of the desired confidence level of coverage against the accrual of such risks would also be realised. Manned Spaceflight and Microgravity 1

3. PROGRAMMATIC RISK MANAGEMENT IMPLEMENTATION 3.1 Overall Cycle The programmatic risk management in a project is an iterative process throughout the total project life cycle, with iterations being determined by the project progress through the different project phases and by changes to a given project baseline influencing project resources. The Risk Management process requires information exchange among all project disciplines. Since the greatest uncertainty is in the earliest stages of a project, where also decisions of major impact are made, it should be initiated as early as possible. The procedure that is applied in MSM is shown in Fig. 1 and described in summary herewith: The first step, the definition of a Risk Management Policy, is of crucial importance because it determines the scope and the extent of the overall Programmatic Risk Management. The establishment of the Risk Management Policy is performed at the beginning of a programme/project but it is subject to review/changes anytime deemed necessary. The frequency of the cycles depends on the needs and complexity of the programme/project and also need to be defined during step 1. Exceptional updates are required when major changes to the schedule, technologies, techniques, performance etc. of the project baseline occur. The second step, the Risk Assessment, identifies and estimates the magnitude of the risk scenarios in terms of cost/schedule impact on the project baseline. In this phase a risk scenario prioritization is also carried out with the aim to sort the risk scenarios by their relative criticality. The third step, Manage the Risk, performs the Contingency Analysis and defines which risks can be accepted and for which risk scenarios avoidance/mitigation plans shall be prepared. Moreover, after preparation of the plans, further decisions are taken upon which avoidance/mitigation plans are suitable to be applied. Finally, acceptance of residual risk is considered. The fourth step, Monitor and Report, foresees the systematic control and track of the implementation of the plans selected in the previous step. A report is produced to show the overall project risk status and to track the risk trend during the life cycle of the project. Manned Spaceflight and Microgravity 2

FIG. 1 - PROGRAMMATIC RISK MANAGEMENT CYCLE Manned Spaceflight and Microgravity 3

3.2 ORGANISATION AND RESPONSIBILITY The MSM Directorate strategy is to build the Risk Management process as part of normal day-to-day project management and to strengthen Risk Management by assigning responsibilities to the lowest level possible within the existing organisation and the allocated resources. The share of responsibility is as follows: Director / Department level: ¾ define the risk management policy for the overall programme; ¾ establish guidelines and approve risk management policy baselines for individual projects; ¾ select areas of application and define cycle interval; ¾ approve project risk prioritisation; ¾ decide if the risk may be accepted; ¾ decide which risk mitigation plan can be applied; ¾ accept the residual risk; ¾ manage contingencies Programme/Project Team: ¾ identify risk scenarios; ¾ assess the risk scenarios; ¾ propose a risk prioritisation; ¾ prepare and submit risk avoidance/mitigation plans; ¾ implement approved risk avoidance/mitigation plans; Programme Integration: ¾ co-ordinate the overall cycle ¾ assist the Project Manager by a Risk Management Facilitator in the identification and the assessment the risk scenarios; ¾ analyse the project and overall Programme risk; ¾ prepare the contingency analysis; ¾ maintain the Risk Management database; ¾ issue the project and overall programme risk report; ¾ monitor the contingency level. Manned Spaceflight and Microgravity 4

3.3 DEFINITION OF RISK MANAGEMENT POLICY BASELINE The risk management process starts with the definition of a Risk Management Policy Baseline. This baseline is established at Directorate/Department level and provides with reference guidelines for the establishment of the project baselines. The baseline identifies principles, boundaries and constraints that will drive the assessment and acceptance of risk. It will constitute the main mean to prioritize the risk scenarios. The definition of a Risk Management Policy Baseline includes the establishment of criteria for: ¾ What are the goals? ¾ When is a risk acceptable? ¾ How to manage which risks? This provides the opportunity to: ¾ Establish goals with related levels of confidence of achievement; ¾ Develop concepts, strategies and tactics consistent with those levels of confidence; ¾ Develop collaborative deals and contracts, which are responsive to partner/customer goals and equitable in their apportionment of opportunity and risk; ¾ Avoid in-built budget and schedule overruns and shortfalls; ¾ Trade-off risks against opportunities whilst capping potential exposure to tolerable levels; ¾ Replace reactive management with proactive management. The output of this task will be a document issued by Programme Integration where project and overall programme baselines are collected. This document shall be reviewed and revised accordingly with the occurrences of significant changes to the external constraints, financing, schedule, technologies, techniques, performance etc. of the programme/project baseline. The following example could constitute a risk policy for ISS programme: ¾ stay within barter boundaries ¾ allow schedule slippage within assembly sequence ¾ meet technical specifications subject to International Agreements ¾ don t exceed yearly PA (i.e. Payment Appropriation) limitation ¾ minimise and anticipate external interface changes ¾ meet countries geodis targets within a figure of 0.9. Manned Spaceflight and Microgravity 5

During this phase the risk management cycle interval must be defined. In principle, MSM will perform this cycle quarterly in order to find a balance between the overhead effort of supporting the exercise and the its usefulness. Twice per year (spring and autumn) synchronous to the Contract Action Plan (CAP) review, there will be a complete re-assessment of the risk at project and overall programme level. This means that a new cycle of interviews will be carried out. In the other two quarters, the update will be done by the Project Managers, in cooperation with the Risk Management facilitator, re-assessing the scenarios previously tracked down, including eventually new risks and the results of the risk avoidance/mitigation actions. 3.4 RISK ASSESSMENT This chapter describes in detail the implementation steps of Risk Management process. 3.4.1 RISK IDENTIFICATION This phase deals with the identification of any element that may cause programmatic risk. Each element is called a risk scenario. The most important rule here to comply with is that each risk scenario addressed shall be an independent element in order to avoid double accounting of the same risk. Likewise, opportunities will be identified as independent elements. The scope of the identification should cover the widest programmatic risk domain such as: ¾ technical risks ¾ estimating risks ¾ degree of definition risks ¾ contract conditions risks ¾ financial risks ¾ contractors / sub- contractors and suppliers risks ¾ human resources risks ¾ schedule risks ¾ political risks Catastrophic risks and exceptional events (e.g. launcher failures) shall not be considered. It is commonly acknowledged that of all stages risk identification has the largest impact on the accuracy of Risk Management. Thus, to accomplish this stage requires the acquisition of expert judgements from inside the project/programme and outside, but knowledgeable, of it. The way these judgements are collected is central to the value and effectiveness of the whole process. The utilisation of experts who are asked a set of questions is a well-known methodology based on the Delphi method. With the agreement of the Project Manager, a selected set of people is earmarked for participating in the risk identification. The experts are selected from inside the project team and outside of it in order to balance possible biases and to allow different views and opinions. Manned Spaceflight and Microgravity 6

The methodology foresees a set of structured questions, which are posed to each individual during interviews (Fig. 2). THE FOLLOWING IS A LIST OF ITEMS TO CONSIDER WHEN PERFORMING A RISK ASSESSMENT ASSESS EACH CATEGORY AND ADD ANY CLARIFICATION AS NEEDED SYSTEMS ENGINEERING AND INTEGRATION D esign M aturity : - Design definition and specs. reasonably mature (Min. Spec. TBD's) - Design definition and specs. inadequate (numerous spec. TBD's) Program internal interfaces (maturity of definition and how handled with subcontractors) Program external interfaces (maturity of definition, approach to resolution of TBD's) Level of definition and timeliness of required systems integration data Complexity of systems analytical integration (highly interactive) Required analytical tools complexity : - complex modelling tools required - tools exist - tools require development Fig. 2- Risk Analysis Check List - excerpt The questions are open-ended in order to explore all facets of the risk scenarios. The interviewer however tries to obtain specific replies, which identify, with the best detail possible, the specific problem, the probability of occurrence and the performance, cost and schedule impacts of its occurrence. The answers are recorded in a Programmatic Risk Assessment Register (Fig. 3). RISK SCENARIO RISK COST CONSEQUENCE (KEUR) SCHEDULE CONSEQUENCE (MONTHS) RISK MAGNITUDE TIMEFRAME RISK OWNER LIKELIHOOD Likely Lowest Highest Likely Lowest Highest Expected Expected (%) Cost Delay OF EXPECTED OCCURRENCE SUM of RISK MAGNITUDE: Fig. 3 - Programmatic Risk Assessment Register Manned Spaceflight and Microgravity 7

During the interview ways of preventing risks (or exploit opportunities) are also addressed and recorded. The interviewer, who acts in this process as Risk Management facilitator, initially consolidates the results of all the interviews, thus eliminating duplications and mediating between different views. The result of this exercise is then submitted to the Project Manager and the team in order to verify the consolidation of data and to get the Project Manager concurrence to finalise the Programmatic Risk Management Register. 3.4.2 RISK ANALYSIS Risk analysis involves evaluating risks and risk interactions to assess the range of possible outcomes in terms of their likelihood and impact with reference to the risk factors (performance, cost, schedule). Utilising the Programmatic Risk Assessment Register the risk magnitude is measured by: R(n) = P(n) * I(n) Where P(n) = probability of occurrence of scenario n I(n) = likely cost/schedule impact of scenario n The risk posed by several risk scenarios can be, in first instance, cumulated. The total risk obtained is the Programme/Project risk magnitude. The risk owner is the entity that is totally/partially responsible of bearing the risk consequences (e.g. ESA, Prime Contractor, and ESA/Prime Contractor). The plot of the risk scenarios on the Probability-Impact Grid, Fig. 4, provides with an immediate and intuitive way to represent the criticality of each risk scenario of the project. Moreover, it provides also with a first preliminary view of risk scenarios rank, i.e., those areas where typically greater efforts need to be concentrated (prioritisation). 100 90 LACK OF ICD DEFINITION ELECTR. PART D&D PLAN LACKS LEG LIFE TEST 80 EEE PARTS EXPOSED TO HIGH VOLTAGE TRANSIENT SPLC CONTRACTOR SUPPORT EMC CHARACTERISTICS OF MOTORS 70 P R O B AB IL ITY (% ) 60 50 40 POWER CONDITIONING AND DISTRIBUT. LACK OF CONTRACTORS FAM ILIAR ITY SPLC AVAILABILITY 30 RELIABILITY FAILURE S PLC SUITABILITY FO R UNPRESSURISED ENVIRONMENT LACK OF EXPRESS PALLE T I/F DEFINITION LACK OF SAGE I/F DEFINITION 20 ANALYTICAL MODEL OF LOADS NOT REPRESENTATIVE SPLC SPARES AVAILABILITY ROLLER SCREWS TRIBOLOGICAL BEHAVIOUR 10 SPLC DELTA DEVELOPMENT 0 IMPACT (KECU) Fig. 4 - EXAMPLE OF PROBABILITY-IMPACT GRID Manned Spaceflight and Microgravity 8

The grid can be used also to represent the impact due to the schedule delays. Having plotted the risk scenarios, three main areas, derived from the Risk Management Policy, can be tracked down (Fig. 5): AVOIDANCE area: (Risk not acceptable) The risk violates the risk policy, it has to be eliminated or mitigated. MITIGATION area: (Risk acceptable after optimisation) The risk is within the risk policy but still represents a threat. Avoidance/mitigation should be considered. ACCEPTANCE area: (Risk negligible) the risk can be accepted. The graphic representation of these areas on the Probability-Impact grid is possible once the constraints and limits imposed by the establishment of the risk policy baseline have been considered. Fig. 5 Probability Impact Areas These regions are not invariable during the life of the project being strictly dependent by the changes of the risk management policy baseline. The result of this process is the quantified assessment of all the risk scenarios identified and a preliminary prioritisation of them. Non quantified risk items are also identified separately as risk potentials. Manned Spaceflight and Microgravity 9

3.4.3 RISK PRIORITISATION The starting point of Risk Prioritisation is the Probability-Impact grid as defined in the Risk Analysis. However, others important contributions are expected to be considered while establishing a worthy prioritisation. The following topics play a key role in the process: ¾ Risk Management policy baseline; ¾ Timeframe of expected occurrence or imminence; ¾ Risk ownership; The Risk Management policy baseline, derived by the overall programme baseline, constitutes a filter to critically revise the grid and consequently the scenarios rank. For instance, it could give more emphasis to schedule then costs constraints as often happen when unmoveable delivery dates are fixed in a project/programme having tight external interfaces. The timeframe of expected occurrence is also an important parameter. Short-term risk scenarios imply the absence of time for action thus the need to allocate resources for avoidance/mitigation actions with higher priority. Risk ownership plays also a key role in the contingency setting as identifies which entity actually will bear the liability of risk accrual. The result of this management process is to build a list of risk scenarios per programme/project sorted by their relative criticality. The Project Manager is responsible for this action and shall submit his prioritisation list to the Directorate/Department level for approval (see Fig. 6). Concurrently with the submission of the prioritisation list, the Project Manager will submit proposals for avoidance/mitigation plans. The approval of the risk prioritisation by Directorate/Department level will start up the implementation of the avoidance/mitigation plans. PROJECT: RISK PRIORITISATION AND AVOIDANCE/MITIGATION PLANS STATUS TABLE DATE: RANK RISK SCENARIO TITLE AVOIDANCE/MITIGATION PLANS PROPOSED ACTIONS AND STATUS Fig. 6 Risk Prioritisation and Avoidance/Mitigation Plans Status Table Manned Spaceflight and Microgravity 10

3.4.4 CONTINGENCY ANALYSIS The purpose of the Contingency Analysis is to establish the financial contingencies required covering project/programme risks in a rational and optimal manner. To this end, a probabilistic method, the Monte Carlo simulation, is used. The Monte Carlo simulation allows calculating the overall risk impact probabilistic distribution starting from the single risk scenario each of which has its own distribution. The most important advantage of this method is that if many independent items are treated as one set the overall probabilistic distribution risk is narrowed. The advantage of applying this method rises with the increase of the number of risk scenarios and/or projects/programmes involved in the aggregated analysis. In the Monte Carlo simulation each risk scenario is allowed to follow its own distribution that is described by a Likely Impact, a Lowest Impact, a Highest Impact and a probability function. The total project/programme risk impact is the sum of the estimate scenarios estimated generating a random impact for each scenario according to its own probability distribution and then adding them up (Fig. 7). The profile of distribution curve is narrower then that obtained simply summing the distribution of each risk alone. This is because of the inter-dependency between the risks. Indeed, the probability that all the risks would happen at the Highest or Lowest Impact is very low. The effect of such approach is clearly shown in Fig. 7 where, with the same level of confidence, the contingency has been reduced from the amount X to X1. A confidence level is a measure of the probability that the project/programme could incur in a certain impact. Expressing in terms of cost, the "S"-curve is very useful to find the probability of the project/programme costing less than any particular cost. A line drawn from a selected probability (confidence level) on the vertical axis, across to the curve and then down to the cost axis, shows the risk cost which will be incurred at the selected confidence level. INDIVIDUAL RISK SCENARIOS PROBABILISTIC DISTRIBUTION X 1000 s OVERALL RISKS Cumulative Cost Fig. 7- Monte Carlo Simulation Manned Spaceflight and Microgravity 11

This can be done for any desired level of confidence. Thus, in assigning the contingency, a confidence level has to be selected to minimise from the potential risk threat. The choice is mainly dependent from: ¾ Risk Management policy baseline; ¾ available resources; ¾ risk typology; ¾ project/programme specificity. The selection of a convenient confidence level is one of the major tasks and, at the same time, opportunity for the programme management. The output of the analysis provides with the level of required contingency for different confidence levels (Fig. 8). A contingency selected at a confidence level of 75% means that the risk impact has a probability of 75% to remain within the amount X1. risk computed 100% with Monte Carlo risk computed with Monte Carlo PROBABILITY (%) each risk alone CUMULATIVE PROBABILITY (%) (LEVEL OF CONFIDENCE) 75% each risk alone X1 X Likely Impact IMPACT IM P A CT Fig. 8 Contingency Analysis Manned Spaceflight and Microgravity 12

3.5 RISK MANAGEMENT After the process of prioritisation, described in paragraph 3.4.3, all the risk scenarios falling in the Probability-Impact grid inside the avoidance and mitigation areas, are, in principle, candidates to the risk avoidance/reduction process. The purpose of this step is to manage the risk by implementing risk avoidance/mitigation plans, crossing off or lowering the magnitude of risk. A risk is reduced by lowering the probability and/or impact, by implementing preventive and mitigative measures aiming at eliminating the cause of a problem and mitigative measures aiming at interrupting the propagation of the problem to the consequence or final effect. The avoidance/mitigation plans are prepared by the Project Manager and they shell be submitted for approval to Directorate/Department level. The avoidance/reduction of identified risks can be broadly categorised into actions to: ¾ avoid the risk; ¾ reduce the likelihood; ¾ reduce the impact; ¾ accept the risk or the residual risk; ¾ transfer/share the risk. Avoidance/reduction plans shall be assessed from a cost/benefit point of view to ensure that the cost of implementing them does not exceed the likely benefits. The optimal selection of risk avoidance/reduction plans, under limited resource constraints, is the one that reduces the risk impact the most for the least cost. The practical application of this concept is based on the calculation of the so-called Risk reduction cost effectiveness. Risk reduction cost effectiveness is a function of the expected risk reduction and the cost of the avoidance/mitigation. Expected risk reduction is a function of the likelihood that the proposed plan will be successful and of the estimated risk reduction that will be achieved. It is possible to breakdown the result of this exercise as follows (Fig. 9): 1. Resolved risk, i.e., those risks moved from the avoidance area to acceptance area; 2. Partially resolved risks, i.e., risks that still constitute a potential danger but for which the effect, in case they will occur, have been lowered within an acceptable use of resources; 3. Unresolved risks, i.e., no mitigation plans can be devised or the resources required to obtain a meaningful risk reduction is equal/greater then benefits achievable or not available. This case includes also the acceptance of risk because any mitigation plan devised would be cost/schedule ineffective. Manned Spaceflight and Microgravity 13

Fig. 9 Avoidance/Mitigation Plans The risk management process can be schematically represented as shown in Fig. 10 Fig. 10 Avoidance/Mitigation Plan Decisional Process (Detail of Fig. 1 Programmatic Risk management Cycle) Manned Spaceflight and Microgravity 14

3.6 RISK MONITOR AND REPORT The purpose of this step is to communicate risk by tracking, monitoring, updating, iterating, identifying risk trends and, finally, issuing the risk report. The control of the risks is performed quarterly by periodically reassessing and reviewing them, taking into account new risk scenarios and the results of the implemented avoidance/mitigation plans. In this phase, also, a particular attention has to be given to those risks potential already identified in the risk analysis but still not quantified. Twice per year, in synchrony with the Contract Action Plan (CAP) review (spring and autumn) there will be a complete re-assessment of the risk at project and overall programme level. This means that a new cycle of interviews will be carried out. In the other two quarters, the update will be done by the Project Managers, in cooperation with the Risk Management facilitator, re-assessing the scenarios previously tracked down, including eventually new risks and the results of the risk mitigation actions. The result is presented in form of report to the Directorate/Department level and thus the Project Manager by the Programme Integration. The report includes: ¾ Programme/Project policy baselines ¾ Programmatic Risk Assessment Register, including potential risks ¾ Probability Impact grid and trend ¾ Risk Analysis ¾ Prioritisation list ¾ Contingency Analysis ¾ Avoidance/Mitigation Plans Implementation Status ¾ Recommendations Under the responsibility of Programme Integration a database is created and maintained to assure the full visibility and evolution of Risk Management in MSM thought time. Manned Spaceflight and Microgravity 15

5. ATTACHMENTS 5.1 WORKING SET FOR INTERVIEWS Manned Spaceflight and Microgravity 16

RISK ASSESSMENT CHECKLIST THE FOLLOWING IS A LIST OF ITEMS TO CONSIDER WHEN PERFORMING A RISK ASSESSMENT ASSESS EACH CATEGORY AND ADD ANY CLARIFICATION AS NEEDED PROJECT : Technical Schedule Cost SYSTEMS ENGINEERING AND INTEGRATION Design Maturity : - Design definition and specs. reasonably mature (Min. Spec. TBD s) - Design definition and specs. inadequate (numerous spec. TBD s) Program internal interfaces (maturity of definition and how handled with subcontractors) Programme external interfaces (maturity of definition, approach to resolution of tbd s) Level of definition and timeliness of required systems integration data Complexity of systems analytical integration (highly interactive) Required analytical tools complexity : - complex modelling tools required - tools exist - tools require development Complexity and interactiveness of the subsystems with the development of the systems (hardware and software) integration and verification Design complexity : - generally understood design practices - performance requirements / specs require complex or highly interactive design Design and development manpower : - adequate - inadequate TECHNOLOGY READINESS Off the shell Technology Advancement Technology Development PRODUCT ASSURANCE AND SAFETY Complexity of control programs (e.g., in materials control for trace contaminants) Complexity of the RAMS requirements (e.g., crew safety) EEE PARTS The availability of experienced suppliers The complexity of the system for definition, procurement, warehousing and delivery

RISK ASSESSMENT CHECKLIST (Cont d) THE FOLLOWING IS A LIST OF ITEMS TO CONSIDER WHEN PERFORMING A RISK ASSESSMENT ASSESS EACH CATEGORY AND ADD ANY CLARIFICATION AS NEEDED PROJECT : SOFTWARE Complexity of software design (at all levels) Software verification / validation complexity Complexity of interdependence of the software within programme (HW/SW interfaces) OPERATIONS Ground and flight operations complexity DESIGN PRODUCIBILITY Standard manufacturing practices Complex and/or unique manufacturing requirements (manufacturing technology) ASSEMBLY INTEGRATION AND TEST Complexity of assembly & integration Complexity of test procedures Test complexity & facilities : - Normal accepted test methods facilities standard and available - Tests and facilities unique and/or complex Adequacy of the manpower proposed for assembly integration and test Adequacy of the schedule proposed for assembly integration and test CONTRACTORS EXPERIENCE & PAST PERFORMANCE Experience : - New in this field - Experienced Performance : - Excellent record - Nominal record - Poor record Technical Schedule Cost

5.2 PROGRAMMATIC RISK ASSESSMENT REGISTER Manned Spaceflight and Microgravity 19

5.3 RISK PRIORITISATION AND AVOIDANCE/MITIGATION PLANS STATUS TABLE Manned Spaceflight and Microgravity 21

PROJECT: RISK PRIORITISATION AND AVOIDANCE/MITIGATION PLANS STATUS DATE: RANK RISK SCENARIO TITLE AVOIDANCE/MITIGATION PLANS PROPOSED ACTIONS AND STATUS INTERVIEWER: INTERVIEWED: