Controlability and Makespan Issues with Robot Action Planning and Execution 1

Size: px
Start display at page:

Download "Controlability and Makespan Issues with Robot Action Planning and Execution 1"

Transcription

1 with Robot Action 1 Matthieu Gallien LAAS-CNRS IWPSS 2006 General 1 Part of this work has been supported by the European Social Fund (ESF).

2 For a planner, the plan execution raises new questions Will a correct plan be always executable? How to improve efficiency of the system? Autonomous robotics context Taking time into account (visibility windows, task durations,...) General Uncertain task durations and task effects

3 Solutions Three improvements of an existing system: Taking into account temporal uncertainties Optimization of the plan time makespan Improving the plan repair strategy General

4 Plan General General

5 of Plan space planner (POCL) Explicit representation of time Now embody a temporal executive Can partially repair a plan while executing the remaining of the plan General Consistency of the plan checked with two CSPs: one STN and a general CSP Flexible plans easy to execute and adapt

6 Typical Mission: Exploration Initially unknown environment: duration of navigations is uncertain Take pictures, communicate during visibility (visibility of an orbiter,...) The system makes its best to accomplish the mission New goals are added, tasks fails,... General validated using a real robot and its simulator

7 Temporal Planning State variables: piecewise constant functions of time PTU_POSITION() forward downward t1 t2 t3 event(ptu_position():(downward,forward),t1) hold(ptu_position():forward,(t2,t3)) Variable based representation (temporal and atemporal) General Able to monitor resource usage Task model partially instantiated Relevant approaches: EUROPA, IDEA, CASPER

8 Produced Plan A ]0, +oo[ MOVE_PTU ]10, +oo[ [12, 16] D E [10, +oo[ <C, 15> MOVE [10, 25] B C TAKE_PICTURE [2, 6] F G MOVE_PTU [12, 16] H I MOVE [15, 32.5] J K <K, 15> [10, +oo[ MOVE_PTU [12, 16] L M MOVE_PTU [12, 16] P Q Controllable link Precedence link Contingent link General R [8, 10] S TAKE_PICTURE [2, 6] N O MOVE T

9 Incremental plan execution An execution cycle: Sensing new events Plan repair if necessary Executing what is needed General Allows the plan repair to be distributed over several cycles Replanning from scratch if needed (failed plan repair) All running tasks are stopped

10 The Statement How to guarantee a correct execution when faced with temporal uncertainties? The dynamic controlability statement Some actions are controlable decides the start and the end time Others are not controlable General The system starts them It must wait the end of the task by observing it Their durations are not known precisely

11 Why and How [0, 50] ]0, +oo[ ]0, +oo[ [15, 20] [25, 40] ]0, +oo[ Start of the plan Start of tasks Upper or lower bounds propagation ]40, 50] End of tasks End of the plan Maximum task duration squeezed by propagation General ]0, 10[ [15, 20] ]0, 10[ [25, 35[ ]0, 10[ The durations are flexible constraints like: duration of a tasks anytime between 15 and 20s for example Consistency checking by propagation: May squeezed possible durations Squeezing an uncontrollable duration may lead to a failure

12 Definition Classically, temporal planning uses simple temporal network (STN) No uncertainty STNU [Vidal et al 97]: new framework with uncertainties Replace consistency by controlabilities General Weak controlability Dynamic controlability Strong controlability

13 Example Definition For the purpose of demonstration, we simulate a need for heating the pan&tilt unit for the camera before moving it The constraints are such than: moving the robot is compatible with moving the cameras For robustness, the heating will allways be done before the move Start and end of MOVE_PAN_TILT_UNIT General [12, 16] ]0, +oo[ [8, 10] A B C D ]0, +oo[ G ]0, +oo[ ]0, +oo[ ]0, +oo[ E [15, 38] F Start and end of MOVE Controllable link Precedence link Contingent link

14 Example of STNU [5.02, +oo[ B MOVE_PTU [12, 16] D [0.01, +oo[ General A [5.01, +oo[ [2.01, +oo[ G [0.01, +oo[ E MOVE [15, 38] F [2.02, +oo[

15 Strong Controlability [28.01, +oo[ B MOVE_PTU [12, 16] D [0.01, +oo[ General A [28.01, +oo[ [2.01, +oo[ G [0.01, +oo[ E MOVE [15, 38] F [2.02, +oo[

16 [15.01, +oo[ B MOVE_PTU [12, 16] D [0.01, +oo[ General A <F, 28.01> [15, +oo[ [2.01, +oo[ G [0.01, +oo[ E MOVE [15, 38] F [2.02, +oo[

17 Weak Controlability [18.02, +oo[ B MOVE_PTU [13, 13] D [0.01, +oo[ General A [18.01, +oo[ [3.01, +oo[ G [0.01, +oo[ E MOVE [28, 28] F [3.02, +oo[

18 Algorithm 3DC+ [Morris et al. 2001] Introduce waits" whose are conditional constraints Complete, polynomial and correct algorithm Analyze triangles of constraints Require more computations than path consistency of an STN Integration of an STNU in allows to make contingent plans General E [10, 25] F E [10, 25] F [8, +oo[ ]-oo, 10] [10, +oo[ <F, 15> ]-oo, 10] B B

19 an heuristic planner Depth first search Least commitment heuristic General Depend on a computed cost for each resolvant Theoretically the cost depends on the number of removed solutions In practice, it is computed with one formula by resolvant type

20 How The classical heuristic makes an equal repartition over the whole plan of all tasks: General The new one modify the temporal related cost functions to try to minimize the makespan

21 Plan General General

22 The LAAS Architecture General I has been integrated in the LAAS architecture I It works on a real robot and on its simulator

23 Result concerning the new heuristic Most of initial plans are shorter, some are not better Plan robustness: Not good if used with an STN General Good if used with an STNU Not a significant difference on planning duration

24 With an STN May work if you are lucky: statistically 50% of goals are abandonned May have very bad effect: May produce trivially not executable plans, instead of cancelling low priority goals and fails to execute the more priority goals General

25 Better with an STNU In all runs except one, all goals were achieved At execution, it takes 10ms for each timepoint, with an STN it takes 1ms General The planning duration with 8 goals is 3 times more than with an STN

26 Example of Plan Repair Initial Loc LOC 1 LOC 2 General LOC 5 LOC 3 LOC 4

27 Inefficiency of Actual Plan Repair Initial Loc LOC 1 Current position of the robot LOC 2 General LOC 5 LOC 3 LOC 6 New goal LOC 4

28 The New Plan Repair Initial Loc LOC 1 LOC 5 Current position of the robot LOC 2 LOC 3 General LOC 6 New goal LOC 4

29 a system for plan generation and execution New problematics due to plan execution Integrated a temporal framework with uncertainties Use a makespan minimizing heuristic General The simulator, a way to evaluate the system versus other versions Current work on upgrading the plan repair algorithm

Investment Analysis of Software Assets for Product Lines

Investment Analysis of Software Assets for Product Lines Investment Analysis of Software Assets for Product Lines James V. Withey October 1996 Software Engineering Institute Carnegie Mellon University Pittsburgh, PA 1521 3 Sponsored by the U.S. Department of

More information

CHAPTER 12 APPENDIX Valuing Some More Real Options

CHAPTER 12 APPENDIX Valuing Some More Real Options CHAPTER 12 APPENDIX Valuing Some More Real Options This appendix demonstrates how to work out the value of different types of real options. By assuming the world is risk neutral, it is ignoring the fact

More information

MDP Algorithms. Thomas Keller. June 20, University of Basel

MDP Algorithms. Thomas Keller. June 20, University of Basel MDP Algorithms Thomas Keller University of Basel June 20, 208 Outline of this lecture Markov decision processes Planning via determinization Monte-Carlo methods Monte-Carlo Tree Search Heuristic Search

More information

Unblinded Sample Size Re-Estimation in Bioequivalence Trials with Small Samples. Sam Hsiao, Cytel Lingyun Liu, Cytel Romeo Maciuca, Genentech

Unblinded Sample Size Re-Estimation in Bioequivalence Trials with Small Samples. Sam Hsiao, Cytel Lingyun Liu, Cytel Romeo Maciuca, Genentech Unblinded Sample Size Re-Estimation in Bioequivalence Trials with Small Samples Sam Hsiao, Cytel Lingyun Liu, Cytel Romeo Maciuca, Genentech Goal Describe simple adjustment to CHW method (Cui, Hung, Wang

More information

SOLVING ROBUST SUPPLY CHAIN PROBLEMS

SOLVING ROBUST SUPPLY CHAIN PROBLEMS SOLVING ROBUST SUPPLY CHAIN PROBLEMS Daniel Bienstock Nuri Sercan Özbay Columbia University, New York November 13, 2005 Project with Lucent Technologies Optimize the inventory buffer levels in a complicated

More information

CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM

CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM 6.1 Introduction Project Management is the process of planning, controlling and monitoring the activities

More information

Extending MCTS

Extending MCTS Extending MCTS 2-17-16 Reading Quiz (from Monday) What is the relationship between Monte Carlo tree search and upper confidence bound applied to trees? a) MCTS is a type of UCT b) UCT is a type of MCTS

More information

Introduction to Decision Making. CS 486/686: Introduction to Artificial Intelligence

Introduction to Decision Making. CS 486/686: Introduction to Artificial Intelligence Introduction to Decision Making CS 486/686: Introduction to Artificial Intelligence 1 Outline Utility Theory Decision Trees 2 Decision Making Under Uncertainty I give a robot a planning problem: I want

More information

The Problem of Temporal Abstraction

The Problem of Temporal Abstraction The Problem of Temporal Abstraction How do we connect the high level to the low-level? " the human level to the physical level? " the decide level to the action level? MDPs are great, search is great,

More information

A Formal Study of Distributed Resource Allocation Strategies in Multi-Agent Systems

A Formal Study of Distributed Resource Allocation Strategies in Multi-Agent Systems A Formal Study of Distributed Resource Allocation Strategies in Multi-Agent Systems Jiaying Shen, Micah Adler, Victor Lesser Department of Computer Science University of Massachusetts Amherst, MA 13 Abstract

More information

Monte-Carlo Planning: Introduction and Bandit Basics. Alan Fern

Monte-Carlo Planning: Introduction and Bandit Basics. Alan Fern Monte-Carlo Planning: Introduction and Bandit Basics Alan Fern 1 Large Worlds We have considered basic model-based planning algorithms Model-based planning: assumes MDP model is available Methods we learned

More information

Managing Project Risk DHY

Managing Project Risk DHY Managing Project Risk DHY01 0407 Copyright ESI International April 2007 All rights reserved. No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or

More information

Comments on social insurance and the optimum piecewise linear income tax

Comments on social insurance and the optimum piecewise linear income tax Comments on social insurance and the optimum piecewise linear income tax Michael Lundholm May 999; Revised June 999 Abstract Using Varian s social insurance framework with a piecewise linear two bracket

More information

SENSITIVITY ANALYSIS IN CAPITAL BUDGETING USING CRYSTAL BALL. Petter Gokstad 1

SENSITIVITY ANALYSIS IN CAPITAL BUDGETING USING CRYSTAL BALL. Petter Gokstad 1 SENSITIVITY ANALYSIS IN CAPITAL BUDGETING USING CRYSTAL BALL Petter Gokstad 1 Graduate Assistant, Department of Finance, University of North Dakota Box 7096 Grand Forks, ND 58202-7096, USA Nancy Beneda

More information

Learning Objectives. Learning Objectives 17/03/2016. Chapter 7 Establishing Objectives and Budgeting for the Promotional Program

Learning Objectives. Learning Objectives 17/03/2016. Chapter 7 Establishing Objectives and Budgeting for the Promotional Program Chapter 7 Establishing Objectives and Budgeting for the Promotional Program Copyright 2015 McGraw-Hill Education. All rights reserved. No reproduction or distribution without the prior written consent

More information

INTRODUCTION PROJECT MANAGEMENT

INTRODUCTION PROJECT MANAGEMENT CHAPTER 7. 1 RESOURCE INTRODUCTION ALLOCATION TO PROJECT MANAGEMENT Prepared by: Dr. Maria Elisa Linda T. Cruz Prepared by: Dr. Maria Elisa Linda T. Cruz 1 Chapter 7. Resource Allocation 7.1 Critical Path

More information

Reinforcement Learning

Reinforcement Learning Reinforcement Learning Basic idea: Receive feedback in the form of rewards Agent s utility is defined by the reward function Must (learn to) act so as to maximize expected rewards Grid World The agent

More information

Portfolio Analysis with Random Portfolios

Portfolio Analysis with Random Portfolios pjb25 Portfolio Analysis with Random Portfolios Patrick Burns http://www.burns-stat.com stat.com September 2006 filename 1 1 Slide 1 pjb25 This was presented in London on 5 September 2006 at an event sponsored

More information

Action Selection for MDPs: Anytime AO* vs. UCT

Action Selection for MDPs: Anytime AO* vs. UCT Action Selection for MDPs: Anytime AO* vs. UCT Blai Bonet 1 and Hector Geffner 2 1 Universidad Simón Boĺıvar 2 ICREA & Universitat Pompeu Fabra AAAI, Toronto, Canada, July 2012 Online MDP Planning and

More information

A Short Survey on Pursuit-Evasion Games

A Short Survey on Pursuit-Evasion Games A Short Survey on Pursuit-Evasion Games Peng Cheng Dept. of Computer Science University of Illinois at Urbana-Champaign 1 Introduction Pursuit-evasion game is about how to guide one or a group of pursuers

More information

On-line Supplement for Constraint Aggregation in Column Generation Models for Resource-Constrained Covering Problems

On-line Supplement for Constraint Aggregation in Column Generation Models for Resource-Constrained Covering Problems Submitted to INFORMS Journal on Computing manuscript (Please, provide the mansucript number!) Authors are encouraged to submit new papers to INFORMS journals by means of a style file template, which includes

More information

Commentary: Challenges for Monetary Policy: New and Old

Commentary: Challenges for Monetary Policy: New and Old Commentary: Challenges for Monetary Policy: New and Old John B. Taylor Mervyn King s paper is jam-packed with interesting ideas and good common sense about monetary policy. I admire the clearly stated

More information

Oil prices and depletion path

Oil prices and depletion path Pierre-Noël GIRAUD (CERNA, Paris) Aline SUTTER Timothée DENIS (EDF R&D) timothee.denis@edf.fr Oil prices and depletion path Hubbert oil peak and Hotelling rent through a combined Simulation and Optimisation

More information

Retirement. Optimal Asset Allocation in Retirement: A Downside Risk Perspective. JUne W. Van Harlow, Ph.D., CFA Director of Research ABSTRACT

Retirement. Optimal Asset Allocation in Retirement: A Downside Risk Perspective. JUne W. Van Harlow, Ph.D., CFA Director of Research ABSTRACT Putnam Institute JUne 2011 Optimal Asset Allocation in : A Downside Perspective W. Van Harlow, Ph.D., CFA Director of Research ABSTRACT Once an individual has retired, asset allocation becomes a critical

More information

June 11, Dynamic Programming( Weighted Interval Scheduling)

June 11, Dynamic Programming( Weighted Interval Scheduling) Dynamic Programming( Weighted Interval Scheduling) June 11, 2014 Problem Statement: 1 We have a resource and many people request to use the resource for periods of time (an interval of time) 2 Each interval

More information

Ez Trading Platform. Alltogether, traders are able to perform a more comprehensive probability analysis of their trades.

Ez Trading Platform. Alltogether, traders are able to perform a more comprehensive probability analysis of their trades. Ez Trading Platform The Ez Trading Platform contains a robust set of tools built from the ground up to allow traders to take advantage of a new methodology in calculating probability that we call Probability

More information

Coordinated Issue All Industries Research Tax Credit - Internal Use Software (Effective Date: August 26, 1999)

Coordinated Issue All Industries Research Tax Credit - Internal Use Software (Effective Date: August 26, 1999) Coordinated Issue All Industries Research Tax Credit - Internal Use Software (Effective Date: August 26, 1999) UIL 41.51-10 ISSUE Effective Date: August 26, 1999 Are X's activities related to the installation,

More information

Reasoning with Uncertainty

Reasoning with Uncertainty Reasoning with Uncertainty Markov Decision Models Manfred Huber 2015 1 Markov Decision Process Models Markov models represent the behavior of a random process, including its internal state and the externally

More information

Markov Decision Processes

Markov Decision Processes Markov Decision Processes Robert Platt Northeastern University Some images and slides are used from: 1. CS188 UC Berkeley 2. AIMA 3. Chris Amato Stochastic domains So far, we have studied search Can use

More information

Iran s Stock Market Prediction By Neural Networks and GA

Iran s Stock Market Prediction By Neural Networks and GA Iran s Stock Market Prediction By Neural Networks and GA Mahmood Khatibi MS. in Control Engineering mahmood.khatibi@gmail.com Habib Rajabi Mashhadi Associate Professor h_mashhadi@ferdowsi.um.ac.ir Electrical

More information

Essays on Some Combinatorial Optimization Problems with Interval Data

Essays on Some Combinatorial Optimization Problems with Interval Data Essays on Some Combinatorial Optimization Problems with Interval Data a thesis submitted to the department of industrial engineering and the institute of engineering and sciences of bilkent university

More information

PART II IT Methods in Finance

PART II IT Methods in Finance PART II IT Methods in Finance Introduction to Part II This part contains 12 chapters and is devoted to IT methods in finance. There are essentially two ways where IT enters and influences methods used

More information

Dynamic Resource Allocation for Spot Markets in Cloud Computi

Dynamic Resource Allocation for Spot Markets in Cloud Computi Dynamic Resource Allocation for Spot Markets in Cloud Computing Environments Qi Zhang 1, Quanyan Zhu 2, Raouf Boutaba 1,3 1 David. R. Cheriton School of Computer Science University of Waterloo 2 Department

More information

Monte-Carlo Planning: Introduction and Bandit Basics. Alan Fern

Monte-Carlo Planning: Introduction and Bandit Basics. Alan Fern Monte-Carlo Planning: Introduction and Bandit Basics Alan Fern 1 Large Worlds We have considered basic model-based planning algorithms Model-based planning: assumes MDP model is available Methods we learned

More information

Managing the Uncertainty: An Approach to Private Equity Modeling

Managing the Uncertainty: An Approach to Private Equity Modeling Managing the Uncertainty: An Approach to Private Equity Modeling We propose a Monte Carlo model that enables endowments to project the distributions of asset values and unfunded liability levels for the

More information

Online Appendix: Extensions

Online Appendix: Extensions B Online Appendix: Extensions In this online appendix we demonstrate that many important variations of the exact cost-basis LUL framework remain tractable. In particular, dual problem instances corresponding

More information

Please contact Bill Rapp assistant director of Public Policy at the Academy, if you have any questions.

Please contact Bill Rapp assistant director of Public Policy at the Academy, if you have any questions. July 25, 2014 Mike Boerner, Chair Life Actuarial Task Force National Association of Insurance Commissioners Dear Mike, The attached revisions to AG33 are the result of a request from the NAIC s Life Actuarial

More information

CEC login. Student Details Name SOLUTIONS

CEC login. Student Details Name SOLUTIONS Student Details Name SOLUTIONS CEC login Instructions You have roughly 1 minute per point, so schedule your time accordingly. There is only one correct answer per question. Good luck! Question 1. Searching

More information

Stochastic Optimization Methods in Scheduling. Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms

Stochastic Optimization Methods in Scheduling. Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms Stochastic Optimization Methods in Scheduling Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms More expensive and longer... Eurotunnel Unexpected loss of 400,000,000

More information

2D5362 Machine Learning

2D5362 Machine Learning 2D5362 Machine Learning Reinforcement Learning MIT GALib Available at http://lancet.mit.edu/ga/ download galib245.tar.gz gunzip galib245.tar.gz tar xvf galib245.tar cd galib245 make or access my files

More information

5 Error Control. 5.1 The Milne Device and Predictor-Corrector Methods

5 Error Control. 5.1 The Milne Device and Predictor-Corrector Methods 5 Error Control 5. The Milne Device and Predictor-Corrector Methods We already discussed the basic idea of the predictor-corrector approach in Section 2. In particular, there we gave the following algorithm

More information

Lecture 12: MDP1. Victor R. Lesser. CMPSCI 683 Fall 2010

Lecture 12: MDP1. Victor R. Lesser. CMPSCI 683 Fall 2010 Lecture 12: MDP1 Victor R. Lesser CMPSCI 683 Fall 2010 Biased Random GSAT - WalkSat Notice no random restart 2 Today s lecture Search where there is Uncertainty in Operator Outcome --Sequential Decision

More information

Partial Differential Equations of Fluid Dynamics

Partial Differential Equations of Fluid Dynamics Partial Differential Equations of Fluid Dynamics Ville Vuorinen,D.Sc.(Tech.) 1 1 Department of Energy Technology, Internal Combustion Engine Research Group Department of Energy Technology Outline Introduction

More information

COMP417 Introduction to Robotics and Intelligent Systems. Reinforcement Learning - 2

COMP417 Introduction to Robotics and Intelligent Systems. Reinforcement Learning - 2 COMP417 Introduction to Robotics and Intelligent Systems Reinforcement Learning - 2 Speaker: Sandeep Manjanna Acklowledgement: These slides use material from Pieter Abbeel s, Dan Klein s and John Schulman

More information

CSE 417 Dynamic Programming (pt 2) Look at the Last Element

CSE 417 Dynamic Programming (pt 2) Look at the Last Element CSE 417 Dynamic Programming (pt 2) Look at the Last Element Reminders > HW4 is due on Friday start early! if you run into problems loading data (date parsing), try running java with Duser.country=US Duser.language=en

More information

Expectations and market microstructure when liquidity is lost

Expectations and market microstructure when liquidity is lost Expectations and market microstructure when liquidity is lost Jun Muranaga and Tokiko Shimizu* Bank of Japan Abstract In this paper, we focus on the halt of discovery function in the financial markets

More information

Getting Beyond Ordinary MANAGING PLAN COSTS IN AUTOMATIC PROGRAMS

Getting Beyond Ordinary MANAGING PLAN COSTS IN AUTOMATIC PROGRAMS PRICE PERSPECTIVE In-depth analysis and insights to inform your decision-making. Getting Beyond Ordinary MANAGING PLAN COSTS IN AUTOMATIC PROGRAMS EXECUTIVE SUMMARY Plan sponsors today are faced with unprecedented

More information

Stochastic Approximation Algorithms and Applications

Stochastic Approximation Algorithms and Applications Harold J. Kushner G. George Yin Stochastic Approximation Algorithms and Applications With 24 Figures Springer Contents Preface and Introduction xiii 1 Introduction: Applications and Issues 1 1.0 Outline

More information

# 6. Comparing Alternatives

# 6. Comparing Alternatives IE 5441 1 # 6. Comparing Alternatives One of the main purposes of this course is to discuss how to make decisions in engineering economy. Let us first consider a single period case. Suppose that there

More information

Monetary Policy. ECON 30020: Intermediate Macroeconomics. Prof. Eric Sims. Spring University of Notre Dame

Monetary Policy. ECON 30020: Intermediate Macroeconomics. Prof. Eric Sims. Spring University of Notre Dame Monetary Policy ECON 30020: Intermediate Macroeconomics Prof. Eric Sims University of Notre Dame Spring 2018 1 / 19 Inefficiency in the New Keynesian Model Backbone of the New Keynesian model is the neoclassical

More information

Likelihood-based Optimization of Threat Operation Timeline Estimation

Likelihood-based Optimization of Threat Operation Timeline Estimation 12th International Conference on Information Fusion Seattle, WA, USA, July 6-9, 2009 Likelihood-based Optimization of Threat Operation Timeline Estimation Gregory A. Godfrey Advanced Mathematics Applications

More information

CHAPTER 2 LITERATURE REVIEW

CHAPTER 2 LITERATURE REVIEW CHAPTER 2 LITERATURE REVIEW Capital budgeting is the process of analyzing investment opportunities and deciding which ones to accept. (Pearson Education, 2007, 178). 2.1. INTRODUCTION OF CAPITAL BUDGETING

More information

Evaluating Spending Policies in a Low-Return Environment

Evaluating Spending Policies in a Low-Return Environment Evaluating Spending Policies in a Low-Return Environment Many institutional investors are concerned that a low-return environment is ahead, forcing stakeholders to reevaluate the prudence of their investment

More information

6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE

6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE 6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE Suboptimal control Cost approximation methods: Classification Certainty equivalent control: An example Limited lookahead policies Performance bounds

More information

Active Management IN AN UNCERTAIN FINANCIAL ENVIRONMENT, ADDING VALUE VIA ACTIVE BOND MANAGEMENT

Active Management IN AN UNCERTAIN FINANCIAL ENVIRONMENT, ADDING VALUE VIA ACTIVE BOND MANAGEMENT PRICE PERSPECTIVE September 2016 In-depth analysis and insights to inform your decision-making. Active Management IN AN UNCERTAIN FINANCIAL ENVIRONMENT, ADDING VALUE VIA ACTIVE BOND MANAGEMENT EXECUTIVE

More information

Foreign exchange derivatives Commerzbank AG

Foreign exchange derivatives Commerzbank AG Foreign exchange derivatives Commerzbank AG 2. The popularity of barrier options Isn't there anything cheaper than vanilla options? From an actuarial point of view a put or a call option is an insurance

More information

Numerical Methods in Option Pricing (Part III)

Numerical Methods in Option Pricing (Part III) Numerical Methods in Option Pricing (Part III) E. Explicit Finite Differences. Use of the Forward, Central, and Symmetric Central a. In order to obtain an explicit solution for the price of the derivative,

More information

Catastrophe Reinsurance Risk A Unique Asset Class

Catastrophe Reinsurance Risk A Unique Asset Class Catastrophe Reinsurance Risk A Unique Asset Class Columbia University FinancialEngineering Seminar Feb 15 th, 2010 Lixin Zeng Validus Holdings, Ltd. Outline The natural catastrophe reinsurance market Characteristics

More information

POMDPs: Partially Observable Markov Decision Processes Advanced AI

POMDPs: Partially Observable Markov Decision Processes Advanced AI POMDPs: Partially Observable Markov Decision Processes Advanced AI Wolfram Burgard Types of Planning Problems Classical Planning State observable Action Model Deterministic, accurate MDPs observable stochastic

More information

Computational Finance Least Squares Monte Carlo

Computational Finance Least Squares Monte Carlo Computational Finance Least Squares Monte Carlo School of Mathematics 2019 Monte Carlo and Binomial Methods In the last two lectures we discussed the binomial tree method and convergence problems. One

More information

To earn the extra credit, one of the following has to hold true. Please circle and sign.

To earn the extra credit, one of the following has to hold true. Please circle and sign. CS 188 Fall 2018 Introduction to Artificial Intelligence Practice Midterm 1 To earn the extra credit, one of the following has to hold true. Please circle and sign. A I spent 2 or more hours on the practice

More information

Risk Management for Chemical Supply Chain Planning under Uncertainty

Risk Management for Chemical Supply Chain Planning under Uncertainty for Chemical Supply Chain Planning under Uncertainty Fengqi You and Ignacio E. Grossmann Dept. of Chemical Engineering, Carnegie Mellon University John M. Wassick The Dow Chemical Company Introduction

More information

Coordination through Plan Repair

Coordination through Plan Repair Coordination through Plan Repair Roman van der Krogt and Mathijs de Weerdt Delft University of Technology PO Box 5031, 2600 GA Delft, The Netherlands {R.P.J.vanderKrogt,M.M.deWeerdt}@ewi.tudelft.nl Abstract.

More information

Capital Base Expectations and Solvency

Capital Base Expectations and Solvency Capital Base Expectations and Solvency Presented by: Kevin Wick, FCAS, MAAA Kevin.L.Wick@us.pwc.com 206-398-3518 Two Distinct Business Models Have Emerged Risk Risk Surplus Cash Call Surplus Surplus 1

More information

Characterization of the Optimum

Characterization of the Optimum ECO 317 Economics of Uncertainty Fall Term 2009 Notes for lectures 5. Portfolio Allocation with One Riskless, One Risky Asset Characterization of the Optimum Consider a risk-averse, expected-utility-maximizing

More information

SUGGESTED SOLUTION FINAL MAY 2019 EXAM. Test Code - FNJ 7081

SUGGESTED SOLUTION FINAL MAY 2019 EXAM. Test Code - FNJ 7081 SUGGESTED SOLUTION FINAL MAY 2019 EXAM SUBJECT- SCM & PE Test Code - FNJ 7081 BRANCH - () (Date :) Head Office : Shraddha, 3 rd Floor, Near Chinai College, Andheri (E), Mumbai 69. Tel : (022) 26836666

More information

Contents Critique 26. portfolio optimization 32

Contents Critique 26. portfolio optimization 32 Contents Preface vii 1 Financial problems and numerical methods 3 1.1 MATLAB environment 4 1.1.1 Why MATLAB? 5 1.2 Fixed-income securities: analysis and portfolio immunization 6 1.2.1 Basic valuation of

More information

EFFECTIVE TECHNIQUES IN RISK MANAGEMENT. Joseph W. Mayo, PMP, RMP, CRISC September 27, 2011

EFFECTIVE TECHNIQUES IN RISK MANAGEMENT. Joseph W. Mayo, PMP, RMP, CRISC September 27, 2011 EFFECTIVE TECHNIQUES IN RISK MANAGEMENT Joseph W. Mayo, PMP, RMP, CRISC September 27, 2011 Effective Techniques in Risk Management Risk Management Overview Exercise #1 Break Risk IT Exercise #2 Break Risk

More information

OPPA European Social Fund Prague & EU: We invest in your future.

OPPA European Social Fund Prague & EU: We invest in your future. OPPA European Social Fund Prague & EU: We invest in your future. Cooperative Game Theory Michal Jakob and Michal Pěchouček Agent Technology Center, Dept. of Computer Science and Engineering, FEE, Czech

More information

WHS FutureStation - Guide LiveStatistics

WHS FutureStation - Guide LiveStatistics WHS FutureStation - Guide LiveStatistics LiveStatistics is a paying module for the WHS FutureStation trading platform. This guide is intended to give the reader a flavour of the phenomenal possibilities

More information

An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking

An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking Mika Sumida School of Operations Research and Information Engineering, Cornell University, Ithaca, New York

More information

PROPOSALS BY THE AD HOC COMMITTEE: UPGRADES ON EQUITY MARKETS REGULATION

PROPOSALS BY THE AD HOC COMMITTEE: UPGRADES ON EQUITY MARKETS REGULATION PROPOSALS BY THE AD HOC COMMITTEE: UPGRADES ON EQUITY MARKETS REGULATION February 2018 1 Contents 1 INTRODUCTION... 3 2 SUMMARY OF PROPOSALS... 4 3 DETAILED PROPOSAL DESCRIPTIONS... 5 3.1 CLOSING PRICE,

More information

Introduction to Fall 2007 Artificial Intelligence Final Exam

Introduction to Fall 2007 Artificial Intelligence Final Exam NAME: SID#: Login: Sec: 1 CS 188 Introduction to Fall 2007 Artificial Intelligence Final Exam You have 180 minutes. The exam is closed book, closed notes except a two-page crib sheet, basic calculators

More information

Sharper Fund Management

Sharper Fund Management Sharper Fund Management Patrick Burns 17th November 2003 Abstract The current practice of fund management can be altered to improve the lot of both the investor and the fund manager. Tracking error constraints

More information

The Accrual Anomaly in the Game-Theoretic Setting

The Accrual Anomaly in the Game-Theoretic Setting The Accrual Anomaly in the Game-Theoretic Setting Khrystyna Bochkay Academic adviser: Glenn Shafer Rutgers Business School Summer 2010 Abstract This paper proposes an alternative analysis of the accrual

More information

1 Overview. 2 The Gradient Descent Algorithm. AM 221: Advanced Optimization Spring 2016

1 Overview. 2 The Gradient Descent Algorithm. AM 221: Advanced Optimization Spring 2016 AM 22: Advanced Optimization Spring 206 Prof. Yaron Singer Lecture 9 February 24th Overview In the previous lecture we reviewed results from multivariate calculus in preparation for our journey into convex

More information

Problem Set on Adverse Selection and an Individual Mandate. Developed by Amanda Kowalski, Austin Schaefer, Jack Welsh, and Megan Wilson

Problem Set on Adverse Selection and an Individual Mandate. Developed by Amanda Kowalski, Austin Schaefer, Jack Welsh, and Megan Wilson Problem Set on Adverse Selection and an Individual Mandate Developed by Amanda Kowalski, Austin Schaefer, Jack Welsh, and Megan Wilson This problem set is based on Hackmann, Kolstad, and Kowalski (2015)

More information

Value of Dynamic Financial Analysis for Insurance Companies.

Value of Dynamic Financial Analysis for Insurance Companies. Value of Dynamic Financial Analysis for Insurance Companies www.ultirisk.com Main Applications of DFA 1. Ceded Reinsurance Evaluation and Optimisation 2. Risk-Adjusted Capital Allocation and Pricing 3.

More information

Alpha, Beta, and Now Gamma

Alpha, Beta, and Now Gamma Alpha, Beta, and Now Gamma David Blanchett, CFA, CFP Head of Retirement Research, Morningstar Investment Management Paul D. Kaplan, Ph.D., CFA Director of Research, Morningstar Canada 2012 Morningstar.

More information

Project Management. Managing Risk. Clifford F. Gray Eric W. Larson Third Edition. Chapter 7

Project Management. Managing Risk. Clifford F. Gray Eric W. Larson Third Edition. Chapter 7 Project Management THE MANAGERIAL PROCESS Clifford F. Gray Eric W. Larson Third Edition Chapter 7 Managing Risk Copyright 2006 The McGraw-Hill Companies. All rights reserved. PowerPoint Presentation by

More information

The exam is closed book, closed calculator, and closed notes except your three crib sheets.

The exam is closed book, closed calculator, and closed notes except your three crib sheets. CS 188 Spring 2016 Introduction to Artificial Intelligence Final V2 You have approximately 2 hours and 50 minutes. The exam is closed book, closed calculator, and closed notes except your three crib sheets.

More information

Working Together to Meet Your Investment Goals

Working Together to Meet Your Investment Goals Working Together to Meet Your Investment Goals Integrated Investment Consulting Services Integrated Investment Consulting Services Working Together to Meet Your Investment Goals Fiduciaries and trustees

More information

Option Models for Bonds and Interest Rate Claims

Option Models for Bonds and Interest Rate Claims Option Models for Bonds and Interest Rate Claims Peter Ritchken 1 Learning Objectives We want to be able to price any fixed income derivative product using a binomial lattice. When we use the lattice to

More information

Problem Set 2: Answers

Problem Set 2: Answers Economics 623 J.R.Walker Page 1 Problem Set 2: Answers The problem set came from Michael A. Trick, Senior Associate Dean, Education and Professor Tepper School of Business, Carnegie Mellon University.

More information

In physics and engineering education, Fermi problems

In physics and engineering education, Fermi problems A THOUGHT ON FERMI PROBLEMS FOR ACTUARIES By Runhuan Feng In physics and engineering education, Fermi problems are named after the physicist Enrico Fermi who was known for his ability to make good approximate

More information

Binary Options Trading Strategies How to Become a Successful Trader?

Binary Options Trading Strategies How to Become a Successful Trader? Binary Options Trading Strategies or How to Become a Successful Trader? Brought to You by: 1. Successful Binary Options Trading Strategy Successful binary options traders approach the market with three

More information

Modeling, Analysis, and Characterization of Dubai Financial Market as a Social Network

Modeling, Analysis, and Characterization of Dubai Financial Market as a Social Network Modeling, Analysis, and Characterization of Dubai Financial Market as a Social Network Ahmed El Toukhy 1, Maytham Safar 1, Khaled Mahdi 2 1 Computer Engineering Department, Kuwait University 2 Chemical

More information

A Branch-and-Price method for the Multiple-depot Vehicle and Crew Scheduling Problem

A Branch-and-Price method for the Multiple-depot Vehicle and Crew Scheduling Problem A Branch-and-Price method for the Multiple-depot Vehicle and Crew Scheduling Problem SCIP Workshop 2018, Aachen Markó Horváth Tamás Kis Institute for Computer Science and Control Hungarian Academy of Sciences

More information

Ellipsoid Method. ellipsoid method. convergence proof. inequality constraints. feasibility problems. Prof. S. Boyd, EE364b, Stanford University

Ellipsoid Method. ellipsoid method. convergence proof. inequality constraints. feasibility problems. Prof. S. Boyd, EE364b, Stanford University Ellipsoid Method ellipsoid method convergence proof inequality constraints feasibility problems Prof. S. Boyd, EE364b, Stanford University Ellipsoid method developed by Shor, Nemirovsky, Yudin in 1970s

More information

Evaluating the Selection Process for Determining the Going Concern Discount Rate

Evaluating the Selection Process for Determining the Going Concern Discount Rate By: Kendra Kaake, Senior Investment Strategist, ASA, ACIA, FRM MARCH, 2013 Evaluating the Selection Process for Determining the Going Concern Discount Rate The Going Concern Issue The going concern valuation

More information

Cost Slope Analysis 1

Cost Slope Analysis 1 Cost Slope Analysis 1 Running head: Cost Slope Analysis Cost Slope Analysis Technique Summary Su-Cheng Wu Cost Slope Analysis 2 Abstract: Cost Slope Analysis considers the following: direct, indirect cost,

More information

Government spending in a model where debt effects output gap

Government spending in a model where debt effects output gap MPRA Munich Personal RePEc Archive Government spending in a model where debt effects output gap Peter N Bell University of Victoria 12. April 2012 Online at http://mpra.ub.uni-muenchen.de/38347/ MPRA Paper

More information

Fiduciary Insights LEVERAGING PORTFOLIOS EFFICIENTLY

Fiduciary Insights LEVERAGING PORTFOLIOS EFFICIENTLY LEVERAGING PORTFOLIOS EFFICIENTLY WHETHER TO USE LEVERAGE AND HOW BEST TO USE IT TO IMPROVE THE EFFICIENCY AND RISK-ADJUSTED RETURNS OF PORTFOLIOS ARE AMONG THE MOST RELEVANT AND LEAST UNDERSTOOD QUESTIONS

More information

Modeling of Life Cycle Alternatives in the National Bridge Investment Analysis System (NBIAS) Prepared by: Bill Robert, SPP Steve Sissel, FHWA

Modeling of Life Cycle Alternatives in the National Bridge Investment Analysis System (NBIAS) Prepared by: Bill Robert, SPP Steve Sissel, FHWA Modeling of Life Cycle Alternatives in the National Bridge Investment Analysis System (NBIAS) Prepared by: Bill Robert, SPP Steve Sissel, FHWA TRB International Bridge & Structure Management Conference

More information

Real Options and Risk Analysis in Capital Budgeting

Real Options and Risk Analysis in Capital Budgeting Real options Real Options and Risk Analysis in Capital Budgeting Traditional NPV analysis should not be viewed as static. This can lead to decision-making problems in a dynamic environment when not all

More information

We are not saying it s easy, we are just trying to make it simpler than before. An Online Platform for backtesting quantitative trading strategies.

We are not saying it s easy, we are just trying to make it simpler than before. An Online Platform for backtesting quantitative trading strategies. We are not saying it s easy, we are just trying to make it simpler than before. An Online Platform for backtesting quantitative trading strategies. Visit www.kuants.in to get your free access to Stock

More information

12 Bounds. on Option Prices. Answers to Questions and Problems

12 Bounds. on Option Prices. Answers to Questions and Problems 12 Bounds on Option Prices 90 Answers to Questions and Problems 1. What is the maximum theoretical value for a call? Under what conditions does a call reach this maximum value? Explain. The highest price

More information

Regional IAM: analysis of riskadjusted costs and benefits of climate policies

Regional IAM: analysis of riskadjusted costs and benefits of climate policies Regional IAM: analysis of riskadjusted costs and benefits of climate policies Alexander Golub, The American University (Washington DC) Ramon Arigoni Ortiz, Anil Markandya (BC 3, Spain), Background Near-term

More information

Optimal Dam Management

Optimal Dam Management Optimal Dam Management Michel De Lara et Vincent Leclère July 3, 2012 Contents 1 Problem statement 1 1.1 Dam dynamics.................................. 2 1.2 Intertemporal payoff criterion..........................

More information

Back- and Side Testing of Price Simulation Models

Back- and Side Testing of Price Simulation Models Back- and Side Testing of Price Simulation Models Universität Duisburg Essen - Seminarreihe Energy & Finance 23. Juni 2010 Henrik Specht, Vattenfall Europe AG The starting point Question: How do I know

More information