SOLVING ROBUST SUPPLY CHAIN PROBLEMS

Size: px
Start display at page:

Download "SOLVING ROBUST SUPPLY CHAIN PROBLEMS"

Transcription

1 SOLVING ROBUST SUPPLY CHAIN PROBLEMS Daniel Bienstock Nuri Sercan Özbay Columbia University, New York November 13, 2005

2 Project with Lucent Technologies Optimize the inventory buffer levels in a complicated supply chain network. Business objective: meet the demand in a timely fashion and without excessive inventory buildup Limited demand data Poor quality of forecasts there is a paucity of data Short product life cycles Occasional boosts in demand Long lead-times with high uncertainty They need policies that are simple to implement How to handle uncertainty?

3 Robust Optimization Addresses the parameter uncertainty in optimization problems Developed in late 90 s Ben-Tal and Nemirovski (1998), (1999), (2000). El-Ghaoui et al. (1997), (1998). Bertsimas and Sim (2003). Ben-Tal et al.(2004). Application to supply chain management Bertsimas and Thiele (2003). Adversarial queueing Cruz (1991). Borodin et. al. (1996). Andrews et.al. (1996). Other work Gallego, Ryan and Simchi-Levi (1996).

4 Supply Chain Problem - Basic Model Single item, single station inventory problem over a finite time horizon t = 1, 2,..., T x t : inventory level at the beginning of period t, u t : amount of items ordered in period t, d t : demand in period t. u_t u_t+1 x_t x_t+1 x_t+2 t t+1 d_t d_t+1 Inventory level evolves according to the equation x t+1 = x t + u t d t

5 Supply Chain Problem - Basic Model Single item, single station inventory problem over a finite time horizon t = 1, 2,..., T x t : inventory level at the beginning of period t, u t : amount of items ordered in period t, d t : demand in period t. Inventory level at the beginning of period t x t+1 = x t + u t d t = x 1 + t i=1 (u i d i ) c t : unit ordering cost in period t, h t : unit holding cost in period t, b t : unit backlogging cost in period t. Inventory holding/shortage cost: max{h t (x t + u t d t ), b t (d t u t x t )} Ordering cost: c t u t Total cost of a given demand stream, d and order vector u t=1 C(u, d) = T c tu t + max{h t (x 1 + t (u i d i )), b t ( x 1 + t (d i u i ))} i=1 i=1

6 Demand Uncertainty No probability distribution is given. Demand can take any value from a set D First model we consider: Bertsimas and Thiele model, uses some ideas from Bertsimas and Sim In each period demand is in some interval d t [µ t δ t, µ t + δ t ] Risk in period t = d t µ t Budgets for risk: Γ t δ t d 1 µ 1 δ 1 + d 2 µ d t µ t Γ t δ 2 δ t D = { (d 1, d 2,..., d T ) : d 1 µ 1 δ d t µ t Γ t, 0 δ t d t µ t δ t 1, t {1, 2,..., T } }

7 Demand Uncertainty No probability distribution is given. Demand can take any value from a set D First model we consider: Bertsimas and Thiele model, uses some ideas from Bertsimas and Sim { } d 1 µ 1 D = (d 1, d 2,..., d T ) : δ d t µ t 1 δ Γ d t µ t t, 0 t δ 1, t {1, 2,..., T } t Second model: Demands with peaks (adversarial queuing model) Interval or peak value: d t [µ t δ t, µ t + δ t ] {p t } Window size parameter w. At most one peak in w consecutive periods D = {(d 1,..., d T ) : d t = s t + I t p t, I t (µ t δ t ) s t I t (µ t + δ t ), I t {0, 1} for t = 1,..., T t+w 1 I t 1 for t = 1,..., T w + 1} i=t

8 Demand Uncertainty No probability distribution is given. Demand can take any value from a set D Bertsimas and Sim model { D = (d 1, d 2,..., d T ) : d 1 µ 1 δ d t µ t Γ t, 0 Demand model with peaks (adversarial queuing model) δ t d t µ t δ t 1, t {1, 2,..., T } } D = {(d 1,..., d T ) : d t = s t + I t p t, I t (µ t δ t ) s t I t (µ t + δ t ), I t {0, 1} for t = 1,..., T t+w 1 I t 1 for t = 1,..., T w + 1} i=t Robust Supply Chain Problem min u 0 max {C(u, d)} d D (C(u, d)= cost with orders u and demands d)

9 Static vs. Dynamic Policies Static policies: Inventory controller determines the exact order amounts, i.e. u t s in advance. Orders are fixed no matter how much inventory you have Poor performance when demand is uncertain Dynamic policies: In each period inventory controller specifies the orders as a function of the beginning inventory Handles the uncertainties in the demand since it gives the inventory controller freedom to change the orders according to the inventory level Very hard to implement if you don t have a closed form definition of the function Basestock Policies: Given a basestock level, σ, place an order of σ x t if your beginning inventory, x t, in period t is less than σ, do nothing otherwise. In between two extreme policies Gives some power to inventory controller to handle uncertainties Easy to implement, widely used in practice

10 Static Policies: LP Formulation Reformulating robust supply chain problem Min K s.t K max d D { C( u, d ) }. u 0

11 Static Policies: LP Formulation Reformulating robust supply chain problem Min s.t K + T t=1 K T t=1 c t u t max{h t (x 1 + t (u i d i )), b t ( x 1 + t (d i u i ))} d D i=1 i=1 u 0

12 Static Policies: LP Formulation Reformulating robust supply chain problem LP(D) Min s.t T t=1 c t u t + K K T Kt d t=1 Kt d h t (x 1 + t (u i d i )) t = 1, 2,..., T d D i=1 Kt d b t (x 1 + t (u i d i )) t = 1, 2,..., T u 0 i=1 LP with infinite number of constraints Benders like approach; maintain a working formulation Maintain a subset ˆD D. Solve the LP( ˆD) to get a candidate for the optimal solution. Optimal cost of LP( ˆD) gives a lower bound for the original problem.

13 Prototype Algorithm Given a vector u of orders, we solve the Adversarial Problem to generate a cut: Seperates the current u Gives an upper bound for the optimal cost max {C( u, d )}. d D Step 1. Let d D. Set ˆD = {d}. Set UB to infinity. Step 2. Solve LP( ˆD). Set LB to objective value of the LP( ˆD). Set u to the optimal solution to the LP( ˆD). Step 3. Solve Adversarial Problem using u. Update U B according to the objective value. Set d to the solution to the Adversarial Problem. Step 4. If LB UB, set ˆD = ˆD {d }. Go to Step 2. Step 5. Otherwise, u is optimal. Stop.

14 Adversarial Problem: Bertsimas and Thiele Demand Model d 1 µ 1 δ d t µ t δ t Γ t, d t [µ t δ t, µ t + δ t ] δ t, µ t, Γ t, parameters, d t = demand at t max d D { Tt=1 {c t u t + max{h t (x t + u t d t ), b t ( (x t + u t ) + d t )} } Assume that Γ t is integral for every t: then all extreme points of the polyhedral set D have DP formulation for adversarial problem d t µ t δ t integral, t. V t (x, k) = cost-to-go assuming inventory x and k units of risk used up V t (x, k) = ( max {c t u t + max{h t (x + u t d), b t (d u t x)} + V t+1 x + u t d, k + d {µ t,µ t +δ t,µ t δ t } d µ t δ t )} V T +1 (x, k) = 0 k V t (x, k) is convex piecewise linear in x with finite number of pieces. Construct the function V t (x, k) for each integral 0 k Γ t

15 Numerical Results 500 test runs for each class. Running Time (sec.) Number of Iterations # periods average max min average max min Periodic (with peaks) Periodic (with budgets) Discounted (with peaks) Discounted (with budgets)

16 Basestock Problem Recap: Basestock level is equal to sigma means, we order σ inventory level whenever the inventory level drops below σ System dynamics Ordering cost x t+1 = max{x t d t, σ d t } Inventory holding/shortage cost becomes c t max{0, σ x t } max{h t max{x t d t, σ d t }, b t max{x t d t, σ d t }} Problem: min σ max d D t (ordering cost at t + holding/shortage cost at t)

17 Static vs Basestock Policies Example Static Policy Basestock Policy Error (%) 1 10, , , , , , ,800, , , , ,440, , Basestock policies are significantly better when uncertainty is high

18 Numerical Results for Basestock Model Up to 45% error in the cost We generate budgets using Bertsimas and Thiele formula - Assuming we know first two moments of the demand dist. Cost changes linearly according to the variability of the demand

19 Impact of variance on optimal basestock P = peak size (constant), W = window size experiment: scale P and W by the same constant Scale Optimal Basestock Matches results for stochastic models

20 Basestock Problem: Finite Number of Demand Patterns Decision maker s problem: We want to choose σ so as to minimize max d ˆD C(σ, d) Total cost C(σ, d) = T (c t max{0, σ x t } + max{h t max{x t d t, σ d t }, b t max{x t d t, σ d t }}) t=1 Second term is non-convex w.r.t σ due to shortage cost. However, C(σ, d) is piecewise-convex with a polynomial number of pieces. RESULT: If ˆD is a finite set we can solve using binary search min σ max {C(σ, d)} d ˆD

21 Adversarial Problem Remark: If beginning inventory drops below σ in some period t, then it will be below σ for all periods after t. Divides the horizon into two parts with different cost structure and dynamics Part 1: Inventory evolution: x t+1 = x t d t Ordering cost: 0 Inventory cost: h t (x 1 t i=1 d i ) Part 2: Inventory evolution: x t+1 = σ d t Ordering cost: c t (σ x t ) Inventory cost: max{h t (σ d t ), b t (σ d t )} For each t, solve each part separately

22 Comparison with Bertsimas and Thiele Model Min s.t K + T c t u t t=1 K T max{max {h t(x 1 + t (u i d i ))}, max {b t( x 1 + t (d i u i ))}} d D d D t=1 i=1 i=1 u 0 Maximizes RHS of each constraint seperately. More conservative. Example Robust Optimal B-T Objective B-T Real Cost Error % % % % %

Log-Robust Portfolio Management

Log-Robust Portfolio Management Log-Robust Portfolio Management Dr. Aurélie Thiele Lehigh University Joint work with Elcin Cetinkaya and Ban Kawas Research partially supported by the National Science Foundation Grant CMMI-0757983 Dr.

More information

Robust Dual Dynamic Programming

Robust Dual Dynamic Programming 1 / 18 Robust Dual Dynamic Programming Angelos Georghiou, Angelos Tsoukalas, Wolfram Wiesemann American University of Beirut Olayan School of Business 31 May 217 2 / 18 Inspired by SDDP Stochastic optimization

More information

Risk Management for Chemical Supply Chain Planning under Uncertainty

Risk Management for Chemical Supply Chain Planning under Uncertainty for Chemical Supply Chain Planning under Uncertainty Fengqi You and Ignacio E. Grossmann Dept. of Chemical Engineering, Carnegie Mellon University John M. Wassick The Dow Chemical Company Introduction

More information

ROBUST OPTIMIZATION OF MULTI-PERIOD PRODUCTION PLANNING UNDER DEMAND UNCERTAINTY. A. Ben-Tal, B. Golany and M. Rozenblit

ROBUST OPTIMIZATION OF MULTI-PERIOD PRODUCTION PLANNING UNDER DEMAND UNCERTAINTY. A. Ben-Tal, B. Golany and M. Rozenblit ROBUST OPTIMIZATION OF MULTI-PERIOD PRODUCTION PLANNING UNDER DEMAND UNCERTAINTY A. Ben-Tal, B. Golany and M. Rozenblit Faculty of Industrial Engineering and Management, Technion, Haifa 32000, Israel ABSTRACT

More information

A Robust Option Pricing Problem

A Robust Option Pricing Problem IMA 2003 Workshop, March 12-19, 2003 A Robust Option Pricing Problem Laurent El Ghaoui Department of EECS, UC Berkeley 3 Robust optimization standard form: min x sup u U f 0 (x, u) : u U, f i (x, u) 0,

More information

Robust Portfolio Optimization with Derivative Insurance Guarantees

Robust Portfolio Optimization with Derivative Insurance Guarantees Robust Portfolio Optimization with Derivative Insurance Guarantees Steve Zymler Berç Rustem Daniel Kuhn Department of Computing Imperial College London Mean-Variance Portfolio Optimization Optimal Asset

More information

Asset-Liability Management

Asset-Liability Management Asset-Liability Management John Birge University of Chicago Booth School of Business JRBirge INFORMS San Francisco, Nov. 2014 1 Overview Portfolio optimization involves: Modeling Optimization Estimation

More information

Stochastic Dual Dynamic Programming Algorithm for Multistage Stochastic Programming

Stochastic Dual Dynamic Programming Algorithm for Multistage Stochastic Programming Stochastic Dual Dynamic Programg Algorithm for Multistage Stochastic Programg Final presentation ISyE 8813 Fall 2011 Guido Lagos Wajdi Tekaya Georgia Institute of Technology November 30, 2011 Multistage

More information

Dynamic Portfolio Choice II

Dynamic Portfolio Choice II Dynamic Portfolio Choice II Dynamic Programming Leonid Kogan MIT, Sloan 15.450, Fall 2010 c Leonid Kogan ( MIT, Sloan ) Dynamic Portfolio Choice II 15.450, Fall 2010 1 / 35 Outline 1 Introduction to Dynamic

More information

Portfolio selection with multiple risk measures

Portfolio selection with multiple risk measures Portfolio selection with multiple risk measures Garud Iyengar Columbia University Industrial Engineering and Operations Research Joint work with Carlos Abad Outline Portfolio selection and risk measures

More information

Dynamic Programming: An overview. 1 Preliminaries: The basic principle underlying dynamic programming

Dynamic Programming: An overview. 1 Preliminaries: The basic principle underlying dynamic programming Dynamic Programming: An overview These notes summarize some key properties of the Dynamic Programming principle to optimize a function or cost that depends on an interval or stages. This plays a key role

More information

Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints

Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints David Laibson 9/11/2014 Outline: 1. Precautionary savings motives 2. Liquidity constraints 3. Application: Numerical solution

More information

Handout 8: Introduction to Stochastic Dynamic Programming. 2 Examples of Stochastic Dynamic Programming Problems

Handout 8: Introduction to Stochastic Dynamic Programming. 2 Examples of Stochastic Dynamic Programming Problems SEEM 3470: Dynamic Optimization and Applications 2013 14 Second Term Handout 8: Introduction to Stochastic Dynamic Programming Instructor: Shiqian Ma March 10, 2014 Suggested Reading: Chapter 1 of Bertsekas,

More information

Final exam solutions

Final exam solutions EE365 Stochastic Control / MS&E251 Stochastic Decision Models Profs. S. Lall, S. Boyd June 5 6 or June 6 7, 2013 Final exam solutions This is a 24 hour take-home final. Please turn it in to one of the

More information

OPTIMAL PORTFOLIO CONTROL WITH TRADING STRATEGIES OF FINITE

OPTIMAL PORTFOLIO CONTROL WITH TRADING STRATEGIES OF FINITE Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference 005 Seville, Spain, December 1-15, 005 WeA11.6 OPTIMAL PORTFOLIO CONTROL WITH TRADING STRATEGIES OF

More information

Lecture 7: Bayesian approach to MAB - Gittins index

Lecture 7: Bayesian approach to MAB - Gittins index Advanced Topics in Machine Learning and Algorithmic Game Theory Lecture 7: Bayesian approach to MAB - Gittins index Lecturer: Yishay Mansour Scribe: Mariano Schain 7.1 Introduction In the Bayesian approach

More information

Optimizing (s, S) policies for multi-period inventory models with demand distribution uncertainty: Robust dynamic programming approaches

Optimizing (s, S) policies for multi-period inventory models with demand distribution uncertainty: Robust dynamic programming approaches Singapore Management University Institutional Knowledge at Singapore Management University Research Collection Lee Kong Chian School Of Business Lee Kong Chian School of Business 9-2017 Optimizing (s,

More information

Unblinded Sample Size Re-Estimation in Bioequivalence Trials with Small Samples. Sam Hsiao, Cytel Lingyun Liu, Cytel Romeo Maciuca, Genentech

Unblinded Sample Size Re-Estimation in Bioequivalence Trials with Small Samples. Sam Hsiao, Cytel Lingyun Liu, Cytel Romeo Maciuca, Genentech Unblinded Sample Size Re-Estimation in Bioequivalence Trials with Small Samples Sam Hsiao, Cytel Lingyun Liu, Cytel Romeo Maciuca, Genentech Goal Describe simple adjustment to CHW method (Cui, Hung, Wang

More information

Dynamic Replication of Non-Maturing Assets and Liabilities

Dynamic Replication of Non-Maturing Assets and Liabilities Dynamic Replication of Non-Maturing Assets and Liabilities Michael Schürle Institute for Operations Research and Computational Finance, University of St. Gallen, Bodanstr. 6, CH-9000 St. Gallen, Switzerland

More information

Sensitivity Analysis with Data Tables. 10% annual interest now =$110 one year later. 10% annual interest now =$121 one year later

Sensitivity Analysis with Data Tables. 10% annual interest now =$110 one year later. 10% annual interest now =$121 one year later Sensitivity Analysis with Data Tables Time Value of Money: A Special kind of Trade-Off: $100 @ 10% annual interest now =$110 one year later $110 @ 10% annual interest now =$121 one year later $100 @ 10%

More information

Budget Management In GSP (2018)

Budget Management In GSP (2018) Budget Management In GSP (2018) Yahoo! March 18, 2018 Miguel March 18, 2018 1 / 26 Today s Presentation: Budget Management Strategies in Repeated auctions, Balseiro, Kim, and Mahdian, WWW2017 Learning

More information

On-line Supplement for Constraint Aggregation in Column Generation Models for Resource-Constrained Covering Problems

On-line Supplement for Constraint Aggregation in Column Generation Models for Resource-Constrained Covering Problems Submitted to INFORMS Journal on Computing manuscript (Please, provide the mansucript number!) Authors are encouraged to submit new papers to INFORMS journals by means of a style file template, which includes

More information

Developing a robust-fuzzy multi-objective optimization model for portfolio selection

Developing a robust-fuzzy multi-objective optimization model for portfolio selection Developing a robust-fuzzy multi-objective optimization model for portfolio selection COMPUTATIONAL MANAGEMENT SCIENCE University of Bergamo, Italy May 31, 217 Mohammad Salehifar 1 PhD student in finance,

More information

Optimal Dam Management

Optimal Dam Management Optimal Dam Management Michel De Lara et Vincent Leclère July 3, 2012 Contents 1 Problem statement 1 1.1 Dam dynamics.................................. 2 1.2 Intertemporal payoff criterion..........................

More information

Worst-Case Value-at-Risk of Derivative Portfolios

Worst-Case Value-at-Risk of Derivative Portfolios Worst-Case Value-at-Risk of Derivative Portfolios Steve Zymler Berç Rustem Daniel Kuhn Department of Computing Imperial College London Thalesians Seminar Series, November 2009 Risk Management is a Hot

More information

Cash flow matching with risks controlled by buffered probability of exceedance and conditional value-at-risk

Cash flow matching with risks controlled by buffered probability of exceedance and conditional value-at-risk DOI 10.1007/s10479-016-2354-6 ADVANCES OF OR IN COMMODITIES AND FINANCIAL MODELLING Cash flow matching with risks controlled by buffered probability of exceedance and conditional value-at-risk Danjue Shang

More information

Optimization in Financial Engineering in the Post-Boom Market

Optimization in Financial Engineering in the Post-Boom Market Optimization in Financial Engineering in the Post-Boom Market John R. Birge Northwestern University www.iems.northwestern.edu/~jrbirge SIAM Optimization Toronto May 2002 1 Introduction History of financial

More information

Optimization Models in Financial Mathematics

Optimization Models in Financial Mathematics Optimization Models in Financial Mathematics John R. Birge Northwestern University www.iems.northwestern.edu/~jrbirge Illinois Section MAA, April 3, 2004 1 Introduction Trends in financial mathematics

More information

13.3 A Stochastic Production Planning Model

13.3 A Stochastic Production Planning Model 13.3. A Stochastic Production Planning Model 347 From (13.9), we can formally write (dx t ) = f (dt) + G (dz t ) + fgdz t dt, (13.3) dx t dt = f(dt) + Gdz t dt. (13.33) The exact meaning of these expressions

More information

An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking

An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking Mika Sumida School of Operations Research and Information Engineering, Cornell University, Ithaca, New York

More information

1 The EOQ and Extensions

1 The EOQ and Extensions IEOR4000: Production Management Lecture 2 Professor Guillermo Gallego September 16, 2003 Lecture Plan 1. The EOQ and Extensions 2. Multi-Item EOQ Model 1 The EOQ and Extensions We have explored some of

More information

6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE

6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE 6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE Suboptimal control Cost approximation methods: Classification Certainty equivalent control: An example Limited lookahead policies Performance bounds

More information

Scenario Generation and Sampling Methods

Scenario Generation and Sampling Methods Scenario Generation and Sampling Methods Güzin Bayraksan Tito Homem-de-Mello SVAN 2016 IMPA May 9th, 2016 Bayraksan (OSU) & Homem-de-Mello (UAI) Scenario Generation and Sampling SVAN IMPA May 9 1 / 30

More information

Evaluation of proportional portfolio insurance strategies

Evaluation of proportional portfolio insurance strategies Evaluation of proportional portfolio insurance strategies Prof. Dr. Antje Mahayni Department of Accounting and Finance, Mercator School of Management, University of Duisburg Essen 11th Scientific Day of

More information

Lecture outline W.B.Powell 1

Lecture outline W.B.Powell 1 Lecture outline What is a policy? Policy function approximations (PFAs) Cost function approximations (CFAs) alue function approximations (FAs) Lookahead policies Finding good policies Optimizing continuous

More information

Multistage risk-averse asset allocation with transaction costs

Multistage risk-averse asset allocation with transaction costs Multistage risk-averse asset allocation with transaction costs 1 Introduction Václav Kozmík 1 Abstract. This paper deals with asset allocation problems formulated as multistage stochastic programming models.

More information

Making Complex Decisions

Making Complex Decisions Ch. 17 p.1/29 Making Complex Decisions Chapter 17 Ch. 17 p.2/29 Outline Sequential decision problems Value iteration algorithm Policy iteration algorithm Ch. 17 p.3/29 A simple environment 3 +1 p=0.8 2

More information

POMDPs: Partially Observable Markov Decision Processes Advanced AI

POMDPs: Partially Observable Markov Decision Processes Advanced AI POMDPs: Partially Observable Markov Decision Processes Advanced AI Wolfram Burgard Types of Planning Problems Classical Planning State observable Action Model Deterministic, accurate MDPs observable stochastic

More information

EE266 Homework 5 Solutions

EE266 Homework 5 Solutions EE, Spring 15-1 Professor S. Lall EE Homework 5 Solutions 1. A refined inventory model. In this problem we consider an inventory model that is more refined than the one you ve seen in the lectures. The

More information

Lecture 17: More on Markov Decision Processes. Reinforcement learning

Lecture 17: More on Markov Decision Processes. Reinforcement learning Lecture 17: More on Markov Decision Processes. Reinforcement learning Learning a model: maximum likelihood Learning a value function directly Monte Carlo Temporal-difference (TD) learning COMP-424, Lecture

More information

American options and early exercise

American options and early exercise Chapter 3 American options and early exercise American options are contracts that may be exercised early, prior to expiry. These options are contrasted with European options for which exercise is only

More information

Worst-Case Value-at-Risk of Non-Linear Portfolios

Worst-Case Value-at-Risk of Non-Linear Portfolios Worst-Case Value-at-Risk of Non-Linear Portfolios Steve Zymler Daniel Kuhn Berç Rustem Department of Computing Imperial College London Portfolio Optimization Consider a market consisting of m assets. Optimal

More information

Introduction to Real-Time Systems. Note: Slides are adopted from Lui Sha and Marco Caccamo

Introduction to Real-Time Systems. Note: Slides are adopted from Lui Sha and Marco Caccamo Introduction to Real-Time Systems Note: Slides are adopted from Lui Sha and Marco Caccamo 1 Recap Schedulability analysis - Determine whether a given real-time taskset is schedulable or not L&L least upper

More information

Sequential Decision Making

Sequential Decision Making Sequential Decision Making Dynamic programming Christos Dimitrakakis Intelligent Autonomous Systems, IvI, University of Amsterdam, The Netherlands March 18, 2008 Introduction Some examples Dynamic programming

More information

Numerical schemes for SDEs

Numerical schemes for SDEs Lecture 5 Numerical schemes for SDEs Lecture Notes by Jan Palczewski Computational Finance p. 1 A Stochastic Differential Equation (SDE) is an object of the following type dx t = a(t,x t )dt + b(t,x t

More information

A Simple, Adjustably Robust, Dynamic Portfolio Policy under Expected Return Ambiguity

A Simple, Adjustably Robust, Dynamic Portfolio Policy under Expected Return Ambiguity A Simple, Adjustably Robust, Dynamic Portfolio Policy under Expected Return Ambiguity Mustafa Ç. Pınar Department of Industrial Engineering Bilkent University 06800 Bilkent, Ankara, Turkey March 16, 2012

More information

Mengdi Wang. July 3rd, Laboratory for Information and Decision Systems, M.I.T.

Mengdi Wang. July 3rd, Laboratory for Information and Decision Systems, M.I.T. Practice July 3rd, 2012 Laboratory for Information and Decision Systems, M.I.T. 1 2 Infinite-Horizon DP Minimize over policies the objective cost function J π (x 0 ) = lim N E w k,k=0,1,... DP π = {µ 0,µ

More information

Comparison of Static and Dynamic Asset Allocation Models

Comparison of Static and Dynamic Asset Allocation Models Comparison of Static and Dynamic Asset Allocation Models John R. Birge University of Michigan University of Michigan 1 Outline Basic Models Static Markowitz mean-variance Dynamic stochastic programming

More information

Portfolio Optimization. Prof. Daniel P. Palomar

Portfolio Optimization. Prof. Daniel P. Palomar Portfolio Optimization Prof. Daniel P. Palomar The Hong Kong University of Science and Technology (HKUST) MAFS6010R- Portfolio Optimization with R MSc in Financial Mathematics Fall 2018-19, HKUST, Hong

More information

THE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION

THE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION THE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION SILAS A. IHEDIOHA 1, BRIGHT O. OSU 2 1 Department of Mathematics, Plateau State University, Bokkos, P. M. B. 2012, Jos,

More information

The Value of Stochastic Modeling in Two-Stage Stochastic Programs

The Value of Stochastic Modeling in Two-Stage Stochastic Programs The Value of Stochastic Modeling in Two-Stage Stochastic Programs Erick Delage, HEC Montréal Sharon Arroyo, The Boeing Cie. Yinyu Ye, Stanford University Tuesday, October 8 th, 2013 1 Delage et al. Value

More information

Analyzing Pricing and Production Decisions with Capacity Constraints and Setup Costs

Analyzing Pricing and Production Decisions with Capacity Constraints and Setup Costs Erasmus University Rotterdam Bachelor Thesis Logistics Analyzing Pricing and Production Decisions with Capacity Constraints and Setup Costs Author: Bianca Doodeman Studentnumber: 359215 Supervisor: W.

More information

Multi-armed bandit problems

Multi-armed bandit problems Multi-armed bandit problems Stochastic Decision Theory (2WB12) Arnoud den Boer 13 March 2013 Set-up 13 and 14 March: Lectures. 20 and 21 March: Paper presentations (Four groups, 45 min per group). Before

More information

CPS 270: Artificial Intelligence Markov decision processes, POMDPs

CPS 270: Artificial Intelligence  Markov decision processes, POMDPs CPS 270: Artificial Intelligence http://www.cs.duke.edu/courses/fall08/cps270/ Markov decision processes, POMDPs Instructor: Vincent Conitzer Warmup: a Markov process with rewards We derive some reward

More information

Stochastic Optimization Methods in Scheduling. Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms

Stochastic Optimization Methods in Scheduling. Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms Stochastic Optimization Methods in Scheduling Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms More expensive and longer... Eurotunnel Unexpected loss of 400,000,000

More information

Financial Optimization ISE 347/447. Lecture 15. Dr. Ted Ralphs

Financial Optimization ISE 347/447. Lecture 15. Dr. Ted Ralphs Financial Optimization ISE 347/447 Lecture 15 Dr. Ted Ralphs ISE 347/447 Lecture 15 1 Reading for This Lecture C&T Chapter 12 ISE 347/447 Lecture 15 2 Stock Market Indices A stock market index is a statistic

More information

Linear functions Increasing Linear Functions. Decreasing Linear Functions

Linear functions Increasing Linear Functions. Decreasing Linear Functions 3.5 Increasing, Decreasing, Max, and Min So far we have been describing graphs using quantitative information. That s just a fancy way to say that we ve been using numbers. Specifically, we have described

More information

A simple wealth model

A simple wealth model Quantitative Macroeconomics Raül Santaeulàlia-Llopis, MOVE-UAB and Barcelona GSE Homework 5, due Thu Nov 1 I A simple wealth model Consider the sequential problem of a household that maximizes over streams

More information

Online Appendix: Extensions

Online Appendix: Extensions B Online Appendix: Extensions In this online appendix we demonstrate that many important variations of the exact cost-basis LUL framework remain tractable. In particular, dual problem instances corresponding

More information

Optimal Portfolio Selection Under the Estimation Risk in Mean Return

Optimal Portfolio Selection Under the Estimation Risk in Mean Return Optimal Portfolio Selection Under the Estimation Risk in Mean Return by Lei Zhu A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Mathematics

More information

Essays on Some Combinatorial Optimization Problems with Interval Data

Essays on Some Combinatorial Optimization Problems with Interval Data Essays on Some Combinatorial Optimization Problems with Interval Data a thesis submitted to the department of industrial engineering and the institute of engineering and sciences of bilkent university

More information

Forecast Horizons for Production Planning with Stochastic Demand

Forecast Horizons for Production Planning with Stochastic Demand Forecast Horizons for Production Planning with Stochastic Demand Alfredo Garcia and Robert L. Smith Department of Industrial and Operations Engineering Universityof Michigan, Ann Arbor MI 48109 December

More information

Optimization Models for Quantitative Asset Management 1

Optimization Models for Quantitative Asset Management 1 Optimization Models for Quantitative Asset Management 1 Reha H. Tütüncü Goldman Sachs Asset Management Quantitative Equity Joint work with D. Jeria, GS Fields Industrial Optimization Seminar November 13,

More information

The Uncertain Volatility Model

The Uncertain Volatility Model The Uncertain Volatility Model Claude Martini, Antoine Jacquier July 14, 008 1 Black-Scholes and realised volatility What happens when a trader uses the Black-Scholes (BS in the sequel) formula to sell

More information

Data-Driven Optimization for Portfolio Selection

Data-Driven Optimization for Portfolio Selection Delage E., Data-Driven Optimization for Portfolio Selection p. 1/16 Data-Driven Optimization for Portfolio Selection Erick Delage, edelage@stanford.edu Yinyu Ye, yinyu-ye@stanford.edu Stanford University

More information

Optimization Models in Financial Engineering and Modeling Challenges

Optimization Models in Financial Engineering and Modeling Challenges Optimization Models in Financial Engineering and Modeling Challenges John Birge University of Chicago Booth School of Business JRBirge UIUC, 25 Mar 2009 1 Introduction History of financial engineering

More information

Optimization Models one variable optimization and multivariable optimization

Optimization Models one variable optimization and multivariable optimization Georg-August-Universität Göttingen Optimization Models one variable optimization and multivariable optimization Wenzhong Li lwz@nju.edu.cn Feb 2011 Mathematical Optimization Problems in optimization are

More information

Multi-period mean variance asset allocation: Is it bad to win the lottery?

Multi-period mean variance asset allocation: Is it bad to win the lottery? Multi-period mean variance asset allocation: Is it bad to win the lottery? Peter Forsyth 1 D.M. Dang 1 1 Cheriton School of Computer Science University of Waterloo Guangzhou, July 28, 2014 1 / 29 The Basic

More information

Non-Deterministic Search

Non-Deterministic Search Non-Deterministic Search MDP s 1 Non-Deterministic Search How do you plan (search) when your actions might fail? In general case, how do you plan, when the actions have multiple possible outcomes? 2 Example:

More information

Modelling Anti-Terrorist Surveillance Systems from a Queueing Perspective

Modelling Anti-Terrorist Surveillance Systems from a Queueing Perspective Systems from a Queueing Perspective September 7, 2012 Problem A surveillance resource must observe several areas, searching for potential adversaries. Problem A surveillance resource must observe several

More information

Confidence Intervals for the Difference Between Two Means with Tolerance Probability

Confidence Intervals for the Difference Between Two Means with Tolerance Probability Chapter 47 Confidence Intervals for the Difference Between Two Means with Tolerance Probability Introduction This procedure calculates the sample size necessary to achieve a specified distance from the

More information

Optimal Security Liquidation Algorithms

Optimal Security Liquidation Algorithms Optimal Security Liquidation Algorithms Sergiy Butenko Department of Industrial Engineering, Texas A&M University, College Station, TX 77843-3131, USA Alexander Golodnikov Glushkov Institute of Cybernetics,

More information

Dynamic Contract Trading in Spectrum Markets

Dynamic Contract Trading in Spectrum Markets 1 Dynamic Contract Trading in Spectrum Markets G. Kasbekar, S. Sarkar, K. Kar, P. Muthusamy, A. Gupta Abstract We address the question of optimal trading of bandwidth (service) contracts in wireless spectrum

More information

Stochastic Optimal Control

Stochastic Optimal Control Stochastic Optimal Control Lecturer: Eilyan Bitar, Cornell ECE Scribe: Kevin Kircher, Cornell MAE These notes summarize some of the material from ECE 5555 (Stochastic Systems) at Cornell in the fall of

More information

Continuous-Time Pension-Fund Modelling

Continuous-Time Pension-Fund Modelling . Continuous-Time Pension-Fund Modelling Andrew J.G. Cairns Department of Actuarial Mathematics and Statistics, Heriot-Watt University, Riccarton, Edinburgh, EH4 4AS, United Kingdom Abstract This paper

More information

Applications of Linear Programming

Applications of Linear Programming Applications of Linear Programming lecturer: András London University of Szeged Institute of Informatics Department of Computational Optimization Lecture 8 The portfolio selection problem The portfolio

More information

Pakes (1986): Patents as Options: Some Estimates of the Value of Holding European Patent Stocks

Pakes (1986): Patents as Options: Some Estimates of the Value of Holding European Patent Stocks Pakes (1986): Patents as Options: Some Estimates of the Value of Holding European Patent Stocks Spring 2009 Main question: How much are patents worth? Answering this question is important, because it helps

More information

Lecture 8: The Black-Scholes theory

Lecture 8: The Black-Scholes theory Lecture 8: The Black-Scholes theory Dr. Roman V Belavkin MSO4112 Contents 1 Geometric Brownian motion 1 2 The Black-Scholes pricing 2 3 The Black-Scholes equation 3 References 5 1 Geometric Brownian motion

More information

THE TRAVELING SALESMAN PROBLEM FOR MOVING POINTS ON A LINE

THE TRAVELING SALESMAN PROBLEM FOR MOVING POINTS ON A LINE THE TRAVELING SALESMAN PROBLEM FOR MOVING POINTS ON A LINE GÜNTER ROTE Abstract. A salesperson wants to visit each of n objects that move on a line at given constant speeds in the shortest possible time,

More information

Stock Repurchase with an Adaptive Reservation Price: A Study of the Greedy Policy

Stock Repurchase with an Adaptive Reservation Price: A Study of the Greedy Policy Stock Repurchase with an Adaptive Reservation Price: A Study of the Greedy Policy Ye Lu Asuman Ozdaglar David Simchi-Levi November 8, 200 Abstract. We consider the problem of stock repurchase over a finite

More information

Quasi-Convex Stochastic Dynamic Programming

Quasi-Convex Stochastic Dynamic Programming Quasi-Convex Stochastic Dynamic Programming John R. Birge University of Chicago Booth School of Business JRBirge SIAM FM12, MSP, 10 July 2012 1 General Theme Many dynamic optimization problems dealing

More information

Revenue Management Under the Markov Chain Choice Model

Revenue Management Under the Markov Chain Choice Model Revenue Management Under the Markov Chain Choice Model Jacob B. Feldman School of Operations Research and Information Engineering, Cornell University, Ithaca, New York 14853, USA jbf232@cornell.edu Huseyin

More information

6.231 DYNAMIC PROGRAMMING LECTURE 10 LECTURE OUTLINE

6.231 DYNAMIC PROGRAMMING LECTURE 10 LECTURE OUTLINE 6.231 DYNAMIC PROGRAMMING LECTURE 10 LECTURE OUTLINE Rollout algorithms Cost improvement property Discrete deterministic problems Approximations of rollout algorithms Discretization of continuous time

More information

The Yield Envelope: Price Ranges for Fixed Income Products

The Yield Envelope: Price Ranges for Fixed Income Products The Yield Envelope: Price Ranges for Fixed Income Products by David Epstein (LINK:www.maths.ox.ac.uk/users/epstein) Mathematical Institute (LINK:www.maths.ox.ac.uk) Oxford Paul Wilmott (LINK:www.oxfordfinancial.co.uk/pw)

More information

Optimal routing and placement of orders in limit order markets

Optimal routing and placement of orders in limit order markets Optimal routing and placement of orders in limit order markets Rama CONT Arseniy KUKANOV Imperial College London Columbia University New York CFEM-GARP Joint Event and Seminar 05/01/13, New York Choices,

More information

Characterization of the Optimum

Characterization of the Optimum ECO 317 Economics of Uncertainty Fall Term 2009 Notes for lectures 5. Portfolio Allocation with One Riskless, One Risky Asset Characterization of the Optimum Consider a risk-averse, expected-utility-maximizing

More information

Report for technical cooperation between Georgia Institute of Technology and ONS - Operador Nacional do Sistema Elétrico Risk Averse Approach

Report for technical cooperation between Georgia Institute of Technology and ONS - Operador Nacional do Sistema Elétrico Risk Averse Approach Report for technical cooperation between Georgia Institute of Technology and ONS - Operador Nacional do Sistema Elétrico Risk Averse Approach Alexander Shapiro and Wajdi Tekaya School of Industrial and

More information

A Data Driven Functionally Robust Approach for Coordinating. Pricing and Order Quantity Decisions with Unknown Demand. Function

A Data Driven Functionally Robust Approach for Coordinating. Pricing and Order Quantity Decisions with Unknown Demand. Function A Data Driven Functionally Robust Approach for Coordinating Pricing and Order Quantity Decisions with Unknown Demand Function Jian Hu, Junxuan Li Department of Industrial and Manufacturing Systems Engineering

More information

Machine Learning in Computer Vision Markov Random Fields Part II

Machine Learning in Computer Vision Markov Random Fields Part II Machine Learning in Computer Vision Markov Random Fields Part II Oren Freifeld Computer Science, Ben-Gurion University March 22, 2018 Mar 22, 2018 1 / 40 1 Some MRF Computations 2 Mar 22, 2018 2 / 40 Few

More information

Approximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications

Approximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications Approximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications Anna Timonina University of Vienna, Abraham Wald PhD Program in Statistics and Operations

More information

Multi-Period Trading via Convex Optimization

Multi-Period Trading via Convex Optimization Multi-Period Trading via Convex Optimization Stephen Boyd Enzo Busseti Steven Diamond Ronald Kahn Kwangmoo Koh Peter Nystrup Jan Speth Stanford University & Blackrock City University of Hong Kong September

More information

A Markov decision model for optimising economic production lot size under stochastic demand

A Markov decision model for optimising economic production lot size under stochastic demand Volume 26 (1) pp. 45 52 http://www.orssa.org.za ORiON IN 0529-191-X c 2010 A Markov decision model for optimising economic production lot size under stochastic demand Paul Kizito Mubiru Received: 2 October

More information

An Online Algorithm for Multi-Strategy Trading Utilizing Market Regimes

An Online Algorithm for Multi-Strategy Trading Utilizing Market Regimes An Online Algorithm for Multi-Strategy Trading Utilizing Market Regimes Hynek Mlnařík 1 Subramanian Ramamoorthy 2 Rahul Savani 1 1 Warwick Institute for Financial Computing Department of Computer Science

More information

Mathematics in Finance

Mathematics in Finance Mathematics in Finance Steven E. Shreve Department of Mathematical Sciences Carnegie Mellon University Pittsburgh, PA 15213 USA shreve@andrew.cmu.edu A Talk in the Series Probability in Science and Industry

More information

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Basic idea: Receive feedback in the form of rewards Agent s utility is defined by the

More information

Arbitrage-Free Option Pricing by Convex Optimization

Arbitrage-Free Option Pricing by Convex Optimization Arbitrage-Free Option Pricing by Convex Optimization Alex Bain June 1, 2011 1 Description In this project we consider the problem of pricing an option on an underlying stock given a risk-free interest

More information

Introduction to Dynamic Programming

Introduction to Dynamic Programming Introduction to Dynamic Programming http://bicmr.pku.edu.cn/~wenzw/bigdata2018.html Acknowledgement: this slides is based on Prof. Mengdi Wang s and Prof. Dimitri Bertsekas lecture notes Outline 2/65 1

More information

Optimization in Finance

Optimization in Finance Research Reports on Mathematical and Computing Sciences Series B : Operations Research Department of Mathematical and Computing Sciences Tokyo Institute of Technology 2-12-1 Oh-Okayama, Meguro-ku, Tokyo

More information

The Optimization Process: An example of portfolio optimization

The Optimization Process: An example of portfolio optimization ISyE 6669: Deterministic Optimization The Optimization Process: An example of portfolio optimization Shabbir Ahmed Fall 2002 1 Introduction Optimization can be roughly defined as a quantitative approach

More information

1 Precautionary Savings: Prudence and Borrowing Constraints

1 Precautionary Savings: Prudence and Borrowing Constraints 1 Precautionary Savings: Prudence and Borrowing Constraints In this section we study conditions under which savings react to changes in income uncertainty. Recall that in the PIH, when you abstract from

More information