SOLVING ROBUST SUPPLY CHAIN PROBLEMS
|
|
- Augustine Porter
- 6 years ago
- Views:
Transcription
1 SOLVING ROBUST SUPPLY CHAIN PROBLEMS Daniel Bienstock Nuri Sercan Özbay Columbia University, New York November 13, 2005
2 Project with Lucent Technologies Optimize the inventory buffer levels in a complicated supply chain network. Business objective: meet the demand in a timely fashion and without excessive inventory buildup Limited demand data Poor quality of forecasts there is a paucity of data Short product life cycles Occasional boosts in demand Long lead-times with high uncertainty They need policies that are simple to implement How to handle uncertainty?
3 Robust Optimization Addresses the parameter uncertainty in optimization problems Developed in late 90 s Ben-Tal and Nemirovski (1998), (1999), (2000). El-Ghaoui et al. (1997), (1998). Bertsimas and Sim (2003). Ben-Tal et al.(2004). Application to supply chain management Bertsimas and Thiele (2003). Adversarial queueing Cruz (1991). Borodin et. al. (1996). Andrews et.al. (1996). Other work Gallego, Ryan and Simchi-Levi (1996).
4 Supply Chain Problem - Basic Model Single item, single station inventory problem over a finite time horizon t = 1, 2,..., T x t : inventory level at the beginning of period t, u t : amount of items ordered in period t, d t : demand in period t. u_t u_t+1 x_t x_t+1 x_t+2 t t+1 d_t d_t+1 Inventory level evolves according to the equation x t+1 = x t + u t d t
5 Supply Chain Problem - Basic Model Single item, single station inventory problem over a finite time horizon t = 1, 2,..., T x t : inventory level at the beginning of period t, u t : amount of items ordered in period t, d t : demand in period t. Inventory level at the beginning of period t x t+1 = x t + u t d t = x 1 + t i=1 (u i d i ) c t : unit ordering cost in period t, h t : unit holding cost in period t, b t : unit backlogging cost in period t. Inventory holding/shortage cost: max{h t (x t + u t d t ), b t (d t u t x t )} Ordering cost: c t u t Total cost of a given demand stream, d and order vector u t=1 C(u, d) = T c tu t + max{h t (x 1 + t (u i d i )), b t ( x 1 + t (d i u i ))} i=1 i=1
6 Demand Uncertainty No probability distribution is given. Demand can take any value from a set D First model we consider: Bertsimas and Thiele model, uses some ideas from Bertsimas and Sim In each period demand is in some interval d t [µ t δ t, µ t + δ t ] Risk in period t = d t µ t Budgets for risk: Γ t δ t d 1 µ 1 δ 1 + d 2 µ d t µ t Γ t δ 2 δ t D = { (d 1, d 2,..., d T ) : d 1 µ 1 δ d t µ t Γ t, 0 δ t d t µ t δ t 1, t {1, 2,..., T } }
7 Demand Uncertainty No probability distribution is given. Demand can take any value from a set D First model we consider: Bertsimas and Thiele model, uses some ideas from Bertsimas and Sim { } d 1 µ 1 D = (d 1, d 2,..., d T ) : δ d t µ t 1 δ Γ d t µ t t, 0 t δ 1, t {1, 2,..., T } t Second model: Demands with peaks (adversarial queuing model) Interval or peak value: d t [µ t δ t, µ t + δ t ] {p t } Window size parameter w. At most one peak in w consecutive periods D = {(d 1,..., d T ) : d t = s t + I t p t, I t (µ t δ t ) s t I t (µ t + δ t ), I t {0, 1} for t = 1,..., T t+w 1 I t 1 for t = 1,..., T w + 1} i=t
8 Demand Uncertainty No probability distribution is given. Demand can take any value from a set D Bertsimas and Sim model { D = (d 1, d 2,..., d T ) : d 1 µ 1 δ d t µ t Γ t, 0 Demand model with peaks (adversarial queuing model) δ t d t µ t δ t 1, t {1, 2,..., T } } D = {(d 1,..., d T ) : d t = s t + I t p t, I t (µ t δ t ) s t I t (µ t + δ t ), I t {0, 1} for t = 1,..., T t+w 1 I t 1 for t = 1,..., T w + 1} i=t Robust Supply Chain Problem min u 0 max {C(u, d)} d D (C(u, d)= cost with orders u and demands d)
9 Static vs. Dynamic Policies Static policies: Inventory controller determines the exact order amounts, i.e. u t s in advance. Orders are fixed no matter how much inventory you have Poor performance when demand is uncertain Dynamic policies: In each period inventory controller specifies the orders as a function of the beginning inventory Handles the uncertainties in the demand since it gives the inventory controller freedom to change the orders according to the inventory level Very hard to implement if you don t have a closed form definition of the function Basestock Policies: Given a basestock level, σ, place an order of σ x t if your beginning inventory, x t, in period t is less than σ, do nothing otherwise. In between two extreme policies Gives some power to inventory controller to handle uncertainties Easy to implement, widely used in practice
10 Static Policies: LP Formulation Reformulating robust supply chain problem Min K s.t K max d D { C( u, d ) }. u 0
11 Static Policies: LP Formulation Reformulating robust supply chain problem Min s.t K + T t=1 K T t=1 c t u t max{h t (x 1 + t (u i d i )), b t ( x 1 + t (d i u i ))} d D i=1 i=1 u 0
12 Static Policies: LP Formulation Reformulating robust supply chain problem LP(D) Min s.t T t=1 c t u t + K K T Kt d t=1 Kt d h t (x 1 + t (u i d i )) t = 1, 2,..., T d D i=1 Kt d b t (x 1 + t (u i d i )) t = 1, 2,..., T u 0 i=1 LP with infinite number of constraints Benders like approach; maintain a working formulation Maintain a subset ˆD D. Solve the LP( ˆD) to get a candidate for the optimal solution. Optimal cost of LP( ˆD) gives a lower bound for the original problem.
13 Prototype Algorithm Given a vector u of orders, we solve the Adversarial Problem to generate a cut: Seperates the current u Gives an upper bound for the optimal cost max {C( u, d )}. d D Step 1. Let d D. Set ˆD = {d}. Set UB to infinity. Step 2. Solve LP( ˆD). Set LB to objective value of the LP( ˆD). Set u to the optimal solution to the LP( ˆD). Step 3. Solve Adversarial Problem using u. Update U B according to the objective value. Set d to the solution to the Adversarial Problem. Step 4. If LB UB, set ˆD = ˆD {d }. Go to Step 2. Step 5. Otherwise, u is optimal. Stop.
14 Adversarial Problem: Bertsimas and Thiele Demand Model d 1 µ 1 δ d t µ t δ t Γ t, d t [µ t δ t, µ t + δ t ] δ t, µ t, Γ t, parameters, d t = demand at t max d D { Tt=1 {c t u t + max{h t (x t + u t d t ), b t ( (x t + u t ) + d t )} } Assume that Γ t is integral for every t: then all extreme points of the polyhedral set D have DP formulation for adversarial problem d t µ t δ t integral, t. V t (x, k) = cost-to-go assuming inventory x and k units of risk used up V t (x, k) = ( max {c t u t + max{h t (x + u t d), b t (d u t x)} + V t+1 x + u t d, k + d {µ t,µ t +δ t,µ t δ t } d µ t δ t )} V T +1 (x, k) = 0 k V t (x, k) is convex piecewise linear in x with finite number of pieces. Construct the function V t (x, k) for each integral 0 k Γ t
15 Numerical Results 500 test runs for each class. Running Time (sec.) Number of Iterations # periods average max min average max min Periodic (with peaks) Periodic (with budgets) Discounted (with peaks) Discounted (with budgets)
16 Basestock Problem Recap: Basestock level is equal to sigma means, we order σ inventory level whenever the inventory level drops below σ System dynamics Ordering cost x t+1 = max{x t d t, σ d t } Inventory holding/shortage cost becomes c t max{0, σ x t } max{h t max{x t d t, σ d t }, b t max{x t d t, σ d t }} Problem: min σ max d D t (ordering cost at t + holding/shortage cost at t)
17 Static vs Basestock Policies Example Static Policy Basestock Policy Error (%) 1 10, , , , , , ,800, , , , ,440, , Basestock policies are significantly better when uncertainty is high
18 Numerical Results for Basestock Model Up to 45% error in the cost We generate budgets using Bertsimas and Thiele formula - Assuming we know first two moments of the demand dist. Cost changes linearly according to the variability of the demand
19 Impact of variance on optimal basestock P = peak size (constant), W = window size experiment: scale P and W by the same constant Scale Optimal Basestock Matches results for stochastic models
20 Basestock Problem: Finite Number of Demand Patterns Decision maker s problem: We want to choose σ so as to minimize max d ˆD C(σ, d) Total cost C(σ, d) = T (c t max{0, σ x t } + max{h t max{x t d t, σ d t }, b t max{x t d t, σ d t }}) t=1 Second term is non-convex w.r.t σ due to shortage cost. However, C(σ, d) is piecewise-convex with a polynomial number of pieces. RESULT: If ˆD is a finite set we can solve using binary search min σ max {C(σ, d)} d ˆD
21 Adversarial Problem Remark: If beginning inventory drops below σ in some period t, then it will be below σ for all periods after t. Divides the horizon into two parts with different cost structure and dynamics Part 1: Inventory evolution: x t+1 = x t d t Ordering cost: 0 Inventory cost: h t (x 1 t i=1 d i ) Part 2: Inventory evolution: x t+1 = σ d t Ordering cost: c t (σ x t ) Inventory cost: max{h t (σ d t ), b t (σ d t )} For each t, solve each part separately
22 Comparison with Bertsimas and Thiele Model Min s.t K + T c t u t t=1 K T max{max {h t(x 1 + t (u i d i ))}, max {b t( x 1 + t (d i u i ))}} d D d D t=1 i=1 i=1 u 0 Maximizes RHS of each constraint seperately. More conservative. Example Robust Optimal B-T Objective B-T Real Cost Error % % % % %
Log-Robust Portfolio Management
Log-Robust Portfolio Management Dr. Aurélie Thiele Lehigh University Joint work with Elcin Cetinkaya and Ban Kawas Research partially supported by the National Science Foundation Grant CMMI-0757983 Dr.
More informationRobust Dual Dynamic Programming
1 / 18 Robust Dual Dynamic Programming Angelos Georghiou, Angelos Tsoukalas, Wolfram Wiesemann American University of Beirut Olayan School of Business 31 May 217 2 / 18 Inspired by SDDP Stochastic optimization
More informationRisk Management for Chemical Supply Chain Planning under Uncertainty
for Chemical Supply Chain Planning under Uncertainty Fengqi You and Ignacio E. Grossmann Dept. of Chemical Engineering, Carnegie Mellon University John M. Wassick The Dow Chemical Company Introduction
More informationROBUST OPTIMIZATION OF MULTI-PERIOD PRODUCTION PLANNING UNDER DEMAND UNCERTAINTY. A. Ben-Tal, B. Golany and M. Rozenblit
ROBUST OPTIMIZATION OF MULTI-PERIOD PRODUCTION PLANNING UNDER DEMAND UNCERTAINTY A. Ben-Tal, B. Golany and M. Rozenblit Faculty of Industrial Engineering and Management, Technion, Haifa 32000, Israel ABSTRACT
More informationA Robust Option Pricing Problem
IMA 2003 Workshop, March 12-19, 2003 A Robust Option Pricing Problem Laurent El Ghaoui Department of EECS, UC Berkeley 3 Robust optimization standard form: min x sup u U f 0 (x, u) : u U, f i (x, u) 0,
More informationRobust Portfolio Optimization with Derivative Insurance Guarantees
Robust Portfolio Optimization with Derivative Insurance Guarantees Steve Zymler Berç Rustem Daniel Kuhn Department of Computing Imperial College London Mean-Variance Portfolio Optimization Optimal Asset
More informationAsset-Liability Management
Asset-Liability Management John Birge University of Chicago Booth School of Business JRBirge INFORMS San Francisco, Nov. 2014 1 Overview Portfolio optimization involves: Modeling Optimization Estimation
More informationStochastic Dual Dynamic Programming Algorithm for Multistage Stochastic Programming
Stochastic Dual Dynamic Programg Algorithm for Multistage Stochastic Programg Final presentation ISyE 8813 Fall 2011 Guido Lagos Wajdi Tekaya Georgia Institute of Technology November 30, 2011 Multistage
More informationDynamic Portfolio Choice II
Dynamic Portfolio Choice II Dynamic Programming Leonid Kogan MIT, Sloan 15.450, Fall 2010 c Leonid Kogan ( MIT, Sloan ) Dynamic Portfolio Choice II 15.450, Fall 2010 1 / 35 Outline 1 Introduction to Dynamic
More informationPortfolio selection with multiple risk measures
Portfolio selection with multiple risk measures Garud Iyengar Columbia University Industrial Engineering and Operations Research Joint work with Carlos Abad Outline Portfolio selection and risk measures
More informationDynamic Programming: An overview. 1 Preliminaries: The basic principle underlying dynamic programming
Dynamic Programming: An overview These notes summarize some key properties of the Dynamic Programming principle to optimize a function or cost that depends on an interval or stages. This plays a key role
More informationEconomics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints
Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints David Laibson 9/11/2014 Outline: 1. Precautionary savings motives 2. Liquidity constraints 3. Application: Numerical solution
More informationHandout 8: Introduction to Stochastic Dynamic Programming. 2 Examples of Stochastic Dynamic Programming Problems
SEEM 3470: Dynamic Optimization and Applications 2013 14 Second Term Handout 8: Introduction to Stochastic Dynamic Programming Instructor: Shiqian Ma March 10, 2014 Suggested Reading: Chapter 1 of Bertsekas,
More informationFinal exam solutions
EE365 Stochastic Control / MS&E251 Stochastic Decision Models Profs. S. Lall, S. Boyd June 5 6 or June 6 7, 2013 Final exam solutions This is a 24 hour take-home final. Please turn it in to one of the
More informationOPTIMAL PORTFOLIO CONTROL WITH TRADING STRATEGIES OF FINITE
Proceedings of the 44th IEEE Conference on Decision and Control, and the European Control Conference 005 Seville, Spain, December 1-15, 005 WeA11.6 OPTIMAL PORTFOLIO CONTROL WITH TRADING STRATEGIES OF
More informationLecture 7: Bayesian approach to MAB - Gittins index
Advanced Topics in Machine Learning and Algorithmic Game Theory Lecture 7: Bayesian approach to MAB - Gittins index Lecturer: Yishay Mansour Scribe: Mariano Schain 7.1 Introduction In the Bayesian approach
More informationOptimizing (s, S) policies for multi-period inventory models with demand distribution uncertainty: Robust dynamic programming approaches
Singapore Management University Institutional Knowledge at Singapore Management University Research Collection Lee Kong Chian School Of Business Lee Kong Chian School of Business 9-2017 Optimizing (s,
More informationUnblinded Sample Size Re-Estimation in Bioequivalence Trials with Small Samples. Sam Hsiao, Cytel Lingyun Liu, Cytel Romeo Maciuca, Genentech
Unblinded Sample Size Re-Estimation in Bioequivalence Trials with Small Samples Sam Hsiao, Cytel Lingyun Liu, Cytel Romeo Maciuca, Genentech Goal Describe simple adjustment to CHW method (Cui, Hung, Wang
More informationDynamic Replication of Non-Maturing Assets and Liabilities
Dynamic Replication of Non-Maturing Assets and Liabilities Michael Schürle Institute for Operations Research and Computational Finance, University of St. Gallen, Bodanstr. 6, CH-9000 St. Gallen, Switzerland
More informationSensitivity Analysis with Data Tables. 10% annual interest now =$110 one year later. 10% annual interest now =$121 one year later
Sensitivity Analysis with Data Tables Time Value of Money: A Special kind of Trade-Off: $100 @ 10% annual interest now =$110 one year later $110 @ 10% annual interest now =$121 one year later $100 @ 10%
More informationBudget Management In GSP (2018)
Budget Management In GSP (2018) Yahoo! March 18, 2018 Miguel March 18, 2018 1 / 26 Today s Presentation: Budget Management Strategies in Repeated auctions, Balseiro, Kim, and Mahdian, WWW2017 Learning
More informationOn-line Supplement for Constraint Aggregation in Column Generation Models for Resource-Constrained Covering Problems
Submitted to INFORMS Journal on Computing manuscript (Please, provide the mansucript number!) Authors are encouraged to submit new papers to INFORMS journals by means of a style file template, which includes
More informationDeveloping a robust-fuzzy multi-objective optimization model for portfolio selection
Developing a robust-fuzzy multi-objective optimization model for portfolio selection COMPUTATIONAL MANAGEMENT SCIENCE University of Bergamo, Italy May 31, 217 Mohammad Salehifar 1 PhD student in finance,
More informationOptimal Dam Management
Optimal Dam Management Michel De Lara et Vincent Leclère July 3, 2012 Contents 1 Problem statement 1 1.1 Dam dynamics.................................. 2 1.2 Intertemporal payoff criterion..........................
More informationWorst-Case Value-at-Risk of Derivative Portfolios
Worst-Case Value-at-Risk of Derivative Portfolios Steve Zymler Berç Rustem Daniel Kuhn Department of Computing Imperial College London Thalesians Seminar Series, November 2009 Risk Management is a Hot
More informationCash flow matching with risks controlled by buffered probability of exceedance and conditional value-at-risk
DOI 10.1007/s10479-016-2354-6 ADVANCES OF OR IN COMMODITIES AND FINANCIAL MODELLING Cash flow matching with risks controlled by buffered probability of exceedance and conditional value-at-risk Danjue Shang
More informationOptimization in Financial Engineering in the Post-Boom Market
Optimization in Financial Engineering in the Post-Boom Market John R. Birge Northwestern University www.iems.northwestern.edu/~jrbirge SIAM Optimization Toronto May 2002 1 Introduction History of financial
More informationOptimization Models in Financial Mathematics
Optimization Models in Financial Mathematics John R. Birge Northwestern University www.iems.northwestern.edu/~jrbirge Illinois Section MAA, April 3, 2004 1 Introduction Trends in financial mathematics
More information13.3 A Stochastic Production Planning Model
13.3. A Stochastic Production Planning Model 347 From (13.9), we can formally write (dx t ) = f (dt) + G (dz t ) + fgdz t dt, (13.3) dx t dt = f(dt) + Gdz t dt. (13.33) The exact meaning of these expressions
More informationAn Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking
An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking Mika Sumida School of Operations Research and Information Engineering, Cornell University, Ithaca, New York
More information1 The EOQ and Extensions
IEOR4000: Production Management Lecture 2 Professor Guillermo Gallego September 16, 2003 Lecture Plan 1. The EOQ and Extensions 2. Multi-Item EOQ Model 1 The EOQ and Extensions We have explored some of
More information6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE
6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE Suboptimal control Cost approximation methods: Classification Certainty equivalent control: An example Limited lookahead policies Performance bounds
More informationScenario Generation and Sampling Methods
Scenario Generation and Sampling Methods Güzin Bayraksan Tito Homem-de-Mello SVAN 2016 IMPA May 9th, 2016 Bayraksan (OSU) & Homem-de-Mello (UAI) Scenario Generation and Sampling SVAN IMPA May 9 1 / 30
More informationEvaluation of proportional portfolio insurance strategies
Evaluation of proportional portfolio insurance strategies Prof. Dr. Antje Mahayni Department of Accounting and Finance, Mercator School of Management, University of Duisburg Essen 11th Scientific Day of
More informationLecture outline W.B.Powell 1
Lecture outline What is a policy? Policy function approximations (PFAs) Cost function approximations (CFAs) alue function approximations (FAs) Lookahead policies Finding good policies Optimizing continuous
More informationMultistage risk-averse asset allocation with transaction costs
Multistage risk-averse asset allocation with transaction costs 1 Introduction Václav Kozmík 1 Abstract. This paper deals with asset allocation problems formulated as multistage stochastic programming models.
More informationMaking Complex Decisions
Ch. 17 p.1/29 Making Complex Decisions Chapter 17 Ch. 17 p.2/29 Outline Sequential decision problems Value iteration algorithm Policy iteration algorithm Ch. 17 p.3/29 A simple environment 3 +1 p=0.8 2
More informationPOMDPs: Partially Observable Markov Decision Processes Advanced AI
POMDPs: Partially Observable Markov Decision Processes Advanced AI Wolfram Burgard Types of Planning Problems Classical Planning State observable Action Model Deterministic, accurate MDPs observable stochastic
More informationEE266 Homework 5 Solutions
EE, Spring 15-1 Professor S. Lall EE Homework 5 Solutions 1. A refined inventory model. In this problem we consider an inventory model that is more refined than the one you ve seen in the lectures. The
More informationLecture 17: More on Markov Decision Processes. Reinforcement learning
Lecture 17: More on Markov Decision Processes. Reinforcement learning Learning a model: maximum likelihood Learning a value function directly Monte Carlo Temporal-difference (TD) learning COMP-424, Lecture
More informationAmerican options and early exercise
Chapter 3 American options and early exercise American options are contracts that may be exercised early, prior to expiry. These options are contrasted with European options for which exercise is only
More informationWorst-Case Value-at-Risk of Non-Linear Portfolios
Worst-Case Value-at-Risk of Non-Linear Portfolios Steve Zymler Daniel Kuhn Berç Rustem Department of Computing Imperial College London Portfolio Optimization Consider a market consisting of m assets. Optimal
More informationIntroduction to Real-Time Systems. Note: Slides are adopted from Lui Sha and Marco Caccamo
Introduction to Real-Time Systems Note: Slides are adopted from Lui Sha and Marco Caccamo 1 Recap Schedulability analysis - Determine whether a given real-time taskset is schedulable or not L&L least upper
More informationSequential Decision Making
Sequential Decision Making Dynamic programming Christos Dimitrakakis Intelligent Autonomous Systems, IvI, University of Amsterdam, The Netherlands March 18, 2008 Introduction Some examples Dynamic programming
More informationNumerical schemes for SDEs
Lecture 5 Numerical schemes for SDEs Lecture Notes by Jan Palczewski Computational Finance p. 1 A Stochastic Differential Equation (SDE) is an object of the following type dx t = a(t,x t )dt + b(t,x t
More informationA Simple, Adjustably Robust, Dynamic Portfolio Policy under Expected Return Ambiguity
A Simple, Adjustably Robust, Dynamic Portfolio Policy under Expected Return Ambiguity Mustafa Ç. Pınar Department of Industrial Engineering Bilkent University 06800 Bilkent, Ankara, Turkey March 16, 2012
More informationMengdi Wang. July 3rd, Laboratory for Information and Decision Systems, M.I.T.
Practice July 3rd, 2012 Laboratory for Information and Decision Systems, M.I.T. 1 2 Infinite-Horizon DP Minimize over policies the objective cost function J π (x 0 ) = lim N E w k,k=0,1,... DP π = {µ 0,µ
More informationComparison of Static and Dynamic Asset Allocation Models
Comparison of Static and Dynamic Asset Allocation Models John R. Birge University of Michigan University of Michigan 1 Outline Basic Models Static Markowitz mean-variance Dynamic stochastic programming
More informationPortfolio Optimization. Prof. Daniel P. Palomar
Portfolio Optimization Prof. Daniel P. Palomar The Hong Kong University of Science and Technology (HKUST) MAFS6010R- Portfolio Optimization with R MSc in Financial Mathematics Fall 2018-19, HKUST, Hong
More informationTHE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION
THE OPTIMAL ASSET ALLOCATION PROBLEMFOR AN INVESTOR THROUGH UTILITY MAXIMIZATION SILAS A. IHEDIOHA 1, BRIGHT O. OSU 2 1 Department of Mathematics, Plateau State University, Bokkos, P. M. B. 2012, Jos,
More informationThe Value of Stochastic Modeling in Two-Stage Stochastic Programs
The Value of Stochastic Modeling in Two-Stage Stochastic Programs Erick Delage, HEC Montréal Sharon Arroyo, The Boeing Cie. Yinyu Ye, Stanford University Tuesday, October 8 th, 2013 1 Delage et al. Value
More informationAnalyzing Pricing and Production Decisions with Capacity Constraints and Setup Costs
Erasmus University Rotterdam Bachelor Thesis Logistics Analyzing Pricing and Production Decisions with Capacity Constraints and Setup Costs Author: Bianca Doodeman Studentnumber: 359215 Supervisor: W.
More informationMulti-armed bandit problems
Multi-armed bandit problems Stochastic Decision Theory (2WB12) Arnoud den Boer 13 March 2013 Set-up 13 and 14 March: Lectures. 20 and 21 March: Paper presentations (Four groups, 45 min per group). Before
More informationCPS 270: Artificial Intelligence Markov decision processes, POMDPs
CPS 270: Artificial Intelligence http://www.cs.duke.edu/courses/fall08/cps270/ Markov decision processes, POMDPs Instructor: Vincent Conitzer Warmup: a Markov process with rewards We derive some reward
More informationStochastic Optimization Methods in Scheduling. Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms
Stochastic Optimization Methods in Scheduling Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms More expensive and longer... Eurotunnel Unexpected loss of 400,000,000
More informationFinancial Optimization ISE 347/447. Lecture 15. Dr. Ted Ralphs
Financial Optimization ISE 347/447 Lecture 15 Dr. Ted Ralphs ISE 347/447 Lecture 15 1 Reading for This Lecture C&T Chapter 12 ISE 347/447 Lecture 15 2 Stock Market Indices A stock market index is a statistic
More informationLinear functions Increasing Linear Functions. Decreasing Linear Functions
3.5 Increasing, Decreasing, Max, and Min So far we have been describing graphs using quantitative information. That s just a fancy way to say that we ve been using numbers. Specifically, we have described
More informationA simple wealth model
Quantitative Macroeconomics Raül Santaeulàlia-Llopis, MOVE-UAB and Barcelona GSE Homework 5, due Thu Nov 1 I A simple wealth model Consider the sequential problem of a household that maximizes over streams
More informationOnline Appendix: Extensions
B Online Appendix: Extensions In this online appendix we demonstrate that many important variations of the exact cost-basis LUL framework remain tractable. In particular, dual problem instances corresponding
More informationOptimal Portfolio Selection Under the Estimation Risk in Mean Return
Optimal Portfolio Selection Under the Estimation Risk in Mean Return by Lei Zhu A thesis presented to the University of Waterloo in fulfillment of the thesis requirement for the degree of Master of Mathematics
More informationEssays on Some Combinatorial Optimization Problems with Interval Data
Essays on Some Combinatorial Optimization Problems with Interval Data a thesis submitted to the department of industrial engineering and the institute of engineering and sciences of bilkent university
More informationForecast Horizons for Production Planning with Stochastic Demand
Forecast Horizons for Production Planning with Stochastic Demand Alfredo Garcia and Robert L. Smith Department of Industrial and Operations Engineering Universityof Michigan, Ann Arbor MI 48109 December
More informationOptimization Models for Quantitative Asset Management 1
Optimization Models for Quantitative Asset Management 1 Reha H. Tütüncü Goldman Sachs Asset Management Quantitative Equity Joint work with D. Jeria, GS Fields Industrial Optimization Seminar November 13,
More informationThe Uncertain Volatility Model
The Uncertain Volatility Model Claude Martini, Antoine Jacquier July 14, 008 1 Black-Scholes and realised volatility What happens when a trader uses the Black-Scholes (BS in the sequel) formula to sell
More informationData-Driven Optimization for Portfolio Selection
Delage E., Data-Driven Optimization for Portfolio Selection p. 1/16 Data-Driven Optimization for Portfolio Selection Erick Delage, edelage@stanford.edu Yinyu Ye, yinyu-ye@stanford.edu Stanford University
More informationOptimization Models in Financial Engineering and Modeling Challenges
Optimization Models in Financial Engineering and Modeling Challenges John Birge University of Chicago Booth School of Business JRBirge UIUC, 25 Mar 2009 1 Introduction History of financial engineering
More informationOptimization Models one variable optimization and multivariable optimization
Georg-August-Universität Göttingen Optimization Models one variable optimization and multivariable optimization Wenzhong Li lwz@nju.edu.cn Feb 2011 Mathematical Optimization Problems in optimization are
More informationMulti-period mean variance asset allocation: Is it bad to win the lottery?
Multi-period mean variance asset allocation: Is it bad to win the lottery? Peter Forsyth 1 D.M. Dang 1 1 Cheriton School of Computer Science University of Waterloo Guangzhou, July 28, 2014 1 / 29 The Basic
More informationNon-Deterministic Search
Non-Deterministic Search MDP s 1 Non-Deterministic Search How do you plan (search) when your actions might fail? In general case, how do you plan, when the actions have multiple possible outcomes? 2 Example:
More informationModelling Anti-Terrorist Surveillance Systems from a Queueing Perspective
Systems from a Queueing Perspective September 7, 2012 Problem A surveillance resource must observe several areas, searching for potential adversaries. Problem A surveillance resource must observe several
More informationConfidence Intervals for the Difference Between Two Means with Tolerance Probability
Chapter 47 Confidence Intervals for the Difference Between Two Means with Tolerance Probability Introduction This procedure calculates the sample size necessary to achieve a specified distance from the
More informationOptimal Security Liquidation Algorithms
Optimal Security Liquidation Algorithms Sergiy Butenko Department of Industrial Engineering, Texas A&M University, College Station, TX 77843-3131, USA Alexander Golodnikov Glushkov Institute of Cybernetics,
More informationDynamic Contract Trading in Spectrum Markets
1 Dynamic Contract Trading in Spectrum Markets G. Kasbekar, S. Sarkar, K. Kar, P. Muthusamy, A. Gupta Abstract We address the question of optimal trading of bandwidth (service) contracts in wireless spectrum
More informationStochastic Optimal Control
Stochastic Optimal Control Lecturer: Eilyan Bitar, Cornell ECE Scribe: Kevin Kircher, Cornell MAE These notes summarize some of the material from ECE 5555 (Stochastic Systems) at Cornell in the fall of
More informationContinuous-Time Pension-Fund Modelling
. Continuous-Time Pension-Fund Modelling Andrew J.G. Cairns Department of Actuarial Mathematics and Statistics, Heriot-Watt University, Riccarton, Edinburgh, EH4 4AS, United Kingdom Abstract This paper
More informationApplications of Linear Programming
Applications of Linear Programming lecturer: András London University of Szeged Institute of Informatics Department of Computational Optimization Lecture 8 The portfolio selection problem The portfolio
More informationPakes (1986): Patents as Options: Some Estimates of the Value of Holding European Patent Stocks
Pakes (1986): Patents as Options: Some Estimates of the Value of Holding European Patent Stocks Spring 2009 Main question: How much are patents worth? Answering this question is important, because it helps
More informationLecture 8: The Black-Scholes theory
Lecture 8: The Black-Scholes theory Dr. Roman V Belavkin MSO4112 Contents 1 Geometric Brownian motion 1 2 The Black-Scholes pricing 2 3 The Black-Scholes equation 3 References 5 1 Geometric Brownian motion
More informationTHE TRAVELING SALESMAN PROBLEM FOR MOVING POINTS ON A LINE
THE TRAVELING SALESMAN PROBLEM FOR MOVING POINTS ON A LINE GÜNTER ROTE Abstract. A salesperson wants to visit each of n objects that move on a line at given constant speeds in the shortest possible time,
More informationStock Repurchase with an Adaptive Reservation Price: A Study of the Greedy Policy
Stock Repurchase with an Adaptive Reservation Price: A Study of the Greedy Policy Ye Lu Asuman Ozdaglar David Simchi-Levi November 8, 200 Abstract. We consider the problem of stock repurchase over a finite
More informationQuasi-Convex Stochastic Dynamic Programming
Quasi-Convex Stochastic Dynamic Programming John R. Birge University of Chicago Booth School of Business JRBirge SIAM FM12, MSP, 10 July 2012 1 General Theme Many dynamic optimization problems dealing
More informationRevenue Management Under the Markov Chain Choice Model
Revenue Management Under the Markov Chain Choice Model Jacob B. Feldman School of Operations Research and Information Engineering, Cornell University, Ithaca, New York 14853, USA jbf232@cornell.edu Huseyin
More information6.231 DYNAMIC PROGRAMMING LECTURE 10 LECTURE OUTLINE
6.231 DYNAMIC PROGRAMMING LECTURE 10 LECTURE OUTLINE Rollout algorithms Cost improvement property Discrete deterministic problems Approximations of rollout algorithms Discretization of continuous time
More informationThe Yield Envelope: Price Ranges for Fixed Income Products
The Yield Envelope: Price Ranges for Fixed Income Products by David Epstein (LINK:www.maths.ox.ac.uk/users/epstein) Mathematical Institute (LINK:www.maths.ox.ac.uk) Oxford Paul Wilmott (LINK:www.oxfordfinancial.co.uk/pw)
More informationOptimal routing and placement of orders in limit order markets
Optimal routing and placement of orders in limit order markets Rama CONT Arseniy KUKANOV Imperial College London Columbia University New York CFEM-GARP Joint Event and Seminar 05/01/13, New York Choices,
More informationCharacterization of the Optimum
ECO 317 Economics of Uncertainty Fall Term 2009 Notes for lectures 5. Portfolio Allocation with One Riskless, One Risky Asset Characterization of the Optimum Consider a risk-averse, expected-utility-maximizing
More informationReport for technical cooperation between Georgia Institute of Technology and ONS - Operador Nacional do Sistema Elétrico Risk Averse Approach
Report for technical cooperation between Georgia Institute of Technology and ONS - Operador Nacional do Sistema Elétrico Risk Averse Approach Alexander Shapiro and Wajdi Tekaya School of Industrial and
More informationA Data Driven Functionally Robust Approach for Coordinating. Pricing and Order Quantity Decisions with Unknown Demand. Function
A Data Driven Functionally Robust Approach for Coordinating Pricing and Order Quantity Decisions with Unknown Demand Function Jian Hu, Junxuan Li Department of Industrial and Manufacturing Systems Engineering
More informationMachine Learning in Computer Vision Markov Random Fields Part II
Machine Learning in Computer Vision Markov Random Fields Part II Oren Freifeld Computer Science, Ben-Gurion University March 22, 2018 Mar 22, 2018 1 / 40 1 Some MRF Computations 2 Mar 22, 2018 2 / 40 Few
More informationApproximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications
Approximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications Anna Timonina University of Vienna, Abraham Wald PhD Program in Statistics and Operations
More informationMulti-Period Trading via Convex Optimization
Multi-Period Trading via Convex Optimization Stephen Boyd Enzo Busseti Steven Diamond Ronald Kahn Kwangmoo Koh Peter Nystrup Jan Speth Stanford University & Blackrock City University of Hong Kong September
More informationA Markov decision model for optimising economic production lot size under stochastic demand
Volume 26 (1) pp. 45 52 http://www.orssa.org.za ORiON IN 0529-191-X c 2010 A Markov decision model for optimising economic production lot size under stochastic demand Paul Kizito Mubiru Received: 2 October
More informationAn Online Algorithm for Multi-Strategy Trading Utilizing Market Regimes
An Online Algorithm for Multi-Strategy Trading Utilizing Market Regimes Hynek Mlnařík 1 Subramanian Ramamoorthy 2 Rahul Savani 1 1 Warwick Institute for Financial Computing Department of Computer Science
More informationMathematics in Finance
Mathematics in Finance Steven E. Shreve Department of Mathematical Sciences Carnegie Mellon University Pittsburgh, PA 15213 USA shreve@andrew.cmu.edu A Talk in the Series Probability in Science and Industry
More informationReinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein
Reinforcement Learning Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Basic idea: Receive feedback in the form of rewards Agent s utility is defined by the
More informationArbitrage-Free Option Pricing by Convex Optimization
Arbitrage-Free Option Pricing by Convex Optimization Alex Bain June 1, 2011 1 Description In this project we consider the problem of pricing an option on an underlying stock given a risk-free interest
More informationIntroduction to Dynamic Programming
Introduction to Dynamic Programming http://bicmr.pku.edu.cn/~wenzw/bigdata2018.html Acknowledgement: this slides is based on Prof. Mengdi Wang s and Prof. Dimitri Bertsekas lecture notes Outline 2/65 1
More informationOptimization in Finance
Research Reports on Mathematical and Computing Sciences Series B : Operations Research Department of Mathematical and Computing Sciences Tokyo Institute of Technology 2-12-1 Oh-Okayama, Meguro-ku, Tokyo
More informationThe Optimization Process: An example of portfolio optimization
ISyE 6669: Deterministic Optimization The Optimization Process: An example of portfolio optimization Shabbir Ahmed Fall 2002 1 Introduction Optimization can be roughly defined as a quantitative approach
More information1 Precautionary Savings: Prudence and Borrowing Constraints
1 Precautionary Savings: Prudence and Borrowing Constraints In this section we study conditions under which savings react to changes in income uncertainty. Recall that in the PIH, when you abstract from
More information