Stochastic Optimization Methods in Scheduling. Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms

Size: px
Start display at page:

Download "Stochastic Optimization Methods in Scheduling. Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms"

Transcription

1 Stochastic Optimization Methods in Scheduling Rolf H. Möhring Technische Universität Berlin Combinatorial Optimization and Graph Algorithms

2 More expensive and longer... Eurotunnel Unexpected loss of 400,000,000 in first half of 995 Delays in project start and excecution

3 More expensive and longer... Government & parliament buildings in Berlin Not ready for move of the government & parliament Expected to be (much) more expensive July 7, 999

4 We are deeply disappointed and even somewhat depressed

5 Reasons Planning assumes certainty about project details deterministic models Project excecution is subject to many influences that are beyond control machine breakdowns, weather, illness, leads to underestimation of expected makespan and cost Fulkerson 96 Therefore Need models and techniques to cope with uncertainty

6 Coworkers M. & Frederik Stork DFG Project Scheduling Problems with Varying Processing Times M., Andreas Schulz, Martin Skutella & Marc Uetz Esther Frostig & Gideon Weiss GIF Project Polyhedral Methods in Stochastic Scheduling Background M., Radermacher & Weiss

7 Overview The model Classes of policies Computation and approximation Open problems

8 The discrete data a set V of n jobs j =,..., n (no preemption) a graph (partial order) G of precedence constraints a system F of forbidden sets (resource constraints ) G F {3,4,5}, {,4}

9 The continuous data a joint distribution Q of job processing times job j has random processing time X j with distribution Q j a cost function κ ( C,..., C n ) depending on the (random) completion times C,..., C n Examples: C max and w j C j

10 The objective Plan jobs non-preemptively over time and... respect the precedence constraints resource constraints minimize expected cost or other parameters of the cost distribution

11 Planning with policies The dynamic view t S(t) t planned time Decision at decision time t non-anticipative start set S(t) (possibly empty) fix tentative next decision time t planned next planned next, t = min{ t, C } Minimize expected cost: min{ E[ κ Π ] Π is a policy}

12 Policies An Example 3 4 m = machines F ={,3,4} forbidden X j ~ exp(a), independent common due date d penalties for lateness: v for job, w for jobs 3,4, v << w Minimize E( Σ penalties )

13 Example: starting job and early 3 4 Start jobs and at t = 0 Danger: job blocks machine d expensive jobs 3 and 4 sequentially

14 Example: leaving the second machine idle 3 4 Start only job and wait for its completion Danger: deadline is approaching d expensive jobs 3 and 4 in parallel short span to deadline

15 Example: use tentative decision times Start at time 0. Fix tentative decision time t panic panic if C t start 3 and 4 at C else start at t panic panic 3 4 d 3 4 panic Jobs may start when no other job ends d

16 Example: best policy uses tentative decision time Expected cost for a =, d = 3, v = 0, w = d = 3 panic t

17 Comparison with Stochastic Programming -stage stochastic program: min E[ f (ξ, x, x (ξ ))] s.t. x C x C ( ξ, x ) ξ x x observation first stage decision second stage decision ξ independent from x in this model but not in stochastic scheduling!

18 Stability of policies Data deficiencies, use of approximate methods (simulation) require stability condition: Q approximates Q κ approximates κ OPT( Q, κ ) approximates OPT( Q, κ)

19 Excessive information yields instability 4 min EC ( max ) 3 5 Q j : x y j with probability j with probability = (,,, 4, ) = (, 4,,, ) Exploit info when completes x j y E j ( C ) Q max j 8

20 Q j j Q : x y = = ( 4,,,, ) ( 4,,,, ) with probability with probability No info when completes. So start after x y EQ ( C ) = max 9 lim E ( C ) = j Q max j 8 8 0

21 Robust information and decisions S(t) t t planned Robust information at time t which jobs have completed by t which jobs are running at t Start jobs only at completions of other jobs

22 Overview The model Classes of policies Computation and approximation Open problems

23 Policies viewed as functions Π : IR n IR n processing time vector x schedule ( x,..., x ) ( S,..., S ) n n Π( x) Discuss properties of policies like being continuous convex monotone...

24 A policy is three objects dynamic planning rule function n IR IR n combinatorial object

25 Classes of policies priority policies preselective policies earliest start policies (ES-policies) linear preselective policies distinct conflict solving strategies on forbidden sets a general class of robust policies

26 Priority policies Solve resource conflicts by priorities At every decision time t, use a priority list Lt : j < j <... < j Start as many jobs as possible in the order of L k Greedy use of scarce resources

27 Priority policies are neither continuous nor monotone (Graham anomalies) 4 6 identical machines 5 min Cmax 3 7 L = < <...< 7 x = (4,,,5,5,0,0) y = x = (3,,,4,4,9,9)

28 Classes of policies priority policies preselective policies earliest start policies (ES-policies) linear preselective policies distinct conflict solving strategies on forbidden sets a general class of robust policies

29 Preselective policies Solve resource conflicts by pre-selecting a waiting job i j k i k j for every forbidden set F, select waiting job j from F, j must wait for at least one job from F Start every job as early as possible w.r.t. to G + waiting conditions delaying alternative waiting condition

30 A preselective policy for Graham s example identical machines F = {4,5,7} is only forbidden set x = (4,,,5,5,0,0) y = x = (3,,,4,4,9,9)

31 Preselective policies and AND/OR networks G 3 F 6 F 4 6 F F 7 F : {3,4,5}, {,4} 4 4 waiting jobs define policy Π AND/OR network representing Π start in Π = min of longest paths lengths = min of max of sums of processing times Π is monotone and continuous

32 Problems related to AND/OR networks may contain cycles 5 F Tasks test feasibility 3 4 F 6 F 3 9 detect forced waiting conditions (transitivity) compute earliest start 7 F 4 8 F 5 0 Fast algorithms available

33 3 views on preselective policies early start scheduling w.r.t. waiting conditions dynamic planning rule function n IR IR n combinatorial object continuous, monotone stability AND/OR networks

34 Classes of robust policies priority policies preselective policies earliest start policies (ES-policies) linear preselective policies distinct conflict solving strategies on forbidden sets a general class of robust policies

35 Set policies: A general class of robust policies Only exploitable information at time t set of completed jobs set of busy jobs Jobs start only at completions of other jobs S(t) Special cases priority policies preselective policies t t planned

36 Set policies behave locally like ES-policies For every set policy Π, there exists a partition of IR n into finitely many convex polyhedral cones Z,..., Z k and feasible partial orders G,..., G k such that Π( x) = ES ( x) for x Z G i i Π( x) = ES ( x) G Π( x) = ES ( x) G Graham anomalies only at boundaries of cones! Stability for continuous distributions!

37 Optimality of set policies If all jobs are exponentially distributed and independent the cost function κ is additive then there is an optimal set policy Π (among all policies). κ is additive if there is a set function g : IR (the cost rate) with κ ( C,..., Cn ) = g( U( t)) dt U( t) = set of uncompleted jobs at t V g( ) g( ) g( )

38 Overview The model Classes of policies Computation and approximation Open problems

39 How to find good policies efficiently? Determining an an optimal policy is is NP-hard Exact methods: limited applicability Construct policies with provable performance guarantee Heuristics: use good deterministic schedules to to construct policies

40 Algorithms Heuristics {,} Extract good policies from several deterministic schedules Exact methods Branch & Bound and exterior sampling {3,4,5} Rolf Möhring 00

41 Computing (linear) preselective policies Truncated Erlang distribution on [0.*mean;.6*mean] 57 forbidden sets, 5 jobs Optimum deterministic makespan 03 CPU:.7 sec Optimum expected makespan 43. Optimal preselective policy Nodes: 5007 CPU: sec Opt. linear pres. policy Nodes: 409 CPU: sec

42 How good are simple policies? Simple = priority or linear preselective or?? A simple setting: m identical machines κ = wc j j Use ideas from the deterministic case LP-relaxation LP-guided construction of a list L defining the policy

43 The LP-based approach Consider the achievable region Π Π n ( EC [ ], K, EC [ n ]) IR Π policy } Find a polyhedral relaxation P Solve the linear program LP j LP (LP) min{ wc C P} j j Use the list L: i i i n defined by C LP C LP C LP i i... i n as list for priority/lin. pres./other policy C LP

44 Performance guarantees from the LP Let Π L be the policy induced by L: i i i n L Hope that E[ κ Π LP ] α OPT, α /α. OPT α. OPT OPT OPT LP cost of Π L

45 The case without precedence constraints Generalize valid inequalities from deterministic scheduling Hall, Shmoys, Schulz & Wein 97 Π EX [ k] EC [ k ] EX [ k ] + EX [ k ] m k A k A k A m m k A Var[ X k ] for all A {,,n } and all policies Π

46 The term k Var[X k ] Var[ X j ] [ ] Coefficient of variation CV[X j ] = ( EX ) for all distributions that are NBUE New Better than Used in Expectation EX [ t X > t] EX [ ] for all t> 0 j j j Assume CV[X j ] j

47 The modified polyhedral relaxation Assume CV[X j ] Π EX [ k] EC [ k ] EX [ k ] + EX [ k ] m k A k A k A ( m )( ) m k A for all A {,,n } and all policies Π EX [ k ] RHS depends only on E[X j ], LP can be solved in polynomial time

48 Performance guarantees for NBUE The LP leads to a linear preselective policy with performance 3 m WSEPT leads to a priority policy with performance m Adding release dates: WSEPT: EX [ ] EX [ ]... w w EX [ n] w The LP leads to a linear preselective policy with performance 4 n m WSEPT may be arbitrarily bad

49 Dealing with precedence constraints Skutella & Uetz 00: Combine valid inequalities for the stochastic case with delay list scheduling by Chekuri, Motwani, Natarajan & Stein 97 Use inequalities Π m EX [ j] EC [ j ] EX [ j ] EX [ j ] m + m j A j A j A j A Var[ X j ] EC [ ] EC [ ] + EX [ ] if i j j i j for constructing the list L from an optimum LP-solution

50 Delay list scheduling Use list L for linear preselective policy Use tentative decision times to avoid too much idle time Consider decision time t Let i be the first unscheduled and available job in L Let j be the first unscheduled job in L if j is available then start j at t charge uncharged idle time in [r j,t] to j else if there is at least β E[X i ] uncharged idle time in [r i,t] then start i at t and charge this idle time to i else set next tentative decision time to t + β E[X k ] for suitable k

51 Performance guarantees LP-based delay list scheduling leads to a policy with performance m m + + ( + β ) + max, max mβ m 5.83 for NBUE processing times j VX [ ] j EX [ ] j

52 Overview The model Classes of policies Computation and approximation Open problems

53 Open problems Better computational methods When do tentative decision times help? They help for P w j C j. What about P C max?? What are optimal policies for exponential models P p j ~ exp κ LEPT/SEPT optimal for C / C max j [Weiss & Pinedo 80] What about w j C j? Detailed policy analysis (cost distribution function) #P complete for earliest start scheduling (PERT model) How to approximate?

54 Additional information Contact the speaker: Prof. Dr. Rolf Möhring TU Berlin, MA 6- Straße des 7. Juni Berlin Tel , Fax: Browse our web pages: in particular

Essays on Some Combinatorial Optimization Problems with Interval Data

Essays on Some Combinatorial Optimization Problems with Interval Data Essays on Some Combinatorial Optimization Problems with Interval Data a thesis submitted to the department of industrial engineering and the institute of engineering and sciences of bilkent university

More information

Single Machine Inserted Idle Time Scheduling with Release Times and Due Dates

Single Machine Inserted Idle Time Scheduling with Release Times and Due Dates Single Machine Inserted Idle Time Scheduling with Release Times and Due Dates Natalia Grigoreva Department of Mathematics and Mechanics, St.Petersburg State University, Russia n.s.grig@gmail.com Abstract.

More information

CS599: Algorithm Design in Strategic Settings Fall 2012 Lecture 6: Prior-Free Single-Parameter Mechanism Design (Continued)

CS599: Algorithm Design in Strategic Settings Fall 2012 Lecture 6: Prior-Free Single-Parameter Mechanism Design (Continued) CS599: Algorithm Design in Strategic Settings Fall 2012 Lecture 6: Prior-Free Single-Parameter Mechanism Design (Continued) Instructor: Shaddin Dughmi Administrivia Homework 1 due today. Homework 2 out

More information

The Irrevocable Multi-Armed Bandit Problem

The Irrevocable Multi-Armed Bandit Problem The Irrevocable Multi-Armed Bandit Problem Ritesh Madan Qualcomm-Flarion Technologies May 27, 2009 Joint work with Vivek Farias (MIT) 2 Multi-Armed Bandit Problem n arms, where each arm i is a Markov Decision

More information

6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE

6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE 6.231 DYNAMIC PROGRAMMING LECTURE 8 LECTURE OUTLINE Suboptimal control Cost approximation methods: Classification Certainty equivalent control: An example Limited lookahead policies Performance bounds

More information

Robust Dual Dynamic Programming

Robust Dual Dynamic Programming 1 / 18 Robust Dual Dynamic Programming Angelos Georghiou, Angelos Tsoukalas, Wolfram Wiesemann American University of Beirut Olayan School of Business 31 May 217 2 / 18 Inspired by SDDP Stochastic optimization

More information

SOLVING ROBUST SUPPLY CHAIN PROBLEMS

SOLVING ROBUST SUPPLY CHAIN PROBLEMS SOLVING ROBUST SUPPLY CHAIN PROBLEMS Daniel Bienstock Nuri Sercan Özbay Columbia University, New York November 13, 2005 Project with Lucent Technologies Optimize the inventory buffer levels in a complicated

More information

Project Planning. Jesper Larsen. Department of Management Engineering Technical University of Denmark

Project Planning. Jesper Larsen. Department of Management Engineering Technical University of Denmark Project Planning jesla@man.dtu.dk Department of Management Engineering Technical University of Denmark 1 Project Management Project Management is a set of techniques that helps management manage large-scale

More information

CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM

CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM 6.1 Introduction Project Management is the process of planning, controlling and monitoring the activities

More information

Markov Decision Processes II

Markov Decision Processes II Markov Decision Processes II Daisuke Oyama Topics in Economic Theory December 17, 2014 Review Finite state space S, finite action space A. The value of a policy σ A S : v σ = β t Q t σr σ, t=0 which satisfies

More information

Integer Programming Models

Integer Programming Models Integer Programming Models Fabio Furini December 10, 2014 Integer Programming Models 1 Outline 1 Combinatorial Auctions 2 The Lockbox Problem 3 Constructing an Index Fund Integer Programming Models 2 Integer

More information

EE365: Risk Averse Control

EE365: Risk Averse Control EE365: Risk Averse Control Risk averse optimization Exponential risk aversion Risk averse control 1 Outline Risk averse optimization Exponential risk aversion Risk averse control Risk averse optimization

More information

Bounding Optimal Expected Revenues for Assortment Optimization under Mixtures of Multinomial Logits

Bounding Optimal Expected Revenues for Assortment Optimization under Mixtures of Multinomial Logits Bounding Optimal Expected Revenues for Assortment Optimization under Mixtures of Multinomial Logits Jacob Feldman School of Operations Research and Information Engineering, Cornell University, Ithaca,

More information

Scenario Generation and Sampling Methods

Scenario Generation and Sampling Methods Scenario Generation and Sampling Methods Güzin Bayraksan Tito Homem-de-Mello SVAN 2016 IMPA May 9th, 2016 Bayraksan (OSU) & Homem-de-Mello (UAI) Scenario Generation and Sampling SVAN IMPA May 9 1 / 30

More information

MAFS Computational Methods for Pricing Structured Products

MAFS Computational Methods for Pricing Structured Products MAFS550 - Computational Methods for Pricing Structured Products Solution to Homework Two Course instructor: Prof YK Kwok 1 Expand f(x 0 ) and f(x 0 x) at x 0 into Taylor series, where f(x 0 ) = f(x 0 )

More information

Approximation Algorithms for Stochastic Inventory Control Models

Approximation Algorithms for Stochastic Inventory Control Models Approximation Algorithms for Stochastic Inventory Control Models Retsef Levi Martin Pal Robin Roundy David B. Shmoys Abstract We consider stochastic control inventory models in which the goal is to coordinate

More information

Scenario reduction and scenario tree construction for power management problems

Scenario reduction and scenario tree construction for power management problems Scenario reduction and scenario tree construction for power management problems N. Gröwe-Kuska, H. Heitsch and W. Römisch Humboldt-University Berlin Institute of Mathematics Page 1 of 20 IEEE Bologna POWER

More information

Stochastic Dual Dynamic Programming Algorithm for Multistage Stochastic Programming

Stochastic Dual Dynamic Programming Algorithm for Multistage Stochastic Programming Stochastic Dual Dynamic Programg Algorithm for Multistage Stochastic Programg Final presentation ISyE 8813 Fall 2011 Guido Lagos Wajdi Tekaya Georgia Institute of Technology November 30, 2011 Multistage

More information

Mechanism Design and Auctions

Mechanism Design and Auctions Mechanism Design and Auctions Game Theory Algorithmic Game Theory 1 TOC Mechanism Design Basics Myerson s Lemma Revenue-Maximizing Auctions Near-Optimal Auctions Multi-Parameter Mechanism Design and the

More information

EC316a: Advanced Scientific Computation, Fall Discrete time, continuous state dynamic models: solution methods

EC316a: Advanced Scientific Computation, Fall Discrete time, continuous state dynamic models: solution methods EC316a: Advanced Scientific Computation, Fall 2003 Notes Section 4 Discrete time, continuous state dynamic models: solution methods We consider now solution methods for discrete time models in which decisions

More information

More Advanced Single Machine Models. University at Buffalo IE661 Scheduling Theory 1

More Advanced Single Machine Models. University at Buffalo IE661 Scheduling Theory 1 More Advanced Single Machine Models University at Buffalo IE661 Scheduling Theory 1 Total Earliness And Tardiness Non-regular performance measures Ej + Tj Early jobs (Set j 1 ) and Late jobs (Set j 2 )

More information

Equity correlations implied by index options: estimation and model uncertainty analysis

Equity correlations implied by index options: estimation and model uncertainty analysis 1/18 : estimation and model analysis, EDHEC Business School (joint work with Rama COT) Modeling and managing financial risks Paris, 10 13 January 2011 2/18 Outline 1 2 of multi-asset models Solution to

More information

Transactions with Hidden Action: Part 1. Dr. Margaret Meyer Nuffield College

Transactions with Hidden Action: Part 1. Dr. Margaret Meyer Nuffield College Transactions with Hidden Action: Part 1 Dr. Margaret Meyer Nuffield College 2015 Transactions with hidden action A risk-neutral principal (P) delegates performance of a task to an agent (A) Key features

More information

A Robust Option Pricing Problem

A Robust Option Pricing Problem IMA 2003 Workshop, March 12-19, 2003 A Robust Option Pricing Problem Laurent El Ghaoui Department of EECS, UC Berkeley 3 Robust optimization standard form: min x sup u U f 0 (x, u) : u U, f i (x, u) 0,

More information

Dynamic Replication of Non-Maturing Assets and Liabilities

Dynamic Replication of Non-Maturing Assets and Liabilities Dynamic Replication of Non-Maturing Assets and Liabilities Michael Schürle Institute for Operations Research and Computational Finance, University of St. Gallen, Bodanstr. 6, CH-9000 St. Gallen, Switzerland

More information

Dynamic Programming: An overview. 1 Preliminaries: The basic principle underlying dynamic programming

Dynamic Programming: An overview. 1 Preliminaries: The basic principle underlying dynamic programming Dynamic Programming: An overview These notes summarize some key properties of the Dynamic Programming principle to optimize a function or cost that depends on an interval or stages. This plays a key role

More information

Handout 4: Deterministic Systems and the Shortest Path Problem

Handout 4: Deterministic Systems and the Shortest Path Problem SEEM 3470: Dynamic Optimization and Applications 2013 14 Second Term Handout 4: Deterministic Systems and the Shortest Path Problem Instructor: Shiqian Ma January 27, 2014 Suggested Reading: Bertsekas

More information

A Heuristic Method for Statistical Digital Circuit Sizing

A Heuristic Method for Statistical Digital Circuit Sizing A Heuristic Method for Statistical Digital Circuit Sizing Stephen Boyd Seung-Jean Kim Dinesh Patil Mark Horowitz Microlithography 06 2/23/06 Statistical variation in digital circuits growing in importance

More information

Martingale Pricing Theory in Discrete-Time and Discrete-Space Models

Martingale Pricing Theory in Discrete-Time and Discrete-Space Models IEOR E4707: Foundations of Financial Engineering c 206 by Martin Haugh Martingale Pricing Theory in Discrete-Time and Discrete-Space Models These notes develop the theory of martingale pricing in a discrete-time,

More information

TTIC An Introduction to the Theory of Machine Learning. The Adversarial Multi-armed Bandit Problem Avrim Blum.

TTIC An Introduction to the Theory of Machine Learning. The Adversarial Multi-armed Bandit Problem Avrim Blum. TTIC 31250 An Introduction to the Theory of Machine Learning The Adversarial Multi-armed Bandit Problem Avrim Blum Start with recap 1 Algorithm Consider the following setting Each morning, you need to

More information

Yao s Minimax Principle

Yao s Minimax Principle Complexity of algorithms The complexity of an algorithm is usually measured with respect to the size of the input, where size may for example refer to the length of a binary word describing the input,

More information

SRPT is 1.86-Competitive for Completion Time Scheduling

SRPT is 1.86-Competitive for Completion Time Scheduling SRPT is 1.86-Competitive for Completion Time Scheduling Christine Chung Tim Nonner Alexander Souza Abstract We consider the classical problem of scheduling preemptible jobs, that arrive over time, on identical

More information

Adjusting scheduling model with release and due dates in production planning

Adjusting scheduling model with release and due dates in production planning PRODUCTION & MANUFACTURING RESEARCH ARTICLE Adjusting scheduling model with release and due dates in production planning Elisa Chinos and Nodari Vakhania Cogent Engineering (2017), 4: 1321175 Page 1 of

More information

Log-Robust Portfolio Management

Log-Robust Portfolio Management Log-Robust Portfolio Management Dr. Aurélie Thiele Lehigh University Joint work with Elcin Cetinkaya and Ban Kawas Research partially supported by the National Science Foundation Grant CMMI-0757983 Dr.

More information

Dynamic Risk Management in Electricity Portfolio Optimization via Polyhedral Risk Functionals

Dynamic Risk Management in Electricity Portfolio Optimization via Polyhedral Risk Functionals Dynamic Risk Management in Electricity Portfolio Optimization via Polyhedral Risk Functionals A. Eichhorn and W. Römisch Humboldt-University Berlin, Department of Mathematics, Germany http://www.math.hu-berlin.de/~romisch

More information

CSCI 1951-G Optimization Methods in Finance Part 00: Course Logistics Introduction to Finance Optimization Problems

CSCI 1951-G Optimization Methods in Finance Part 00: Course Logistics Introduction to Finance Optimization Problems CSCI 1951-G Optimization Methods in Finance Part 00: Course Logistics Introduction to Finance Optimization Problems January 26, 2018 1 / 24 Basic information All information is available in the syllabus

More information

Practice Problems 1: Moral Hazard

Practice Problems 1: Moral Hazard Practice Problems 1: Moral Hazard December 5, 2012 Question 1 (Comparative Performance Evaluation) Consider the same normal linear model as in Question 1 of Homework 1. This time the principal employs

More information

Lecture 7: Bayesian approach to MAB - Gittins index

Lecture 7: Bayesian approach to MAB - Gittins index Advanced Topics in Machine Learning and Algorithmic Game Theory Lecture 7: Bayesian approach to MAB - Gittins index Lecturer: Yishay Mansour Scribe: Mariano Schain 7.1 Introduction In the Bayesian approach

More information

Reasoning with Uncertainty

Reasoning with Uncertainty Reasoning with Uncertainty Markov Decision Models Manfred Huber 2015 1 Markov Decision Process Models Markov models represent the behavior of a random process, including its internal state and the externally

More information

Slides credited from Hsu-Chun Hsiao

Slides credited from Hsu-Chun Hsiao Slides credited from Hsu-Chun Hsiao Greedy Algorithms Greedy #1: Activity-Selection / Interval Scheduling Greedy #2: Coin Changing Greedy #3: Fractional Knapsack Problem Greedy #4: Breakpoint Selection

More information

4 Reinforcement Learning Basic Algorithms

4 Reinforcement Learning Basic Algorithms Learning in Complex Systems Spring 2011 Lecture Notes Nahum Shimkin 4 Reinforcement Learning Basic Algorithms 4.1 Introduction RL methods essentially deal with the solution of (optimal) control problems

More information

Optimization Methods in Management Science

Optimization Methods in Management Science Problem Set Rules: Optimization Methods in Management Science MIT 15.053, Spring 2013 Problem Set 6, Due: Thursday April 11th, 2013 1. Each student should hand in an individual problem set. 2. Discussing

More information

Problem 1: Random variables, common distributions and the monopoly price

Problem 1: Random variables, common distributions and the monopoly price Problem 1: Random variables, common distributions and the monopoly price In this problem, we will revise some basic concepts in probability, and use these to better understand the monopoly price (alternatively

More information

Convex-Cardinality Problems

Convex-Cardinality Problems l 1 -norm Methods for Convex-Cardinality Problems problems involving cardinality the l 1 -norm heuristic convex relaxation and convex envelope interpretations examples recent results Prof. S. Boyd, EE364b,

More information

Online Appendix: Extensions

Online Appendix: Extensions B Online Appendix: Extensions In this online appendix we demonstrate that many important variations of the exact cost-basis LUL framework remain tractable. In particular, dual problem instances corresponding

More information

Lecture outline W.B.Powell 1

Lecture outline W.B.Powell 1 Lecture outline What is a policy? Policy function approximations (PFAs) Cost function approximations (CFAs) alue function approximations (FAs) Lookahead policies Finding good policies Optimizing continuous

More information

An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking

An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking An Approximation Algorithm for Capacity Allocation over a Single Flight Leg with Fare-Locking Mika Sumida School of Operations Research and Information Engineering, Cornell University, Ithaca, New York

More information

Asset-Liability Management

Asset-Liability Management Asset-Liability Management John Birge University of Chicago Booth School of Business JRBirge INFORMS San Francisco, Nov. 2014 1 Overview Portfolio optimization involves: Modeling Optimization Estimation

More information

56:171 Operations Research Midterm Exam Solutions October 22, 1993

56:171 Operations Research Midterm Exam Solutions October 22, 1993 56:171 O.R. Midterm Exam Solutions page 1 56:171 Operations Research Midterm Exam Solutions October 22, 1993 (A.) /: Indicate by "+" ="true" or "o" ="false" : 1. A "dummy" activity in CPM has duration

More information

An Analysis of Sequencing Surgeries with Durations that Follow the Lognormal, Gamma, or Normal Distribution

An Analysis of Sequencing Surgeries with Durations that Follow the Lognormal, Gamma, or Normal Distribution An Analysis of Sequencing Surgeries with Durations that Follow the Lognormal, Gamma, or Normal Distribution SANGDO CHOI and WILBERT E. WILHELM 1 Department of Industrial and Systems Engineering, Texas

More information

Lecture 10: The knapsack problem

Lecture 10: The knapsack problem Optimization Methods in Finance (EPFL, Fall 2010) Lecture 10: The knapsack problem 24.11.2010 Lecturer: Prof. Friedrich Eisenbrand Scribe: Anu Harjula The knapsack problem The Knapsack problem is a problem

More information

Accelerated Option Pricing Multiple Scenarios

Accelerated Option Pricing Multiple Scenarios Accelerated Option Pricing in Multiple Scenarios 04.07.2008 Stefan Dirnstorfer (stefan@thetaris.com) Andreas J. Grau (grau@thetaris.com) 1 Abstract This paper covers a massive acceleration of Monte-Carlo

More information

Approximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications

Approximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications Approximation of Continuous-State Scenario Processes in Multi-Stage Stochastic Optimization and its Applications Anna Timonina University of Vienna, Abraham Wald PhD Program in Statistics and Operations

More information

What can we do with numerical optimization?

What can we do with numerical optimization? Optimization motivation and background Eddie Wadbro Introduction to PDE Constrained Optimization, 2016 February 15 16, 2016 Eddie Wadbro, Introduction to PDE Constrained Optimization, February 15 16, 2016

More information

DM559/DM545 Linear and integer programming

DM559/DM545 Linear and integer programming Department of Mathematics and Computer Science University of Southern Denmark, Odense May 22, 2018 Marco Chiarandini DM559/DM55 Linear and integer programming Sheet, Spring 2018 [pdf format] Contains Solutions!

More information

A Branch-and-Price method for the Multiple-depot Vehicle and Crew Scheduling Problem

A Branch-and-Price method for the Multiple-depot Vehicle and Crew Scheduling Problem A Branch-and-Price method for the Multiple-depot Vehicle and Crew Scheduling Problem SCIP Workshop 2018, Aachen Markó Horváth Tamás Kis Institute for Computer Science and Control Hungarian Academy of Sciences

More information

Homework solutions, Chapter 8

Homework solutions, Chapter 8 Homework solutions, Chapter 8 NOTE: We might think of 8.1 as being a section devoted to setting up the networks and 8.2 as solving them, but only 8.2 has a homework section. Section 8.2 2. Use Dijkstra

More information

Stochastic Programming Modeling

Stochastic Programming Modeling IE 495 Lecture 3 Stochastic Programming Modeling Prof. Jeff Linderoth January 20, 2003 January 20, 2003 Stochastic Programming Lecture 3 Slide 1 Outline Review convexity Review Farmer Ted Expected Value

More information

Chapter wise Question bank

Chapter wise Question bank GOVERNMENT ENGINEERING COLLEGE - MODASA Chapter wise Question bank Subject Name Analysis and Design of Algorithm Semester Department 5 th Term ODD 2015 Information Technology / Computer Engineering Chapter

More information

56:171 Operations Research Midterm Examination October 25, 1991 PART ONE

56:171 Operations Research Midterm Examination October 25, 1991 PART ONE 56:171 O.R. Midterm Exam - 1 - Name or Initials 56:171 Operations Research Midterm Examination October 25, 1991 Write your name on the first page, and initial the other pages. Answer both questions of

More information

Threshold Accepting for Credit Risk Assessment and Validation

Threshold Accepting for Credit Risk Assessment and Validation Threshold Accepting for Credit Risk Assessment and Validation M. Lyra 1 A. Onwunta P. Winker COMPSTAT 2010 August 24, 2010 1 Financial support from the EU Commission through COMISEF is gratefully acknowledged

More information

Approximations of Stochastic Programs. Scenario Tree Reduction and Construction

Approximations of Stochastic Programs. Scenario Tree Reduction and Construction Approximations of Stochastic Programs. Scenario Tree Reduction and Construction W. Römisch Humboldt-University Berlin Institute of Mathematics 10099 Berlin, Germany www.mathematik.hu-berlin.de/~romisch

More information

Integer Solution to a Graph-based Linear Programming Problem

Integer Solution to a Graph-based Linear Programming Problem Integer Solution to a Graph-based Linear Programming Problem E. Bozorgzadeh S. Ghiasi A. Takahashi M. Sarrafzadeh Computer Science Department University of California, Los Angeles (UCLA) Los Angeles, CA

More information

Portfolio selection with multiple risk measures

Portfolio selection with multiple risk measures Portfolio selection with multiple risk measures Garud Iyengar Columbia University Industrial Engineering and Operations Research Joint work with Carlos Abad Outline Portfolio selection and risk measures

More information

Version A. Problem 1. Let X be the continuous random variable defined by the following pdf: 1 x/2 when 0 x 2, f(x) = 0 otherwise.

Version A. Problem 1. Let X be the continuous random variable defined by the following pdf: 1 x/2 when 0 x 2, f(x) = 0 otherwise. Math 224 Q Exam 3A Fall 217 Tues Dec 12 Version A Problem 1. Let X be the continuous random variable defined by the following pdf: { 1 x/2 when x 2, f(x) otherwise. (a) Compute the mean µ E[X]. E[X] x

More information

DRAFT. 1 exercise in state (S, t), π(s, t) = 0 do not exercise in state (S, t) Review of the Risk Neutral Stock Dynamics

DRAFT. 1 exercise in state (S, t), π(s, t) = 0 do not exercise in state (S, t) Review of the Risk Neutral Stock Dynamics Chapter 12 American Put Option Recall that the American option has strike K and maturity T and gives the holder the right to exercise at any time in [0, T ]. The American option is not straightforward

More information

CSCI 1951-G Optimization Methods in Finance Part 07: Portfolio Optimization

CSCI 1951-G Optimization Methods in Finance Part 07: Portfolio Optimization CSCI 1951-G Optimization Methods in Finance Part 07: Portfolio Optimization March 9 16, 2018 1 / 19 The portfolio optimization problem How to best allocate our money to n risky assets S 1,..., S n with

More information

Performance Bounds and Suboptimal Policies for Multi-Period Investment

Performance Bounds and Suboptimal Policies for Multi-Period Investment Foundations and Trends R in Optimization Vol. 1, No. 1 (2014) 1 72 c 2014 S. Boyd, M. Mueller, B. O Donoghue, Y. Wang DOI: 10.1561/2400000001 Performance Bounds and Suboptimal Policies for Multi-Period

More information

Financial Optimization ISE 347/447. Lecture 15. Dr. Ted Ralphs

Financial Optimization ISE 347/447. Lecture 15. Dr. Ted Ralphs Financial Optimization ISE 347/447 Lecture 15 Dr. Ted Ralphs ISE 347/447 Lecture 15 1 Reading for This Lecture C&T Chapter 12 ISE 347/447 Lecture 15 2 Stock Market Indices A stock market index is a statistic

More information

Forecast Horizons for Production Planning with Stochastic Demand

Forecast Horizons for Production Planning with Stochastic Demand Forecast Horizons for Production Planning with Stochastic Demand Alfredo Garcia and Robert L. Smith Department of Industrial and Operations Engineering Universityof Michigan, Ann Arbor MI 48109 December

More information

No-arbitrage theorem for multi-factor uncertain stock model with floating interest rate

No-arbitrage theorem for multi-factor uncertain stock model with floating interest rate Fuzzy Optim Decis Making 217 16:221 234 DOI 117/s17-16-9246-8 No-arbitrage theorem for multi-factor uncertain stock model with floating interest rate Xiaoyu Ji 1 Hua Ke 2 Published online: 17 May 216 Springer

More information

Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints

Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints Economics 2010c: Lecture 4 Precautionary Savings and Liquidity Constraints David Laibson 9/11/2014 Outline: 1. Precautionary savings motives 2. Liquidity constraints 3. Application: Numerical solution

More information

Computational Aspects of Prediction Markets

Computational Aspects of Prediction Markets Computational Aspects of Prediction Markets David M. Pennock, Yahoo! Research Yiling Chen, Lance Fortnow, Joe Kilian, Evdokia Nikolova, Rahul Sami, Michael Wellman Mech Design for Prediction Q: Will there

More information

6.231 DYNAMIC PROGRAMMING LECTURE 5 LECTURE OUTLINE

6.231 DYNAMIC PROGRAMMING LECTURE 5 LECTURE OUTLINE 6.231 DYNAMIC PROGRAMMING LECTURE 5 LECTURE OUTLINE Stopping problems Scheduling problems Minimax Control 1 PURE STOPPING PROBLEMS Two possible controls: Stop (incur a one-time stopping cost, and move

More information

Scenario tree generation for stochastic programming models using GAMS/SCENRED

Scenario tree generation for stochastic programming models using GAMS/SCENRED Scenario tree generation for stochastic programming models using GAMS/SCENRED Holger Heitsch 1 and Steven Dirkse 2 1 Humboldt-University Berlin, Department of Mathematics, Germany 2 GAMS Development Corp.,

More information

CEC login. Student Details Name SOLUTIONS

CEC login. Student Details Name SOLUTIONS Student Details Name SOLUTIONS CEC login Instructions You have roughly 1 minute per point, so schedule your time accordingly. There is only one correct answer per question. Good luck! Question 1. Searching

More information

The assignment game: Decentralized dynamics, rate of convergence, and equitable core selection

The assignment game: Decentralized dynamics, rate of convergence, and equitable core selection 1 / 29 The assignment game: Decentralized dynamics, rate of convergence, and equitable core selection Bary S. R. Pradelski (with Heinrich H. Nax) ETH Zurich October 19, 2015 2 / 29 3 / 29 Two-sided, one-to-one

More information

The rth moment of a real-valued random variable X with density f(x) is. x r f(x) dx

The rth moment of a real-valued random variable X with density f(x) is. x r f(x) dx 1 Cumulants 1.1 Definition The rth moment of a real-valued random variable X with density f(x) is µ r = E(X r ) = x r f(x) dx for integer r = 0, 1,.... The value is assumed to be finite. Provided that

More information

Dynamic Appointment Scheduling in Healthcare

Dynamic Appointment Scheduling in Healthcare Brigham Young University BYU ScholarsArchive All Theses and Dissertations 2011-12-05 Dynamic Appointment Scheduling in Healthcare McKay N. Heasley Brigham Young University - Provo Follow this and additional

More information

Sublinear Time Algorithms Oct 19, Lecture 1

Sublinear Time Algorithms Oct 19, Lecture 1 0368.416701 Sublinear Time Algorithms Oct 19, 2009 Lecturer: Ronitt Rubinfeld Lecture 1 Scribe: Daniel Shahaf 1 Sublinear-time algorithms: motivation Twenty years ago, there was practically no investigation

More information

CS599: Algorithm Design in Strategic Settings Fall 2012 Lecture 4: Prior-Free Single-Parameter Mechanism Design. Instructor: Shaddin Dughmi

CS599: Algorithm Design in Strategic Settings Fall 2012 Lecture 4: Prior-Free Single-Parameter Mechanism Design. Instructor: Shaddin Dughmi CS599: Algorithm Design in Strategic Settings Fall 2012 Lecture 4: Prior-Free Single-Parameter Mechanism Design Instructor: Shaddin Dughmi Administrivia HW out, due Friday 10/5 Very hard (I think) Discuss

More information

6.231 DYNAMIC PROGRAMMING LECTURE 10 LECTURE OUTLINE

6.231 DYNAMIC PROGRAMMING LECTURE 10 LECTURE OUTLINE 6.231 DYNAMIC PROGRAMMING LECTURE 10 LECTURE OUTLINE Rollout algorithms Cost improvement property Discrete deterministic problems Approximations of rollout algorithms Discretization of continuous time

More information

Contents Critique 26. portfolio optimization 32

Contents Critique 26. portfolio optimization 32 Contents Preface vii 1 Financial problems and numerical methods 3 1.1 MATLAB environment 4 1.1.1 Why MATLAB? 5 1.2 Fixed-income securities: analysis and portfolio immunization 6 1.2.1 Basic valuation of

More information

Lecture Outline. Scheduling aperiodic jobs (cont d) Scheduling sporadic jobs

Lecture Outline. Scheduling aperiodic jobs (cont d) Scheduling sporadic jobs Priority Driven Scheduling of Aperiodic and Sporadic Tasks (2) Embedded Real-Time Software Lecture 8 Lecture Outline Scheduling aperiodic jobs (cont d) Sporadic servers Constant utilization servers Total

More information

Worst-case-expectation approach to optimization under uncertainty

Worst-case-expectation approach to optimization under uncertainty Worst-case-expectation approach to optimization under uncertainty Wajdi Tekaya Joint research with Alexander Shapiro, Murilo Pereira Soares and Joari Paulo da Costa : Cambridge Systems Associates; : Georgia

More information

Levin Reduction and Parsimonious Reductions

Levin Reduction and Parsimonious Reductions Levin Reduction and Parsimonious Reductions The reduction R in Cook s theorem (p. 266) is such that Each satisfying truth assignment for circuit R(x) corresponds to an accepting computation path for M(x).

More information

Making Decisions. CS 3793 Artificial Intelligence Making Decisions 1

Making Decisions. CS 3793 Artificial Intelligence Making Decisions 1 Making Decisions CS 3793 Artificial Intelligence Making Decisions 1 Planning under uncertainty should address: The world is nondeterministic. Actions are not certain to succeed. Many events are outside

More information

We formulate and solve two new stochastic linear programming formulations of appointment scheduling

We formulate and solve two new stochastic linear programming formulations of appointment scheduling Published online ahead of print December 7, 2011 INFORMS Journal on Computing Articles in Advance, pp. 1 17 issn 1091-9856 eissn 1526-5528 http://dx.doi.org/10.1287/ijoc.1110.0482 2011 INFORMS Dynamic

More information

Setting Optimal Due Dates in a Basic Safe Scheduling Model. Kenneth R. Baker. Tuck School of Business Dartmouth College Hanover, NH 03755

Setting Optimal Due Dates in a Basic Safe Scheduling Model. Kenneth R. Baker. Tuck School of Business Dartmouth College Hanover, NH 03755 Setting Optimal Due Dates in a Basic Safe Scheduling Model By Kenneth R. Baker Tuck School of Business Dartmouth College Hanover, NH 03755 ken.baker@dartmouth.edu July, 2013 Abstract We examine a basic

More information

Optimal Control of Batch Service Queues with Finite Service Capacity and General Holding Costs

Optimal Control of Batch Service Queues with Finite Service Capacity and General Holding Costs Queueing Colloquium, CWI, Amsterdam, February 24, 1999 Optimal Control of Batch Service Queues with Finite Service Capacity and General Holding Costs Samuli Aalto EURANDOM Eindhoven 24-2-99 cwi.ppt 1 Background

More information

Introduction to Decision Making. CS 486/686: Introduction to Artificial Intelligence

Introduction to Decision Making. CS 486/686: Introduction to Artificial Intelligence Introduction to Decision Making CS 486/686: Introduction to Artificial Intelligence 1 Outline Utility Theory Decision Trees 2 Decision Making Under Uncertainty I give a robot a planning problem: I want

More information

Financial Risk Management

Financial Risk Management Financial Risk Management Professor: Thierry Roncalli Evry University Assistant: Enareta Kurtbegu Evry University Tutorial exercices #4 1 Correlation and copulas 1. The bivariate Gaussian copula is given

More information

ON COMPETING NON-LIFE INSURERS

ON COMPETING NON-LIFE INSURERS ON COMPETING NON-LIFE INSURERS JOINT WORK WITH HANSJOERG ALBRECHER (LAUSANNE) AND CHRISTOPHE DUTANG (STRASBOURG) Stéphane Loisel ISFA, Université Lyon 1 2 octobre 2012 INTRODUCTION Lapse rates Price elasticity

More information

The value of multi-stage stochastic programming in capacity planning under uncertainty

The value of multi-stage stochastic programming in capacity planning under uncertainty The value of multi-stage stochastic programming in capacity planning under uncertainty Kai Huang and Shabbir Ahmed School of Industrial & Systems Engineering Georgia Institute of Technology April 26, 2005

More information

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Basic idea: Receive feedback in the form of rewards Agent s utility is defined by the

More information

6/7/2018. Overview PERT / CPM PERT/CPM. Project Scheduling PERT/CPM PERT/CPM

6/7/2018. Overview PERT / CPM PERT/CPM. Project Scheduling PERT/CPM PERT/CPM /7/018 PERT / CPM BSAD 0 Dave Novak Summer 018 Overview Introduce PERT/CPM Discuss what a critical path is Discuss critical path algorithm Example Source: Anderson et al., 01 Quantitative Methods for Business

More information

CS224W: Social and Information Network Analysis Jure Leskovec, Stanford University

CS224W: Social and Information Network Analysis Jure Leskovec, Stanford University CS224W: Social and Information Network Analysis Jure Leskovec, Stanford University http://cs224w.stanford.edu 10/27/16 Jure Leskovec, Stanford CS224W: Social and Information Network Analysis, http://cs224w.stanford.edu

More information

Multistage Stochastic Demand-side Management for Price-Making Major Consumers of Electricity in a Co-optimized Energy and Reserve Market

Multistage Stochastic Demand-side Management for Price-Making Major Consumers of Electricity in a Co-optimized Energy and Reserve Market Multistage Stochastic Demand-side Management for Price-Making Major Consumers of Electricity in a Co-optimized Energy and Reserve Market Mahbubeh Habibian Anthony Downward Golbon Zakeri Abstract In this

More information

Exam in TFY4275/FY8907 CLASSICAL TRANSPORT THEORY Feb 14, 2014

Exam in TFY4275/FY8907 CLASSICAL TRANSPORT THEORY Feb 14, 2014 NTNU Page 1 of 5 Institutt for fysikk Contact during the exam: Professor Ingve Simonsen Exam in TFY4275/FY8907 CLASSICAL TRANSPORT THEORY Feb 14, 2014 Allowed help: Alternativ D All written material This

More information

Multistage Stochastic Programming

Multistage Stochastic Programming IE 495 Lecture 21 Multistage Stochastic Programming Prof. Jeff Linderoth April 16, 2003 April 16, 2002 Stochastic Programming Lecture 21 Slide 1 Outline HW Fixes Multistage Stochastic Programming Modeling

More information