A new PDE-based approach for construction scheduling and resource allocation. Paul Gabet, Julien Nachef CE 291F Project Presentation Spring 2014

Size: px
Start display at page:

Download "A new PDE-based approach for construction scheduling and resource allocation. Paul Gabet, Julien Nachef CE 291F Project Presentation Spring 2014"

Transcription

1 A new PDE-based approach for construction scheduling and resource allocation Paul Gabet, Julien Nachef CE 291F Project Presentation Spring 2014

2 Problem Statement What is the schedule of a project? A chronological list of tasks (Task 1, Task 2, etc.) Constraints: Precedents and Following Tasks Nodes/Events Example of schedule CE 291F - Project Presentation 2

3 Cost of resources ($) Problem Statement Cost of a task i is a function of the desire duration C i = C i (d i ) Workers Time/Cost Tradeoff for an Activity Task completed quickly with massive resources involved Task completed slowly with minimum price Equipment Time (t) Payment depends on time of completion Cement mixer CE 291F - Project Presentation 3

4 Problem Statement Control: Resources allocated to all the future tasks Task duration d i = E i S i Time of events S i, E i and E node Time of project completion E end Objective: Subject to: C i = C i d i Maximize: P E end C i i for all tasks i d i = E i S i for all tasks i Precedence and Following tasks constraints CE 291F - Project Presentation 4

5 Industry State of the Art Widely-used of the Critical Path Method (CPM) Main limitations No systematic optimization of resource allocation Approximate iterative method Not designed for real-time adjustment When deviation occurs between actual and scheduled progress Addresses poorly criticality of tasks CE 291F - Project Presentation 5

6 Our PDE approach Local resource allocation (sub-optimality) C E 1 = C 1 E 1 S + C 2 E E 1 Minimum for C E 1 = 0 C 1 E 1 S = C 2 E E 1 Dynamic D1 E 1 t = γ [C 1 E 1 S C 2 E E 1 ] Tasks behave like springs of tension c i (d i ) 6

7 General Case Local resource allocation (sub-optimality) Dynamic D1: E node t Dynamic D2: 2 E node 2 t = γ ( = γ i i c i E node S i c i E node S i j j c j (E j E node ), for all nodes c j (E j E node ) + f E t damping term Behaves as a real spring network dynamic, for all nodes 7

8 Literature Review Optimization of schedules without changing task duration Use of Genetic algorithms (Tarek Hegazy, 1999) Use of Back propagation models (Elazouni et al., 1997) Optimization of schedules and resource allocation simultaneously Use of Lyapunov function and a global dynamic (Adeli, 2001) What we do is different: We are using a local dynamic to optimize an entire schedule CE 291F - Project Presentation 8

9 Contribution Use PDE approach for resource allocation in project scheduling Proof of convergence of the model toward optimal schedule Proof of local exponential stability of the model Implementation of the model on Matlab (Oriented Object) CE 291F - Project Presentation 9

10 Contribution Demonstration of good behavior on An elementary project (9 tasks) A real construction project (~250 tasks) Provide a new approach to task criticality Simulation in real-time Benefits of continuous scheduling optimization along with task progress assimilation CE 291F - Project Presentation 10

11 Accuracy and exponential convergence Dynamic D1: For all node E node t Assumption: Cost functions (c i ) i are strictly convex. = γ ( i c i E node S i j c j (E j E node ) Proposition: Dynamic D1 has a unique equilibrium which is the optimal schedule. Theorem: Dynamic D1 converges locally exponentially towards optimum. CE 291F - Project Presentation 11

12 Accuracy and exponential convergence Dynamic D1: For all node Scheme of proof: Linearization of D1 near optimum (E ) node : d E dt E node t = γ ( i c i E node S i j c j (E j E node ) Theorem: Dynamic D1 converges locally exponentially towards optimum. = A E where ( E) node = (E) node (E ) node and matrix A = + positive diagonal matrix A is Hurwitz if cost functions (c i ) i are strictly convex near equilibrium. CE 291F - Project Presentation 12

13 Elementary Project Task 1: Obtain Building permit Task 2: Install temporary networks Task 3: Idle task Task 4: Order cable trays, work space outlets Task 5: Order router, cabling, etc. Task 6: Install cable trays Task 7: Install work space outlets Task 8: Install, test new file servers Task 9: Test communication systems CE 291F - Project Presentation 13

14 Elementary Project Time (days) Profit (k$) Initial Schedule Optimized Schedule % improvement 31% 108% CE 291F - Project Presentation 14

15 Task Criticality Low time pressure High time pressure How to characterize the criticality of task 1? Spring analogy: tension c 1 (d 1 ) c 1 (d 1 ): cost to finish task 1 one day earlier or how difficult it is to catch up a one day delay CE 291F - Project Presentation 15

16 Criticality on an elementary example Evolution of the criticality of each task while optimizing the schedule CE 291F - Project Presentation 16

17 Criticality on real construction project Change of the desired time completion of the project CE 291F - Project Presentation 17

18 Assimilation of progress data P=0% P estimated P=100% Progress P t CE 291F - Project Presentation 18

19 Assimilation of progress data P=0% P estimated P=100% P data Progress P t CE 291F - Project Presentation 19

20 Assimilation of progress data P=0% P estimated P=100% P data Progress P t CE 291F - Project Presentation 20

21 Assimilation of progress data P=100% P estimated = P data Progress P t End of task is loose: Future tasks can take more time and less resources. The project can be advanced. Apply dynamic D1 Only if continuous optimization of resource allocation. CE 291F - Project Presentation 21

22 Real-time simulation of project SIMULATION OF REALITY (TASK PROGRESS) Time t Random progress ΔP on current tasks Time t + Δt Random progress ΔP on current tasks Sparse progress data Time Assimilate progress data Update effort on current task Iterate dynamic D1 Adjust allocated resources SCHEDULING CE 291F - Project Presentation 22

23 Real-time simulation of project On-going work: quantify the gain of continuously optimizing the schedule CE 291F - Project Presentation 23

24 A new PDE-based approach for construction scheduling and resource allocation Paul Gabet, Julien Nachef CE 291F Project Presentation Spring 2014 Thank you

CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM

CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM CHAPTER 6 CRASHING STOCHASTIC PERT NETWORKS WITH RESOURCE CONSTRAINED PROJECT SCHEDULING PROBLEM 6.1 Introduction Project Management is the process of planning, controlling and monitoring the activities

More information

Martingale Pricing Theory in Discrete-Time and Discrete-Space Models

Martingale Pricing Theory in Discrete-Time and Discrete-Space Models IEOR E4707: Foundations of Financial Engineering c 206 by Martin Haugh Martingale Pricing Theory in Discrete-Time and Discrete-Space Models These notes develop the theory of martingale pricing in a discrete-time,

More information

1. Introduction 2. Model Formulation 3. Solution Approach 4. Case Study and Findings 5. On-going Research

1. Introduction 2. Model Formulation 3. Solution Approach 4. Case Study and Findings 5. On-going Research 1. Introduction 2. Model Formulation 3. Solution Approach 4. Case Study and Findings 5. On-going Research Natural disasters have caused: Huge amount of economical loss Fatal injuries Through effective

More information

A simulation study of two combinatorial auctions

A simulation study of two combinatorial auctions A simulation study of two combinatorial auctions David Nordström Department of Economics Lund University Supervisor: Tommy Andersson Co-supervisor: Albin Erlanson May 24, 2012 Abstract Combinatorial auctions

More information

Log-Robust Portfolio Management

Log-Robust Portfolio Management Log-Robust Portfolio Management Dr. Aurélie Thiele Lehigh University Joint work with Elcin Cetinkaya and Ban Kawas Research partially supported by the National Science Foundation Grant CMMI-0757983 Dr.

More information

Project Theft Management,

Project Theft Management, Project Theft Management, by applying best practises of Project Risk Management Philip Rosslee, BEng. PrEng. MBA PMP PMO Projects South Africa PMO Projects Group www.pmo-projects.co.za philip.rosslee@pmo-projects.com

More information

Dynamic Macroeconomics

Dynamic Macroeconomics Chapter 1 Introduction Dynamic Macroeconomics Prof. George Alogoskoufis Fletcher School, Tufts University and Athens University of Economics and Business 1.1 The Nature and Evolution of Macroeconomics

More information

1.1 Some Apparently Simple Questions 0:2. q =p :

1.1 Some Apparently Simple Questions 0:2. q =p : Chapter 1 Introduction 1.1 Some Apparently Simple Questions Consider the constant elasticity demand function 0:2 q =p : This is a function because for each price p there is an unique quantity demanded

More information

Robust Dual Dynamic Programming

Robust Dual Dynamic Programming 1 / 18 Robust Dual Dynamic Programming Angelos Georghiou, Angelos Tsoukalas, Wolfram Wiesemann American University of Beirut Olayan School of Business 31 May 217 2 / 18 Inspired by SDDP Stochastic optimization

More information

Is Greedy Coordinate Descent a Terrible Algorithm?

Is Greedy Coordinate Descent a Terrible Algorithm? Is Greedy Coordinate Descent a Terrible Algorithm? Julie Nutini, Mark Schmidt, Issam Laradji, Michael Friedlander, Hoyt Koepke University of British Columbia Optimization and Big Data, 2015 Context: Random

More information

On the Optimality of Financial Repression

On the Optimality of Financial Repression On the Optimality of Financial Repression V.V. Chari, Alessandro Dovis and Patrick Kehoe Conference in honor of Robert E. Lucas Jr, October 2016 Financial Repression Regulation forcing financial institutions

More information

56:171 Operations Research Midterm Exam Solutions October 22, 1993

56:171 Operations Research Midterm Exam Solutions October 22, 1993 56:171 O.R. Midterm Exam Solutions page 1 56:171 Operations Research Midterm Exam Solutions October 22, 1993 (A.) /: Indicate by "+" ="true" or "o" ="false" : 1. A "dummy" activity in CPM has duration

More information

Efficiency and Herd Behavior in a Signalling Market. Jeffrey Gao

Efficiency and Herd Behavior in a Signalling Market. Jeffrey Gao Efficiency and Herd Behavior in a Signalling Market Jeffrey Gao ABSTRACT This paper extends a model of herd behavior developed by Bikhchandani and Sharma (000) to establish conditions for varying levels

More information

Supplementary Material to: Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya

Supplementary Material to: Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya Supplementary Material to: Peer Effects, Teacher Incentives, and the Impact of Tracking: Evidence from a Randomized Evaluation in Kenya by Esther Duflo, Pascaline Dupas, and Michael Kremer This document

More information

Comparison of Logit Models to Machine Learning Algorithms for Modeling Individual Daily Activity Patterns

Comparison of Logit Models to Machine Learning Algorithms for Modeling Individual Daily Activity Patterns Comparison of Logit Models to Machine Learning Algorithms for Modeling Individual Daily Activity Patterns Daniel Fay, Peter Vovsha, Gaurav Vyas (WSP USA) 1 Logit vs. Machine Learning Models Logit Models:

More information

Monte Carlo Methods in Structuring and Derivatives Pricing

Monte Carlo Methods in Structuring and Derivatives Pricing Monte Carlo Methods in Structuring and Derivatives Pricing Prof. Manuela Pedio (guest) 20263 Advanced Tools for Risk Management and Pricing Spring 2017 Outline and objectives The basic Monte Carlo algorithm

More information

Project Time-Cost Trade-Off

Project Time-Cost Trade-Off Project Time-Cost Trade-Off 7.1 Introduction In the previous chapters, duration of activities discussed as either fixed or random numbers with known characteristics. However, activity durations can often

More information

An Intelligent Approach for Option Pricing

An Intelligent Approach for Option Pricing IOSR Journal of Economics and Finance (IOSR-JEF) e-issn: 2321-5933, p-issn: 2321-5925. PP 92-96 www.iosrjournals.org An Intelligent Approach for Option Pricing Vijayalaxmi 1, C.S.Adiga 1, H.G.Joshi 2 1

More information

Extensive-Form Games with Imperfect Information

Extensive-Form Games with Imperfect Information May 6, 2015 Example 2, 2 A 3, 3 C Player 1 Player 1 Up B Player 2 D 0, 0 1 0, 0 Down C Player 1 D 3, 3 Extensive-Form Games With Imperfect Information Finite No simultaneous moves: each node belongs to

More information

What can we do with numerical optimization?

What can we do with numerical optimization? Optimization motivation and background Eddie Wadbro Introduction to PDE Constrained Optimization, 2016 February 15 16, 2016 Eddie Wadbro, Introduction to PDE Constrained Optimization, February 15 16, 2016

More information

An introduction on game theory for wireless networking [1]

An introduction on game theory for wireless networking [1] An introduction on game theory for wireless networking [1] Ning Zhang 14 May, 2012 [1] Game Theory in Wireless Networks: A Tutorial 1 Roadmap 1 Introduction 2 Static games 3 Extensive-form games 4 Summary

More information

Contents Critique 26. portfolio optimization 32

Contents Critique 26. portfolio optimization 32 Contents Preface vii 1 Financial problems and numerical methods 3 1.1 MATLAB environment 4 1.1.1 Why MATLAB? 5 1.2 Fixed-income securities: analysis and portfolio immunization 6 1.2.1 Basic valuation of

More information

Section 3.1: Discrete Event Simulation

Section 3.1: Discrete Event Simulation Section 3.1: Discrete Event Simulation Discrete-Event Simulation: A First Course c 2006 Pearson Ed., Inc. 0-13-142917-5 Discrete-Event Simulation: A First Course Section 3.1: Discrete Event Simulation

More information

Regret Minimization and Correlated Equilibria

Regret Minimization and Correlated Equilibria Algorithmic Game heory Summer 2017, Week 4 EH Zürich Overview Regret Minimization and Correlated Equilibria Paolo Penna We have seen different type of equilibria and also considered the corresponding price

More information

Scheduling arrivals to queues: a model with no-shows

Scheduling arrivals to queues: a model with no-shows TEL-AVIV UNIVERSITY RAYMOND AND BEVERLY SACKLER FACULTY OF EXACT SCIENCES SCHOOL OF MATHEMATICAL SCIENCES, DEPARTMENT OF STATISTICS AND OPERATIONS RESEARCH Scheduling arrivals to queues: a model with no-shows

More information

AIRCURRENTS: PORTFOLIO OPTIMIZATION FOR REINSURERS

AIRCURRENTS: PORTFOLIO OPTIMIZATION FOR REINSURERS MARCH 12 AIRCURRENTS: PORTFOLIO OPTIMIZATION FOR REINSURERS EDITOR S NOTE: A previous AIRCurrent explored portfolio optimization techniques for primary insurance companies. In this article, Dr. SiewMun

More information

Computational Finance Least Squares Monte Carlo

Computational Finance Least Squares Monte Carlo Computational Finance Least Squares Monte Carlo School of Mathematics 2019 Monte Carlo and Binomial Methods In the last two lectures we discussed the binomial tree method and convergence problems. One

More information

Optimization of variable proportion portfolio insurance strategy

Optimization of variable proportion portfolio insurance strategy Helsinki University of Technology Mat-2.177 Seminar on Case Studies in Operations Research Spring 2008 Optimization of variable proportion portfolio insurance strategy Sampo Bank Inc. Project plan 29.2.2008

More information

STOCHASTIC REPUTATION DYNAMICS UNDER DUOPOLY COMPETITION

STOCHASTIC REPUTATION DYNAMICS UNDER DUOPOLY COMPETITION STOCHASTIC REPUTATION DYNAMICS UNDER DUOPOLY COMPETITION BINGCHAO HUANGFU Abstract This paper studies a dynamic duopoly model of reputation-building in which reputations are treated as capital stocks that

More information

Online Shopping Intermediaries: The Strategic Design of Search Environments

Online Shopping Intermediaries: The Strategic Design of Search Environments Online Supplemental Appendix to Online Shopping Intermediaries: The Strategic Design of Search Environments Anthony Dukes University of Southern California Lin Liu University of Central Florida February

More information

Lecture Notes in Macroeconomics. Christian Groth

Lecture Notes in Macroeconomics. Christian Groth Lecture Notes in Macroeconomics Christian Groth July 28, 2016 ii Contents Preface xvii I THE FIELD AND BASIC CATEGORIES 1 1 Introduction 3 1.1 Macroeconomics............................ 3 1.1.1 The field............................

More information

The Edgeworth exchange formulation of bargaining models and market experiments

The Edgeworth exchange formulation of bargaining models and market experiments The Edgeworth exchange formulation of bargaining models and market experiments Steven D. Gjerstad and Jason M. Shachat Department of Economics McClelland Hall University of Arizona Tucson, AZ 857 T.J.

More information

Project Planning. Planning is an important step in project execution. Planning means:

Project Planning. Planning is an important step in project execution. Planning means: Project Planning Planning is an important step in project execution. Planning means: Thinking through future project actions Seeking and mentally inspecting the long path from the start to the finish Achieving

More information

Socially-Optimal Design of Crowdsourcing Platforms with Reputation Update Errors

Socially-Optimal Design of Crowdsourcing Platforms with Reputation Update Errors Socially-Optimal Design of Crowdsourcing Platforms with Reputation Update Errors 1 Yuanzhang Xiao, Yu Zhang, and Mihaela van der Schaar Abstract Crowdsourcing systems (e.g. Yahoo! Answers and Amazon Mechanical

More information

Revenue Management Under the Markov Chain Choice Model

Revenue Management Under the Markov Chain Choice Model Revenue Management Under the Markov Chain Choice Model Jacob B. Feldman School of Operations Research and Information Engineering, Cornell University, Ithaca, New York 14853, USA jbf232@cornell.edu Huseyin

More information

Strategies and Nash Equilibrium. A Whirlwind Tour of Game Theory

Strategies and Nash Equilibrium. A Whirlwind Tour of Game Theory Strategies and Nash Equilibrium A Whirlwind Tour of Game Theory (Mostly from Fudenberg & Tirole) Players choose actions, receive rewards based on their own actions and those of the other players. Example,

More information

A SINGLE STEP CPM TIME-COST TRADEOFF ALGORITHM. In Mathematics and Computing. Under the guidance of Dr. Mahesh Kumar Sharma

A SINGLE STEP CPM TIME-COST TRADEOFF ALGORITHM. In Mathematics and Computing. Under the guidance of Dr. Mahesh Kumar Sharma A SINGLE STEP CPM TIME-COST TRADEOFF ALGORITHM Thesis submitted in partial fulfillment of the requirement for The award of the degree of Master of Science In Mathematics and Computing Submitted by Gurpreet

More information

CDA6530: Performance Models of Computers and Networks. Chapter 9: Discrete Event Simulation Example --- Three callers problem

CDA6530: Performance Models of Computers and Networks. Chapter 9: Discrete Event Simulation Example --- Three callers problem CDA6530: Performance Models of Computers and Networks Chapter 9: Discrete Event Simulation Example --- Three callers problem Problem Description Two lines services three callers. Each caller makes calls

More information

Yao s Minimax Principle

Yao s Minimax Principle Complexity of algorithms The complexity of an algorithm is usually measured with respect to the size of the input, where size may for example refer to the length of a binary word describing the input,

More information

Department of Mathematics. Mathematics of Financial Derivatives

Department of Mathematics. Mathematics of Financial Derivatives Department of Mathematics MA408 Mathematics of Financial Derivatives Thursday 15th January, 2009 2pm 4pm Duration: 2 hours Attempt THREE questions MA408 Page 1 of 5 1. (a) Suppose 0 < E 1 < E 3 and E 2

More information

SYSM 6304: Risk and Decision Analysis Lecture 6: Pricing and Hedging Financial Derivatives

SYSM 6304: Risk and Decision Analysis Lecture 6: Pricing and Hedging Financial Derivatives SYSM 6304: Risk and Decision Analysis Lecture 6: Pricing and Hedging Financial Derivatives M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu October

More information

A brief introduction to evolutionary game theory

A brief introduction to evolutionary game theory A brief introduction to evolutionary game theory Thomas Brihaye UMONS 27 October 2015 Outline 1 An example, three points of view 2 A brief review of strategic games Nash equilibrium et al Symmetric two-player

More information

June 11, Dynamic Programming( Weighted Interval Scheduling)

June 11, Dynamic Programming( Weighted Interval Scheduling) Dynamic Programming( Weighted Interval Scheduling) June 11, 2014 Problem Statement: 1 We have a resource and many people request to use the resource for periods of time (an interval of time) 2 Each interval

More information

Research Methods Outline

Research Methods Outline : Project Management James Gain jgain@cs.uct.ac.za Outline Introduction [] Project Management [] Experimental Computer Science [] Role of Mathematics [1] Designing User Experiments [] Qualitative Research

More information

Microeconomic Theory II Preliminary Examination Solutions

Microeconomic Theory II Preliminary Examination Solutions Microeconomic Theory II Preliminary Examination Solutions 1. (45 points) Consider the following normal form game played by Bruce and Sheila: L Sheila R T 1, 0 3, 3 Bruce M 1, x 0, 0 B 0, 0 4, 1 (a) Suppose

More information

Optimal routing and placement of orders in limit order markets

Optimal routing and placement of orders in limit order markets Optimal routing and placement of orders in limit order markets Rama CONT Arseniy KUKANOV Imperial College London Columbia University New York CFEM-GARP Joint Event and Seminar 05/01/13, New York Choices,

More information

Supplementary Material for Combinatorial Partial Monitoring Game with Linear Feedback and Its Application. A. Full proof for Theorems 4.1 and 4.

Supplementary Material for Combinatorial Partial Monitoring Game with Linear Feedback and Its Application. A. Full proof for Theorems 4.1 and 4. Supplementary Material for Combinatorial Partial Monitoring Game with Linear Feedback and Its Application. A. Full proof for Theorems 4.1 and 4. If the reader will recall, we have the following problem-specific

More information

Time and Cost Optimization Techniques in Construction Project Management

Time and Cost Optimization Techniques in Construction Project Management Time and Cost Optimization Techniques in Construction Project Management Mr.Bhushan V 1. Tatar and Prof.Rahul S.Patil 2 1. INTRODUCTION In the field of Construction the term project refers as a temporary

More information

A Linear Programming Approach for Optimum Project Scheduling Taking Into Account Overhead Expenses and Tardiness Penalty Function

A Linear Programming Approach for Optimum Project Scheduling Taking Into Account Overhead Expenses and Tardiness Penalty Function A Linear Programming Approach for Optimum Project Scheduling Taking Into Account Overhead Expenses and Tardiness Penalty Function Mohammed Woyeso Geda, Industrial Engineering Department Ethiopian Institute

More information

Analyses of an Internet Auction Market Focusing on the Fixed-Price Selling at a Buyout Price

Analyses of an Internet Auction Market Focusing on the Fixed-Price Selling at a Buyout Price Master Thesis Analyses of an Internet Auction Market Focusing on the Fixed-Price Selling at a Buyout Price Supervisor Associate Professor Shigeo Matsubara Department of Social Informatics Graduate School

More information

Budget Constrained Choice with Two Commodities

Budget Constrained Choice with Two Commodities Budget Constrained Choice with Two Commodities Joseph Tao-yi Wang 2009/10/2 (Lecture 4, Micro Theory I) 1 The Consumer Problem We have some powerful tools: Constrained Maximization (Shadow Prices) Envelope

More information

CS 188: Artificial Intelligence Spring Announcements

CS 188: Artificial Intelligence Spring Announcements CS 188: Artificial Intelligence Spring 2011 Lecture 9: MDPs 2/16/2011 Pieter Abbeel UC Berkeley Many slides over the course adapted from either Dan Klein, Stuart Russell or Andrew Moore 1 Announcements

More information

Aquaculture Technology and the Sustainability of Fisheries

Aquaculture Technology and the Sustainability of Fisheries the Sustainability Esther Regnier & Katheline Paris School of Economics and University Paris 1 Panthon-Sorbonne IIFET 2012 50% of world marine fish stocks are fully exploited, 32% are overexploited (FAO

More information

Reinforcement Learning

Reinforcement Learning Reinforcement Learning MDP March May, 2013 MDP MDP: S, A, P, R, γ, µ State can be partially observable: Partially Observable MDPs () Actions can be temporally extended: Semi MDPs (SMDPs) and Hierarchical

More information

Systems Engineering. Engineering 101 By Virgilio Gonzalez

Systems Engineering. Engineering 101 By Virgilio Gonzalez Systems Engineering Engineering 101 By Virgilio Gonzalez Systems process What is a System? What is your definition? A system is a construct or collection of different elements that together produce results

More information

CSE 473: Artificial Intelligence

CSE 473: Artificial Intelligence CSE 473: Artificial Intelligence Markov Decision Processes (MDPs) Luke Zettlemoyer Many slides over the course adapted from Dan Klein, Stuart Russell or Andrew Moore 1 Announcements PS2 online now Due

More information

CS 188: Artificial Intelligence Fall 2011

CS 188: Artificial Intelligence Fall 2011 CS 188: Artificial Intelligence Fall 2011 Lecture 9: MDPs 9/22/2011 Dan Klein UC Berkeley Many slides over the course adapted from either Stuart Russell or Andrew Moore 2 Grid World The agent lives in

More information

Political Lobbying in a Recurring Environment

Political Lobbying in a Recurring Environment Political Lobbying in a Recurring Environment Avihai Lifschitz Tel Aviv University This Draft: October 2015 Abstract This paper develops a dynamic model of the labor market, in which the employed workers,

More information

Lecture 10: The knapsack problem

Lecture 10: The knapsack problem Optimization Methods in Finance (EPFL, Fall 2010) Lecture 10: The knapsack problem 24.11.2010 Lecturer: Prof. Friedrich Eisenbrand Scribe: Anu Harjula The knapsack problem The Knapsack problem is a problem

More information

Artificially Intelligent Forecasting of Stock Market Indexes

Artificially Intelligent Forecasting of Stock Market Indexes Artificially Intelligent Forecasting of Stock Market Indexes Loyola Marymount University Math 560 Final Paper 05-01 - 2018 Daniel McGrath Advisor: Dr. Benjamin Fitzpatrick Contents I. Introduction II.

More information

Introducing nominal rigidities.

Introducing nominal rigidities. Introducing nominal rigidities. Olivier Blanchard May 22 14.452. Spring 22. Topic 7. 14.452. Spring, 22 2 In the model we just saw, the price level (the price of goods in terms of money) behaved like an

More information

6/7/2018. Overview PERT / CPM PERT/CPM. Project Scheduling PERT/CPM PERT/CPM

6/7/2018. Overview PERT / CPM PERT/CPM. Project Scheduling PERT/CPM PERT/CPM /7/018 PERT / CPM BSAD 0 Dave Novak Summer 018 Overview Introduce PERT/CPM Discuss what a critical path is Discuss critical path algorithm Example Source: Anderson et al., 01 Quantitative Methods for Business

More information

Online Appendix for Debt Contracts with Partial Commitment by Natalia Kovrijnykh

Online Appendix for Debt Contracts with Partial Commitment by Natalia Kovrijnykh Online Appendix for Debt Contracts with Partial Commitment by Natalia Kovrijnykh Omitted Proofs LEMMA 5: Function ˆV is concave with slope between 1 and 0. PROOF: The fact that ˆV (w) is decreasing in

More information

COMP331/557. Chapter 6: Optimisation in Finance: Cash-Flow. (Cornuejols & Tütüncü, Chapter 3)

COMP331/557. Chapter 6: Optimisation in Finance: Cash-Flow. (Cornuejols & Tütüncü, Chapter 3) COMP331/557 Chapter 6: Optimisation in Finance: Cash-Flow (Cornuejols & Tütüncü, Chapter 3) 159 Cash-Flow Management Problem A company has the following net cash flow requirements (in 1000 s of ): Month

More information

Multi-period Portfolio Choice and Bayesian Dynamic Models

Multi-period Portfolio Choice and Bayesian Dynamic Models Multi-period Portfolio Choice and Bayesian Dynamic Models Petter Kolm and Gordon Ritter Courant Institute, NYU Paper appeared in Risk Magazine, Feb. 25 (2015) issue Working paper version: papers.ssrn.com/sol3/papers.cfm?abstract_id=2472768

More information

Non-Deterministic Search

Non-Deterministic Search Non-Deterministic Search MDP s 1 Non-Deterministic Search How do you plan (search) when your actions might fail? In general case, how do you plan, when the actions have multiple possible outcomes? 2 Example:

More information

Ramsey s Growth Model (Solution Ex. 2.1 (f) and (g))

Ramsey s Growth Model (Solution Ex. 2.1 (f) and (g)) Problem Set 2: Ramsey s Growth Model (Solution Ex. 2.1 (f) and (g)) Exercise 2.1: An infinite horizon problem with perfect foresight In this exercise we will study at a discrete-time version of Ramsey

More information

56:171 Operations Research Midterm Exam Solutions October 19, 1994

56:171 Operations Research Midterm Exam Solutions October 19, 1994 56:171 Operations Research Midterm Exam Solutions October 19, 1994 Possible Score A. True/False & Multiple Choice 30 B. Sensitivity analysis (LINDO) 20 C.1. Transportation 15 C.2. Decision Tree 15 C.3.

More information

Pareto Efficient Allocations with Collateral in Double Auctions (Working Paper)

Pareto Efficient Allocations with Collateral in Double Auctions (Working Paper) Pareto Efficient Allocations with Collateral in Double Auctions (Working Paper) Hans-Joachim Vollbrecht November 12, 2015 The general conditions are studied on which Continuous Double Auctions (CDA) for

More information

Lecture 5 Leadership and Reputation

Lecture 5 Leadership and Reputation Lecture 5 Leadership and Reputation Reputations arise in situations where there is an element of repetition, and also where coordination between players is possible. One definition of leadership is that

More information

EE/AA 578 Univ. of Washington, Fall Homework 8

EE/AA 578 Univ. of Washington, Fall Homework 8 EE/AA 578 Univ. of Washington, Fall 2016 Homework 8 1. Multi-label SVM. The basic Support Vector Machine (SVM) described in the lecture (and textbook) is used for classification of data with two labels.

More information

Lecture 17: More on Markov Decision Processes. Reinforcement learning

Lecture 17: More on Markov Decision Processes. Reinforcement learning Lecture 17: More on Markov Decision Processes. Reinforcement learning Learning a model: maximum likelihood Learning a value function directly Monte Carlo Temporal-difference (TD) learning COMP-424, Lecture

More information

Behavioral Finance and Asset Pricing

Behavioral Finance and Asset Pricing Behavioral Finance and Asset Pricing Behavioral Finance and Asset Pricing /49 Introduction We present models of asset pricing where investors preferences are subject to psychological biases or where investors

More information

Course Handouts - Introduction ECON 8704 FINANCIAL ECONOMICS. Jan Werner. University of Minnesota

Course Handouts - Introduction ECON 8704 FINANCIAL ECONOMICS. Jan Werner. University of Minnesota Course Handouts - Introduction ECON 8704 FINANCIAL ECONOMICS Jan Werner University of Minnesota SPRING 2019 1 I.1 Equilibrium Prices in Security Markets Assume throughout this section that utility functions

More information

Reinforcement Learning Analysis, Grid World Applications

Reinforcement Learning Analysis, Grid World Applications Reinforcement Learning Analysis, Grid World Applications Kunal Sharma GTID: ksharma74, CS 4641 Machine Learning Abstract This paper explores two Markov decision process problems with varying state sizes.

More information

Mechanisms for Matching Markets with Budgets

Mechanisms for Matching Markets with Budgets Mechanisms for Matching Markets with Budgets Paul Dütting Stanford LSE Joint work with Monika Henzinger and Ingmar Weber Seminar on Discrete Mathematics and Game Theory London School of Economics July

More information

A Course in Environmental Economics: Theory, Policy, and Practice. Daniel J. Phaneuf and Till Requate

A Course in Environmental Economics: Theory, Policy, and Practice. Daniel J. Phaneuf and Till Requate 1 A Course in Environmental Economics: Theory, Policy, and Practice PART I: ECONOMICS AND THE ENVIRONMENT Daniel J. Phaneuf and Till Requate 1. Introduction to the Theory of Externalities 1.1 Market failure

More information

EC316a: Advanced Scientific Computation, Fall Discrete time, continuous state dynamic models: solution methods

EC316a: Advanced Scientific Computation, Fall Discrete time, continuous state dynamic models: solution methods EC316a: Advanced Scientific Computation, Fall 2003 Notes Section 4 Discrete time, continuous state dynamic models: solution methods We consider now solution methods for discrete time models in which decisions

More information

Algorithms and Networking for Computer Games

Algorithms and Networking for Computer Games Algorithms and Networking for Computer Games Chapter 4: Game Trees http://www.wiley.com/go/smed Game types perfect information games no hidden information two-player, perfect information games Noughts

More information

Lecture 8: Asset pricing

Lecture 8: Asset pricing BURNABY SIMON FRASER UNIVERSITY BRITISH COLUMBIA Paul Klein Office: WMC 3635 Phone: (778) 782-9391 Email: paul klein 2@sfu.ca URL: http://paulklein.ca/newsite/teaching/483.php Economics 483 Advanced Topics

More information

6.825 Homework 3: Solutions

6.825 Homework 3: Solutions 6.825 Homework 3: Solutions 1 Easy EM You are given the network structure shown in Figure 1 and the data in the following table, with actual observed values for A, B, and C, and expected counts for D.

More information

Distributed Computing in Finance: Case Model Calibration

Distributed Computing in Finance: Case Model Calibration Distributed Computing in Finance: Case Model Calibration Global Derivatives Trading & Risk Management 19 May 2010 Techila Technologies, Tampere University of Technology juho.kanniainen@techila.fi juho.kanniainen@tut.fi

More information

COST MANAGEMENT IN CONSTRUCTION PROJECTS WITH THE APPROACH OF COST-TIME BALANCING

COST MANAGEMENT IN CONSTRUCTION PROJECTS WITH THE APPROACH OF COST-TIME BALANCING ISSN: 0976-3104 Lou et al. ARTICLE OPEN ACCESS COST MANAGEMENT IN CONSTRUCTION PROJECTS WITH THE APPROACH OF COST-TIME BALANCING Ashkan Khoda Bandeh Lou *, Alireza Parvishi, Ebrahim Javidi Faculty Of Engineering,

More information

CS 188: Artificial Intelligence. Outline

CS 188: Artificial Intelligence. Outline C 188: Artificial Intelligence Markov Decision Processes (MDPs) Pieter Abbeel UC Berkeley ome slides adapted from Dan Klein 1 Outline Markov Decision Processes (MDPs) Formalism Value iteration In essence

More information

Game theory for. Leonardo Badia.

Game theory for. Leonardo Badia. Game theory for information engineering Leonardo Badia leonardo.badia@gmail.com Zero-sum games A special class of games, easier to solve Zero-sum We speak of zero-sum game if u i (s) = -u -i (s). player

More information

G5212: Game Theory. Mark Dean. Spring 2017

G5212: Game Theory. Mark Dean. Spring 2017 G5212: Game Theory Mark Dean Spring 2017 Modelling Dynamics Up until now, our games have lacked any sort of dynamic aspect We have assumed that all players make decisions at the same time Or at least no

More information

Advanced Microeconomics

Advanced Microeconomics Advanced Microeconomics ECON5200 - Fall 2014 Introduction What you have done: - consumers maximize their utility subject to budget constraints and firms maximize their profits given technology and market

More information

Risk Measuring of Chosen Stocks of the Prague Stock Exchange

Risk Measuring of Chosen Stocks of the Prague Stock Exchange Risk Measuring of Chosen Stocks of the Prague Stock Exchange Ing. Mgr. Radim Gottwald, Department of Finance, Faculty of Business and Economics, Mendelu University in Brno, radim.gottwald@mendelu.cz Abstract

More information

A Note on the Extinction of Renewable Resources

A Note on the Extinction of Renewable Resources JOURNAL OF ENVIRONMENTAL ECONOMICS AND MANAGEMENT &64-70 (1988) A Note on the Extinction of Renewable Resources M. L. CROPPER Department of Economics and Bureau of Business and Economic Research, University

More information

Macroeconomics and finance

Macroeconomics and finance Macroeconomics and finance 1 1. Temporary equilibrium and the price level [Lectures 11 and 12] 2. Overlapping generations and learning [Lectures 13 and 14] 2.1 The overlapping generations model 2.2 Expectations

More information

Multi-Period Stochastic Programming Models for Dynamic Asset Allocation

Multi-Period Stochastic Programming Models for Dynamic Asset Allocation Multi-Period Stochastic Programming Models for Dynamic Asset Allocation Norio Hibiki Abstract This paper discusses optimal dynamic investment policies for investors, who make the investment decisions in

More information

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Basic idea: Receive feedback in the form of rewards Agent s utility is defined by the

More information

LIFECYCLE INVESTING : DOES IT MAKE SENSE

LIFECYCLE INVESTING : DOES IT MAKE SENSE Page 1 LIFECYCLE INVESTING : DOES IT MAKE SENSE TO REDUCE RISK AS RETIREMENT APPROACHES? John Livanas UNSW, School of Actuarial Sciences Lifecycle Investing, or the gradual reduction in the investment

More information

Game Theory: Normal Form Games

Game Theory: Normal Form Games Game Theory: Normal Form Games Michael Levet June 23, 2016 1 Introduction Game Theory is a mathematical field that studies how rational agents make decisions in both competitive and cooperative situations.

More information

DRAFT. 1 exercise in state (S, t), π(s, t) = 0 do not exercise in state (S, t) Review of the Risk Neutral Stock Dynamics

DRAFT. 1 exercise in state (S, t), π(s, t) = 0 do not exercise in state (S, t) Review of the Risk Neutral Stock Dynamics Chapter 12 American Put Option Recall that the American option has strike K and maturity T and gives the holder the right to exercise at any time in [0, T ]. The American option is not straightforward

More information

Likelihood-based Optimization of Threat Operation Timeline Estimation

Likelihood-based Optimization of Threat Operation Timeline Estimation 12th International Conference on Information Fusion Seattle, WA, USA, July 6-9, 2009 Likelihood-based Optimization of Threat Operation Timeline Estimation Gregory A. Godfrey Advanced Mathematics Applications

More information

INTELLECTUAL SUPPORT OF INVESTMENT DECISIONS BASED ON A CLUSTERING OF THE CORRELATION GRAPH OF SECURITIES

INTELLECTUAL SUPPORT OF INVESTMENT DECISIONS BASED ON A CLUSTERING OF THE CORRELATION GRAPH OF SECURITIES INTELLECTUAL SUPPORT OF INVESTMENT DECISIONS BASED ON A CLUSTERING OF THE CORRELATION GRAPH OF SECURITIES Izabella V. Lokshina Division of Economics and Business State University of New York Ravine Parkway

More information

King s College London

King s College London King s College London University Of London This paper is part of an examination of the College counting towards the award of a degree. Examinations are governed by the College Regulations under the authority

More information

Reinforcement Learning

Reinforcement Learning Reinforcement Learning Basic idea: Receive feedback in the form of rewards Agent s utility is defined by the reward function Must (learn to) act so as to maximize expected rewards Grid World The agent

More information

Finite Memory and Imperfect Monitoring

Finite Memory and Imperfect Monitoring Federal Reserve Bank of Minneapolis Research Department Finite Memory and Imperfect Monitoring Harold L. Cole and Narayana Kocherlakota Working Paper 604 September 2000 Cole: U.C.L.A. and Federal Reserve

More information