Basic stochastic simulation models

Size: px
Start display at page:

Download "Basic stochastic simulation models"

Transcription

1 Basic stochastic simulation models Clinic on the Meaningful Modeling of Epidemiological Data, 217 African Institute for Mathematical Sciences Muizenberg, South Africa Rebecca Borchering, PhD, MS Postdoctoral Fellow Biology Department & Emerging Pathogens Institute University of Florida Slide Set Citation: DOI: 1.684/m9.figshare The ICI3D Figshare Collection 1

2 Goals Understand motivation for using stochastic models Understand two common approaches to stochastic simulation: discrete time vs. event-driven Be able to relate these models to the differential equation models we have studied Recognize potential benefits and limitations of these stochastic models 2

3 STOCHASTIC DETERMINISTIC Model taxonomy CONTINUOUS TREATMENT OF INDIVIDUALS DISCRETE TREATMENT OF INDIVIDUALS (averages, proportions, or population densities) CONTINUOUS TIME Ordinary differential equations Partial differential equations DISCRETE TIME Difference equations (eg, Reed-Frost type models) CONTINUOUS TIME Stochastic differential equations DISCRETE TIME Stochastic difference equations CONTINUOUS TIME Gillespie algorithm DISCRETE TIME Chain binomial type models (eg, Stochastic Reed-Frost models) 3

4 Animal Rabies Cases in Tanzania Serengeti and Ngorongoro Districts Data Credit: Hampson et al. 29 4

5 Why stochastic? Small populations, extinction Noisy data imperfect observation small samples Environmental stochasticity long term variation in external drivers changes in rates, including birth and death rates Demographic stochasticity comes out of having discrete individuals 5

6 Population size - Continuous Time Markov Chain (CTMC) - finite population size - stochastic Ordinary Differential Equation (ODE) - large (infinite) population size - deterministic 6

7 Reed-Frost (Chain Binomial) Fixed infectious period duration Generations of infectious individuals don t overlap Define probability of infection infectious individuals (cases) at time t susceptible individuals at time t 7

8 The Reed-Frost model Susceptible Infectious Recovered 8

9 The Reed-Frost model For each susceptible individual, at time t: prob. not getting infected by any infectious individual prob. not getting infected by a particular infectious individual prob. of getting infected by any infectious individual Let So the probability of getting infected by any infectious individual is 1

10 The Reed-Frost model The probability of getting infected by any infectious individual is The expected number of cases in the next time unit is Susceptible individuals in the next time unit Recovered individuals in the next time unit 11

11 The Reed-Frost model 12

12 The Reed-Frost model The full set of equations describing the deterministic population update is: If is the total population size, the basic reproductive number for this model is 13

13 Building stochastic R-F model For each susceptible individual, at time t: prob. not getting infected by any infectious individual prob. not getting infected by a particular infectious individual prob. of getting infected by any infectious individual Let So the probability of getting infected by any infectious individual is 14

14 Building stochastic R-F model For each susceptible individual, at time t: prob. of not getting infected by any infectious individual prob. not getting infected by a particular infectious individual 15

15 The stochastic R-F model Putting it all together: number of ways to choose x individuals prob. of x individuals getting infected by any infectious individual prob. of individuals not getting infected by any infectious individual 16

16 The Reed-Frost model Stochastic: Deterministic: 17

17 Chain binomial models Chain binomial models can also be formulated based on the same parameters we used in the ODE models and with overlapping generations Instantaneous hazard of infection for an individual susceptible individual is For a susceptible at time t, the probability of infection by time is Similarly, for an infectious individual at time t, the probability of recovery by time is 18

18 Chain binomial models The stochastic population update can then be described as new infectious individuals new recovered individuals random variables 19

19 Chain binomial models For this model, if D is the average duration of infection, the basic reproductive number is: Non-generation-based chain binomial models can be adapted to include many variations on the natural history of infection. Discrete-time simulation of chain binomials is far more computationally efficient than event-driven simulation in continuous time. 2

20 Chain binomial simulation while (I > and time < MAXTIME) Calculate transition probabilities Determine number of transitions for Update state variables Update time end each type 21

21 Another way to simulate stochastic epidemics event-driven simulation 22

22 Stochastic SIR dynamics Small population Susceptible Infectious Recovered 23

23 Stochastic SIR dynamics Small population Susceptible Infectious Recovered 24

24 Stochastic SIR dynamics Small population Susceptible Infectious Recovered 25

25 Stochastic SIR dynamics Small population Susceptible Infectious Recovered 26

26 Stochastic SIR dynamics Small population Susceptible Infectious Recovered 27

27 Probability density Exponential waiting times time between events waiting time distribution: distribution of times until an event occurs rate Days since infection 28

28 Summary: Gillespie algorithm Assumptions: finite, countable populations well-mixed contacts exponential waiting times (memory-less) 29

29 Summary: Gillespie algorithm Assumptions: finite, countable populations well-mixed contacts exponential waiting times (memory-less) Notes: noise (stochasticity) is introduced by the discrete nature of individuals event-driven simulation computationally slow especially for large populations 3

30 Need to know What happened? When did it happen? Susceptible to Infectious Infectious to Recovered Two event types: Transmission Recovery 31

31 Need to know What happened? ODE analogue: When did it happen? Two event types: Transmission Recovery 32

32 Need to know What happened? EventType When did it happen? EventTime Two event types: Transmission Recovery 33

33 The Gillespie algorithm Two event types: Transmission Recovery Time to the next event: Probability the event is type i: 34

34 Simulating the Gillespie model while (I > and time < MAXTIME) Calculate rates Determine time to next event Determine event type Update state variables Update time end 35

35 Break 36

36 Rabies example? Maintenance population Target population 37

37 Types of transmission Spillover infections Maintenance population Target population Within-population Target population 38

38 R code example SIR model with spillover Associated file is linked from the schedule 39

39 R code example SIR model with spillover Associated file is linked from the schedule Try changing: population size spillover rate transmission rate recovery rate 4

40 Sample output 41

41 Sub-critical or super-critical? Basic reproduction number for SIR model: Sub-critical Super-critical 42

42 Jackal rabies application (rabies is sub-critical) Question: how many additional infections are needed in order for rabies to be super-critical in the jackal population? Rhodes et al. (1998) "Rabies in Zimbabwe: reservoir dogs and the implications for disease control." Philosophical Transactions of the Royal Society B. 43

43 Summary There are many sources of stochasticity including small population size, imperfect observation of cases, and environmental variability The Reed-Frost model is a discrete time model, where the time step is based on the infectious period Chain binomial models can be thought of as a generalization of the stochastic Reed-Frost model with an arbitrary time step and infectious period duration Event-driven simulations where each event is modeled separately are intuitive, but can be computationally slow especially for large populations 44

44 This presentation is made available through a Creative Commons Attribution license. Details of the license and permitted uses are available at International Clinics on Infectious Disease Dynamics and Data Borchering R, Pulliam JRCP. Basic Stochastic Simulation Models Clinic on the Meaningful Modeling of Epidemiological Data. DOI: 1.684/m9.figshare For further information or modifiable slides please contact figshare@ici3d.org. See the entire ICI3D Figshare Collection. DOI: 1.684/m9.figshare.c

Stochastic simulation of epidemics

Stochastic simulation of epidemics Stochastic simulation of epidemics Level 2 module in Modelling course in population and evolutionary biology (701-1418-00) Module author: Roland Regoes Course director: Sebastian Bonhoeffer Theoretical

More information

Electronic appendices are refereed with the text. However, no attempt is made to impose a uniform editorial style on the electronic appendices.

Electronic appendices are refereed with the text. However, no attempt is made to impose a uniform editorial style on the electronic appendices. This is an electronic appendix to the paper by Gumel et al. 2004 Modeling strategies for controlling SARS outbreaks based on Toronto, Hong Kong, Singapore and Beijing experience. Proc. R. Soc. Lond. B

More information

Basic Framework. About this class. Rewards Over Time. [This lecture adapted from Sutton & Barto and Russell & Norvig]

Basic Framework. About this class. Rewards Over Time. [This lecture adapted from Sutton & Barto and Russell & Norvig] Basic Framework [This lecture adapted from Sutton & Barto and Russell & Norvig] About this class Markov Decision Processes The Bellman Equation Dynamic Programming for finding value functions and optimal

More information

An Improved Saddlepoint Approximation Based on the Negative Binomial Distribution for the General Birth Process

An Improved Saddlepoint Approximation Based on the Negative Binomial Distribution for the General Birth Process Computational Statistics 17 (March 2002), 17 28. An Improved Saddlepoint Approximation Based on the Negative Binomial Distribution for the General Birth Process Gordon K. Smyth and Heather M. Podlich Department

More information

Monitoring Accrual and Events in a Time-to-Event Endpoint Trial. BASS November 2, 2015 Jeff Palmer

Monitoring Accrual and Events in a Time-to-Event Endpoint Trial. BASS November 2, 2015 Jeff Palmer Monitoring Accrual and Events in a Time-to-Event Endpoint Trial BASS November 2, 2015 Jeff Palmer Introduction A number of things can go wrong in a survival study, especially if you have a fixed end of

More information

2.1 Random variable, density function, enumerative density function and distribution function

2.1 Random variable, density function, enumerative density function and distribution function Risk Theory I Prof. Dr. Christian Hipp Chair for Science of Insurance, University of Karlsruhe (TH Karlsruhe) Contents 1 Introduction 1.1 Overview on the insurance industry 1.1.1 Insurance in Benin 1.1.2

More information

MODELS FOR QUANTIFYING RISK

MODELS FOR QUANTIFYING RISK MODELS FOR QUANTIFYING RISK THIRD EDITION ROBIN J. CUNNINGHAM, FSA, PH.D. THOMAS N. HERZOG, ASA, PH.D. RICHARD L. LONDON, FSA B 360811 ACTEX PUBLICATIONS, INC. WINSTED, CONNECTICUT PREFACE iii THIRD EDITION

More information

Chain binomial epidemic models

Chain binomial epidemic models Chain binomial epidemic models We will examine the application of the binomial distribution to epidemic modeling developed by Lowell J. Reed and Wade Hampton Frost in the middle of the last century. As

More information

Stochastic Approximation Algorithms and Applications

Stochastic Approximation Algorithms and Applications Harold J. Kushner G. George Yin Stochastic Approximation Algorithms and Applications With 24 Figures Springer Contents Preface and Introduction xiii 1 Introduction: Applications and Issues 1 1.0 Outline

More information

BEHAVIOUR OF PASSAGE TIME FOR A QUEUEING NETWORK MODEL WITH FEEDBACK: A SIMULATION STUDY

BEHAVIOUR OF PASSAGE TIME FOR A QUEUEING NETWORK MODEL WITH FEEDBACK: A SIMULATION STUDY IJMMS 24:24, 1267 1278 PII. S1611712426287 http://ijmms.hindawi.com Hindawi Publishing Corp. BEHAVIOUR OF PASSAGE TIME FOR A QUEUEING NETWORK MODEL WITH FEEDBACK: A SIMULATION STUDY BIDYUT K. MEDYA Received

More information

Intelligent Systems (AI-2)

Intelligent Systems (AI-2) Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 9 Sep, 28, 2016 Slide 1 CPSC 422, Lecture 9 An MDP Approach to Multi-Category Patient Scheduling in a Diagnostic Facility Adapted from: Matthew

More information

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein

Reinforcement Learning. Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Slides based on those used in Berkeley's AI class taught by Dan Klein Reinforcement Learning Basic idea: Receive feedback in the form of rewards Agent s utility is defined by the

More information

Approximate Revenue Maximization with Multiple Items

Approximate Revenue Maximization with Multiple Items Approximate Revenue Maximization with Multiple Items Nir Shabbat - 05305311 December 5, 2012 Introduction The paper I read is called Approximate Revenue Maximization with Multiple Items by Sergiu Hart

More information

Appendix A: Introduction to Queueing Theory

Appendix A: Introduction to Queueing Theory Appendix A: Introduction to Queueing Theory Queueing theory is an advanced mathematical modeling technique that can estimate waiting times. Imagine customers who wait in a checkout line at a grocery store.

More information

Chapter 10 Inventory Theory

Chapter 10 Inventory Theory Chapter 10 Inventory Theory 10.1. (a) Find the smallest n such that g(n) 0. g(1) = 3 g(2) =2 n = 2 (b) Find the smallest n such that g(n) 0. g(1) = 1 25 1 64 g(2) = 1 4 1 25 g(3) =1 1 4 g(4) = 1 16 1

More information

Developing and implementing protective measures for ELF EMF. - a public health economics perspective

Developing and implementing protective measures for ELF EMF. - a public health economics perspective Developing and implementing protective measures for ELF EMF - a public health economics perspective Dan Chisholm, PhD 1 Objectives 1. Rationale for an economic perspective (WHY?) Use / distribution of

More information

Reasoning with Uncertainty

Reasoning with Uncertainty Reasoning with Uncertainty Markov Decision Models Manfred Huber 2015 1 Markov Decision Process Models Markov models represent the behavior of a random process, including its internal state and the externally

More information

FW364 Midterm I - PRACTICE EXAM - KEY February 2012

FW364 Midterm I - PRACTICE EXAM - KEY February 2012 Mass Balance Practice Questions FW364 Midterm I - PRACTICE EXAM - KEY February 2012 1. You are a climate change modeler that is interested in how carbon flows through ecosystems. As a good ecosystem modeler,

More information

Canadian Partnership Against Cancer - Who We are

Canadian Partnership Against Cancer - Who We are Canadian Partnership Against Cancer - Who We are The Canadian Partnership Against Cancer is an independent organization funded by the federal government to accelerate action on cancer control for all Canadians.

More information

Section M Discrete Probability Distribution

Section M Discrete Probability Distribution Section M Discrete Probability Distribution A random variable is a numerical measure of the outcome of a probability experiment, so its value is determined by chance. Random variables are typically denoted

More information

UPDATED IAA EDUCATION SYLLABUS

UPDATED IAA EDUCATION SYLLABUS II. UPDATED IAA EDUCATION SYLLABUS A. Supporting Learning Areas 1. STATISTICS Aim: To enable students to apply core statistical techniques to actuarial applications in insurance, pensions and emerging

More information

Dynamic Replication of Non-Maturing Assets and Liabilities

Dynamic Replication of Non-Maturing Assets and Liabilities Dynamic Replication of Non-Maturing Assets and Liabilities Michael Schürle Institute for Operations Research and Computational Finance, University of St. Gallen, Bodanstr. 6, CH-9000 St. Gallen, Switzerland

More information

MANAGEMENT SCIENCE doi /mnsc ec pp. ec1 ec5

MANAGEMENT SCIENCE doi /mnsc ec pp. ec1 ec5 MANAGEMENT SCIENCE doi 10.1287/mnsc.1070.0712ec pp. ec1 ec5 e-companion ONLY AVAILABLE IN ELECTRONIC FORM informs 2007 INFORMS Electronic Companion The Consequences of Ambidexterity in Strategic Alliance

More information

Stochastic Differential Equations in Finance and Monte Carlo Simulations

Stochastic Differential Equations in Finance and Monte Carlo Simulations Stochastic Differential Equations in Finance and Department of Statistics and Modelling Science University of Strathclyde Glasgow, G1 1XH China 2009 Outline Stochastic Modelling in Asset Prices 1 Stochastic

More information

Modeling epidemics on a regular tree graph

Modeling epidemics on a regular tree graph University of Portland Pilot Scholars Mathematics Faculty Publications and Presentations Mathematics 2016 Modeling epidemics on a regular tree graph Claire Seibold Hannah L. Callender University of Portland,

More information

Slides for DN2281, KTH 1

Slides for DN2281, KTH 1 Slides for DN2281, KTH 1 January 28, 2014 1 Based on the lecture notes Stochastic and Partial Differential Equations with Adapted Numerics, by J. Carlsson, K.-S. Moon, A. Szepessy, R. Tempone, G. Zouraris.

More information

Playing games with transmissible animal disease. Jonathan Cave Research Interest Group 6 May 2008

Playing games with transmissible animal disease. Jonathan Cave Research Interest Group 6 May 2008 Playing games with transmissible animal disease Jonathan Cave Research Interest Group 6 May 2008 Outline The nexus of game theory and epidemiology Some simple disease control games A vaccination game with

More information

CAS Course 3 - Actuarial Models

CAS Course 3 - Actuarial Models CAS Course 3 - Actuarial Models Before commencing study for this four-hour, multiple-choice examination, candidates should read the introduction to Materials for Study. Items marked with a bold W are available

More information

Reinforcement Learning

Reinforcement Learning Reinforcement Learning Basic idea: Receive feedback in the form of rewards Agent s utility is defined by the reward function Must (learn to) act so as to maximize expected rewards Grid World The agent

More information

Markov Decision Processes

Markov Decision Processes Markov Decision Processes Robert Platt Northeastern University Some images and slides are used from: 1. CS188 UC Berkeley 2. AIMA 3. Chris Amato Stochastic domains So far, we have studied search Can use

More information

Estimating HIV transmission rates with rcolgem

Estimating HIV transmission rates with rcolgem Estimating HIV transmission rates with rcolgem Erik M Volz December 5, 2014 This vignette will demonstrate how to use a coalescent models as described in [2] to estimate transmission rate parameters given

More information

Statistics for Managers Using Microsoft Excel/SPSS Chapter 6 The Normal Distribution And Other Continuous Distributions

Statistics for Managers Using Microsoft Excel/SPSS Chapter 6 The Normal Distribution And Other Continuous Distributions Statistics for Managers Using Microsoft Excel/SPSS Chapter 6 The Normal Distribution And Other Continuous Distributions 1999 Prentice-Hall, Inc. Chap. 6-1 Chapter Topics The Normal Distribution The Standard

More information

First Order Delays. Nathaniel Osgood CMPT

First Order Delays. Nathaniel Osgood CMPT First Order Delays Nathaniel Osgood CMPT 858 2-11-2010 Simple First-Order Decay (Create this in Vensim!) Use Initial Value: 1000 Mean time until Death People with Virulent Infection Deaths from Infection

More information

Subject CS2A Risk Modelling and Survival Analysis Core Principles

Subject CS2A Risk Modelling and Survival Analysis Core Principles ` Subject CS2A Risk Modelling and Survival Analysis Core Principles Syllabus for the 2019 exams 1 June 2018 Copyright in this Core Reading is the property of the Institute and Faculty of Actuaries who

More information

Assembly systems with non-exponential machines: Throughput and bottlenecks

Assembly systems with non-exponential machines: Throughput and bottlenecks Nonlinear Analysis 69 (2008) 911 917 www.elsevier.com/locate/na Assembly systems with non-exponential machines: Throughput and bottlenecks ShiNung Ching, Semyon M. Meerkov, Liang Zhang Department of Electrical

More information

Australian Journal of Basic and Applied Sciences. Conditional Maximum Likelihood Estimation For Survival Function Using Cox Model

Australian Journal of Basic and Applied Sciences. Conditional Maximum Likelihood Estimation For Survival Function Using Cox Model AENSI Journals Australian Journal of Basic and Applied Sciences Journal home page: wwwajbaswebcom Conditional Maximum Likelihood Estimation For Survival Function Using Cox Model Khawla Mustafa Sadiq University

More information

CS 188: Artificial Intelligence Spring Announcements

CS 188: Artificial Intelligence Spring Announcements CS 188: Artificial Intelligence Spring 2011 Lecture 9: MDPs 2/16/2011 Pieter Abbeel UC Berkeley Many slides over the course adapted from either Dan Klein, Stuart Russell or Andrew Moore 1 Announcements

More information

CS 360: Advanced Artificial Intelligence Class #16: Reinforcement Learning

CS 360: Advanced Artificial Intelligence Class #16: Reinforcement Learning CS 360: Advanced Artificial Intelligence Class #16: Reinforcement Learning Daniel M. Gaines Note: content for slides adapted from Sutton and Barto [1998] Introduction Animals learn through interaction

More information

Handout 4: Deterministic Systems and the Shortest Path Problem

Handout 4: Deterministic Systems and the Shortest Path Problem SEEM 3470: Dynamic Optimization and Applications 2013 14 Second Term Handout 4: Deterministic Systems and the Shortest Path Problem Instructor: Shiqian Ma January 27, 2014 Suggested Reading: Bertsekas

More information

A Markov decision model for optimising economic production lot size under stochastic demand

A Markov decision model for optimising economic production lot size under stochastic demand Volume 26 (1) pp. 45 52 http://www.orssa.org.za ORiON IN 0529-191-X c 2010 A Markov decision model for optimising economic production lot size under stochastic demand Paul Kizito Mubiru Received: 2 October

More information

STAT Mathematical Statistics

STAT Mathematical Statistics STAT 6201 - Mathematical Statistics Chapter 3 : Random variables 5, Event, Prc ) Random variables and distributions Let S be the sample space associated with a probability experiment Assume that we have

More information

Contagion models with interacting default intensity processes

Contagion models with interacting default intensity processes Contagion models with interacting default intensity processes Yue Kuen KWOK Hong Kong University of Science and Technology This is a joint work with Kwai Sun Leung. 1 Empirical facts Default of one firm

More information

Stochastic Modelling in Finance

Stochastic Modelling in Finance in Finance Department of Mathematics and Statistics University of Strathclyde Glasgow, G1 1XH April 2010 Outline and Probability 1 and Probability 2 Linear modelling Nonlinear modelling 3 The Black Scholes

More information

w w w. I C A o r g

w w w. I C A o r g w w w. I C A 2 0 1 4. o r g Multi-State Microeconomic Model for Pricing and Reserving a disability insurance policy over an arbitrary period Benjamin Schannes April 4, 2014 Some key disability statistics:

More information

Continuous Processes. Brownian motion Stochastic calculus Ito calculus

Continuous Processes. Brownian motion Stochastic calculus Ito calculus Continuous Processes Brownian motion Stochastic calculus Ito calculus Continuous Processes The binomial models are the building block for our realistic models. Three small-scale principles in continuous

More information

CSEP 573: Artificial Intelligence

CSEP 573: Artificial Intelligence CSEP 573: Artificial Intelligence Markov Decision Processes (MDP)! Ali Farhadi Many slides over the course adapted from Luke Zettlemoyer, Dan Klein, Pieter Abbeel, Stuart Russell or Andrew Moore 1 Outline

More information

Econometrics is. The estimation of relationships suggested by economic theory

Econometrics is. The estimation of relationships suggested by economic theory Econometrics is Econometrics is The estimation of relationships suggested by economic theory Econometrics is The estimation of relationships suggested by economic theory The application of mathematical

More information

EE266 Homework 5 Solutions

EE266 Homework 5 Solutions EE, Spring 15-1 Professor S. Lall EE Homework 5 Solutions 1. A refined inventory model. In this problem we consider an inventory model that is more refined than the one you ve seen in the lectures. The

More information

Notes. Cases on Static Optimization. Chapter 6 Algorithms Comparison: The Swing Case

Notes. Cases on Static Optimization. Chapter 6 Algorithms Comparison: The Swing Case Notes Chapter 2 Optimization Methods 1. Stationary points are those points where the partial derivatives of are zero. Chapter 3 Cases on Static Optimization 1. For the interested reader, we used a multivariate

More information

Homework 1 posted, due Friday, September 30, 2 PM. Independence of random variables: We say that a collection of random variables

Homework 1 posted, due Friday, September 30, 2 PM. Independence of random variables: We say that a collection of random variables Generating Functions Tuesday, September 20, 2011 2:00 PM Homework 1 posted, due Friday, September 30, 2 PM. Independence of random variables: We say that a collection of random variables Is independent

More information

Distributions in Excel

Distributions in Excel Distributions in Excel Functions Normal Inverse normal function Log normal Random Number Percentile functions Other distributions Probability Distributions A random variable is a numerical measure of the

More information

ACTEX ACADEMIC SERIES

ACTEX ACADEMIC SERIES ACTEX ACADEMIC SERIES Modekfor Quantifying Risk Sixth Edition Stephen J. Camilli, \S.\ Inn Dunciin, l\ \. I-I \. 1 VI \. M \.\ \ Richard L. London, f's.a ACTEX Publications, Inc. Winsted, CT TABLE OF CONTENTS

More information

What a Difference a Stochastic Process Makes: Epidemiological-Based Real Options Models of Optimal Treatment of Disease

What a Difference a Stochastic Process Makes: Epidemiological-Based Real Options Models of Optimal Treatment of Disease University of St. Andrews Discussion papers in Environmental Economics http://www.st-andrews.ac.uk/gsd/research/envecon/eediscus/ Paper 2016-03 What a Difference a Stochastic Process Makes: Epidemiological-Based

More information

Introduction to Financial Mathematics

Introduction to Financial Mathematics Introduction to Financial Mathematics Zsolt Bihary 211, ELTE Outline Financial mathematics in general, and in market modelling Introduction to classical theory Hedging efficiency in incomplete markets

More information

A Comparison Of Stochastic Systems With Different Types Of Delays

A Comparison Of Stochastic Systems With Different Types Of Delays A omparison Of Stochastic Systems With Different Types Of Delays H.T. Banks, Jared atenacci and Shuhua Hu enter for Research in Scientific omputation, North arolina State University Raleigh, N 27695-8212

More information

Bonus-malus systems 6.1 INTRODUCTION

Bonus-malus systems 6.1 INTRODUCTION 6 Bonus-malus systems 6.1 INTRODUCTION This chapter deals with the theory behind bonus-malus methods for automobile insurance. This is an important branch of non-life insurance, in many countries even

More information

Capital Sensitivity What matters in solvency risk capital assessments

Capital Sensitivity What matters in solvency risk capital assessments Capital Sensitivity What matters in solvency risk capital assessments Dr. Chris Ordowich Senior Consultant, LifeRisks Investigating Future Mortality: Blending Medical & Actuarial Science for Life & Longevity

More information

CS 237: Probability in Computing

CS 237: Probability in Computing CS 237: Probability in Computing Wayne Snyder Computer Science Department Boston University Lecture 12: Continuous Distributions Uniform Distribution Normal Distribution (motivation) Discrete vs Continuous

More information

Probabilistic Analysis of the Economic Impact of Earthquake Prediction Systems

Probabilistic Analysis of the Economic Impact of Earthquake Prediction Systems The Minnesota Journal of Undergraduate Mathematics Probabilistic Analysis of the Economic Impact of Earthquake Prediction Systems Tiffany Kolba and Ruyue Yuan Valparaiso University The Minnesota Journal

More information

Systematic narrative review of decision frameworks to select the appropriate modelling approaches for health economic evaluations

Systematic narrative review of decision frameworks to select the appropriate modelling approaches for health economic evaluations DOI 10.1186/s13104-015-1202-0 RESEARCH ARTICLE Open Access Systematic narrative review of decision s to select the appropriate modelling approaches for health economic evaluations B Tsoi 1,2*, D O Reilly

More information

1. For a special whole life insurance on (x), payable at the moment of death:

1. For a special whole life insurance on (x), payable at the moment of death: **BEGINNING OF EXAMINATION** 1. For a special whole life insurance on (x), payable at the moment of death: µ () t = 0.05, t > 0 (ii) δ = 0.08 x (iii) (iv) The death benefit at time t is bt 0.06t = e, t

More information

Applied Stochastic Processes and Control for Jump-Diffusions

Applied Stochastic Processes and Control for Jump-Diffusions Applied Stochastic Processes and Control for Jump-Diffusions Modeling, Analysis, and Computation Floyd B. Hanson University of Illinois at Chicago Chicago, Illinois siam.. Society for Industrial and Applied

More information

Lecture 9: Markov and Regime

Lecture 9: Markov and Regime Lecture 9: Markov and Regime Switching Models Prof. Massimo Guidolin 20192 Financial Econometrics Spring 2017 Overview Motivation Deterministic vs. Endogeneous, Stochastic Switching Dummy Regressiom Switching

More information

Delay-cost Optimal Coupon Delivery in Mobile Opportunistic Networks

Delay-cost Optimal Coupon Delivery in Mobile Opportunistic Networks Delay-cost Optimal Coupon Delivery in Mobile Opportunistic Networks Srinivasan Venkatramanan 1 Department of ECE, IISc. 19 December 2013 1 Joint work with Prof. Anurag Kumar Srinivasan (IISc.) Coupon Delivery

More information

Back to estimators...

Back to estimators... Back to estimators... So far, we have: Identified estimators for common parameters Discussed the sampling distributions of estimators Introduced ways to judge the goodness of an estimator (bias, MSE, etc.)

More information

Dynamic and Stochastic Knapsack-Type Models for Foreclosed Housing Acquisition and Redevelopment

Dynamic and Stochastic Knapsack-Type Models for Foreclosed Housing Acquisition and Redevelopment Proceedings of the 2012 International Conference on Industrial Engineering and Operations Management Istanbul, Turkey, July 3-6, 2012 Dynamic and Stochastic Knapsack-Type Models for Foreclosed Housing

More information

2017 IAA EDUCATION SYLLABUS

2017 IAA EDUCATION SYLLABUS 2017 IAA EDUCATION SYLLABUS 1. STATISTICS Aim: To enable students to apply core statistical techniques to actuarial applications in insurance, pensions and emerging areas of actuarial practice. 1.1 RANDOM

More information

Probability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016

Probability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016 Probability Theory Probability and Statistics for Data Science CSE594 - Spring 2016 What is Probability? 2 What is Probability? Examples outcome of flipping a coin (seminal example) amount of snowfall

More information

Obtaining Predictive Distributions for Reserves Which Incorporate Expert Opinions R. Verrall A. Estimation of Policy Liabilities

Obtaining Predictive Distributions for Reserves Which Incorporate Expert Opinions R. Verrall A. Estimation of Policy Liabilities Obtaining Predictive Distributions for Reserves Which Incorporate Expert Opinions R. Verrall A. Estimation of Policy Liabilities LEARNING OBJECTIVES 5. Describe the various sources of risk and uncertainty

More information

Final exam solutions

Final exam solutions EE365 Stochastic Control / MS&E251 Stochastic Decision Models Profs. S. Lall, S. Boyd June 5 6 or June 6 7, 2013 Final exam solutions This is a 24 hour take-home final. Please turn it in to one of the

More information

Real Options and Game Theory in Incomplete Markets

Real Options and Game Theory in Incomplete Markets Real Options and Game Theory in Incomplete Markets M. Grasselli Mathematics and Statistics McMaster University IMPA - June 28, 2006 Strategic Decision Making Suppose we want to assign monetary values to

More information

Overnight Index Rate: Model, calibration and simulation

Overnight Index Rate: Model, calibration and simulation Research Article Overnight Index Rate: Model, calibration and simulation Olga Yashkir and Yuri Yashkir Cogent Economics & Finance (2014), 2: 936955 Page 1 of 11 Research Article Overnight Index Rate: Model,

More information

Using MCMC and particle filters to forecast stochastic volatility and jumps in financial time series

Using MCMC and particle filters to forecast stochastic volatility and jumps in financial time series Using MCMC and particle filters to forecast stochastic volatility and jumps in financial time series Ing. Milan Fičura DYME (Dynamical Methods in Economics) University of Economics, Prague 15.6.2016 Outline

More information

A Skewed Truncated Cauchy Logistic. Distribution and its Moments

A Skewed Truncated Cauchy Logistic. Distribution and its Moments International Mathematical Forum, Vol. 11, 2016, no. 20, 975-988 HIKARI Ltd, www.m-hikari.com http://dx.doi.org/10.12988/imf.2016.6791 A Skewed Truncated Cauchy Logistic Distribution and its Moments Zahra

More information

Lecture 8: Markov and Regime

Lecture 8: Markov and Regime Lecture 8: Markov and Regime Switching Models Prof. Massimo Guidolin 20192 Financial Econometrics Spring 2016 Overview Motivation Deterministic vs. Endogeneous, Stochastic Switching Dummy Regressiom Switching

More information

Youngrok Lee and Jaesung Lee

Youngrok Lee and Jaesung Lee orean J. Math. 3 015, No. 1, pp. 81 91 http://dx.doi.org/10.11568/kjm.015.3.1.81 LOCAL VOLATILITY FOR QUANTO OPTION PRICES WITH STOCHASTIC INTEREST RATES Youngrok Lee and Jaesung Lee Abstract. This paper

More information

M.S. in Quantitative Finance & Risk Analytics (QFRA) Fall 2017 & Spring 2018

M.S. in Quantitative Finance & Risk Analytics (QFRA) Fall 2017 & Spring 2018 M.S. in Quantitative Finance & Risk Analytics (QFRA) Fall 2017 & Spring 2018 2 - Required Professional Development &Career Workshops MGMT 7770 Prof. Development Workshop 1/Career Workshops (Fall) Wed.

More information

1 The continuous time limit

1 The continuous time limit Derivative Securities, Courant Institute, Fall 2008 http://www.math.nyu.edu/faculty/goodman/teaching/derivsec08/index.html Jonathan Goodman and Keith Lewis Supplementary notes and comments, Section 3 1

More information

Handout 8: Introduction to Stochastic Dynamic Programming. 2 Examples of Stochastic Dynamic Programming Problems

Handout 8: Introduction to Stochastic Dynamic Programming. 2 Examples of Stochastic Dynamic Programming Problems SEEM 3470: Dynamic Optimization and Applications 2013 14 Second Term Handout 8: Introduction to Stochastic Dynamic Programming Instructor: Shiqian Ma March 10, 2014 Suggested Reading: Chapter 1 of Bertsekas,

More information

warwick.ac.uk/lib-publications

warwick.ac.uk/lib-publications Original citation: Dangerfield, C. E., Whalley, A. Elizabeth, Hanley, N. and Gilligan, C. A.. (2017) What a difference a stochastic process makes : epidemiological-based real options models of optimal

More information

Society of Actuaries Exam MLC: Models for Life Contingencies Draft 2012 Learning Objectives Document Version: August 19, 2011

Society of Actuaries Exam MLC: Models for Life Contingencies Draft 2012 Learning Objectives Document Version: August 19, 2011 Learning Objective Proposed Weighting* (%) Understand how decrements are used in insurances, annuities and investments. Understand the models used to model decrements used in insurances, annuities and

More information

November 2001 Course 1 Mathematical Foundations of Actuarial Science. Society of Actuaries/Casualty Actuarial Society

November 2001 Course 1 Mathematical Foundations of Actuarial Science. Society of Actuaries/Casualty Actuarial Society November 00 Course Mathematical Foundations of Actuarial Science Society of Actuaries/Casualty Actuarial Society . An urn contains 0 balls: 4 red and 6 blue. A second urn contains 6 red balls and an unknown

More information

Lecture 2: Making Good Sequences of Decisions Given a Model of World. CS234: RL Emma Brunskill Winter 2018

Lecture 2: Making Good Sequences of Decisions Given a Model of World. CS234: RL Emma Brunskill Winter 2018 Lecture 2: Making Good Sequences of Decisions Given a Model of World CS234: RL Emma Brunskill Winter 218 Human in the loop exoskeleton work from Steve Collins lab Class Structure Last Time: Introduction

More information

Machine Learning for Quantitative Finance

Machine Learning for Quantitative Finance Machine Learning for Quantitative Finance Fast derivative pricing Sofie Reyners Joint work with Jan De Spiegeleer, Dilip Madan and Wim Schoutens Derivative pricing is time-consuming... Vanilla option pricing

More information

Dynamic Macroeconomics

Dynamic Macroeconomics Chapter 1 Introduction Dynamic Macroeconomics Prof. George Alogoskoufis Fletcher School, Tufts University and Athens University of Economics and Business 1.1 The Nature and Evolution of Macroeconomics

More information

Using Monte Carlo Analysis in Ecological Risk Assessments

Using Monte Carlo Analysis in Ecological Risk Assessments 10/27/00 Page 1 of 15 Using Monte Carlo Analysis in Ecological Risk Assessments Argonne National Laboratory Abstract Monte Carlo analysis is a statistical technique for risk assessors to evaluate the uncertainty

More information

INSTITUTE AND FACULTY OF ACTUARIES. Curriculum 2019 SPECIMEN SOLUTIONS

INSTITUTE AND FACULTY OF ACTUARIES. Curriculum 2019 SPECIMEN SOLUTIONS INSTITUTE AND FACULTY OF ACTUARIES Curriculum 2019 SPECIMEN SOLUTIONS Subject CM1A Actuarial Mathematics Institute and Faculty of Actuaries 1 ( 91 ( 91 365 1 0.08 1 i = + 365 ( 91 365 0.980055 = 1+ i 1+

More information

Elif Özge Özdamar T Reinforcement Learning - Theory and Applications February 14, 2006

Elif Özge Özdamar T Reinforcement Learning - Theory and Applications February 14, 2006 On the convergence of Q-learning Elif Özge Özdamar elif.ozdamar@helsinki.fi T-61.6020 Reinforcement Learning - Theory and Applications February 14, 2006 the covergence of stochastic iterative algorithms

More information

Monte-Carlo Planning: Introduction and Bandit Basics. Alan Fern

Monte-Carlo Planning: Introduction and Bandit Basics. Alan Fern Monte-Carlo Planning: Introduction and Bandit Basics Alan Fern 1 Large Worlds We have considered basic model-based planning algorithms Model-based planning: assumes MDP model is available Methods we learned

More information

Fundamentals of Actuarial Mathematics

Fundamentals of Actuarial Mathematics Fundamentals of Actuarial Mathematics Third Edition S. David Promislow Fundamentals of Actuarial Mathematics Fundamentals of Actuarial Mathematics Third Edition S. David Promislow York University, Toronto,

More information

Analysis of Realized Volatility for Nikkei Stock Average on the Tokyo Stock Exchange

Analysis of Realized Volatility for Nikkei Stock Average on the Tokyo Stock Exchange Journal of Physics: Conference Series PAPER OPEN ACCESS Analysis of Realized Volatility for Nikkei Stock Average on the Tokyo Stock Exchange To cite this article: Tetsuya Takaishi and Toshiaki Watanabe

More information

Chapter 9. Idea of Probability. Randomness and Probability. Basic Practice of Statistics - 3rd Edition. Chapter 9 1. Introducing Probability

Chapter 9. Idea of Probability. Randomness and Probability. Basic Practice of Statistics - 3rd Edition. Chapter 9 1. Introducing Probability Chapter 9 Introducing Probability BPS - 3rd Ed. Chapter 9 1 Idea of Probability Probability is the science of chance behavior Chance behavior is unpredictable in the short run but has a regular and predictable

More information

Unit 5: Sampling Distributions of Statistics

Unit 5: Sampling Distributions of Statistics Unit 5: Sampling Distributions of Statistics Statistics 571: Statistical Methods Ramón V. León 6/12/2004 Unit 5 - Stat 571 - Ramon V. Leon 1 Definitions and Key Concepts A sample statistic used to estimate

More information

Unit 5: Sampling Distributions of Statistics

Unit 5: Sampling Distributions of Statistics Unit 5: Sampling Distributions of Statistics Statistics 571: Statistical Methods Ramón V. León 6/12/2004 Unit 5 - Stat 571 - Ramon V. Leon 1 Definitions and Key Concepts A sample statistic used to estimate

More information

Taming the Beast Workshop. Priors and starting values

Taming the Beast Workshop. Priors and starting values Workshop Veronika Bošková & Chi Zhang June 28, 2016 1 / 21 What is a prior? Distribution of a parameter before the data is collected and analysed as opposed to POSTERIOR distribution which combines the

More information

RESEARCH EDGE REAL OPTIONS OF A STOCK FOLLOWING A JUMP DIFFUSION WITH REGIME SWITCHING. Moussa Kounta 1 & Sidney Larrimore 2

RESEARCH EDGE REAL OPTIONS OF A STOCK FOLLOWING A JUMP DIFFUSION WITH REGIME SWITCHING. Moussa Kounta 1 & Sidney Larrimore 2 Research Edge Working Paper Series, no. 10 p. 1 RESEARCH EDGE REAL OPTIONS OF A STOCK FOLLOWING A JUMP DIFFUSION WITH REGIME SWITCHING Moussa Kounta 1 & Sidney Larrimore 2 Department of Mathematics,, Nassau,

More information

4 Reinforcement Learning Basic Algorithms

4 Reinforcement Learning Basic Algorithms Learning in Complex Systems Spring 2011 Lecture Notes Nahum Shimkin 4 Reinforcement Learning Basic Algorithms 4.1 Introduction RL methods essentially deal with the solution of (optimal) control problems

More information

Discrete-time Asset Pricing Models in Applied Stochastic Finance

Discrete-time Asset Pricing Models in Applied Stochastic Finance Discrete-time Asset Pricing Models in Applied Stochastic Finance P.C.G. Vassiliou ) WILEY Table of Contents Preface xi Chapter ^Probability and Random Variables 1 1.1. Introductory notes 1 1.2. Probability

More information

Modelling Anti-Terrorist Surveillance Systems from a Queueing Perspective

Modelling Anti-Terrorist Surveillance Systems from a Queueing Perspective Systems from a Queueing Perspective September 7, 2012 Problem A surveillance resource must observe several areas, searching for potential adversaries. Problem A surveillance resource must observe several

More information

Probabilistic models for risk assessment of disasters

Probabilistic models for risk assessment of disasters Safety and Security Engineering IV 83 Probabilistic models for risk assessment of disasters A. Lepikhin & I. Lepikhina Department of Safety Engineering Systems, SKTB Nauka KSC SB RAS, Russia Abstract This

More information