The Monte Carlo Method in High Performance Computing
|
|
- Solomon Clark
- 5 years ago
- Views:
Transcription
1 The Monte Carlo Method in High Performance Computing Dieter W. Heermann Monte Carlo Methods 2015 Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
2 Outline The Monte Carlo Method in High Performance Computing Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
3 Revisiting the Poor Man s Monte Carlo Poor Man s Monte Carlo: Statistics Let X 1,...X n be iid random variables with E(X i ) = m = µ for all i. Then E( 1 n n i=1 X i) is an estimator for µ with variance v/n. Assume that we have κ processors available. Assume each processor j produces n samples independently. Then: E j := 1 n E = 1 κ n i=1 X (j) i (1) κ E j (2) j=1 Var(E) = v/(κn) (3) The variance is reduced linearly proportional to κ. Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
4 Revisiting the Poor Man s Monte Carlo Assume now that each processor runs at different speeds. Each processor j obtains n j results. Then E = Assume that we know n j a priori. n j=1 E j κ j=1 n j Hence, if n j has not been reached after a prescribed time, then there is a problem with the processor. Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
5 Revisiting the Poor Man s Monte Carlo { 0 does not report nj Let Z j = 1 otherwise Then n j=1 E = Z je j κ j=1 n jz j No bias. Possibility: The master process assigns the starting values (random number seeds). Lost results are re-computed. Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
6 Revisiting the Poor Man s Monte Carlo Dropping of initial non-stationary state values. 1 nj E j := n j B j +1 i=b j X (j) i Then n j=1 E = Z je j κ j=1 n jz j Will not lead to an exact linear speed-up. Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
7 Parallel Tempering Parallel Tempering Basic idea [1, 2, 3]: Run several (possibly as many as there are processors) individual Markov chains. Supplementing local configurational Metropolis moves with global swap moves that update an entire set of configurations. The replica exchanges are accepted with the Metropolis acceptance probability and rejected with the remaining probability. Induce mixing between the Markov chains. Detailed balance is enforced and the sampled distributions remain stationary. This can be used, for example as a means to accelerate the convergence of Monte Carlo simulations. Widely employed in chemistry, physics, biology, engineering and materials science [4]. Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
8 Parallel Tempering x 0 (1) P (1) x 0 (10) P (10) Swap the elements of the Markov chains. The swap moves induce a random walk in for a given swap element. Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
9 Parallel Tempering Let r uniform(0, 1) be a uniformly distributed random number. Accept or reject a swap between the Markov chains as r < P i(x j )P j (X i ) P i (X i )P j (X j ) Exchange step is not capable of destroying or creating new configurations. New configurations are generated within one Markov chain. Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
10 Parallel Tempering Data Model Prior information D M I Target Posterior p X Α D,M,I Control system diagnostics Hybrid n no. of iterations X Α iterations parallel tempering X Α init start parameters Summary statistics MCMC Σ Α init start proposal Σ 's Best fit model & residuals Nonlinear model Β Tempering levels X Α marginals fitting program X Α 68.3% credible regions p D M,I marginal likelihood for model comparison Adaptive Two Stage Control System 1 Automates selection of an efficient set of Gaussian proposal distribution Σ 's using an annealing operation. 2 Monitors MCMC for emergence of significantly improved parameter set and resets MCMC. Includes a gene crossover algorithm to breed higher probability chains. Figure 1: Schematic of the Bayesian nonlinear model fitting program which employs the hybrid MCMC algorithm to carry out the Bayesian integrals. Taken from: Detecting Extra-solar Planets with a Bayesian hybrid MCMC Kepler periodogram P. C. Gregory, in JSM Proceedings 2008, Planets Around Other Suns Section. Denver, CO: American Statistical Association. Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
11 Simulated Annealing Simulated Annealing Initialization i=0 xopt=x0; Fopt(xi)=Fobj(x0) i=i+1 xi+1=xi+ Fobj,i+1=Fobj(xi+1) No Is xi+1 feasible? Yes Fobj,i+1<Fopt Yes xopt=xi+1 No No Fopt=Fobj,i+1 Stopping criteria satisfied? Yes End Figure 2.8 Flow diagram of the Localized Random Search (LRS) Algorithm Figure taken from Plantwide Optimizing Control for the Continuous Bio-Ethanol Production Process (PhD Thesis) Silvia Mercedes Ochoa Cáceres Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
12 Simulated Annealing PRODUCT F D2 PC Q C F D1 PC LC LC RECTIFICATION COLUMN FEED BEER COLUMN F B2 LC Q R2 F B1 Q R1 Figure 3.11 Flow diagram of a two-distillation column system for ethanol purification. Beer column: no condenser. Rectification column: partial condenser. Figure taken from Plantwide Optimizing Control for the Continuous Bio-Ethanol Production Process (PhD Thesis) Silvia Mercedes Ochoa Cáceres Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
13 Literature Literature Swendsen, R. H. and Wang, J.-S. Replica Monte Carlo Simulation of Spin-Glasses, Phys. Rev. Lett., 57(21):2607?2609, (1986). C.J. Geyer, Markov Chain Monte Carlo Maximum Likelihood, in Computing Science and Statistics: Proceedings of the 23rd Symposium on the Interface, E.M. Keramidas, ed., American Statistical Association, New York (1991). Hukushima K and Nemoto K, Exchange Monte Carlo method and application to spin glass simulations, J. Phys. Soc. Japan (1996) David J. Earl and Michael W. Deem, Phys. Chem. Chem. Phys., 2005, 7, Dieter W. Heermann (Monte Carlo Methods)The Monte Carlo Method in High Performance Computing / 1
Monte Carlo: Naïve Lecture #14 Rigoberto Hernandez. Monte Carlo Methods 3
Major Concepts Naïve Monte Carlo E.g., calculating π" Metropolis Monte Carlo Detailed Balance Improved Sampling Techniques Importance Sampling Umbrella Sampling Torrie and Valleau (1977) The Wolff Algorithm
More informationMonte Carlo: Naïve Lecture #19 Rigoberto Hernandez. Monte Carlo Methods 3
Major Concepts Naïve Monte Carlo E.g., calculating π" Metropolis Monte Carlo Detailed Balance Improved Sampling Techniques Importance Sampling Umbrella Sampling Torrie and Valleau (1977) The Wolff Algorithm
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning Monte Carlo Methods Mark Schmidt University of British Columbia Winter 2019 Last Time: Markov Chains We can use Markov chains for density estimation, d p(x) = p(x 1 ) p(x }{{}
More informationApplication of MCMC Algorithm in Interest Rate Modeling
Application of MCMC Algorithm in Interest Rate Modeling Xiaoxia Feng and Dejun Xie Abstract Interest rate modeling is a challenging but important problem in financial econometrics. This work is concerned
More informationChapter 7: Estimation Sections
1 / 40 Chapter 7: Estimation Sections 7.1 Statistical Inference Bayesian Methods: Chapter 7 7.2 Prior and Posterior Distributions 7.3 Conjugate Prior Distributions 7.4 Bayes Estimators Frequentist Methods:
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning Monte Carlo Methods Mark Schmidt University of British Columbia Winter 2018 Last Time: Markov Chains We can use Markov chains for density estimation, p(x) = p(x 1 ) }{{} d p(x
More informationCOS 513: Gibbs Sampling
COS 513: Gibbs Sampling Matthew Salesi December 6, 2010 1 Overview Concluding the coverage of Markov chain Monte Carlo (MCMC) sampling methods, we look today at Gibbs sampling. Gibbs sampling is a simple
More informationTop-down particle filtering for Bayesian decision trees
Top-down particle filtering for Bayesian decision trees Balaji Lakshminarayanan 1, Daniel M. Roy 2 and Yee Whye Teh 3 1. Gatsby Unit, UCL, 2. University of Cambridge and 3. University of Oxford Outline
More informationDown-Up Metropolis-Hastings Algorithm for Multimodality
Down-Up Metropolis-Hastings Algorithm for Multimodality Hyungsuk Tak Stat310 24 Nov 2015 Joint work with Xiao-Li Meng and David A. van Dyk Outline Motivation & idea Down-Up Metropolis-Hastings (DUMH) algorithm
More informationCalibration of Interest Rates
WDS'12 Proceedings of Contributed Papers, Part I, 25 30, 2012. ISBN 978-80-7378-224-5 MATFYZPRESS Calibration of Interest Rates J. Černý Charles University, Faculty of Mathematics and Physics, Prague,
More informationMonte Carlo Based Reliability Analysis
Monte Carlo Based Reliability Analysis Martin Schwarz 15 May 2014 Martin Schwarz Monte Carlo Based Reliability Analysis 15 May 2014 1 / 19 Plan of Presentation Description of the problem Monte Carlo Simulation
More informationEstimating a Dynamic Oligopolistic Game with Serially Correlated Unobserved Production Costs. SS223B-Empirical IO
Estimating a Dynamic Oligopolistic Game with Serially Correlated Unobserved Production Costs SS223B-Empirical IO Motivation There have been substantial recent developments in the empirical literature on
More informationEvidence from Large Indemnity and Medical Triangles
2009 Casualty Loss Reserve Seminar Session: Workers Compensation - How Long is the Tail? Evidence from Large Indemnity and Medical Triangles Casualty Loss Reserve Seminar September 14-15, 15, 2009 Chicago,
More informationExtracting Information from the Markets: A Bayesian Approach
Extracting Information from the Markets: A Bayesian Approach Daniel Waggoner The Federal Reserve Bank of Atlanta Florida State University, February 29, 2008 Disclaimer: The views expressed are the author
More informationMarkov Processes and Applications
Markov Processes and Applications Algorithms, Networks, Genome and Finance Etienne Pardoux Laboratoire d'analyse, Topologie, Probabilites Centre de Mathematiques et d'injormatique Universite de Provence,
More informationEvidence from Large Workers
Workers Compensation Loss Development Tail Evidence from Large Workers Compensation Triangles CAS Spring Meeting May 23-26, 26, 2010 San Diego, CA Schmid, Frank A. (2009) The Workers Compensation Tail
More informationMachine Learning for Quantitative Finance
Machine Learning for Quantitative Finance Fast derivative pricing Sofie Reyners Joint work with Jan De Spiegeleer, Dilip Madan and Wim Schoutens Derivative pricing is time-consuming... Vanilla option pricing
More informationAdaptive Experiments for Policy Choice. March 8, 2019
Adaptive Experiments for Policy Choice Maximilian Kasy Anja Sautmann March 8, 2019 Introduction The goal of many experiments is to inform policy choices: 1. Job search assistance for refugees: Treatments:
More informationIntroduction to Sequential Monte Carlo Methods
Introduction to Sequential Monte Carlo Methods Arnaud Doucet NCSU, October 2008 Arnaud Doucet () Introduction to SMC NCSU, October 2008 1 / 36 Preliminary Remarks Sequential Monte Carlo (SMC) are a set
More informationBayesian Multinomial Model for Ordinal Data
Bayesian Multinomial Model for Ordinal Data Overview This example illustrates how to fit a Bayesian multinomial model by using the built-in mutinomial density function (MULTINOM) in the MCMC procedure
More information"Pricing Exotic Options using Strong Convergence Properties
Fourth Oxford / Princeton Workshop on Financial Mathematics "Pricing Exotic Options using Strong Convergence Properties Klaus E. Schmitz Abe schmitz@maths.ox.ac.uk www.maths.ox.ac.uk/~schmitz Prof. Mike
More informationChapter 2 Uncertainty Analysis and Sampling Techniques
Chapter 2 Uncertainty Analysis and Sampling Techniques The probabilistic or stochastic modeling (Fig. 2.) iterative loop in the stochastic optimization procedure (Fig..4 in Chap. ) involves:. Specifying
More informationPosterior Inference. , where should we start? Consider the following computational procedure: 1. draw samples. 2. convert. 3. compute properties
Posterior Inference Example. Consider a binomial model where we have a posterior distribution for the probability term, θ. Suppose we want to make inferences about the log-odds γ = log ( θ 1 θ), where
More informationStatistical Computing (36-350)
Statistical Computing (36-350) Lecture 16: Simulation III: Monte Carlo Cosma Shalizi 21 October 2013 Agenda Monte Carlo Monte Carlo approximation of integrals and expectations The rejection method and
More informationSIMULATION METHOD FOR SOLVING HYBRID INFLUENCE DIAGRAMS IN DECISION MAKING. Xi Chen Enlu Zhou
Proceedings of the 2010 Winter Simulation Conference B. Johansson, S. Jain, J. Montoya-Torres, J. Hugan, and E. Yücesan, eds. SIMULATION METHOD FOR SOLVING HYBRID INFLUENCE DIAGRAMS IN DECISION MAKING
More informationAn Introduction to Bayesian Inference and MCMC Methods for Capture-Recapture
An Introduction to Bayesian Inference and MCMC Methods for Capture-Recapture Trinity River Restoration Program Workshop on Outmigration: Population Estimation October 6 8, 2009 An Introduction to Bayesian
More informationBayesian course - problem set 3 (lecture 4)
Bayesian course - problem set 3 (lecture 4) Ben Lambert November 14, 2016 1 Ticked off Imagine once again that you are investigating the occurrence of Lyme disease in the UK. This is a vector-borne disease
More informationOil Price Volatility and Asymmetric Leverage Effects
Oil Price Volatility and Asymmetric Leverage Effects Eunhee Lee and Doo Bong Han Institute of Life Science and Natural Resources, Department of Food and Resource Economics Korea University, Department
More informationAnalysis of the Bitcoin Exchange Using Particle MCMC Methods
Analysis of the Bitcoin Exchange Using Particle MCMC Methods by Michael Johnson M.Sc., University of British Columbia, 2013 B.Sc., University of Winnipeg, 2011 Project Submitted in Partial Fulfillment
More informationSemiparametric Modeling, Penalized Splines, and Mixed Models David Ruppert Cornell University
Semiparametric Modeling, Penalized Splines, and Mixed Models David Ruppert Cornell University Possible Model SBMD i,j is spinal bone mineral density on ith subject at age equal to age i,j lide http://wwworiecornelledu/~davidr
More informationAdaptive Metropolis-Hastings samplers for the Bayesian analysis of large linear Gaussian systems
Adaptive Metropolis-Hastings samplers for the Bayesian analysis of large linear Gaussian systems Stephen KH Yeung stephen.yeung@ncl.ac.uk Darren J Wilkinson d.j.wilkinson@ncl.ac.uk Department of Statistics,
More informationExtend the ideas of Kan and Zhou paper on Optimal Portfolio Construction under parameter uncertainty
Extend the ideas of Kan and Zhou paper on Optimal Portfolio Construction under parameter uncertainty George Photiou Lincoln College University of Oxford A dissertation submitted in partial fulfilment for
More informationA potentially useful approach to model nonlinearities in time series is to assume different behavior (structural break) in different subsamples
1.3 Regime switching models A potentially useful approach to model nonlinearities in time series is to assume different behavior (structural break) in different subsamples (or regimes). If the dates, the
More informationThe Time-Varying Effects of Monetary Aggregates on Inflation and Unemployment
経営情報学論集第 23 号 2017.3 The Time-Varying Effects of Monetary Aggregates on Inflation and Unemployment An Application of the Bayesian Vector Autoregression with Time-Varying Parameters and Stochastic Volatility
More informationSemiparametric Modeling, Penalized Splines, and Mixed Models
Semi 1 Semiparametric Modeling, Penalized Splines, and Mixed Models David Ruppert Cornell University http://wwworiecornelledu/~davidr January 24 Joint work with Babette Brumback, Ray Carroll, Brent Coull,
More informationPart II: Computation for Bayesian Analyses
Part II: Computation for Bayesian Analyses 62 BIO 233, HSPH Spring 2015 Conjugacy In both birth weight eamples the posterior distribution is from the same family as the prior: Prior Likelihood Posterior
More informationTechnical Appendix: Policy Uncertainty and Aggregate Fluctuations.
Technical Appendix: Policy Uncertainty and Aggregate Fluctuations. Haroon Mumtaz Paolo Surico July 18, 2017 1 The Gibbs sampling algorithm Prior Distributions and starting values Consider the model to
More informationGENERATION OF STANDARD NORMAL RANDOM NUMBERS. Naveen Kumar Boiroju and M. Krishna Reddy
GENERATION OF STANDARD NORMAL RANDOM NUMBERS Naveen Kumar Boiroju and M. Krishna Reddy Department of Statistics, Osmania University, Hyderabad- 500 007, INDIA Email: nanibyrozu@gmail.com, reddymk54@gmail.com
More informationA Non-Random Walk Down Wall Street
A Non-Random Walk Down Wall Street Andrew W. Lo A. Craig MacKinlay Princeton University Press Princeton, New Jersey list of Figures List of Tables Preface xiii xv xxi 1 Introduction 3 1.1 The Random Walk
More informationRandom Tree Method. Monte Carlo Methods in Financial Engineering
Random Tree Method Monte Carlo Methods in Financial Engineering What is it for? solve full optimal stopping problem & estimate value of the American option simulate paths of underlying Markov chain produces
More informationImportance sampling and Monte Carlo-based calibration for time-changed Lévy processes
Importance sampling and Monte Carlo-based calibration for time-changed Lévy processes Stefan Kassberger Thomas Liebmann BFS 2010 1 Motivation 2 Time-changed Lévy-models and Esscher transforms 3 Applications
More informationMCMC Package Example (Version 0.5-1)
MCMC Package Example (Version 0.5-1) Charles J. Geyer September 16, 2005 1 The Problem This is an example of using the mcmc package in R. The problem comes from a take-home question on a (take-home) PhD
More informationA start of Variational Methods for ERGM Ranran Wang, UW
A start of Variational Methods for ERGM Ranran Wang, UW MURI-UCI April 24, 2009 Outline A start of Variational Methods for ERGM [1] Introduction to ERGM Current methods of parameter estimation: MCMCMLE:
More informationChapter 7: Estimation Sections
1 / 31 : Estimation Sections 7.1 Statistical Inference Bayesian Methods: 7.2 Prior and Posterior Distributions 7.3 Conjugate Prior Distributions 7.4 Bayes Estimators Frequentist Methods: 7.5 Maximum Likelihood
More informationActuarial Society of India EXAMINATIONS
Actuarial Society of India EXAMINATIONS 7 th June 005 Subject CT6 Statistical Models Time allowed: Three Hours (0.30 am 3.30 pm) INSTRUCTIONS TO THE CANDIDATES. Do not write your name anywhere on the answer
More informationA Markov Chain Monte Carlo Approach to Estimate the Risks of Extremely Large Insurance Claims
International Journal of Business and Economics, 007, Vol. 6, No. 3, 5-36 A Markov Chain Monte Carlo Approach to Estimate the Risks of Extremely Large Insurance Claims Wan-Kai Pang * Department of Applied
More informationSTAT 509: Statistics for Engineers Dr. Dewei Wang. Copyright 2014 John Wiley & Sons, Inc. All rights reserved.
STAT 509: Statistics for Engineers Dr. Dewei Wang Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger 7 Point CHAPTER OUTLINE 7-1 Point Estimation 7-2
More informationInstitute of Actuaries of India Subject CT6 Statistical Methods
Institute of Actuaries of India Subject CT6 Statistical Methods For 2014 Examinations Aim The aim of the Statistical Methods subject is to provide a further grounding in mathematical and statistical techniques
More informationThe Multinomial Logit Model Revisited: A Semiparametric Approach in Discrete Choice Analysis
The Multinomial Logit Model Revisited: A Semiparametric Approach in Discrete Choice Analysis Dr. Baibing Li, Loughborough University Wednesday, 02 February 2011-16:00 Location: Room 610, Skempton (Civil
More informationParallel Multilevel Monte Carlo Simulation
Parallel Simulation Mathematisches Institut Goethe-Universität Frankfurt am Main Advances in Financial Mathematics Paris January 7-10, 2014 Simulation Outline 1 Monte Carlo 2 3 4 Algorithm Numerical Results
More informationEvaluation of a New Variance Components Estimation Method Modi ed Henderson s Method 3 With the Application of Two Way Mixed Model
Evaluation of a New Variance Components Estimation Method Modi ed Henderson s Method 3 With the Application of Two Way Mixed Model Author: Weigang Qie; Chenfan Xu Supervisor: Lars Rönnegård June 0th, 009
More informationMCMC Package Example
MCMC Package Example Charles J. Geyer April 4, 2005 This is an example of using the mcmc package in R. The problem comes from a take-home question on a (take-home) PhD qualifying exam (School of Statistics,
More informationChapter 7: Estimation Sections
Chapter 7: Estimation Sections 7.1 Statistical Inference Bayesian Methods: 7.2 Prior and Posterior Distributions 7.3 Conjugate Prior Distributions Frequentist Methods: 7.5 Maximum Likelihood Estimators
More informationRelevant parameter changes in structural break models
Relevant parameter changes in structural break models A. Dufays J. Rombouts Forecasting from Complexity April 27 th, 2018 1 Outline Sparse Change-Point models 1. Motivation 2. Model specification Shrinkage
More information(5) Multi-parameter models - Summarizing the posterior
(5) Multi-parameter models - Summarizing the posterior Spring, 2017 Models with more than one parameter Thus far we have studied single-parameter models, but most analyses have several parameters For example,
More informationThe Values of Information and Solution in Stochastic Programming
The Values of Information and Solution in Stochastic Programming John R. Birge The University of Chicago Booth School of Business JRBirge ICSP, Bergamo, July 2013 1 Themes The values of information and
More informationEstimation after Model Selection
Estimation after Model Selection Vanja M. Dukić Department of Health Studies University of Chicago E-Mail: vanja@uchicago.edu Edsel A. Peña* Department of Statistics University of South Carolina E-Mail:
More informationInternational Finance. Estimation Error. Campbell R. Harvey Duke University, NBER and Investment Strategy Advisor, Man Group, plc.
International Finance Estimation Error Campbell R. Harvey Duke University, NBER and Investment Strategy Advisor, Man Group, plc February 17, 2017 Motivation The Markowitz Mean Variance Efficiency is the
More informationComparative analysis of three MCMC methods for estimating GARCH models
IOP Conference Series: Materials Science and Engineering PAPER OPEN ACCESS Comparative analysis of three MCMC methods for estimating GARCH models To cite this article: D B Nugroho 2018 IOP Conf. Ser.:
More information# generate data num.obs <- 100 y <- rnorm(num.obs,mean = theta.true, sd = sqrt(sigma.sq.true))
Posterior Sampling from Normal Now we seek to create draws from the joint posterior distribution and the marginal posterior distributions and Note the marginal posterior distributions would be used to
More informationOption Pricing Using Bayesian Neural Networks
Option Pricing Using Bayesian Neural Networks Michael Maio Pires, Tshilidzi Marwala School of Electrical and Information Engineering, University of the Witwatersrand, 2050, South Africa m.pires@ee.wits.ac.za,
More informationSample Size Calculations for Odds Ratio in presence of misclassification (SSCOR Version 1.8, September 2017)
Sample Size Calculations for Odds Ratio in presence of misclassification (SSCOR Version 1.8, September 2017) 1. Introduction The program SSCOR available for Windows only calculates sample size requirements
More informationM.Sc. ACTUARIAL SCIENCE. Term-End Examination
No. of Printed Pages : 15 LMJA-010 (F2F) M.Sc. ACTUARIAL SCIENCE Term-End Examination O CD December, 2011 MIA-010 (F2F) : STATISTICAL METHOD Time : 3 hours Maximum Marks : 100 SECTION - A Attempt any five
More informationChapter 5 Univariate time-series analysis. () Chapter 5 Univariate time-series analysis 1 / 29
Chapter 5 Univariate time-series analysis () Chapter 5 Univariate time-series analysis 1 / 29 Time-Series Time-series is a sequence fx 1, x 2,..., x T g or fx t g, t = 1,..., T, where t is an index denoting
More informationSupplementary Material: Strategies for exploration in the domain of losses
1 Supplementary Material: Strategies for exploration in the domain of losses Paul M. Krueger 1,, Robert C. Wilson 2,, and Jonathan D. Cohen 3,4 1 Department of Psychology, University of California, Berkeley
More informationBAYESIAN STATISTICAL PROCESS ADJUSTMENT FOR UNKNOWN PARAMETER SYSTEMS
The Pennsylvania State University The Graduate School Department of Industrial & Manufacturing Engineering BAYESIAN STATISTICAL PROCESS ADJUSTMENT FOR UNKNOWN PARAMETER SYSTEMS A Thesis in Industrial Engineering
More informationOn Implementation of the Markov Chain Monte Carlo Stochastic Approximation Algorithm
On Implementation of the Markov Chain Monte Carlo Stochastic Approximation Algorithm Yihua Jiang, Peter Karcher and Yuedong Wang Abstract The Markov Chain Monte Carlo Stochastic Approximation Algorithm
More information(11) Case Studies: Adaptive clinical trials. ST440/540: Applied Bayesian Analysis
Use of Bayesian methods in clinical trials Bayesian methods are becoming more common in clinical trials analysis We will study how to compute the sample size for a Bayesian clinical trial We will then
More informationStochastic Claims Reserving _ Methods in Insurance
Stochastic Claims Reserving _ Methods in Insurance and John Wiley & Sons, Ltd ! Contents Preface Acknowledgement, xiii r xi» J.. '..- 1 Introduction and Notation : :.... 1 1.1 Claims process.:.-.. : 1
More informationStatistical Inference and Methods
Department of Mathematics Imperial College London d.stephens@imperial.ac.uk http://stats.ma.ic.ac.uk/ das01/ 14th February 2006 Part VII Session 7: Volatility Modelling Session 7: Volatility Modelling
More informationEstimation Appendix to Dynamics of Fiscal Financing in the United States
Estimation Appendix to Dynamics of Fiscal Financing in the United States Eric M. Leeper, Michael Plante, and Nora Traum July 9, 9. Indiana University. This appendix includes tables and graphs of additional
More informationAlgorithmic and High-Frequency Trading
LOBSTER June 2 nd 2016 Algorithmic and High-Frequency Trading Julia Schmidt Overview Introduction Market Making Grossman-Miller Market Making Model Trading Costs Measuring Liquidity Market Making using
More informationRESEARCH ARTICLE. The Penalized Biclustering Model And Related Algorithms Supplemental Online Material
Journal of Applied Statistics Vol. 00, No. 00, Month 00x, 8 RESEARCH ARTICLE The Penalized Biclustering Model And Related Algorithms Supplemental Online Material Thierry Cheouo and Alejandro Murua Département
More informationConsistent estimators for multilevel generalised linear models using an iterated bootstrap
Multilevel Models Project Working Paper December, 98 Consistent estimators for multilevel generalised linear models using an iterated bootstrap by Harvey Goldstein hgoldstn@ioe.ac.uk Introduction Several
More informationAnalysis of extreme values with random location Abstract Keywords: 1. Introduction and Model
Analysis of extreme values with random location Ali Reza Fotouhi Department of Mathematics and Statistics University of the Fraser Valley Abbotsford, BC, Canada, V2S 7M8 Ali.fotouhi@ufv.ca Abstract Analysis
More informationLecture 17: More on Markov Decision Processes. Reinforcement learning
Lecture 17: More on Markov Decision Processes. Reinforcement learning Learning a model: maximum likelihood Learning a value function directly Monte Carlo Temporal-difference (TD) learning COMP-424, Lecture
More informationECON5160: The compulsory term paper
University of Oslo / Department of Economics / TS+NCF March 9, 2012 ECON5160: The compulsory term paper Formalities: This term paper is compulsory. This paper must be accepted in order to qualify for attending
More informationBayesian Inference for Random Coefficient Dynamic Panel Data Models
Bayesian Inference for Random Coefficient Dynamic Panel Data Models By Peng Zhang and Dylan Small* 1 Department of Statistics, The Wharton School, University of Pennsylvania Abstract We develop a hierarchical
More informationOmitted Variables Bias in Regime-Switching Models with Slope-Constrained Estimators: Evidence from Monte Carlo Simulations
Journal of Statistical and Econometric Methods, vol. 2, no.3, 2013, 49-55 ISSN: 2051-5057 (print version), 2051-5065(online) Scienpress Ltd, 2013 Omitted Variables Bias in Regime-Switching Models with
More information1 Overview. 2 The Gradient Descent Algorithm. AM 221: Advanced Optimization Spring 2016
AM 22: Advanced Optimization Spring 206 Prof. Yaron Singer Lecture 9 February 24th Overview In the previous lecture we reviewed results from multivariate calculus in preparation for our journey into convex
More informationMulti-Regime Analysis
Multi-Regime Analysis Applications to Fixed Income 12/7/2011 Copyright 2011, Hipes Research 1 Credit This research has been done in collaboration with my friend, Thierry F. Bollier, who was the first to
More informationHigh Dimensional Bayesian Optimisation and Bandits via Additive Models
1/20 High Dimensional Bayesian Optimisation and Bandits via Additive Models Kirthevasan Kandasamy, Jeff Schneider, Barnabás Póczos ICML 15 July 8 2015 2/20 Bandits & Optimisation Maximum Likelihood inference
More informationGenerating Random Numbers
Generating Random Numbers Aim: produce random variables for given distribution Inverse Method Let F be the distribution function of an univariate distribution and let F 1 (y) = inf{x F (x) y} (generalized
More informationSELECTION OF VARIABLES INFLUENCING IRAQI BANKS DEPOSITS BY USING NEW BAYESIAN LASSO QUANTILE REGRESSION
Vol. 6, No. 1, Summer 2017 2012 Published by JSES. SELECTION OF VARIABLES INFLUENCING IRAQI BANKS DEPOSITS BY USING NEW BAYESIAN Fadel Hamid Hadi ALHUSSEINI a Abstract The main focus of the paper is modelling
More informationA Practical Implementation of the Gibbs Sampler for Mixture of Distributions: Application to the Determination of Specifications in Food Industry
A Practical Implementation of the for Mixture of Distributions: Application to the Determination of Specifications in Food Industry Julien Cornebise 1 Myriam Maumy 2 Philippe Girard 3 1 Ecole Supérieure
More informationA Comparative Analysis of Crossover Variants in Differential Evolution
Proceedings of the International Multiconference on Computer Science and Information Technology pp. 171 181 ISSN 1896-7094 c 2007 PIPS A Comparative Analysis of Crossover Variants in Differential Evolution
More information1. You are given the following information about a stationary AR(2) model:
Fall 2003 Society of Actuaries **BEGINNING OF EXAMINATION** 1. You are given the following information about a stationary AR(2) model: (i) ρ 1 = 05. (ii) ρ 2 = 01. Determine φ 2. (A) 0.2 (B) 0.1 (C) 0.4
More informationBSc (Hons) Software Engineering BSc (Hons) Computer Science with Network Security
BSc (Hons) Software Engineering BSc (Hons) Computer Science with Network Security Cohorts BCNS/ 06 / Full Time & BSE/ 06 / Full Time Resit Examinations for 2008-2009 / Semester 1 Examinations for 2008-2009
More informationLecture 4: Model-Free Prediction
Lecture 4: Model-Free Prediction David Silver Outline 1 Introduction 2 Monte-Carlo Learning 3 Temporal-Difference Learning 4 TD(λ) Introduction Model-Free Reinforcement Learning Last lecture: Planning
More informationWeek 1 Quantitative Analysis of Financial Markets Distributions B
Week 1 Quantitative Analysis of Financial Markets Distributions B Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 October
More informationOptimal Stopping. Nick Hay (presentation follows Thomas Ferguson s Optimal Stopping and Applications) November 6, 2008
(presentation follows Thomas Ferguson s and Applications) November 6, 2008 1 / 35 Contents: Introduction Problems Markov Models Monotone Stopping Problems Summary 2 / 35 The Secretary problem You have
More informationSequential Monte Carlo Samplers
Sequential Monte Carlo Samplers Pierre Del Moral Université Nice Sophia Antipolis, France Arnaud Doucet University of British Columbia, Canada Ajay Jasra University of Oxford, UK Summary. In this paper,
More informationImplementing Models in Quantitative Finance: Methods and Cases
Gianluca Fusai Andrea Roncoroni Implementing Models in Quantitative Finance: Methods and Cases vl Springer Contents Introduction xv Parti Methods 1 Static Monte Carlo 3 1.1 Motivation and Issues 3 1.1.1
More informationComputational Statistics Handbook with MATLAB
«H Computer Science and Data Analysis Series Computational Statistics Handbook with MATLAB Second Edition Wendy L. Martinez The Office of Naval Research Arlington, Virginia, U.S.A. Angel R. Martinez Naval
More informationThe Market Price of Risk and the Equity Premium: A Legacy of the Great Depression? by Cogley and Sargent
The Market Price of Risk and the Equity Premium: A Legacy of the Great Depression? by Cogley and Sargent James Bullard 21 February 2007 Friedman and Schwartz The paper for this lecture is The Market Price
More informationList of tables List of boxes List of screenshots Preface to the third edition Acknowledgements
Table of List of figures List of tables List of boxes List of screenshots Preface to the third edition Acknowledgements page xii xv xvii xix xxi xxv 1 Introduction 1 1.1 What is econometrics? 2 1.2 Is
More informationInternet Appendix for Asymmetry in Stock Comovements: An Entropy Approach
Internet Appendix for Asymmetry in Stock Comovements: An Entropy Approach Lei Jiang Tsinghua University Ke Wu Renmin University of China Guofu Zhou Washington University in St. Louis August 2017 Jiang,
More informationTwo hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER
Two hours MATH20802 To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER STATISTICAL METHODS Answer any FOUR of the SIX questions.
More informationUsing MCMC and particle filters to forecast stochastic volatility and jumps in financial time series
Using MCMC and particle filters to forecast stochastic volatility and jumps in financial time series Ing. Milan Fičura DYME (Dynamical Methods in Economics) University of Economics, Prague 15.6.2016 Outline
More informationPROBABILITY. Wiley. With Applications and R ROBERT P. DOBROW. Department of Mathematics. Carleton College Northfield, MN
PROBABILITY With Applications and R ROBERT P. DOBROW Department of Mathematics Carleton College Northfield, MN Wiley CONTENTS Preface Acknowledgments Introduction xi xiv xv 1 First Principles 1 1.1 Random
More information