Simulation Wrap-up, Statistics COS 323
|
|
- Alberta Harrison
- 5 years ago
- Views:
Transcription
1 Simulation Wrap-up, Statistics COS 323
2 Today Simulation Re-cap Statistics Variance and confidence intervals for simulations Simulation wrap-up FYI: No class or office hours Thursday
3 Simulation wrap-up
4 Last time Time-driven, event-driven Simulation from differential equations Cellular automata, microsimulation, agentbased simulation see e.g. %20microsimulation.htm Example applications: SIR disease model, population genetics
5 Simulation: Pros and Cons Pros: Building model can be easy (easier) than other approaches Outcomes can be easy to understand Cheap, safe Good for comparisons Cons: Hard to debug No guarantee of optimality Hard to establish validity Can t produce absolute numbers
6 Simulation: Important Considerations Are outcomes statistically significant? (Need many simulation runs to assess this) What should initial state be? How long should the simulation run? Is the model realistic? How sensitive is the model to parameters, initial conditions?
7 Statistics Overview
8
9 Random Variables A random variable is any probabilistic outcome e.g., a coin flip, height of someone randomly chosen from a population A R.V. takes on a value in a sample space space can be discrete, e.g., {H, T} or continuous, e.g. height in (0, infinity) R.V. denoted with capital letter (X), a realization with lowercase letter (x) e.g., X is a coin flip, x is the value (H or T) of that coin flip
10 Probability Mass Function Describes probability for a discrete R.V. e.g.,
11 Probability Density Function Describes probability for a continuous R.V. e.g.,
12 [Population] Mean of a Random Variable aka expected value, first moment for discrete RV: E[ X] = µ = x i p i i for continuous RV: E X [ ] = µ = x p(x) dx
13 [Population] Variance σ 2 = E [(X µ) 2 ] = E[ X 2 2Xµ + µ 2 ] = E[ X 2 ] µ 2 [ ] E X = E X 2 ( [ ]) 2 for discrete RV: i σ 2 = p i (x i µ) 2 for continuous RV: σ 2 = (x µ) 2 p(x) dx
14 Sample mean and sample variance Suppose we have N independent observations of X: x 1, x 2, x N Sample mean: 1 N N i=1 x i = x Sample variance: N 1 (x N 1 i x ) 2 = s 2 i=1 E[x ] = µ E[s 2 ] = σ 2
15 1/(N-1) and the sample variance The N differences x i x (x i x ) = 0 are not independent: If you know N-1 of these values, you can deduce the last one i.e., only N-1 degrees of freedom Could treat sample as population and compute population variance: 1 N N i=1 (x i x ) 2 BUT this underestimates true population variance (especially bad if sample is small)
16 Sample variance using 1/(N-1) is unbiased [ ] = E E s 2 1 N 1 = 1 N 1 E N i=1 N i=1 (x i x ) 2 x 2 i Nx 2 = 1 N 1 N σ 2 + µ 2 = σ 2 ( ) N σ 2 N + µ2
17 Computing sample variance Can compute as s 2 = 1 N 1 N i=1 (x i x ) 2 Prefer: s 2 = N 2 x i i=1 N(x ) 2 N 1
18 The Gaussian Distribution 1 p(x) = σ 2π e E[X] = µ Var[X] = σ 2 1 x µ 2 σ 2
19 Why so important? sum of independent observations of a random variable converges to Gaussian in nature, events having variations resulting from many small, independent effects tend to have Gaussian distributions demo: e.g., measurement error if effects are multiplicative, logarithm is often normally distributed
20 Central Limit Theorem Suppose we sample x 1, x 2, x N from a distribution with mean μ and variance σ 2 Let then x x = 1 N N x i i=1 z = x µ σ / N N(0,1) i.e., distributed normally with mean μ, variance σ 2 /N
21 Important Properties of Normal Distribution 1. Family of normal distributions closed under linear transformations: if X ~ N(μ, σ 2 ) then (ax + b) ~ N(aμ+b, a 2 σ 2 ) 2. Linear combination of normals is also normal: if X 1 ~ N(μ 1, σ 12 ) and X 2 ~ N(μ 2, σ 22 ) then ax 1 +bx 2 ~ N(aμ 1 + bμ 2, a 2 σ b 2 σ 22 )
22 Important Properties of Normal Distribution 3. Of all distributions with mean and variance, normal has maximum entropy Information theory: Entropy like uninformativeness Principle of maximum entropy: choose to represent the world with as uninformative a distribution as possible, subject to testable information If we know x is in [a, b], then uniform distribution on [a, b] has least entropy If we know distribution has mean µ, variance σ 2, normal distribution N(µ, σ 2 ) has least entropy
23 Important Properties of Normal Distribution 4. If errors are normally distributed, a least-squares fit yields the maximum likelihood estimator Finding least-squares x st Ax b finds the value of x that maximizes the likelihood of data A under some model
24 Important Properties of Normal Distribution 5. Many derived random variables have analytically-known densities e.g., sample mean, sample variance 6. Sample mean and variance of n identical independent samples are independent; sample mean is a normally-distributed random variable X n ~ N(µ,σ 2 /n)
25 Distribution of Sample Variance s 2 = 1 N 1 (For Gaussian R.V. X) N i=1 (x i x ) 2 (n 1)s2 define U = σ 2 then U has a χ 2 distribution with (n -1) d.o.f. p(x) = 2 n / 2 Γ n 2 1 ( x) n 2 1 e x / 2, x 0 E[ U] = n 1, Var[ U] = 2(n 1)
26
27 The Chi-Squared Distribution
28 What if we don t know true variance? Sample mean is normally distributed R.V. X n ~ N(µ,σ 2 /n) Taking advantage of this presumes we know σ 2 x µ has a t distribution with (n-1) d.o.f. s n / n
29 [Student s] t-distribution
30 Forming a confidence interval e.g., given that I observed a sample mean of, I m 99% confident that the true mean lies between and. Know that x µ s n / n has t distribution Choose q 1, q 2 such that student t with (n-1) dof has 99% probability of lying between q 1, q 2
31 Confidence interval for the mean if P q 1 < x n µ s n / n < q 2 = 0.99 s then P x n q n 2 n < µ < x q n 1 s n n = 0.99
32 Interpreting Simulation Outcomes How long will customers have to wait, on average? e.g., for given # tellers, arrival rate, service time distribution, etc.
33 Simulate bank for N customers Let x i be the wait time of customer i Is mean(x) a good estimate for µ? How to compute a 95% confidence interval for µ? Problem: x i are not independent!
34 Replications Run simulation to get M observations Repeat simulation N times (different random numbers each time) Treat the sample mean of different runs as approximately uncorrelated s 2 = 1 n 1 i (X i X ) 2
35 Batch Means Run simulation for N (large) Divide x i into k consecutive batches of size b If b large enough, mean(batch1) approx. uncorrelated with mean(batch2), etc.
36 Other approaches Use estimation of autocorrelation between x i s to derive better estimate of variance that can be used for confidence interval Regenerative method: Take advantage of regeneration points or cycles in behavior e.g., points when bank is empty of customers
37 Simulation Wrap-up
38 Finally
39 Implications Who designed it all? How should we behave? What if we start running too many of our own simulations?
40 Software List_of_computer_simulation_software
Random Variables Handout. Xavier Vilà
Random Variables Handout Xavier Vilà Course 2004-2005 1 Discrete Random Variables. 1.1 Introduction 1.1.1 Definition of Random Variable A random variable X is a function that maps each possible outcome
More informationMath489/889 Stochastic Processes and Advanced Mathematical Finance Homework 5
Math489/889 Stochastic Processes and Advanced Mathematical Finance Homework 5 Steve Dunbar Due Fri, October 9, 7. Calculate the m.g.f. of the random variable with uniform distribution on [, ] and then
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 207 Homework 5 Drew Armstrong Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman: Section 3., Exercises 3, 0. Section 3.3, Exercises 2, 3, 0,.
More informationVersion A. Problem 1. Let X be the continuous random variable defined by the following pdf: 1 x/2 when 0 x 2, f(x) = 0 otherwise.
Math 224 Q Exam 3A Fall 217 Tues Dec 12 Version A Problem 1. Let X be the continuous random variable defined by the following pdf: { 1 x/2 when x 2, f(x) otherwise. (a) Compute the mean µ E[X]. E[X] x
More informationStatistics for Business and Economics
Statistics for Business and Economics Chapter 5 Continuous Random Variables and Probability Distributions Ch. 5-1 Probability Distributions Probability Distributions Ch. 4 Discrete Continuous Ch. 5 Probability
More informationBusiness Statistics 41000: Probability 3
Business Statistics 41000: Probability 3 Drew D. Creal University of Chicago, Booth School of Business February 7 and 8, 2014 1 Class information Drew D. Creal Email: dcreal@chicagobooth.edu Office: 404
More informationDefinition 9.1 A point estimate is any function T (X 1,..., X n ) of a random sample. We often write an estimator of the parameter θ as ˆθ.
9 Point estimation 9.1 Rationale behind point estimation When sampling from a population described by a pdf f(x θ) or probability function P [X = x θ] knowledge of θ gives knowledge of the entire population.
More informationPoint Estimators. STATISTICS Lecture no. 10. Department of Econometrics FEM UO Brno office 69a, tel
STATISTICS Lecture no. 10 Department of Econometrics FEM UO Brno office 69a, tel. 973 442029 email:jiri.neubauer@unob.cz 8. 12. 2009 Introduction Suppose that we manufacture lightbulbs and we want to state
More informationProbability is the tool used for anticipating what the distribution of data should look like under a given model.
AP Statistics NAME: Exam Review: Strand 3: Anticipating Patterns Date: Block: III. Anticipating Patterns: Exploring random phenomena using probability and simulation (20%-30%) Probability is the tool used
More informationSampling Distribution
MAT 2379 (Spring 2012) Sampling Distribution Definition : Let X 1,..., X n be a collection of random variables. We say that they are identically distributed if they have a common distribution. Definition
More informationPoint Estimation. Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage
6 Point Estimation Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage Point Estimation Statistical inference: directed toward conclusions about one or more parameters. We will use the generic
More informationcontinuous rv Note for a legitimate pdf, we have f (x) 0 and f (x)dx = 1. For a continuous rv, P(X = c) = c f (x)dx = 0, hence
continuous rv Let X be a continuous rv. Then a probability distribution or probability density function (pdf) of X is a function f(x) such that for any two numbers a and b with a b, P(a X b) = b a f (x)dx.
More informationUnit 5: Sampling Distributions of Statistics
Unit 5: Sampling Distributions of Statistics Statistics 571: Statistical Methods Ramón V. León 6/12/2004 Unit 5 - Stat 571 - Ramon V. Leon 1 Definitions and Key Concepts A sample statistic used to estimate
More informationUnit 5: Sampling Distributions of Statistics
Unit 5: Sampling Distributions of Statistics Statistics 571: Statistical Methods Ramón V. León 6/12/2004 Unit 5 - Stat 571 - Ramon V. Leon 1 Definitions and Key Concepts A sample statistic used to estimate
More informationWeek 2 Quantitative Analysis of Financial Markets Hypothesis Testing and Confidence Intervals
Week 2 Quantitative Analysis of Financial Markets Hypothesis Testing and Confidence Intervals Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg :
More informationME3620. Theory of Engineering Experimentation. Spring Chapter III. Random Variables and Probability Distributions.
ME3620 Theory of Engineering Experimentation Chapter III. Random Variables and Probability Distributions Chapter III 1 3.2 Random Variables In an experiment, a measurement is usually denoted by a variable
More informationReview for Final Exam Spring 2014 Jeremy Orloff and Jonathan Bloom
Review for Final Exam 18.05 Spring 2014 Jeremy Orloff and Jonathan Bloom THANK YOU!!!! JON!! PETER!! RUTHI!! ERIKA!! ALL OF YOU!!!! Probability Counting Sets Inclusion-exclusion principle Rule of product
More informationThe Bernoulli distribution
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More informationDerivative Securities
Derivative Securities he Black-Scholes formula and its applications. his Section deduces the Black- Scholes formula for a European call or put, as a consequence of risk-neutral valuation in the continuous
More informationChapter 7 Sampling Distributions and Point Estimation of Parameters
Chapter 7 Sampling Distributions and Point Estimation of Parameters Part 1: Sampling Distributions, the Central Limit Theorem, Point Estimation & Estimators Sections 7-1 to 7-2 1 / 25 Statistical Inferences
More informationStatistics, Their Distributions, and the Central Limit Theorem
Statistics, Their Distributions, and the Central Limit Theorem MATH 3342 Sections 5.3 and 5.4 Sample Means Suppose you sample from a popula0on 10 0mes. You record the following sample means: 10.1 9.5 9.6
More informationQuantitative Introduction ro Risk and Uncertainty in Business Module 5: Hypothesis Testing Examples
Quantitative Introduction ro Risk and Uncertainty in Business Module 5: Hypothesis Testing Examples M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu
More informationLecture 23. STAT 225 Introduction to Probability Models April 4, Whitney Huang Purdue University. Normal approximation to Binomial
Lecture 23 STAT 225 Introduction to Probability Models April 4, 2014 approximation Whitney Huang Purdue University 23.1 Agenda 1 approximation 2 approximation 23.2 Characteristics of the random variable:
More informationIntroduction to Statistics I
Introduction to Statistics I Keio University, Faculty of Economics Continuous random variables Simon Clinet (Keio University) Intro to Stats November 1, 2018 1 / 18 Definition (Continuous random variable)
More informationLecture 2. Probability Distributions Theophanis Tsandilas
Lecture 2 Probability Distributions Theophanis Tsandilas Comment on measures of dispersion Why do common measures of dispersion (variance and standard deviation) use sums of squares: nx (x i ˆµ) 2 i=1
More informationProbability: Week 4. Kwonsang Lee. University of Pennsylvania February 13, 2015
Probability: Week 4 Kwonsang Lee University of Pennsylvania kwonlee@wharton.upenn.edu February 13, 2015 Kwonsang Lee STAT111 February 13, 2015 1 / 21 Probability Sample space S: the set of all possible
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 10: Continuous RV Families. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 10: Continuous RV Families Prof. Vince Calhoun 1 Reading This class: Section 4.4-4.5 Next class: Section 4.6-4.7 2 Homework 3.9, 3.49, 4.5,
More informationHomework Assignments
Homework Assignments Week 1 (p. 57) #4.1, 4., 4.3 Week (pp 58 6) #4.5, 4.6, 4.8(a), 4.13, 4.0, 4.6(b), 4.8, 4.31, 4.34 Week 3 (pp 15 19) #1.9, 1.1, 1.13, 1.15, 1.18 (pp 9 31) #.,.6,.9 Week 4 (pp 36 37)
More informationChapter 4: Asymptotic Properties of MLE (Part 3)
Chapter 4: Asymptotic Properties of MLE (Part 3) Daniel O. Scharfstein 09/30/13 1 / 1 Breakdown of Assumptions Non-Existence of the MLE Multiple Solutions to Maximization Problem Multiple Solutions to
More informationProbability. An intro for calculus students P= Figure 1: A normal integral
Probability An intro for calculus students.8.6.4.2 P=.87 2 3 4 Figure : A normal integral Suppose we flip a coin 2 times; what is the probability that we get more than 2 heads? Suppose we roll a six-sided
More informationEstimating parameters 5.3 Confidence Intervals 5.4 Sample Variance
Estimating parameters 5.3 Confidence Intervals 5.4 Sample Variance Prof. Tesler Math 186 Winter 2017 Prof. Tesler Ch. 5: Confidence Intervals, Sample Variance Math 186 / Winter 2017 1 / 29 Estimating parameters
More informationTOPIC: PROBABILITY DISTRIBUTIONS
TOPIC: PROBABILITY DISTRIBUTIONS There are two types of random variables: A Discrete random variable can take on only specified, distinct values. A Continuous random variable can take on any value within
More informationThe Normal Distribution
Will Monroe CS 09 The Normal Distribution Lecture Notes # July 9, 207 Based on a chapter by Chris Piech The single most important random variable type is the normal a.k.a. Gaussian) random variable, parametrized
More informationCentral Limit Theorem (cont d) 7/28/2006
Central Limit Theorem (cont d) 7/28/2006 Central Limit Theorem for Binomial Distributions Theorem. For the binomial distribution b(n, p, j) we have lim npq b(n, p, np + x npq ) = φ(x), n where φ(x) is
More informationChapter 4: Commonly Used Distributions. Statistics for Engineers and Scientists Fourth Edition William Navidi
Chapter 4: Commonly Used Distributions Statistics for Engineers and Scientists Fourth Edition William Navidi 2014 by Education. This is proprietary material solely for authorized instructor use. Not authorized
More informationModeling Portfolios that Contain Risky Assets Stochastic Models I: One Risky Asset
Modeling Portfolios that Contain Risky Assets Stochastic Models I: One Risky Asset C. David Levermore University of Maryland, College Park Math 420: Mathematical Modeling March 25, 2014 version c 2014
More information6. Continous Distributions
6. Continous Distributions Chris Piech and Mehran Sahami May 17 So far, all random variables we have seen have been discrete. In all the cases we have seen in CS19 this meant that our RVs could only take
More informationCh4. Variance Reduction Techniques
Ch4. Zhang Jin-Ting Department of Statistics and Applied Probability July 17, 2012 Ch4. Outline Ch4. This chapter aims to improve the Monte Carlo Integration estimator via reducing its variance using some
More informationPoint Estimation. Some General Concepts of Point Estimation. Example. Estimator quality
Point Estimation Some General Concepts of Point Estimation Statistical inference = conclusions about parameters Parameters == population characteristics A point estimate of a parameter is a value (based
More informationIntroduction to Business Statistics QM 120 Chapter 6
DEPARTMENT OF QUANTITATIVE METHODS & INFORMATION SYSTEMS Introduction to Business Statistics QM 120 Chapter 6 Spring 2008 Chapter 6: Continuous Probability Distribution 2 When a RV x is discrete, we can
More informationLECTURE CHAPTER 3 DESCRETE RANDOM VARIABLE
LECTURE CHAPTER 3 DESCRETE RANDOM VARIABLE MSc Đào Việt Hùng Email: hungdv@tlu.edu.vn Random Variable A random variable is a function that assigns a real number to each outcome in the sample space of a
More informationECO220Y Continuous Probability Distributions: Normal Readings: Chapter 9, section 9.10
ECO220Y Continuous Probability Distributions: Normal Readings: Chapter 9, section 9.10 Fall 2011 Lecture 8 Part 2 (Fall 2011) Probability Distributions Lecture 8 Part 2 1 / 23 Normal Density Function f
More informationCommonly Used Distributions
Chapter 4: Commonly Used Distributions 1 Introduction Statistical inference involves drawing a sample from a population and analyzing the sample data to learn about the population. We often have some knowledge
More informationMartingales, Part II, with Exercise Due 9/21
Econ. 487a Fall 1998 C.Sims Martingales, Part II, with Exercise Due 9/21 1. Brownian Motion A process {X t } is a Brownian Motion if and only if i. it is a martingale, ii. t is a continuous time parameter
More informationProbability Theory and Simulation Methods. April 9th, Lecture 20: Special distributions
April 9th, 2018 Lecture 20: Special distributions Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters 4, 6: Random variables Week 9 Chapter
More informationChapter 7: Estimation Sections
1 / 40 Chapter 7: Estimation Sections 7.1 Statistical Inference Bayesian Methods: Chapter 7 7.2 Prior and Posterior Distributions 7.3 Conjugate Prior Distributions 7.4 Bayes Estimators Frequentist Methods:
More informationNormal Probability Distributions
Normal Probability Distributions Properties of Normal Distributions The most important probability distribution in statistics is the normal distribution. Normal curve A normal distribution is a continuous
More informationMLLunsford 1. Activity: Central Limit Theorem Theory and Computations
MLLunsford 1 Activity: Central Limit Theorem Theory and Computations Concepts: The Central Limit Theorem; computations using the Central Limit Theorem. Prerequisites: The student should be familiar with
More informationTwo hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER
Two hours MATH20802 To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER STATISTICAL METHODS Answer any FOUR of the SIX questions.
More informationCHAPTER 6 Random Variables
CHAPTER 6 Random Variables 6.1 Discrete and Continuous Random Variables The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers Discrete and Continuous Random
More informationElementary Statistics Lecture 5
Elementary Statistics Lecture 5 Sampling Distributions Chong Ma Department of Statistics University of South Carolina Chong Ma (Statistics, USC) STAT 201 Elementary Statistics 1 / 24 Outline 1 Introduction
More informationChapter 7: Point Estimation and Sampling Distributions
Chapter 7: Point Estimation and Sampling Distributions Seungchul Baek Department of Statistics, University of South Carolina STAT 509: Statistics for Engineers 1 / 20 Motivation In chapter 3, we learned
More informationMAS3904/MAS8904 Stochastic Financial Modelling
MAS3904/MAS8904 Stochastic Financial Modelling Dr Andrew (Andy) Golightly a.golightly@ncl.ac.uk Semester 1, 2018/19 Administrative Arrangements Lectures on Tuesdays at 14:00 (PERCY G13) and Thursdays at
More informationChapter 8: Sampling distributions of estimators Sections
Chapter 8 continued Chapter 8: Sampling distributions of estimators Sections 8.1 Sampling distribution of a statistic 8.2 The Chi-square distributions 8.3 Joint Distribution of the sample mean and sample
More informationCS 237: Probability in Computing
CS 237: Probability in Computing Wayne Snyder Computer Science Department Boston University Lecture 12: Continuous Distributions Uniform Distribution Normal Distribution (motivation) Discrete vs Continuous
More informationSTA Module 3B Discrete Random Variables
STA 2023 Module 3B Discrete Random Variables Learning Objectives Upon completing this module, you should be able to 1. Determine the probability distribution of a discrete random variable. 2. Construct
More informationχ 2 distributions and confidence intervals for population variance
χ 2 distributions and confidence intervals for population variance Let Z be a standard Normal random variable, i.e., Z N(0, 1). Define Y = Z 2. Y is a non-negative random variable. Its distribution is
More information5.3 Statistics and Their Distributions
Chapter 5 Joint Probability Distributions and Random Samples Instructor: Lingsong Zhang 1 Statistics and Their Distributions 5.3 Statistics and Their Distributions Statistics and Their Distributions Consider
More information12. Conditional heteroscedastic models (ARCH) MA6622, Ernesto Mordecki, CityU, HK, 2006.
12. Conditional heteroscedastic models (ARCH) MA6622, Ernesto Mordecki, CityU, HK, 2006. References for this Lecture: Robert F. Engle. Autoregressive Conditional Heteroscedasticity with Estimates of Variance
More informationChapter 3 - Lecture 4 Moments and Moment Generating Funct
Chapter 3 - Lecture 4 and s October 7th, 2009 Chapter 3 - Lecture 4 and Moment Generating Funct Central Skewness Chapter 3 - Lecture 4 and Moment Generating Funct Central Skewness The expected value of
More informationELEMENTS OF MONTE CARLO SIMULATION
APPENDIX B ELEMENTS OF MONTE CARLO SIMULATION B. GENERAL CONCEPT The basic idea of Monte Carlo simulation is to create a series of experimental samples using a random number sequence. According to the
More informationPROBABILITY DISTRIBUTIONS
CHAPTER 3 PROBABILITY DISTRIBUTIONS Page Contents 3.1 Introduction to Probability Distributions 51 3.2 The Normal Distribution 56 3.3 The Binomial Distribution 60 3.4 The Poisson Distribution 64 Exercise
More informationUsing Monte Carlo Integration and Control Variates to Estimate π
Using Monte Carlo Integration and Control Variates to Estimate π N. Cannady, P. Faciane, D. Miksa LSU July 9, 2009 Abstract We will demonstrate the utility of Monte Carlo integration by using this algorithm
More informationBus 701: Advanced Statistics. Harald Schmidbauer
Bus 701: Advanced Statistics Harald Schmidbauer c Harald Schmidbauer & Angi Rösch, 2008 About These Slides The present slides are not self-contained; they need to be explained and discussed. They contain
More information4-1. Chapter 4. Commonly Used Distributions by The McGraw-Hill Companies, Inc. All rights reserved.
4-1 Chapter 4 Commonly Used Distributions 2014 by The Companies, Inc. All rights reserved. Section 4.1: The Bernoulli Distribution 4-2 We use the Bernoulli distribution when we have an experiment which
More informationChapter 5. Sampling Distributions
Lecture notes, Lang Wu, UBC 1 Chapter 5. Sampling Distributions 5.1. Introduction In statistical inference, we attempt to estimate an unknown population characteristic, such as the population mean, µ,
More informationChapter 5. Continuous Random Variables and Probability Distributions. 5.1 Continuous Random Variables
Chapter 5 Continuous Random Variables and Probability Distributions 5.1 Continuous Random Variables 1 2CHAPTER 5. CONTINUOUS RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Probability Distributions Probability
More information1/2 2. Mean & variance. Mean & standard deviation
Question # 1 of 10 ( Start time: 09:46:03 PM ) Total Marks: 1 The probability distribution of X is given below. x: 0 1 2 3 4 p(x): 0.73? 0.06 0.04 0.01 What is the value of missing probability? 0.54 0.16
More informationStrategies for Improving the Efficiency of Monte-Carlo Methods
Strategies for Improving the Efficiency of Monte-Carlo Methods Paul J. Atzberger General comments or corrections should be sent to: paulatz@cims.nyu.edu Introduction The Monte-Carlo method is a useful
More informationUQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions.
UQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions. Random Variables 2 A random variable X is a numerical (integer, real, complex, vector etc.) summary of the outcome of the random experiment.
More informationINDIAN INSTITUTE OF SCIENCE STOCHASTIC HYDROLOGY. Lecture -5 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc.
INDIAN INSTITUTE OF SCIENCE STOCHASTIC HYDROLOGY Lecture -5 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc. Summary of the previous lecture Moments of a distribubon Measures of
More informationShifting our focus. We were studying statistics (data, displays, sampling...) The next few lectures focus on probability (randomness) Why?
Probability Introduction Shifting our focus We were studying statistics (data, displays, sampling...) The next few lectures focus on probability (randomness) Why? What is Probability? Probability is used
More informationECE 295: Lecture 03 Estimation and Confidence Interval
ECE 295: Lecture 03 Estimation and Confidence Interval Spring 2018 Prof Stanley Chan School of Electrical and Computer Engineering Purdue University 1 / 23 Theme of this Lecture What is Estimation? You
More informationI. Time Series and Stochastic Processes
I. Time Series and Stochastic Processes Purpose of this Module Introduce time series analysis as a method for understanding real-world dynamic phenomena Define different types of time series Explain the
More information9. Statistics I. Mean and variance Expected value Models of probability events
9. Statistics I Mean and variance Expected value Models of probability events 18 Statistic(s) Consider a set of distributed data (values) E.g., age of first marriage and average salary of Japanese If we
More informationIEOR 165 Lecture 1 Probability Review
IEOR 165 Lecture 1 Probability Review 1 Definitions in Probability and Their Consequences 1.1 Defining Probability A probability space (Ω, F, P) consists of three elements: A sample space Ω is the set
More informationChapter 7. Sampling Distributions and the Central Limit Theorem
Chapter 7. Sampling Distributions and the Central Limit Theorem 1 Introduction 2 Sampling Distributions related to the normal distribution 3 The central limit theorem 4 The normal approximation to binomial
More informationStatistics for Business and Economics
Statistics for Business and Economics Chapter 7 Estimation: Single Population Copyright 010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 7-1 Confidence Intervals Contents of this chapter: Confidence
More informationStatistical Methods in Practice STAT/MATH 3379
Statistical Methods in Practice STAT/MATH 3379 Dr. A. B. W. Manage Associate Professor of Mathematics & Statistics Department of Mathematics & Statistics Sam Houston State University Overview 6.1 Discrete
More informationProbability Distributions II
Probability Distributions II Summer 2017 Summer Institutes 63 Multinomial Distribution - Motivation Suppose we modified assumption (1) of the binomial distribution to allow for more than two outcomes.
More informationBinomial Approximation and Joint Distributions Chris Piech CS109, Stanford University
Binomial Approximation and Joint Distributions Chris Piech CS109, Stanford University Four Prototypical Trajectories Review The Normal Distribution X is a Normal Random Variable: X ~ N(µ, s 2 ) Probability
More informationDiscrete Random Variables and Probability Distributions. Stat 4570/5570 Based on Devore s book (Ed 8)
3 Discrete Random Variables and Probability Distributions Stat 4570/5570 Based on Devore s book (Ed 8) Random Variables We can associate each single outcome of an experiment with a real number: We refer
More informationReliability and Risk Analysis. Survival and Reliability Function
Reliability and Risk Analysis Survival function We consider a non-negative random variable X which indicates the waiting time for the risk event (eg failure of the monitored equipment, etc.). The probability
More informationStatistical analysis and bootstrapping
Statistical analysis and bootstrapping p. 1/15 Statistical analysis and bootstrapping Michel Bierlaire michel.bierlaire@epfl.ch Transport and Mobility Laboratory Statistical analysis and bootstrapping
More informationECON Introductory Econometrics. Lecture 1: Introduction and Review of Statistics
ECON4150 - Introductory Econometrics Lecture 1: Introduction and Review of Statistics Monique de Haan (moniqued@econ.uio.no) Stock and Watson Chapter 1-2 Lecture outline 2 What is econometrics? Course
More informationEngineering Statistics ECIV 2305
Engineering Statistics ECIV 2305 Section 5.3 Approximating Distributions with the Normal Distribution Introduction A very useful property of the normal distribution is that it provides good approximations
More informationMATH 3200 Exam 3 Dr. Syring
. Suppose n eligible voters are polled (randomly sampled) from a population of size N. The poll asks voters whether they support or do not support increasing local taxes to fund public parks. Let M be
More informationChapter 5. Statistical inference for Parametric Models
Chapter 5. Statistical inference for Parametric Models Outline Overview Parameter estimation Method of moments How good are method of moments estimates? Interval estimation Statistical Inference for Parametric
More informationINF FALL NATURAL LANGUAGE PROCESSING. Jan Tore Lønning, Lecture 3, 1.9
INF5830 015 FALL NATURAL LANGUAGE PROCESSING Jan Tore Lønning, Lecture 3, 1.9 Today: More statistics Binomial distribution Continuous random variables/distributions Normal distribution Sampling and sampling
More informationDiscrete Random Variables
Discrete Random Variables In this chapter, we introduce a new concept that of a random variable or RV. A random variable is a model to help us describe the state of the world around us. Roughly, a RV can
More informationCPSC 540: Machine Learning
CPSC 540: Machine Learning Monte Carlo Methods Mark Schmidt University of British Columbia Winter 2019 Last Time: Markov Chains We can use Markov chains for density estimation, d p(x) = p(x 1 ) p(x }{{}
More informationStatistics and Probability
Statistics and Probability Continuous RVs (Normal); Confidence Intervals Outline Continuous random variables Normal distribution CLT Point estimation Confidence intervals http://www.isrec.isb-sib.ch/~darlene/geneve/
More informationContinuous Probability Distributions & Normal Distribution
Mathematical Methods Units 3/4 Student Learning Plan Continuous Probability Distributions & Normal Distribution 7 lessons Notes: Students need practice in recognising whether a problem involves a discrete
More informationProbability and Random Variables A FINANCIAL TIMES COMPANY
Probability Basics Probability and Random Variables A FINANCIAL TIMES COMPANY 2 Probability Probability of union P[A [ B] =P[A]+P[B] P[A \ B] Conditional Probability A B P[A B] = Bayes Theorem P[A \ B]
More informationMTH6154 Financial Mathematics I Stochastic Interest Rates
MTH6154 Financial Mathematics I Stochastic Interest Rates Contents 4 Stochastic Interest Rates 45 4.1 Fixed Interest Rate Model............................ 45 4.2 Varying Interest Rate Model...........................
More informationRandom Variables and Probability Distributions
Chapter 3 Random Variables and Probability Distributions Chapter Three Random Variables and Probability Distributions 3. Introduction An event is defined as the possible outcome of an experiment. In engineering
More informationStatistical Analysis of Data from the Stock Markets. UiO-STK4510 Autumn 2015
Statistical Analysis of Data from the Stock Markets UiO-STK4510 Autumn 2015 Sampling Conventions We observe the price process S of some stock (or stock index) at times ft i g i=0,...,n, we denote it by
More informationE509A: Principle of Biostatistics. GY Zou
E509A: Principle of Biostatistics (Week 2: Probability and Distributions) GY Zou gzou@robarts.ca Reporting of continuous data If approximately symmetric, use mean (SD), e.g., Antibody titers ranged from
More informationData Analysis and Statistical Methods Statistics 651
Review of previous lecture: Why confidence intervals? Data Analysis and Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasini/teaching.html Suhasini Subba Rao Suppose you want to know the
More informationChapter 7. Random Variables: 7.1: Discrete and Continuous. Random Variables. 7.2: Means and Variances of. Random Variables
Chapter 7 Random Variables In Chapter 6, we learned that a!random phenomenon" was one that was unpredictable in the short term, but displayed a predictable pattern in the long run. In Statistics, we are
More information