Lecture 9: The law of large numbers and central limit theorem
|
|
- Carmel Eaton
- 5 years ago
- Views:
Transcription
1 Lecture 9: The law of large umbers ad cetral limit theorem Theorem.4 Let X,X 2,... be idepedet radom variables with fiite expectatios. (i) (The SLLN). If there is a costat p [,2] such that E X i p i i= p <, () the (X i EX i ) a.s. 0. i= (ii) (The WLLN). If there is a costat p [,2] such that the lim p i= i= E X i p = 0, (2) (X i EX i ) p 0. UW-Madiso (Statistics) Stat 709 Lecture / 5
2 Remarks Note that () implies (2) (Lemma.6). The result i Theorem.4(i) is called Kolmogorov s SLLN whe p = 2 ad is due to Marcikiewicz ad Zygmud whe p < 2. A obvious sufficiet coditio for () with p (,2] is sup E X p <. The WLLN ad SLLN have may applicatios i probability ad statistics. Example.32 Let f ad g be cotiuous fuctios o [0,] satisfyig 0 f (x) Cg(x) for all x, where C > 0 is a costat. We ow show that lim 0 0 i= f (x i) 0 i= g(x i) dx dx 2 dx = 0 f (x)dx 0 g(x)dx (3) (assumig that 0 g(x)dx 0). UW-Madiso (Statistics) Stat 709 Lecture / 5
3 Example.32 (cotiued) X,X 2,... be i.i.d. radom variables havig the uiform distributio o [0,]. By Theorem.2, E[f (X )] = f (x)dx <, E[g(X )] = g(x)dx <. 0 0 By the SLLN (Theorem.3(ii)), i= By Theorem.0(i), f (X i ) a.s. E[f (X )], i= f (X i) i= g(x i) a.s. i= g(x i ) a.s. E[g(X )], E[f (X )] E[g(X )]. (4) Sice the radom variable o the left-had side of (4) is bouded by C, result (3) follows from the domiated covergece theorem ad the fact that the left-had side of (3) is the expectatio of the radom variable o the left-had side of (4). UW-Madiso (Statistics) Stat 709 Lecture / 5
4 Example Let T = i= X i, where X s are idepedet radom variables satisfyig P(X = ± θ ) = 0.5 ad θ > 0 is a costat. We wat to show that T / a.s. 0 whe θ < 0.5. For θ < 0.5, EX 2 = 2 = = 2θ 2 <. By the Kolmogorov strog law of large umbers, T / a.s. 0. Example (Exercise 65) Let X,X 2,... be idepedet radom variables. Suppose that (X j EX j ) d N(0,), σ where σ 2 = var( X j). UW-Madiso (Statistics) Stat 709 Lecture / 5
5 Example (Exercise 65) We wat to show that (X j EX j ) p 0 iff σ / 0. If σ / 0, the by Slutsky s theorem, (X j EX j ) = σ σ (X j EX j ) d 0. Assume ow σ / does ot coverge to 0 but (X j EX j ) p 0. Without loss of geerality, assume that σ / c (0, ]. By Slutsky s theorem, σ (X j EX j ) = σ (X j EX j ) p 0. This cotradicts the fact that (X j EX j )/σ d N(0,). Hece, (X j EX j ) does ot coverge to 0 i probability. UW-Madiso (Statistics) Stat 709 Lecture / 5
6 The cetral limit theorem The WLLN ad SLLN may ot be useful i approximatig the distributios of (ormalized) sums of idepedet radom variables. We eed to use the cetral limit theorem (CLT), which plays a fudametal role i statistical asymptotic theory. Theorem.5 (Lideberg s CLT) Let {X j,j =,...,k } be idepedet radom variables with k as ad If the σ 2 k 0 < σ 2 = var ( k ) X j <, =,2,..., [ ] E (X j EX j ) 2 I { Xj EX j >εσ } 0 for ay ε > 0, (5) k σ (X j EX j ) d N(0,). UW-Madiso (Statistics) Stat 709 Lecture / 5
7 Proof Cosiderig (X j EX j )/σ, without loss of geerality we may assume EX j = 0 ad σ 2 = i this proof. Let t R be give. From the iequality e tx ( + tx t 2 x 2 /2) mi{ tx 2, tx 3 }, the ch.f. of X j satisfies φ X j (t) ( t 2 σ 2 j /2 ) E ( ) mi{ tx j 2, tx j 3 }, where σ 2 j = var(x j ). For ay ε > 0, the right-had side of the previous expressio is bouded by E( tx j 3 I { Xj <ε}) + E( tx j 2 I { Xj ε}), which is bouded by ε t 3 σ 2 j + t2 E(X 2 j I { X j ε}). UW-Madiso (Statistics) Stat 709 Lecture / 5
8 Proof (cotiued) Summig over j ad usig σ 2 =, we obtai that k ( ) φ X j (t) t 2 σj 2 /2 k {ε t 3 σj 2 + t2 E(Xj 2 I { X j ε})} = ε t 3 + t 2 k by coditio (5). Also by coditio (5) ad σ 2 =, σj 2 max j k σ 2 Sice ε > 0 is arbitrary ad t is fixed, ad k E(X 2 j I { X j ε}) ε t 3 ε 2 + max j k E(X 2 j I { X j >ε}) ε 2 φ X j (t) ( t 2 σ 2 j /2 ) 0 lim max σj 2 j k σ 2 = 0. (6) UW-Madiso (Statistics) Stat 709 Lecture / 5
9 Proof (cotiued) This implies that t 2 σ 2 j are all betwee 0 ad for large eough. Usig the iequality a a m b b m m a j b j for ay complex umbers a j s ad b j s with a j ad b j, j =,...,m, we obtai that k e t2 σj 2 /2 k ( ) t 2 σj 2 /2 k ( ) σ 2 e t2 j /2 t 2 σj 2 /2, which is bouded by t 4 k σ 4 j t 4 max j k σ 2 j 0, sice e x x x 2 /2 if x 2 ad k σ 2 j = σ 2 =. UW-Madiso (Statistics) Stat 709 Lecture / 5
10 Proof (cotiued) The k φ Xj (t) k e t2 σ 2 j /2 k k + 0 φ X j (t) e t2 σ j 2 /2 ( ) φ X j (t) t 2 σj 2 /2 k ( ) σ 2 e t2 j /2 t 2 σj 2 /2 as previously show. Thus, k φ Xj (t) = k e t2 σ 2 j /2 + o() = e t2 /2 + o() i.e., the ch.f. of k X j coverges to the ch.f. of N(0,) for every t. By Theorem.9(ii), the result follows. UW-Madiso (Statistics) Stat 709 Lecture / 5
11 Remarks Coditio (5) is called Lideberg s coditio. From the proof, Lideberg s coditio implies (6), which is called Feller s coditio. Feller s coditio (6) meas that all terms i the sum σ 2 = k σ 2 j are uiformly egligible as. If Feller s coditio is assumed, the Lideberg s coditio is ot oly sufficiet but also ecessary for the result i Theorem.5, which is the well-kow Lideberg-Feller CLT. A proof ca be foud i Billigsley (995, pp ). Note that either Lideberg s coditio or Feller s coditio is ecessary for the result i Theorem.5 (Exercise 58). Liapouov s coditio A sufficiet coditio for Lideberg s coditio is the followig Liapouov s coditio, which is somewhat easier to verify: k E X j EX j 2+δ 0 for some δ > 0. (7) σ 2+δ UW-Madiso (Statistics) Stat 709 Lecture / 5
12 Example.33 Let X,X 2,... be idepedet radom variables. Suppose that X i has the biomial distributio Bi(p i,), i =,2,..., ad that σ 2 = i= var(x i) = i= p i( p i ) as. For each i, EX i = p i ad E X i EX i 3 = ( p i ) 3 p i + p 3 i ( p i) 2p i ( p i ). Hece i= E X i EX i 3 2σ 2, i.e., Liapouov s coditio (7) holds with δ =. Thus, by Theorem.5, σ i= (X i p i ) d N(0,). (8) It ca be show (exercise) that the coditio σ is also ecessary for result (8). The followig are useful corollaries of Theorem.5 ad Theorem.9(iii). UW-Madiso (Statistics) Stat 709 Lecture / 5
13 Corollary.2 (Multivariate CLT) For i.i.d. radom k-vectors X,...,X with a fiite Σ = var(x ), Corollary.3 (X i EX ) d N k (0,Σ). i= Let X i R m i, i =,...,k, be idepedet radom vectors with m i m (a fixed iteger), =,2,..., k as, ad if i, λ [var(x i )] > 0, where λ [A] is the smallest eigevalue of A. Let c i R m i be vectors such that ( lim max c i 2 i k / k ) c i 2 = 0. i= (i) If sup i, E X i 2+δ < for some δ > 0, the k / [ /2 ci τ k (X i EX i ) var(ci i)] τ X d N(0,). (9) i= i= (ii) If wheever m i =m j, i <j k, =,2,..., X i ad X j have the same distributio with E X i 2 <, the (9) holds. UW-Madiso (Statistics) Stat 709 Lecture / 5
14 Remarks Provig Corollary.3 is a good exercise. Applicatios of these corollaries ca be foud i later chapters. More results o the CLT ca be foud, for example, i Serflig (980) ad Shorack ad Weller (986). More o Pólya s theorem Let Y be a sequece of radom variables, {µ } ad {σ } be sequeces of real umbers such that σ > 0 for all, ad The, by Propositio.6, (Y µ )/σ d N(0,). lim sup F (Y µ )/σ (x) Φ(x) = 0, (0) x where Φ is the c.d.f. of N(0,). UW-Madiso (Statistics) Stat 709 Lecture / 5
15 Asymptotic ormality (0) implies that for ay sequece of real umbers {c }, lim P(Y c ) Φ ( c µ ) = 0, σ i.e., P(Y c ) ca be approximated by Φ ( c µ ) σ, regardless of whether {c } has a limit. Sice Φ ( t µ ) σ is the c.d.f. of N(µ,σ 2 ), Y is said to be asymptotically distributed as N(µ,σ 2 ) or simply asymptotically ormal. Examples For example, k i= cτ i X i i Corollary.3 is asymptotically ormal. This ca be exteded to radom vectors. For example, i= X i i Corollary.2 is asymptotically distributed as N k (EX,Σ). UW-Madiso (Statistics) Stat 709 Lecture / 5
Sequences and Series
Sequeces ad Series Matt Rosezweig Cotets Sequeces ad Series. Sequeces.................................................. Series....................................................3 Rudi Chapter 3 Exercises........................................
More information5. Best Unbiased Estimators
Best Ubiased Estimators http://www.math.uah.edu/stat/poit/ubiased.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 5. Best Ubiased Estimators Basic Theory Cosider agai
More informationAsymptotics: Consistency and Delta Method
ad Delta Method MIT 18.655 Dr. Kempthore Sprig 2016 1 MIT 18.655 ad Delta Method Outlie Asymptotics 1 Asymptotics 2 MIT 18.655 ad Delta Method Cosistecy Asymptotics Statistical Estimatio Problem X 1,...,
More information14.30 Introduction to Statistical Methods in Economics Spring 2009
MIT OpeCourseWare http://ocwmitedu 430 Itroductio to Statistical Methods i Ecoomics Sprig 009 For iformatio about citig these materials or our Terms of Use, visit: http://ocwmitedu/terms 430 Itroductio
More informationx satisfying all regularity conditions. Then
AMS570.01 Practice Midterm Exam Sprig, 018 Name: ID: Sigature: Istructio: This is a close book exam. You are allowed oe-page 8x11 formula sheet (-sided). No cellphoe or calculator or computer is allowed.
More informationRafa l Kulik and Marc Raimondo. University of Ottawa and University of Sydney. Supplementary material
Statistica Siica 009: Supplemet 1 L p -WAVELET REGRESSION WITH CORRELATED ERRORS AND INVERSE PROBLEMS Rafa l Kulik ad Marc Raimodo Uiversity of Ottawa ad Uiversity of Sydey Supplemetary material This ote
More informationSummary. Recap. Last Lecture. .1 If you know MLE of θ, can you also know MLE of τ(θ) for any function τ?
Last Lecture Biostatistics 60 - Statistical Iferece Lecture Cramer-Rao Theorem Hyu Mi Kag February 9th, 03 If you kow MLE of, ca you also kow MLE of τ() for ay fuctio τ? What are plausible ways to compare
More informationIntroduction to Probability and Statistics Chapter 7
Itroductio to Probability ad Statistics Chapter 7 Ammar M. Sarha, asarha@mathstat.dal.ca Departmet of Mathematics ad Statistics, Dalhousie Uiversity Fall Semester 008 Chapter 7 Statistical Itervals Based
More informationSELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION
1 SELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION Hyue-Ju Kim 1,, Bibig Yu 2, ad Eric J. Feuer 3 1 Syracuse Uiversity, 2 Natioal Istitute of Agig, ad 3 Natioal Cacer Istitute Supplemetary
More information0.1 Valuation Formula:
0. Valuatio Formula: 0.. Case of Geeral Trees: q = er S S S 3 S q = er S S 4 S 5 S 4 q 3 = er S 3 S 6 S 7 S 6 Therefore, f (3) = e r [q 3 f (7) + ( q 3 ) f (6)] f () = e r [q f (5) + ( q ) f (4)] = f ()
More informationChapter 10 - Lecture 2 The independent two sample t-test and. confidence interval
Assumptios Idepedet Samples - ukow σ 1, σ - 30 or m 30 - Upooled case Idepedet Samples - ukow σ 1, σ - 30 or m 30 - Pooled case Idepedet samples - Pooled variace - Large samples Chapter 10 - Lecture The
More information1 Estimating sensitivities
Copyright c 27 by Karl Sigma 1 Estimatig sesitivities Whe estimatig the Greeks, such as the, the geeral problem ivolves a radom variable Y = Y (α) (such as a discouted payoff) that depeds o a parameter
More informationLecture 5 Point Es/mator and Sampling Distribu/on
Lecture 5 Poit Es/mator ad Samplig Distribu/o Fall 03 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech Road map Poit Es/ma/o Cofidece Iterval
More informationThe Limit of a Sequence (Brief Summary) 1
The Limit of a Sequece (Brief Summary). Defiitio. A real umber L is a it of a sequece of real umbers if every ope iterval cotaiig L cotais all but a fiite umber of terms of the sequece. 2. Claim. A sequece
More informationBinomial Model. Stock Price Dynamics. The Key Idea Riskless Hedge
Biomial Model Stock Price Dyamics The value of a optio at maturity depeds o the price of the uderlyig stock at maturity. The value of the optio today depeds o the expected value of the optio at maturity
More informationSTAT 135 Solutions to Homework 3: 30 points
STAT 35 Solutios to Homework 3: 30 poits Sprig 205 The objective of this Problem Set is to study the Stei Pheomeo 955. Suppose that θ θ, θ 2,..., θ cosists of ukow parameters, with 3. We wish to estimate
More information11.7 (TAYLOR SERIES) NAME: SOLUTIONS 31 July 2018
.7 (TAYLOR SERIES NAME: SOLUTIONS 3 July 08 TAYLOR SERIES ( The power series T(x f ( (c (x c is called the Taylor Series for f(x cetered at x c. If c 0, this is called a Maclauri series. ( The N-th partial
More informationProbability and statistics
4 Probability ad statistics Basic deitios Statistics is a mathematical disciplie that allows us to uderstad pheomea shaped by may evets that we caot keep track of. Sice we miss iformatio to predict the
More informationFourier Transform in L p (R) Spaces, p 1
Ge. Math. Notes, Vol. 3, No., March 20, pp.4-25 ISSN 229-784; Copyright c ICSS Publicatio, 200 www.i-csrs.org Available free olie at http://www.gema.i Fourier Trasform i L p () Spaces, p Devedra Kumar
More informationEXERCISE - BINOMIAL THEOREM
BINOMIAL THOEREM / EXERCISE - BINOMIAL THEOREM LEVEL I SUBJECTIVE QUESTIONS. Expad the followig expressios ad fid the umber of term i the expasio of the expressios. (a) (x + y) 99 (b) ( + a) 9 + ( a) 9
More informationSection Mathematical Induction and Section Strong Induction and Well-Ordering
Sectio 4.1 - Mathematical Iductio ad Sectio 4. - Strog Iductio ad Well-Orderig A very special rule of iferece! Defiitio: A set S is well ordered if every subset has a least elemet. Note: [0, 1] is ot well
More informationLecture 4: Parameter Estimation and Confidence Intervals. GENOME 560 Doug Fowler, GS
Lecture 4: Parameter Estimatio ad Cofidece Itervals GENOME 560 Doug Fowler, GS (dfowler@uw.edu) 1 Review: Probability Distributios Discrete: Biomial distributio Hypergeometric distributio Poisso distributio
More informationParametric Density Estimation: Maximum Likelihood Estimation
Parametric Desity stimatio: Maimum Likelihood stimatio C6 Today Itroductio to desity estimatio Maimum Likelihood stimatio Itroducto Bayesia Decisio Theory i previous lectures tells us how to desig a optimal
More informationSolutions to Problem Sheet 1
Solutios to Problem Sheet ) Use Theorem.4 to prove that p log for all real x 3. This is a versio of Theorem.4 with the iteger N replaced by the real x. Hit Give x 3 let N = [x], the largest iteger x. The,
More information. (The calculated sample mean is symbolized by x.)
Stat 40, sectio 5.4 The Cetral Limit Theorem otes by Tim Pilachowski If you have t doe it yet, go to the Stat 40 page ad dowload the hadout 5.4 supplemet Cetral Limit Theorem. The homework (both practice
More informationSampling Distributions and Estimation
Samplig Distributios ad Estimatio T O P I C # Populatio Proportios, π π the proportio of the populatio havig some characteristic Sample proportio ( p ) provides a estimate of π : x p umber of successes
More informationUnbiased estimators Estimators
19 Ubiased estimators I Chapter 17 we saw that a dataset ca be modeled as a realizatio of a radom sample from a probability distributio ad that quatities of iterest correspod to features of the model distributio.
More information1 The Black-Scholes model
The Blac-Scholes model. The model setup I the simplest versio of the Blac-Scholes model the are two assets: a ris-less asset ba accout or bod)withpriceprocessbt) at timet, adarisyasset stoc) withpriceprocess
More informationNotes on Expected Revenue from Auctions
Notes o Epected Reveue from Auctios Professor Bergstrom These otes spell out some of the mathematical details about first ad secod price sealed bid auctios that were discussed i Thursday s lecture You
More informationExam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011
15.075 Exam 2 Istructor: Cythia Rudi TA: Dimitrios Bisias October 25, 2011 Gradig is based o demostratio of coceptual uderstadig, so you eed to show all of your work. Problem 1 You are i charge of a study
More informationLecture 5: Sampling Distribution
Lecture 5: Samplig Distributio Readigs: Sectios 5.5, 5.6 Itroductio Parameter: describes populatio Statistic: describes the sample; samplig variability Samplig distributio of a statistic: A probability
More informationOnline appendices from Counterparty Risk and Credit Value Adjustment a continuing challenge for global financial markets by Jon Gregory
Olie appedices from Couterparty Risk ad Credit Value Adjustmet a APPENDIX 8A: Formulas for EE, PFE ad EPE for a ormal distributio Cosider a ormal distributio with mea (expected future value) ad stadard
More informationA New Constructive Proof of Graham's Theorem and More New Classes of Functionally Complete Functions
A New Costructive Proof of Graham's Theorem ad More New Classes of Fuctioally Complete Fuctios Azhou Yag, Ph.D. Zhu-qi Lu, Ph.D. Abstract A -valued two-variable truth fuctio is called fuctioally complete,
More informationResearch Paper Number From Discrete to Continuous Time Finance: Weak Convergence of the Financial Gain Process
Research Paper Number 197 From Discrete to Cotiuous Time Fiace: Weak Covergece of the Fiacial Gai Process Darrell Duffie ad Philip Protter November, 1988 Revised: September, 1991 Forthcomig: Mathematical
More informationMath 312, Intro. to Real Analysis: Homework #4 Solutions
Math 3, Itro. to Real Aalysis: Homework #4 Solutios Stephe G. Simpso Moday, March, 009 The assigmet cosists of Exercises 0.6, 0.8, 0.0,.,.3,.6,.0,.,. i the Ross textbook. Each problem couts 0 poits. 0.6.
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 2
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 2 (This versio August 7, 204) Stock/Watso - Itroductio to
More information5 Statistical Inference
5 Statistical Iferece 5.1 Trasitio from Probability Theory to Statistical Iferece 1. We have ow more or less fiished the probability sectio of the course - we ow tur attetio to statistical iferece. I statistical
More informationExam 1 Spring 2015 Statistics for Applications 3/5/2015
8.443 Exam Sprig 05 Statistics for Applicatios 3/5/05. Log Normal Distributio: A radom variable X follows a Logormal(θ, σ ) distributio if l(x) follows a Normal(θ, σ ) distributio. For the ormal radom
More informationSampling Distributions and Estimation
Cotets 40 Samplig Distributios ad Estimatio 40.1 Samplig Distributios 40. Iterval Estimatio for the Variace 13 Learig outcomes You will lear about the distributios which are created whe a populatio is
More informationpoint estimator a random variable (like P or X) whose values are used to estimate a population parameter
Estimatio We have oted that the pollig problem which attempts to estimate the proportio p of Successes i some populatio ad the measuremet problem which attempts to estimate the mea value µ of some quatity
More informationConfidence Intervals. CI for a population mean (σ is known and n > 30 or the variable is normally distributed in the.
Cofidece Itervals A cofidece iterval is a iterval whose purpose is to estimate a parameter (a umber that could, i theory, be calculated from the populatio, if measuremets were available for the whole populatio).
More informationStatistics for Economics & Business
Statistics for Ecoomics & Busiess Cofidece Iterval Estimatio Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for the mea ad the proportio How to determie
More informationEVEN NUMBERED EXERCISES IN CHAPTER 4
Joh Riley 7 July EVEN NUMBERED EXERCISES IN CHAPTER 4 SECTION 4 Exercise 4-: Cost Fuctio of a Cobb-Douglas firm What is the cost fuctio of a firm with a Cobb-Douglas productio fuctio? Rather tha miimie
More informationST 305: Exam 2 Fall 2014
ST 305: Exam Fall 014 By hadig i this completed exam, I state that I have either give or received assistace from aother perso durig the exam period. I have used o resources other tha the exam itself ad
More information1. Suppose X is a variable that follows the normal distribution with known standard deviation σ = 0.3 but unknown mean µ.
Chapter 9 Exercises Suppose X is a variable that follows the ormal distributio with kow stadard deviatio σ = 03 but ukow mea µ (a) Costruct a 95% cofidece iterval for µ if a radom sample of = 6 observatios
More informationMonetary Economics: Problem Set #5 Solutions
Moetary Ecoomics oblem Set #5 Moetary Ecoomics: oblem Set #5 Solutios This problem set is marked out of 1 poits. The weight give to each part is idicated below. Please cotact me asap if you have ay questios.
More informationSupplemental notes for topic 9: April 4, 6
Sta-30: Probablty Sprg 017 Supplemetal otes for topc 9: Aprl 4, 6 9.1 Polyomal equaltes Theorem (Jese. If φ s a covex fucto the φ(ex Eφ(x. Theorem (Beaymé-Chebyshev. For ay radom varable x, ɛ > 0 P( x
More information4.5 Generalized likelihood ratio test
4.5 Geeralized likelihood ratio test A assumptio that is used i the Athlete Biological Passport is that haemoglobi varies equally i all athletes. We wish to test this assumptio o a sample of k athletes.
More informationASYMPTOTIC MEAN SQUARE ERRORS OF VARIANCE ESTIMATORS FOR U-STATISTICS AND THEIR EDGEWORTH EXPANSIONS
J. Japa Statist. Soc. Vol. 8 No. 1 1998 1 19 ASYMPTOTIC MEAN SQUARE ERRORS OF VARIANCE ESTIMATORS FOR U-STATISTICS AND THEIR EDGEWORTH EXPANSIONS Yoshihiko Maesoo* This paper studies variace estimators
More informationSTAT/MATH 395 PROBABILITY II
STAT/MATH 395 PROBABILITY II Distribution of Random Samples & Limit Theorems Néhémy Lim University of Washington Winter 2017 Outline Distribution of i.i.d. Samples Convergence of random variables The Laws
More informationChpt 5. Discrete Probability Distributions. 5-3 Mean, Variance, Standard Deviation, and Expectation
Chpt 5 Discrete Probability Distributios 5-3 Mea, Variace, Stadard Deviatio, ad Expectatio 1/23 Homework p252 Applyig the Cocepts Exercises p253 1-19 2/23 Objective Fid the mea, variace, stadard deviatio,
More informationLecture 4: Probability (continued)
Lecture 4: Probability (cotiued) Desity Curves We ve defied probabilities for discrete variables (such as coi tossig). Probabilities for cotiuous or measuremet variables also are evaluated usig relative
More informationCombining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010
Combiig imperfect data, ad a itroductio to data assimilatio Ross Baister, NCEO, September 00 rbaister@readigacuk The probability desity fuctio (PDF prob that x lies betwee x ad x + dx p (x restrictio o
More informationSampling Distributions & Estimators
API-209 TF Sessio 2 Teddy Svoroos September 18, 2015 Samplig Distributios & Estimators I. Estimators The Importace of Samplig Radomly Three Properties of Estimators 1. Ubiased 2. Cosistet 3. Efficiet I
More information18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013
18.S096 Problem Set 5 Fall 2013 Volatility Modelig Due Date: 10/29/2013 1. Sample Estimators of Diffusio Process Volatility ad Drift Let {X t } be the price of a fiacial security that follows a geometric
More informationMaximum Empirical Likelihood Estimation (MELE)
Maximum Empirical Likelihood Estimatio (MELE Natha Smooha Abstract Estimatio of Stadard Liear Model - Maximum Empirical Likelihood Estimator: Combiatio of the idea of imum likelihood method of momets,
More informationBayes Estimator for Coefficient of Variation and Inverse Coefficient of Variation for the Normal Distribution
Iteratioal Joural of Statistics ad Systems ISSN 0973-675 Volume, Number 4 (07, pp. 7-73 Research Idia Publicatios http://www.ripublicatio.com Bayes Estimator for Coefficiet of Variatio ad Iverse Coefficiet
More informationA random variable is a variable whose value is a numerical outcome of a random phenomenon.
The Practice of Statistics, d ed ates, Moore, ad Stares Itroductio We are ofte more iterested i the umber of times a give outcome ca occur tha i the possible outcomes themselves For example, if we toss
More informationDiener and Diener and Walsh follow as special cases. In addition, by making. smooth, as numerically observed by Tian. Moreover, we propose the center
Smooth Covergece i the Biomial Model Lo-Bi Chag ad Ke Palmer Departmet of Mathematics, Natioal Taiwa Uiversity Abstract Various authors have studied the covergece of the biomial optio price to the Black-Scholes
More information1 Random Variables and Key Statistics
Review of Statistics 1 Radom Variables ad Key Statistics Radom Variable: A radom variable is a variable that takes o differet umerical values from a sample space determied by chace (probability distributio,
More informationTopic 14: Maximum Likelihood Estimation
Toic 4: November, 009 As before, we begi with a samle X = (X,, X of radom variables chose accordig to oe of a family of robabilities P θ I additio, f(x θ, x = (x,, x will be used to deote the desity fuctio
More informationFINM6900 Finance Theory How Is Asymmetric Information Reflected in Asset Prices?
FINM6900 Fiace Theory How Is Asymmetric Iformatio Reflected i Asset Prices? February 3, 2012 Referece S. Grossma, O the Efficiecy of Competitive Stock Markets where Traders Have Diverse iformatio, Joural
More informationCHAPTER 8 Estimating with Confidence
CHAPTER 8 Estimatig with Cofidece 8.2 Estimatig a Populatio Proportio The Practice of Statistics, 5th Editio Stares, Tabor, Yates, Moore Bedford Freema Worth Publishers Estimatig a Populatio Proportio
More informationToday: Finish Chapter 9 (Sections 9.6 to 9.8 and 9.9 Lesson 3)
Today: Fiish Chapter 9 (Sectios 9.6 to 9.8 ad 9.9 Lesso 3) ANNOUNCEMENTS: Quiz #7 begis after class today, eds Moday at 3pm. Quiz #8 will begi ext Friday ad ed at 10am Moday (day of fial). There will be
More informationChapter 13 Binomial Trees. Options, Futures, and Other Derivatives, 9th Edition, Copyright John C. Hull
Chapter 13 Biomial Trees 1 A Simple Biomial Model! A stock price is curretly $20! I 3 moths it will be either $22 or $18 Stock price $20 Stock Price $22 Stock Price $18 2 A Call Optio (Figure 13.1, page
More informationInferential Statistics and Probability a Holistic Approach. Inference Process. Inference Process. Chapter 8 Slides. Maurice Geraghty,
Iferetial Statistics ad Probability a Holistic Approach Chapter 8 Poit Estimatio ad Cofidece Itervals This Course Material by Maurice Geraghty is licesed uder a Creative Commos Attributio-ShareAlike 4.0
More informationOutline. Populations. Defs: A (finite) population is a (finite) set P of elements e. A variable is a function v : P IR. Population and Characteristics
Outlie Populatio Characteristics Types of Samples Sample Characterstics Sample Aalogue Estimatio Populatios Defs: A (fiite) populatio is a (fiite) set P of elemets e. A variable is a fuctio v : P IR. Examples
More informationThe material in this chapter is motivated by Experiment 9.
Chapter 5 Optimal Auctios The material i this chapter is motivated by Experimet 9. We wish to aalyze the decisio of a seller who sets a reserve price whe auctioig off a item to a group of bidders. We begi
More informationChapter 8 Interval Estimation. Estimation Concepts. General Form of a Confidence Interval
Chapter 8 Iterval Estimatio Estimatio Cocepts Usually ca't take a cesus, so we must make decisios based o sample data It imperative that we take the risk of samplig error ito accout whe we iterpret sample
More informationChapter 8. Confidence Interval Estimation. Copyright 2015, 2012, 2009 Pearson Education, Inc. Chapter 8, Slide 1
Chapter 8 Cofidece Iterval Estimatio Copyright 2015, 2012, 2009 Pearso Educatio, Ic. Chapter 8, Slide 1 Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for
More informationAMS Portfolio Theory and Capital Markets
AMS 69.0 - Portfolio Theory ad Capital Markets I Class 6 - Asset yamics Robert J. Frey Research Professor Stoy Brook iversity, Applied Mathematics ad Statistics frey@ams.suysb.edu http://www.ams.suysb.edu/~frey/
More informationResearch Article The Probability That a Measurement Falls within a Range of n Standard Deviations from an Estimate of the Mean
Iteratioal Scholarly Research Network ISRN Applied Mathematics Volume 0, Article ID 70806, 8 pages doi:0.540/0/70806 Research Article The Probability That a Measuremet Falls withi a Rage of Stadard Deviatios
More informationB = A x z
114 Block 3 Erdeky == Begi 6.3 ============================================================== 1 / 8 / 2008 1 Correspodig Areas uder a ormal curve ad the stadard ormal curve are equal. Below: Area B = Area
More informationQuantitative Analysis
EduPristie www.edupristie.com Modellig Mea Variace Skewess Kurtosis Mea: X i = i Mode: Value that occurs most frequetly Media: Midpoit of data arraged i ascedig/ descedig order s Avg. of squared deviatios
More informationStandard Deviations for Normal Sampling Distributions are: For proportions For means _
Sectio 9.2 Cofidece Itervals for Proportios We will lear to use a sample to say somethig about the world at large. This process (statistical iferece) is based o our uderstadig of samplig models, ad will
More informationBOUNDS FOR TAIL PROBABILITIES OF MARTINGALES USING SKEWNESS AND KURTOSIS. January 2008
BOUNDS FOR TAIL PROBABILITIES OF MARTINGALES USING SKEWNESS AND KURTOSIS V. Betkus 1,2 ad T. Juškevičius 1 Jauary 2008 Abstract. Let M = X 1 + + X be a sum of idepedet radom variables such that X k 1,
More informationA point estimate is the value of a statistic that estimates the value of a parameter.
Chapter 9 Estimatig the Value of a Parameter Chapter 9.1 Estimatig a Populatio Proportio Objective A : Poit Estimate A poit estimate is the value of a statistic that estimates the value of a parameter.
More informationFOUNDATION ACTED COURSE (FAC)
FOUNDATION ACTED COURSE (FAC) What is the Foudatio ActEd Course (FAC)? FAC is desiged to help studets improve their mathematical skills i preparatio for the Core Techical subjects. It is a referece documet
More information= α e ; x 0. Such a random variable is said to have an exponential distribution, with parameter α. [Here, view X as time-to-failure.
1 Homewor 1 AERE 573 Fall 018 DUE 8/9 (W) Name ***NOTE: A wor MUST be placed directly beeath the associated part of a give problem.*** PROBEM 1. (5pts) [Boo 3 rd ed. 1.1 / 4 th ed. 1.13] et ~Uiform[0,].
More informationConfidence Intervals Introduction
Cofidece Itervals Itroductio A poit estimate provides o iformatio about the precisio ad reliability of estimatio. For example, the sample mea X is a poit estimate of the populatio mea μ but because of
More informationCHAPTER 2 PRICING OF BONDS
CHAPTER 2 PRICING OF BONDS CHAPTER SUARY This chapter will focus o the time value of moey ad how to calculate the price of a bod. Whe pricig a bod it is ecessary to estimate the expected cash flows ad
More informationQuantitative Analysis
EduPristie FRM I \ Quatitative Aalysis EduPristie www.edupristie.com Momets distributio Samplig Testig Correlatio & Regressio Estimatio Simulatio Modellig EduPristie FRM I \ Quatitative Aalysis 2 Momets
More informationTopic-7. Large Sample Estimation
Topic-7 Large Sample Estimatio TYPES OF INFERENCE Ò Estimatio: É Estimatig or predictig the value of the parameter É What is (are) the most likely values of m or p? Ò Hypothesis Testig: É Decidig about
More informationBasic formula for confidence intervals. Formulas for estimating population variance Normal Uniform Proportion
Basic formula for the Chi-square test (Observed - Expected ) Expected Basic formula for cofidece itervals sˆ x ± Z ' Sample size adjustmet for fiite populatio (N * ) (N + - 1) Formulas for estimatig populatio
More informationINTERVAL GAMES. and player 2 selects 1, then player 2 would give player 1 a payoff of, 1) = 0.
INTERVAL GAMES ANTHONY MENDES Let I ad I 2 be itervals of real umbers. A iterval game is played i this way: player secretly selects x I ad player 2 secretly ad idepedetly selects y I 2. After x ad y are
More informationEstimating Proportions with Confidence
Aoucemets: Discussio today is review for midterm, o credit. You may atted more tha oe discussio sectio. Brig sheets of otes ad calculator to midterm. We will provide Scatro form. Homework: (Due Wed Chapter
More information1 Basic Growth Models
UCLA Aderso MGMT37B: Fudametals i Fiace Fall 015) Week #1 rofessor Eduardo Schwartz November 9, 015 Hadout writte by Sheje Hshieh 1 Basic Growth Models 1.1 Cotiuous Compoudig roof: lim 1 + i m = expi)
More informationSCHOOL OF ACCOUNTING AND BUSINESS BSc. (APPLIED ACCOUNTING) GENERAL / SPECIAL DEGREE PROGRAMME
All Right Reserved No. of Pages - 10 No of Questios - 08 SCHOOL OF ACCOUNTING AND BUSINESS BSc. (APPLIED ACCOUNTING) GENERAL / SPECIAL DEGREE PROGRAMME YEAR I SEMESTER I (Group B) END SEMESTER EXAMINATION
More informationBASIC STATISTICS ECOE 1323
BASIC STATISTICS ECOE 33 SPRING 007 FINAL EXAM NAME: ID NUMBER: INSTRUCTIONS:. Write your ame ad studet ID.. You have hours 3. This eam must be your ow work etirely. You caot talk to or share iformatio
More informationMonopoly vs. Competition in Light of Extraction Norms. Abstract
Moopoly vs. Competitio i Light of Extractio Norms By Arkadi Koziashvili, Shmuel Nitza ad Yossef Tobol Abstract This ote demostrates that whether the market is competitive or moopolistic eed ot be the result
More informationSimulation Efficiency and an Introduction to Variance Reduction Methods
Mote Carlo Simulatio: IEOR E4703 Columbia Uiversity c 2017 by Marti Haugh Simulatio Efficiecy ad a Itroductio to Variace Reductio Methods I these otes we discuss the efficiecy of a Mote-Carlo estimator.
More informationValuation of options on discretely sampled variance: A general analytic approximation
Valuatio of optios o discretely sampled variace: A geeral aalytic approximatio Gabriel Drimus Walter Farkas, Elise Gourier 3 Previous versio: Jauary 3 This versio: July 4 Abstract The values of optios
More informationDiscriminating Between The Log-normal and Gamma Distributions
Discrimiatig Betwee The Log-ormal ad Gamma Distributios Debasis Kudu & Aubhav Maglick Abstract For a give data set the problem of selectig either log-ormal or gamma distributio with ukow shape ad scale
More information. The firm makes different types of furniture. Let x ( x1,..., x n. If the firm produces nothing it rents out the entire space and so has a profit of
Joh Riley F Maimizatio with a sigle costrait F3 The Ecoomic approach - - shadow prices Suppose that a firm has a log term retal of uits of factory space The firm ca ret additioal space at a retal rate
More informationGenerative Models, Maximum Likelihood, Soft Clustering, and Expectation Maximization
Geerative Models Maximum Likelihood Soft Clusterig ad Expectatio Maximizatio Aris Aagostopoulos We will see why we desig models for data how to lear their parameters ad how by cosiderig a mixture model
More informationOnline appendices from The xva Challenge by Jon Gregory. APPENDIX 10A: Exposure and swaption analogy.
APPENDIX 10A: Exposure ad swaptio aalogy. Sorese ad Bollier (1994), effectively calculate the CVA of a swap positio ad show this ca be writte as: CVA swap = LGD V swaptio (t; t i, T) PD(t i 1, t i ). i=1
More informationStrong consistency of nonparametric Bayes density estimation on compact metric spaces
Strog cosistecy of oparametric Bayes desity estimatio o compact metric spaces Abhishek Bhattacharya ad David Duso Departmet of Statistical Sciece, Duke Uiversity duso@stat.duke.edu Abstract. This article
More informationSolution to Tutorial 6
Solutio to Tutorial 6 2012/2013 Semester I MA4264 Game Theory Tutor: Xiag Su October 12, 2012 1 Review Static game of icomplete iformatio The ormal-form represetatio of a -player static Bayesia game: {A
More informationAverage Distance and Vertex-Connectivity
Average Distace ad Vertex-Coectivity Peter Dakelma, Simo Mukwembi, Heda C. Swart School of Mathematical Scieces Uiversity of KwaZulu-Natal, Durba, 4041 South Africa March 17, 013 Abstract The average distace
More informationWe analyze the computational problem of estimating financial risk in a nested simulation. In this approach,
MANAGEMENT SCIENCE Vol. 57, No. 6, Jue 2011, pp. 1172 1194 iss 0025-1909 eiss 1526-5501 11 5706 1172 doi 10.1287/msc.1110.1330 2011 INFORMS Efficiet Risk Estimatio via Nested Sequetial Simulatio Mark Broadie
More information