ECON 5350 Class Notes Maximum Likelihood Estimation
|
|
- Melanie Griffin
- 5 years ago
- Views:
Transcription
1 ECON 5350 Class Notes Maximum Likelihood Estimatio 1 Maximum Likelihood Estimatio Example #1. Cosider the radom sample {X 1 = 0.5, X 2 = 2.0, X 3 = 10.0, X 4 = 1.5, X 5 = 7.0} geerated from a expoetial distributio. What is the maximum likelihood (ML) estimator of β? Aswer. Begi by formig the likelihood fuctio, L(θ): L = f(x 1, x 2, x 3, x 4, x 5 ; β) = 5 f(x i) = 5 1 β exp( x i/β) = 1 β 5 exp( 5 x i/β) where θ = 1/β. It is ofte more coveiet to work with the mootoic trasformatio: l L(θ) = l(θ 5 ) θ(x 1 + x 2 + x 3 + x 4 + x 5 ) = 5 l(θ) 21θ. The ML estimator of θ, ˆθ, is the value of θ that maximizes L(θ) or l L(θ). Now we calculate ˆθ. d l L(θ) dθ = 5 θ 21 = 0 = ˆθ = 5/21 = ˆβ = 4.2. Next, we check the secod-order coditio to esure that ˆθ = 5/21 is ideed a maximum. d 2 l L(θ) dθ 2 = 5θ 2 < 0. Therefore, ˆβ = 4.2 is the maximum likelihood estimator of E(X) = β. Notes: [ ] [ ] 1. The iformatio umber is I(θ) = E 2 l L(θ) = E ( θ 2 θ ) 2. [ ] 2. The iformatio matrix is I(θ) = E 2 l L(θ) θ θ = E (k 1) colum vector. [ ] θ θ where θ = {θ 1,..., θ k } is a 3. The Cramer-Rao lower boud, I(θ) 1, is the lowest value the variace of a ubiased estimator ˆθ ca attai, give certai regularity coditios are satisfied. 1
2 Example #2. Fid the ML estimators for µ ad σ 2 from a ormal distributio. Let X 1,..., X be a radom sample from N(µ, σ 2 ). L(µ, σ 2 ) = [ { (2πσ 2 ) 0.5 exp ( 1 }] 2σ 2 )(x i µ) 2. Takig atural logs: l L(µ, σ 2 ) = 0.5 l(2πσ 2 ) 1 2σ 2 (x i µ) 2. First take partial derivatives with respect to µ ad σ 2 : µ = 1 σ 2 (x i µ); σ 2 2 l L(θ) µ 2 = σ 2 ; 2 l L(θ) µ σ 2 = 1 σ 4 (x i µ); = 2σ σ 4 (x i µ) 2 2 l L(θ) (σ 2 ) 2 = 2σ 4 1 σ 6 (x i µ) 2. Now set first derivatives equal to zero ad solve for the ML estimators: = 1 µ σ 2 (x i µ) = 0 = ˆµ = X σ 2 = 2σ σ 4 (x i µ) 2 = 0 = ˆσ 2 = 1 (x i X) 2. Cramer-Rao Lower Boud θ = (µ, σ 2 ). The iformatio matrix is I(θ) = E 1 σ 2 1 σ 4 (x i µ) σ 4 (x i µ) 2σ 1 4 σ 6 (x i µ) 2 = σ σ 4 ad the CRLB is I(θ) 1 = σ σ 4. Questio. Aswer. Are X, s 2 ad ˆσ 2 effi ciet estimators? Recall, E( X) = µ, E(s 2 ) = σ 2 ad E(ˆσ 2 ) = 1 σ2. var( X) = σ 2 / = X is a miimum variace liear ubiased estimator. var(s 2 ) = 2σ 4 /( 1) = s 2 may or may ot be ubiased effi ciet. ˆσ 2 p σ 2 ad asy.var.(ˆσ 2 ) = 2σ 4 / = ˆσ 2 is asymptotically effi ciet. 2
3 Properties of ML Estimators (uder regularity, Greee p. 515 ). 1. ˆθ ML p θ. 2. ˆθ ML asy N(θ, I 1 (θ)). 3. ˆθ ML achieves the CRLB ad is therefore asymptotically effi ciet. 4. Ivariace (i.e., γ = g(θ) = ˆγ ML = g(ˆθ ML )). Notes: The asymptotic covariace matrix of ˆθ ML is ofte hard or impossible to estimate. Three possible (asymptotically equivalet) estimators are: 1. I 1 (ˆθ ML ), which is ofte ot feasible. 2. ( ) 2 1 l L(ˆθ), which is sometimes quite complicated. ˆθ ˆθ 3. BHHH estimator: ( l f(x i, ˆθ) θ l f(x i, ˆθ) ) 1. ˆθ 2 Likelihood Ratio, Wald ad Lagrage Multiplier Tests The likelihood ratio (LR), Wald (W) ad Lagrage multiplier (LM) tests are asymptotically equivalet tests that may produce differet results i small samples. Whe o other iformatio exists, you ca choose the test that is the easiest to compute. See the attached figure for a graphical represetatio of each test. 2.1 Likelihood Ratio Test Let ˆθ R (ˆθ U ) ad ˆL R (ˆL U ) be the restricted (urestricted) estimate ad likelihood value, respectively. Let the ull ad alterative hypotheses be H 0 : c(θ) = q H 1 : c(θ) q. The likelihood ratio is defied as λ = ˆL R /ˆL U where 0 λ 1. The LR statistic is the LR = 2 l λ asy χ 2 (r) 3
4 where r is the umber of restrictios imposed. 2.2 Wald Test I the LR test, oe eeds to calculate ˆL U ad ˆL R. A advatage of the Wald test is that ˆθ R does ot eed to be calculated. The Wald statistic is W = (c(ˆθ U ) q) var(c(ˆθ U ) q) 1 (c(ˆθ U ) q) asy χ 2 (r). If c(ˆθ) is ormally distributed, the W is a quadratic form i a ormal vector ad is distributed chi-square for all sample sizes. 2.3 Lagrage Multiplier Test This test is based o the restricted model. Derivatio. Begi by formig the Lagragia: l L (θ) = l L(θ) + λ (c(θ) q). The first-order coditios are l L θ l L λ = θ = c(θ) q = 0. + c(θ) θ λ = 0 At ˆθ R, l L(ˆθ R ) ˆθ R = c(ˆθ R ) ˆθ R ˆλ = ĝr. If H 0 : c(θ) = q is correct, ĝ R should be close to zero i large samples. This fact is used as motivatio for LM = ĝ RI 1 (ˆθ R )ĝ R asy χ 2 (r) A Example Usig the LR, W ad LM Tests Cosider a artificial radom sample ( = 100) from a expoetial(β = 0.1) distributio. The log likelihood fuctio is l L(θ) = l(θ) θ x i 4
5 where θ = 1/β. The first-order coditio ad urestricted ML estimator is θ = θ x i = 0 = ˆθ U = X 1. The secod-order coditio is 2 l L(θ) θ 2 = θ 2 < 0 so ˆθ U is ideed a maximum. Now cosider testig the followig hypothesis H 0 : θ = 7.5 H 1 : θ 7.5 so that ˆθ R = Likelihood Ratio Test The likelihood values are ˆL U = ˆL R = ˆθ 100 U exp( ˆθ U x i) ˆθ 100 R exp( ˆθ R x i) ad the LR statistic is LR = 2 l(ˆl R /ˆL U ). 2. Wald Test The Wald statistic is ( where var(ˆθ U ) = Î 1 (ˆθ U ) = 3. Lagrage Multiplier Test The LM statistic is W = (ˆθ U 7.5) 2 var(ˆθ U 7.5) = (ˆθ U 7.5) 2 var(ˆθ U ) 2 l L(ˆθ U ) ˆθ 2 U ) 1 = ˆθ 2 U /. LM = ĝ2 R I(ˆθ R ) where ĝ R = ˆθR x i ad I(ˆθ R ) = /ˆθ 2 R. 5
6 Fially, the critical regio is defied by the chi-square critical value with r = 1 degrees of freedom ad a 95% cofidece level. Usig the chi-square table (iside cover i Greee s text), the critical value is Therefore, If LR, W or LM is greater tha 3.84, we reject the ull H 0 : θ = 7.5 i favor of the alterative. If LR, W or LM is less tha or equal to 3.84, we fail to reject the ull H 0 : θ = Maximum Likelihood Estimatio: Regressio Model with Ω Kow Now cosider effi ciet estimatio via maximum likelihood whe the errors are ormally distributed. The log likelihood fuctio is l L(β, σ 2 Y, X) = 0.5 l(2π) 0.5 l σ 2 Ω 0.5(Y Xβ) (σ 2 Ω) 1 (Y Xβ). (1) Takig derivates of (1) with respect to β ad σ 2 ad settig equal to zero gives l(l) β = 1 σ 2 (X Ω 1 Y X Ω 1 Xβ) = 0 (2) l(l) σ 2 = 0.5 σ σ 4 (Y X β) (Y X β) = 0. (3) Solvig this set of equatios gives ˆβ ML = (X X ) 1 (X Y ) ˆσ 2 ML = e e / so that whe ɛ N(0, σ 2 Ω), the ML estimator is the GLS estimator. 4 Maximum Likelihood Estimatio: Regressio Model with Ω Ukow Cosider maximizatio of (1) by choosig Ω, as well as β ad σ 2. The problem with treatig Ω as a free parameter is that it icludes ( + 1)/2 ukow elemets, while there are oly data poits. This ca 6
7 also be see by takig first-order coditio with respect to Ω, settig equal to zero ad solvig: l(l) Ω 1 = 0.5(Ω 1 σ 2 e e ) = 0, which implies that ˆΩ ML = e e /ˆσ 2 ML, which is a sigular matrix ad caot be used i the GLS formula. The obvious solutio is to parameterize Ω with a smaller umber of parameters θ, i.e., Ω(θ). The we would istead take derivative of l(l) with respect to θ, set equal to zero, ad solve joitly with (2) ad (3). This will be a oliear optimizatio problem, for which the search methods outlied earlier could be applied. Alteratively, a (iterative) two-step procedure, credited to Oberhofer ad Kmeta, is possible. 1. Fid a cosistet estimate of θ ad use it to calculate ˆβ F GLS ad ˆσ 2 F GLS. 2. Reestimate θ usig ˆβ F GLS ad ˆσ 2 F GLS ad the equatio l(l)/ θ = 0. This procedure will be asymptotically effi ciet at step #2 (ad all subsequet iteratios), ad uder fairly iocuous coditios, ca be show to coverge to the ML estimator. Further iteratios of steps #1 ad #2, while providig o asymptotic beefits, may produce better results i smaller samples. 7
8
5. Best Unbiased Estimators
Best Ubiased Estimators http://www.math.uah.edu/stat/poit/ubiased.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 5. Best Ubiased Estimators Basic Theory Cosider agai
More informationTopic 14: Maximum Likelihood Estimation
Toic 4: November, 009 As before, we begi with a samle X = (X,, X of radom variables chose accordig to oe of a family of robabilities P θ I additio, f(x θ, x = (x,, x will be used to deote the desity fuctio
More informationExam 1 Spring 2015 Statistics for Applications 3/5/2015
8.443 Exam Sprig 05 Statistics for Applicatios 3/5/05. Log Normal Distributio: A radom variable X follows a Logormal(θ, σ ) distributio if l(x) follows a Normal(θ, σ ) distributio. For the ormal radom
More informationSTAT 135 Solutions to Homework 3: 30 points
STAT 35 Solutios to Homework 3: 30 poits Sprig 205 The objective of this Problem Set is to study the Stei Pheomeo 955. Suppose that θ θ, θ 2,..., θ cosists of ukow parameters, with 3. We wish to estimate
More information5 Statistical Inference
5 Statistical Iferece 5.1 Trasitio from Probability Theory to Statistical Iferece 1. We have ow more or less fiished the probability sectio of the course - we ow tur attetio to statistical iferece. I statistical
More information14.30 Introduction to Statistical Methods in Economics Spring 2009
MIT OpeCourseWare http://ocwmitedu 430 Itroductio to Statistical Methods i Ecoomics Sprig 009 For iformatio about citig these materials or our Terms of Use, visit: http://ocwmitedu/terms 430 Itroductio
More informationParametric Density Estimation: Maximum Likelihood Estimation
Parametric Desity stimatio: Maimum Likelihood stimatio C6 Today Itroductio to desity estimatio Maimum Likelihood stimatio Itroducto Bayesia Decisio Theory i previous lectures tells us how to desig a optimal
More informationLecture 5 Point Es/mator and Sampling Distribu/on
Lecture 5 Poit Es/mator ad Samplig Distribu/o Fall 03 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech Road map Poit Es/ma/o Cofidece Iterval
More information18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013
18.S096 Problem Set 5 Fall 2013 Volatility Modelig Due Date: 10/29/2013 1. Sample Estimators of Diffusio Process Volatility ad Drift Let {X t } be the price of a fiacial security that follows a geometric
More information4.5 Generalized likelihood ratio test
4.5 Geeralized likelihood ratio test A assumptio that is used i the Athlete Biological Passport is that haemoglobi varies equally i all athletes. We wish to test this assumptio o a sample of k athletes.
More informationx satisfying all regularity conditions. Then
AMS570.01 Practice Midterm Exam Sprig, 018 Name: ID: Sigature: Istructio: This is a close book exam. You are allowed oe-page 8x11 formula sheet (-sided). No cellphoe or calculator or computer is allowed.
More informationCombining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010
Combiig imperfect data, ad a itroductio to data assimilatio Ross Baister, NCEO, September 00 rbaister@readigacuk The probability desity fuctio (PDF prob that x lies betwee x ad x + dx p (x restrictio o
More informationSummary. Recap. Last Lecture. .1 If you know MLE of θ, can you also know MLE of τ(θ) for any function τ?
Last Lecture Biostatistics 60 - Statistical Iferece Lecture Cramer-Rao Theorem Hyu Mi Kag February 9th, 03 If you kow MLE of, ca you also kow MLE of τ() for ay fuctio τ? What are plausible ways to compare
More informationMaximum Empirical Likelihood Estimation (MELE)
Maximum Empirical Likelihood Estimatio (MELE Natha Smooha Abstract Estimatio of Stadard Liear Model - Maximum Empirical Likelihood Estimator: Combiatio of the idea of imum likelihood method of momets,
More informationInferential Statistics and Probability a Holistic Approach. Inference Process. Inference Process. Chapter 8 Slides. Maurice Geraghty,
Iferetial Statistics ad Probability a Holistic Approach Chapter 8 Poit Estimatio ad Cofidece Itervals This Course Material by Maurice Geraghty is licesed uder a Creative Commos Attributio-ShareAlike 4.0
More informationpoint estimator a random variable (like P or X) whose values are used to estimate a population parameter
Estimatio We have oted that the pollig problem which attempts to estimate the proportio p of Successes i some populatio ad the measuremet problem which attempts to estimate the mea value µ of some quatity
More informationOverlapping Generations
Eco. 53a all 996 C. Sims. troductio Overlappig Geeratios We wat to study how asset markets allow idividuals, motivated by the eed to provide icome for their retiremet years, to fiace capital accumulatio
More informationA Bayesian perspective on estimating mean, variance, and standard-deviation from data
Brigham Youg Uiversity BYU ScholarsArchive All Faculty Publicatios 006--05 A Bayesia perspective o estimatig mea, variace, ad stadard-deviatio from data Travis E. Oliphat Follow this ad additioal works
More informationFINM6900 Finance Theory How Is Asymmetric Information Reflected in Asset Prices?
FINM6900 Fiace Theory How Is Asymmetric Iformatio Reflected i Asset Prices? February 3, 2012 Referece S. Grossma, O the Efficiecy of Competitive Stock Markets where Traders Have Diverse iformatio, Joural
More information1 Random Variables and Key Statistics
Review of Statistics 1 Radom Variables ad Key Statistics Radom Variable: A radom variable is a variable that takes o differet umerical values from a sample space determied by chace (probability distributio,
More informationSampling Distributions and Estimation
Cotets 40 Samplig Distributios ad Estimatio 40.1 Samplig Distributios 40. Iterval Estimatio for the Variace 13 Learig outcomes You will lear about the distributios which are created whe a populatio is
More informationChapter 10 - Lecture 2 The independent two sample t-test and. confidence interval
Assumptios Idepedet Samples - ukow σ 1, σ - 30 or m 30 - Upooled case Idepedet Samples - ukow σ 1, σ - 30 or m 30 - Pooled case Idepedet samples - Pooled variace - Large samples Chapter 10 - Lecture The
More informationIntroduction to the Maximum Likelihood Estimation Technique. September 24, 2015
Introduction to the Maximum Likelihood Estimation Technique September 24, 2015 So far our Dependent Variable is Continuous That is, our outcome variable Y is assumed to follow a normal distribution having
More informationAY Term 2 Mock Examination
AY 206-7 Term 2 Mock Examiatio Date / Start Time Course Group Istructor 24 March 207 / 2 PM to 3:00 PM QF302 Ivestmet ad Fiacial Data Aalysis G Christopher Tig INSTRUCTIONS TO STUDENTS. This mock examiatio
More informationGenerative Models, Maximum Likelihood, Soft Clustering, and Expectation Maximization
Geerative Models Maximum Likelihood Soft Clusterig ad Expectatio Maximizatio Aris Aagostopoulos We will see why we desig models for data how to lear their parameters ad how by cosiderig a mixture model
More informationLecture 4: Parameter Estimation and Confidence Intervals. GENOME 560 Doug Fowler, GS
Lecture 4: Parameter Estimatio ad Cofidece Itervals GENOME 560 Doug Fowler, GS (dfowler@uw.edu) 1 Review: Probability Distributios Discrete: Biomial distributio Hypergeometric distributio Poisso distributio
More informationUnbiased estimators Estimators
19 Ubiased estimators I Chapter 17 we saw that a dataset ca be modeled as a realizatio of a radom sample from a probability distributio ad that quatities of iterest correspod to features of the model distributio.
More informationEstimating Proportions with Confidence
Aoucemets: Discussio today is review for midterm, o credit. You may atted more tha oe discussio sectio. Brig sheets of otes ad calculator to midterm. We will provide Scatro form. Homework: (Due Wed Chapter
More informationExam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011
15.075 Exam 2 Istructor: Cythia Rudi TA: Dimitrios Bisias October 25, 2011 Gradig is based o demostratio of coceptual uderstadig, so you eed to show all of your work. Problem 1 You are i charge of a study
More informationIntroduction to Probability and Statistics Chapter 7
Itroductio to Probability ad Statistics Chapter 7 Ammar M. Sarha, asarha@mathstat.dal.ca Departmet of Mathematics ad Statistics, Dalhousie Uiversity Fall Semester 008 Chapter 7 Statistical Itervals Based
More informationr i = a i + b i f b i = Cov[r i, f] The only parameters to be estimated for this model are a i 's, b i 's, σe 2 i
The iformatio required by the mea-variace approach is substatial whe the umber of assets is large; there are mea values, variaces, ad )/2 covariaces - a total of 2 + )/2 parameters. Sigle-factor model:
More informationStatistics for Economics & Business
Statistics for Ecoomics & Busiess Cofidece Iterval Estimatio Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for the mea ad the proportio How to determie
More informationToday: Finish Chapter 9 (Sections 9.6 to 9.8 and 9.9 Lesson 3)
Today: Fiish Chapter 9 (Sectios 9.6 to 9.8 ad 9.9 Lesso 3) ANNOUNCEMENTS: Quiz #7 begis after class today, eds Moday at 3pm. Quiz #8 will begi ext Friday ad ed at 10am Moday (day of fial). There will be
More informationTopic-7. Large Sample Estimation
Topic-7 Large Sample Estimatio TYPES OF INFERENCE Ò Estimatio: É Estimatig or predictig the value of the parameter É What is (are) the most likely values of m or p? Ò Hypothesis Testig: É Decidig about
More informationST 305: Exam 2 Fall 2014
ST 305: Exam Fall 014 By hadig i this completed exam, I state that I have either give or received assistace from aother perso durig the exam period. I have used o resources other tha the exam itself ad
More informationii. Interval estimation:
1 Types of estimatio: i. Poit estimatio: Example (1) Cosider the sample observatios 17,3,5,1,18,6,16,10 X 8 X i i1 8 17 3 5 118 6 16 10 8 116 8 14.5 14.5 is a poit estimate for usig the estimator X ad
More informationMath 124: Lecture for Week 10 of 17
What we will do toight 1 Lecture for of 17 David Meredith Departmet of Mathematics Sa Fracisco State Uiversity 2 3 4 April 8, 2008 5 6 II Take the midterm. At the ed aswer the followig questio: To be revealed
More informationChapter 8. Confidence Interval Estimation. Copyright 2015, 2012, 2009 Pearson Education, Inc. Chapter 8, Slide 1
Chapter 8 Cofidece Iterval Estimatio Copyright 2015, 2012, 2009 Pearso Educatio, Ic. Chapter 8, Slide 1 Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for
More information1. Suppose X is a variable that follows the normal distribution with known standard deviation σ = 0.3 but unknown mean µ.
Chapter 9 Exercises Suppose X is a variable that follows the ormal distributio with kow stadard deviatio σ = 03 but ukow mea µ (a) Costruct a 95% cofidece iterval for µ if a radom sample of = 6 observatios
More informationNOTES ON ESTIMATION AND CONFIDENCE INTERVALS. 1. Estimation
NOTES ON ESTIMATION AND CONFIDENCE INTERVALS MICHAEL N. KATEHAKIS 1. Estimatio Estimatio is a brach of statistics that deals with estimatig the values of parameters of a uderlyig distributio based o observed/empirical
More informationRafa l Kulik and Marc Raimondo. University of Ottawa and University of Sydney. Supplementary material
Statistica Siica 009: Supplemet 1 L p -WAVELET REGRESSION WITH CORRELATED ERRORS AND INVERSE PROBLEMS Rafa l Kulik ad Marc Raimodo Uiversity of Ottawa ad Uiversity of Sydey Supplemetary material This ote
More informationConfidence Intervals. CI for a population mean (σ is known and n > 30 or the variable is normally distributed in the.
Cofidece Itervals A cofidece iterval is a iterval whose purpose is to estimate a parameter (a umber that could, i theory, be calculated from the populatio, if measuremets were available for the whole populatio).
More informationChapter 4: Asymptotic Properties of MLE (Part 3)
Chapter 4: Asymptotic Properties of MLE (Part 3) Daniel O. Scharfstein 09/30/13 1 / 1 Breakdown of Assumptions Non-Existence of the MLE Multiple Solutions to Maximization Problem Multiple Solutions to
More informationDefinition 9.1 A point estimate is any function T (X 1,..., X n ) of a random sample. We often write an estimator of the parameter θ as ˆθ.
9 Point estimation 9.1 Rationale behind point estimation When sampling from a population described by a pdf f(x θ) or probability function P [X = x θ] knowledge of θ gives knowledge of the entire population.
More informationMath 312, Intro. to Real Analysis: Homework #4 Solutions
Math 3, Itro. to Real Aalysis: Homework #4 Solutios Stephe G. Simpso Moday, March, 009 The assigmet cosists of Exercises 0.6, 0.8, 0.0,.,.3,.6,.0,.,. i the Ross textbook. Each problem couts 0 poits. 0.6.
More information1 Estimating sensitivities
Copyright c 27 by Karl Sigma 1 Estimatig sesitivities Whe estimatig the Greeks, such as the, the geeral problem ivolves a radom variable Y = Y (α) (such as a discouted payoff) that depeds o a parameter
More informationFOUNDATION ACTED COURSE (FAC)
FOUNDATION ACTED COURSE (FAC) What is the Foudatio ActEd Course (FAC)? FAC is desiged to help studets improve their mathematical skills i preparatio for the Core Techical subjects. It is a referece documet
More informationBASIC STATISTICS ECOE 1323
BASIC STATISTICS ECOE 33 SPRING 007 FINAL EXAM NAME: ID NUMBER: INSTRUCTIONS:. Write your ame ad studet ID.. You have hours 3. This eam must be your ow work etirely. You caot talk to or share iformatio
More information. (The calculated sample mean is symbolized by x.)
Stat 40, sectio 5.4 The Cetral Limit Theorem otes by Tim Pilachowski If you have t doe it yet, go to the Stat 40 page ad dowload the hadout 5.4 supplemet Cetral Limit Theorem. The homework (both practice
More informationSELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION
1 SELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION Hyue-Ju Kim 1,, Bibig Yu 2, ad Eric J. Feuer 3 1 Syracuse Uiversity, 2 Natioal Istitute of Agig, ad 3 Natioal Cacer Istitute Supplemetary
More informationA random variable is a variable whose value is a numerical outcome of a random phenomenon.
The Practice of Statistics, d ed ates, Moore, ad Stares Itroductio We are ofte more iterested i the umber of times a give outcome ca occur tha i the possible outcomes themselves For example, if we toss
More informationEVEN NUMBERED EXERCISES IN CHAPTER 4
Joh Riley 7 July EVEN NUMBERED EXERCISES IN CHAPTER 4 SECTION 4 Exercise 4-: Cost Fuctio of a Cobb-Douglas firm What is the cost fuctio of a firm with a Cobb-Douglas productio fuctio? Rather tha miimie
More informationCHAPTER 8 Estimating with Confidence
CHAPTER 8 Estimatig with Cofidece 8.2 Estimatig a Populatio Proportio The Practice of Statistics, 5th Editio Stares, Tabor, Yates, Moore Bedford Freema Worth Publishers Estimatig a Populatio Proportio
More informationChapter 8: Estimation of Mean & Proportion. Introduction
Chapter 8: Estimatio of Mea & Proportio 8.1 Estimatio, Poit Estimate, ad Iterval Estimate 8.2 Estimatio of a Populatio Mea: σ Kow 8.3 Estimatio of a Populatio Mea: σ Not Kow 8.4 Estimatio of a Populatio
More informationHopscotch and Explicit difference method for solving Black-Scholes PDE
Mälardale iversity Fiacial Egieerig Program Aalytical Fiace Semiar Report Hopscotch ad Explicit differece method for solvig Blac-Scholes PDE Istructor: Ja Röma Team members: A Gog HaiLog Zhao Hog Cui 0
More informationGov 2001: Section 5. I. A Normal Example II. Uncertainty. Gov Spring 2010
Gov 2001: Section 5 I. A Normal Example II. Uncertainty Gov 2001 Spring 2010 A roadmap We started by introducing the concept of likelihood in the simplest univariate context one observation, one variable.
More informationStandard Deviations for Normal Sampling Distributions are: For proportions For means _
Sectio 9.2 Cofidece Itervals for Proportios We will lear to use a sample to say somethig about the world at large. This process (statistical iferece) is based o our uderstadig of samplig models, ad will
More informationSolutions to Problem Sheet 1
Solutios to Problem Sheet ) Use Theorem.4 to prove that p log for all real x 3. This is a versio of Theorem.4 with the iteger N replaced by the real x. Hit Give x 3 let N = [x], the largest iteger x. The,
More informationLikelihood Methods of Inference. Toss coin 6 times and get Heads twice.
Methods of Inference Toss coin 6 times and get Heads twice. p is probability of getting H. Probability of getting exactly 2 heads is 15p 2 (1 p) 4 This function of p, is likelihood function. Definition:
More informationOutline. Populations. Defs: A (finite) population is a (finite) set P of elements e. A variable is a function v : P IR. Population and Characteristics
Outlie Populatio Characteristics Types of Samples Sample Characterstics Sample Aalogue Estimatio Populatios Defs: A (fiite) populatio is a (fiite) set P of elemets e. A variable is a fuctio v : P IR. Examples
More informationPoint Estimation by MLE Lesson 5
Poit Estimatio b MLE Lesso 5 Review Defied Likelihood Maximum Likelihood Estimatio Step : Costruct Likelihood Step : Maximize fuctio Take Log of likelihood fuctio Take derivative of fuctio Set derivative
More informationPoint Estimators. STATISTICS Lecture no. 10. Department of Econometrics FEM UO Brno office 69a, tel
STATISTICS Lecture no. 10 Department of Econometrics FEM UO Brno office 69a, tel. 973 442029 email:jiri.neubauer@unob.cz 8. 12. 2009 Introduction Suppose that we manufacture lightbulbs and we want to state
More informationMonetary Economics: Problem Set #5 Solutions
Moetary Ecoomics oblem Set #5 Moetary Ecoomics: oblem Set #5 Solutios This problem set is marked out of 1 poits. The weight give to each part is idicated below. Please cotact me asap if you have ay questios.
More informationMA Lesson 11 Section 1.3. Solving Applied Problems with Linear Equations of one Variable
MA 15200 Lesso 11 Sectio 1. I Solvig Applied Problems with Liear Equatios of oe Variable 1. After readig the problem, let a variable represet the ukow (or oe of the ukows). Represet ay other ukow usig
More informationPoint Estimation by MLE Lesson 5
Poit Estimatio b MLE Lesso 5 Review Defied Likelihood Maximum Likelihood Estimatio Step : Costruct Likelihood Step : Maximize fuctio Take Log of likelihood fuctio Take derivative of fuctio Set derivative
More informationLecture 10: Point Estimation
Lecture 10: Point Estimation MSU-STT-351-Sum-17B (P. Vellaisamy: MSU-STT-351-Sum-17B) Probability & Statistics for Engineers 1 / 31 Basic Concepts of Point Estimation A point estimate of a parameter θ,
More informationBasic formula for confidence intervals. Formulas for estimating population variance Normal Uniform Proportion
Basic formula for the Chi-square test (Observed - Expected ) Expected Basic formula for cofidece itervals sˆ x ± Z ' Sample size adjustmet for fiite populatio (N * ) (N + - 1) Formulas for estimatig populatio
More informationSampling Distributions and Estimation
Samplig Distributios ad Estimatio T O P I C # Populatio Proportios, π π the proportio of the populatio havig some characteristic Sample proportio ( p ) provides a estimate of π : x p umber of successes
More informationB = A x z
114 Block 3 Erdeky == Begi 6.3 ============================================================== 1 / 8 / 2008 1 Correspodig Areas uder a ormal curve ad the stadard ormal curve are equal. Below: Area B = Area
More informationThe method of Maximum Likelihood.
Maximum Likelihood The method of Maximum Likelihood. In developing the least squares estimator - no mention of probabilities. Minimize the distance between the predicted linear regression and the observed
More informationAn Empirical Study of the Behaviour of the Sample Kurtosis in Samples from Symmetric Stable Distributions
A Empirical Study of the Behaviour of the Sample Kurtosis i Samples from Symmetric Stable Distributios J. Marti va Zyl Departmet of Actuarial Sciece ad Mathematical Statistics, Uiversity of the Free State,
More informationBIOSTATS 540 Fall Estimation Page 1 of 72. Unit 6. Estimation. Use at least twelve observations in constructing a confidence interval
BIOSTATS 540 Fall 015 6. Estimatio Page 1 of 7 Uit 6. Estimatio Use at least twelve observatios i costructig a cofidece iterval - Gerald va Belle What is the mea of the blood pressures of all the studets
More informationSimulation Efficiency and an Introduction to Variance Reduction Methods
Mote Carlo Simulatio: IEOR E4703 Columbia Uiversity c 2017 by Marti Haugh Simulatio Efficiecy ad a Itroductio to Variace Reductio Methods I these otes we discuss the efficiecy of a Mote-Carlo estimator.
More informationLecture 4: Probability (continued)
Lecture 4: Probability (cotiued) Desity Curves We ve defied probabilities for discrete variables (such as coi tossig). Probabilities for cotiuous or measuremet variables also are evaluated usig relative
More informationAsymptotics: Consistency and Delta Method
ad Delta Method MIT 18.655 Dr. Kempthore Sprig 2016 1 MIT 18.655 ad Delta Method Outlie Asymptotics 1 Asymptotics 2 MIT 18.655 ad Delta Method Cosistecy Asymptotics Statistical Estimatio Problem X 1,...,
More informationResearch Article The Probability That a Measurement Falls within a Range of n Standard Deviations from an Estimate of the Mean
Iteratioal Scholarly Research Network ISRN Applied Mathematics Volume 0, Article ID 70806, 8 pages doi:0.540/0/70806 Research Article The Probability That a Measuremet Falls withi a Rage of Stadard Deviatios
More informationBayes Estimator for Coefficient of Variation and Inverse Coefficient of Variation for the Normal Distribution
Iteratioal Joural of Statistics ad Systems ISSN 0973-675 Volume, Number 4 (07, pp. 7-73 Research Idia Publicatios http://www.ripublicatio.com Bayes Estimator for Coefficiet of Variatio ad Iverse Coefficiet
More informationSTRAND: FINANCE. Unit 3 Loans and Mortgages TEXT. Contents. Section. 3.1 Annual Percentage Rate (APR) 3.2 APR for Repayment of Loans
CMM Subject Support Strad: FINANCE Uit 3 Loas ad Mortgages: Text m e p STRAND: FINANCE Uit 3 Loas ad Mortgages TEXT Cotets Sectio 3.1 Aual Percetage Rate (APR) 3.2 APR for Repaymet of Loas 3.3 Credit Purchases
More informationDiscriminating Between The Log-normal and Gamma Distributions
Discrimiatig Betwee The Log-ormal ad Gamma Distributios Debasis Kudu & Aubhav Maglick Abstract For a give data set the problem of selectig either log-ormal or gamma distributio with ukow shape ad scale
More informationA point estimate is the value of a statistic that estimates the value of a parameter.
Chapter 9 Estimatig the Value of a Parameter Chapter 9.1 Estimatig a Populatio Proportio Objective A : Poit Estimate A poit estimate is the value of a statistic that estimates the value of a parameter.
More informationChapter 8: Sampling distributions of estimators Sections
Chapter 8 continued Chapter 8: Sampling distributions of estimators Sections 8.1 Sampling distribution of a statistic 8.2 The Chi-square distributions 8.3 Joint Distribution of the sample mean and sample
More informationCAPITAL PROJECT SCREENING AND SELECTION
CAPITAL PROJECT SCREEIG AD SELECTIO Before studyig the three measures of ivestmet attractiveess, we will review a simple method that is commoly used to scree capital ivestmets. Oe of the primary cocers
More informationSampling Distributions & Estimators
API-209 TF Sessio 2 Teddy Svoroos September 18, 2015 Samplig Distributios & Estimators I. Estimators The Importace of Samplig Radomly Three Properties of Estimators 1. Ubiased 2. Cosistet 3. Efficiet I
More informationCalculation of the Annual Equivalent Rate (AER)
Appedix to Code of Coduct for the Advertisig of Iterest Bearig Accouts. (31/1/0) Calculatio of the Aual Equivalet Rate (AER) a) The most geeral case of the calculatio is the rate of iterest which, if applied
More informationLimits of sequences. Contents 1. Introduction 2 2. Some notation for sequences The behaviour of infinite sequences 3
Limits of sequeces I this uit, we recall what is meat by a simple sequece, ad itroduce ifiite sequeces. We explai what it meas for two sequeces to be the same, ad what is meat by the -th term of a sequece.
More informationINTERVAL GAMES. and player 2 selects 1, then player 2 would give player 1 a payoff of, 1) = 0.
INTERVAL GAMES ANTHONY MENDES Let I ad I 2 be itervals of real umbers. A iterval game is played i this way: player secretly selects x I ad player 2 secretly ad idepedetly selects y I 2. After x ad y are
More information1 Basic Growth Models
UCLA Aderso MGMT37B: Fudametals i Fiace Fall 015) Week #1 rofessor Eduardo Schwartz November 9, 015 Hadout writte by Sheje Hshieh 1 Basic Growth Models 1.1 Cotiuous Compoudig roof: lim 1 + i m = expi)
More informationCHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions
CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Meas ad Proportios Itroductio: I this chapter we wat to fid out the value of a parameter for a populatio. We do t kow the value of this parameter for the etire
More informationLecture 5: Sampling Distribution
Lecture 5: Samplig Distributio Readigs: Sectios 5.5, 5.6 Itroductio Parameter: describes populatio Statistic: describes the sample; samplig variability Samplig distributio of a statistic: A probability
More informationNotes on Expected Revenue from Auctions
Notes o Epected Reveue from Auctios Professor Bergstrom These otes spell out some of the mathematical details about first ad secod price sealed bid auctios that were discussed i Thursday s lecture You
More informationASYMPTOTIC MEAN SQUARE ERRORS OF VARIANCE ESTIMATORS FOR U-STATISTICS AND THEIR EDGEWORTH EXPANSIONS
J. Japa Statist. Soc. Vol. 8 No. 1 1998 1 19 ASYMPTOTIC MEAN SQUARE ERRORS OF VARIANCE ESTIMATORS FOR U-STATISTICS AND THEIR EDGEWORTH EXPANSIONS Yoshihiko Maesoo* This paper studies variace estimators
More informationBinomial Model. Stock Price Dynamics. The Key Idea Riskless Hedge
Biomial Model Stock Price Dyamics The value of a optio at maturity depeds o the price of the uderlyig stock at maturity. The value of the optio today depeds o the expected value of the optio at maturity
More informationSCHOOL OF ACCOUNTING AND BUSINESS BSc. (APPLIED ACCOUNTING) GENERAL / SPECIAL DEGREE PROGRAMME
All Right Reserved No. of Pages - 10 No of Questios - 08 SCHOOL OF ACCOUNTING AND BUSINESS BSc. (APPLIED ACCOUNTING) GENERAL / SPECIAL DEGREE PROGRAMME YEAR I SEMESTER I (Group B) END SEMESTER EXAMINATION
More informationOnline appendices from Counterparty Risk and Credit Value Adjustment a continuing challenge for global financial markets by Jon Gregory
Olie appedices from Couterparty Risk ad Credit Value Adjustmet a APPENDIX 8A: Formulas for EE, PFE ad EPE for a ormal distributio Cosider a ormal distributio with mea (expected future value) ad stadard
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 2
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 2 (This versio August 7, 204) Stock/Watso - Itroductio to
More informationChapter 7 - Lecture 1 General concepts and criteria
Chapter 7 - Lecture 1 General concepts and criteria January 29th, 2010 Best estimator Mean Square error Unbiased estimators Example Unbiased estimators not unique Special case MVUE Bootstrap General Question
More informationKernel Density Estimation. Let X be a random variable with continuous distribution F (x) and density f(x) = d
Kerel Desity Estimatio Let X be a radom variable wit cotiuous distributio F (x) ad desity f(x) = d dx F (x). Te goal is to estimate f(x). Wile F (x) ca be estimated by te EDF ˆF (x), we caot set ˆf(x)
More informationThe material in this chapter is motivated by Experiment 9.
Chapter 5 Optimal Auctios The material i this chapter is motivated by Experimet 9. We wish to aalyze the decisio of a seller who sets a reserve price whe auctioig off a item to a group of bidders. We begi
More informationA DOUBLE INCREMENTAL AGGREGATED GRADIENT METHOD WITH LINEAR CONVERGENCE RATE FOR LARGE-SCALE OPTIMIZATION
A DOUBLE INCREMENTAL AGGREGATED GRADIENT METHOD WITH LINEAR CONVERGENCE RATE FOR LARGE-SCALE OPTIMIZATION Arya Mokhtari, Mert Gürbüzbalaba, ad Alejadro Ribeiro Departmet of Electrical ad Systems Egieerig,
More information6. Genetics examples: Hardy-Weinberg Equilibrium
PBCB 206 (Fall 2006) Instructor: Fei Zou email: fzou@bios.unc.edu office: 3107D McGavran-Greenberg Hall Lecture 4 Topics for Lecture 4 1. Parametric models and estimating parameters from data 2. Method
More information