Parametric Density Estimation: Maximum Likelihood Estimation
|
|
- Blake Summers
- 5 years ago
- Views:
Transcription
1 Parametric Desity stimatio: Maimum Likelihood stimatio C6
2 Today Itroductio to desity estimatio Maimum Likelihood stimatio
3 Itroducto Bayesia Decisio Theory i previous lectures tells us how to desig a optimal classifier if we kew: P(c i ) (priors) P( c i ) (class-coditioal desities) Ufortuately, we rarely have this complete iformatio!
4 Probability desity methods Parametric methods assume we kow the shape of the distributio, but ot the parameters. Two types of parameter estimatio: Maimum Likelihood stimatio Bayesia stimatio No parametric methods the form of the desity is etirely determied by the data without ay model.
5 Idepedece Across Classes We have traiig data for each class salmo sea bass salmo salmo sea bass sea bass Whe estimatig parameters for oe class, will oly use the data collected for that class reasoable assumptio that data from class c i gives o iformatio about distributio of class c j estimate parameters for distributio of salmo from estimate parameters for distributio of bass from
6 Idepedece Across Classes For each class c i we have a proposed desity p i ( c i ) with ukow parameters θ i which we eed to estimate Sice we assumed idepedece of data across the classes, estimatio is a idetical procedure for all classes To simplify otatio, we drop sub-idees ad say that we eed to estimate parameters θ for desity p() the fact that we eed to do so for each class o the traiig data that came from that class is implied
7 Maimum Likelihood Parameter stimatio Parameters θ are ukow but fied (i.e. ot radom variables). Give the traiig data, choose the parameter value θ that makes the data most probable (i.e., maimizes the probability of obtaiig the sample that has actually bee observed)
8 Maimum Likelihood Parameter stimatio We have desity p() which is completely specified by parameters θ [θ,, θ k ] If p() is N(, σ ) the θ [, σ ] To highlight that p() depeds o parameters θ we will write p( θ) Note overloaded otatio, p( θ) is ot a coditioal desity Let D{,,, } be the idepedet traiig samples i our data If p() is N(, σ ) the,,, are iid samples from N(, σ )
9 Maimum Likelihood Parameter stimatio Cosider the followig fuctio, which is called likelihood of θ with respect to the set of samples D k p( D θ ) p( θ ) k k F( θ ) Maimum likelihood estimate (abbreviated ML) of θ is the value of θ that maimizes the likelihood fuctio p(d θ) ˆ θ arg ma θ ( ) p( D θ )
10 ML Parameter stimatio vs. ML Classifier Recall ML classifier fied data decide class c i which maimizes p( c i ) Compare with ML parameter estimatio fied data choose θ that maimizes p(d θ) ML classifier ad ML parameter estimatio use the same priciples applied to differet problems
11 Maimum Likelihood stimatio (ML) Istead of maimizig p(d θ), it is usually easier to maimize l(p(d θ)) Sice log is mootoic ˆ θ arg ma θ arg ma θ ( ) p(d θ ) ( ) l p(d θ ) p(d θ) l(p(d θ)) To simplify otatio, l(p(d θ))l(θ) ˆ θ arg ma L k θ θ k θ k k ( θ ) arg ma l p( θ ) arg ma l p( θ ) k
12
13 ML: Maimizatio Methods Maimizig L(θ) ca be solved usig stadard methods from Calculus Let θ (θ, θ,, θ p ) t ad let θ be the gradiet operator θ θ, θ,..., Set of ecessary coditios for a optimum is: θ l 0 Also have to check that θ that satisfies the above coditio is maimum, ot miimum or saddle poit. Also check the boudary of rage of θ θ p t
14 ML ample: Gaussia with ukow Fortuately for us, most of the ML estimates of ay desities we would care about have bee computed Let s go through a eample ayway Let p( ) be N(,σ ) that is σ is kow, but is ukow ad eeds to be estimated, so θ ˆ arg ma L( ) arg ma l p( k ) k ( ) k arg ma l ep k πσ σ arg ma k l πσ ( ) k σ
15 ML ample: Gaussia with ukow arg ma ( L( )) arg ma k l πσ ( ) k σ d d σ ( L( )) ( ) 0 k k ˆ k k 0 k k Thus the ML estimate of the mea is just the average value of the traiig data, very ituitive! average of the traiig data would be our guess for the mea eve if we did t kow about ML estimates
16 ML for Gaussia with ukow, σ Similarly it ca be show that if p(,σ ) is N(, σ ), that is both mea ad variace are ukow, the agai very ituitive result ˆ σˆ ( ) k ˆ k k Similarly it ca be show that if p(,σ) is N(, Σ), that is is a multivariate Gaussia with both mea ad covariace matri ukow, the ˆ k ˆ ( )( ) Σ k ˆ k ˆ k k k t
17 How to Measure Performace of ML? How good is a ML estimate? or actually ay other estimate of a parameter? θ ˆ θ The atural measure of error would be But θ ˆ θ is radom, we caot compute it before we carry out eperimets We wat to say somethig meaigful about our estimate as a fuctio of θ A way to solve this difficulty is to average the error, i.e. compute the mea absolute error θˆ (,,..., ) [ θ ˆ θ ] θ ˆ θ p dd... d
18 How to Measure Performace of ML?s It is usually much easier to compute a almost equivalet measure of performace, the mea squared error: ( θ θˆ ) Do a little algebra, ad use Var(X)(X )-((X)) ( θ ˆ θ ) Var( ˆ θ ) + ( ( ˆ θ ) θ ) variace estimator should have low variace bias epectatio should be close to the true θ
19 How to Measure Performace of ML? ( θ ˆ θ ) Var( ˆ θ ) + ( ( ˆ θ ) θ ) variace bias ideal case bad case bad case p( θˆ ) p( θˆ ) p( θˆ ) ( ˆ θ ) θ θ ( θˆ ) ( ˆ θ ) θ o bias low variace large bias low variace o bias high variace
20 Let s compute the bias for ML estimate of the mea Bias ad Variace for ML of the Mea How about variace of ML estimate of the mea? [ ] k k ˆ Thus this estimate is ubiased! ( ) [ ] [ ] i j j i i j j i i i i i ) )( ( ) )( ( ) ( ˆ σ σ [ ] k k k Thus variace is very small for a large umber of samples (the more samples, the smaller is variace) Thus the ML of the mea is a very good estimator
21 Bias ad Variace for ML of the Mea Suppose someoe claims they have a ew great estimator for the mea, just take the first sample! ˆ Thus this estimator is ubiased: However its variace is: [( ) ] ˆ ( ) [ ] σ ( ) ( ) ˆ p( θˆ ) Thus variace ca be very large ad does ot improve as we icrease the umber of samples ( ˆ θ ) θ o bias high variace
22 ML Bias for Mea ad Variace How about ML estimate for the variace? k k [ ] ˆ σ ( ˆ ) σ σ Thus this estimate is biased! This is because we used ˆ istead of true Bias 0 as ifiity, asymptotically ubiased Ubiased estimate σˆ k ( k ˆ ) Variace of ML of variace ca be show to go to 0 as goes to ifiity
23 ML for Uiform distributio U[0,θ] X is U[0,θ ] if its desity is /θ iside [0,θ] ad 0 otherwise (uiform distributio o [0,θ] ) p ( θ ) F ( θ ) θ 3 θ 3 θ The likelihood is F ( θ ) k θ 0 if θ ma{,..., } p( ) k θ k if θ < ma{,..., } Thus k ˆ θ arg ma θ k p ( k θ ) ma{,..., This is ot very pleasig sice for sure θ should be larger tha ay observed! }
5. Best Unbiased Estimators
Best Ubiased Estimators http://www.math.uah.edu/stat/poit/ubiased.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 5. Best Ubiased Estimators Basic Theory Cosider agai
More information14.30 Introduction to Statistical Methods in Economics Spring 2009
MIT OpeCourseWare http://ocwmitedu 430 Itroductio to Statistical Methods i Ecoomics Sprig 009 For iformatio about citig these materials or our Terms of Use, visit: http://ocwmitedu/terms 430 Itroductio
More informationSTAT 135 Solutions to Homework 3: 30 points
STAT 35 Solutios to Homework 3: 30 poits Sprig 205 The objective of this Problem Set is to study the Stei Pheomeo 955. Suppose that θ θ, θ 2,..., θ cosists of ukow parameters, with 3. We wish to estimate
More informationLecture 5 Point Es/mator and Sampling Distribu/on
Lecture 5 Poit Es/mator ad Samplig Distribu/o Fall 03 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech Road map Poit Es/ma/o Cofidece Iterval
More informationpoint estimator a random variable (like P or X) whose values are used to estimate a population parameter
Estimatio We have oted that the pollig problem which attempts to estimate the proportio p of Successes i some populatio ad the measuremet problem which attempts to estimate the mea value µ of some quatity
More informationECON 5350 Class Notes Maximum Likelihood Estimation
ECON 5350 Class Notes Maximum Likelihood Estimatio 1 Maximum Likelihood Estimatio Example #1. Cosider the radom sample {X 1 = 0.5, X 2 = 2.0, X 3 = 10.0, X 4 = 1.5, X 5 = 7.0} geerated from a expoetial
More informationLecture 4: Parameter Estimation and Confidence Intervals. GENOME 560 Doug Fowler, GS
Lecture 4: Parameter Estimatio ad Cofidece Itervals GENOME 560 Doug Fowler, GS (dfowler@uw.edu) 1 Review: Probability Distributios Discrete: Biomial distributio Hypergeometric distributio Poisso distributio
More informationCombining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010
Combiig imperfect data, ad a itroductio to data assimilatio Ross Baister, NCEO, September 00 rbaister@readigacuk The probability desity fuctio (PDF prob that x lies betwee x ad x + dx p (x restrictio o
More informationInferential Statistics and Probability a Holistic Approach. Inference Process. Inference Process. Chapter 8 Slides. Maurice Geraghty,
Iferetial Statistics ad Probability a Holistic Approach Chapter 8 Poit Estimatio ad Cofidece Itervals This Course Material by Maurice Geraghty is licesed uder a Creative Commos Attributio-ShareAlike 4.0
More informationIntroduction to Probability and Statistics Chapter 7
Itroductio to Probability ad Statistics Chapter 7 Ammar M. Sarha, asarha@mathstat.dal.ca Departmet of Mathematics ad Statistics, Dalhousie Uiversity Fall Semester 008 Chapter 7 Statistical Itervals Based
More informationNotes on Expected Revenue from Auctions
Notes o Epected Reveue from Auctios Professor Bergstrom These otes spell out some of the mathematical details about first ad secod price sealed bid auctios that were discussed i Thursday s lecture You
More informationMaximum Empirical Likelihood Estimation (MELE)
Maximum Empirical Likelihood Estimatio (MELE Natha Smooha Abstract Estimatio of Stadard Liear Model - Maximum Empirical Likelihood Estimator: Combiatio of the idea of imum likelihood method of momets,
More informationChapter 8. Confidence Interval Estimation. Copyright 2015, 2012, 2009 Pearson Education, Inc. Chapter 8, Slide 1
Chapter 8 Cofidece Iterval Estimatio Copyright 2015, 2012, 2009 Pearso Educatio, Ic. Chapter 8, Slide 1 Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for
More information18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013
18.S096 Problem Set 5 Fall 2013 Volatility Modelig Due Date: 10/29/2013 1. Sample Estimators of Diffusio Process Volatility ad Drift Let {X t } be the price of a fiacial security that follows a geometric
More informationStandard Deviations for Normal Sampling Distributions are: For proportions For means _
Sectio 9.2 Cofidece Itervals for Proportios We will lear to use a sample to say somethig about the world at large. This process (statistical iferece) is based o our uderstadig of samplig models, ad will
More informationr i = a i + b i f b i = Cov[r i, f] The only parameters to be estimated for this model are a i 's, b i 's, σe 2 i
The iformatio required by the mea-variace approach is substatial whe the umber of assets is large; there are mea values, variaces, ad )/2 covariaces - a total of 2 + )/2 parameters. Sigle-factor model:
More informationToday: Finish Chapter 9 (Sections 9.6 to 9.8 and 9.9 Lesson 3)
Today: Fiish Chapter 9 (Sectios 9.6 to 9.8 ad 9.9 Lesso 3) ANNOUNCEMENTS: Quiz #7 begis after class today, eds Moday at 3pm. Quiz #8 will begi ext Friday ad ed at 10am Moday (day of fial). There will be
More informationA random variable is a variable whose value is a numerical outcome of a random phenomenon.
The Practice of Statistics, d ed ates, Moore, ad Stares Itroductio We are ofte more iterested i the umber of times a give outcome ca occur tha i the possible outcomes themselves For example, if we toss
More informationConfidence Intervals. CI for a population mean (σ is known and n > 30 or the variable is normally distributed in the.
Cofidece Itervals A cofidece iterval is a iterval whose purpose is to estimate a parameter (a umber that could, i theory, be calculated from the populatio, if measuremets were available for the whole populatio).
More informationEstimating Proportions with Confidence
Aoucemets: Discussio today is review for midterm, o credit. You may atted more tha oe discussio sectio. Brig sheets of otes ad calculator to midterm. We will provide Scatro form. Homework: (Due Wed Chapter
More informationTopic-7. Large Sample Estimation
Topic-7 Large Sample Estimatio TYPES OF INFERENCE Ò Estimatio: É Estimatig or predictig the value of the parameter É What is (are) the most likely values of m or p? Ò Hypothesis Testig: É Decidig about
More information0.1 Valuation Formula:
0. Valuatio Formula: 0.. Case of Geeral Trees: q = er S S S 3 S q = er S S 4 S 5 S 4 q 3 = er S 3 S 6 S 7 S 6 Therefore, f (3) = e r [q 3 f (7) + ( q 3 ) f (6)] f () = e r [q f (5) + ( q ) f (4)] = f ()
More informationExam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011
15.075 Exam 2 Istructor: Cythia Rudi TA: Dimitrios Bisias October 25, 2011 Gradig is based o demostratio of coceptual uderstadig, so you eed to show all of your work. Problem 1 You are i charge of a study
More information. The firm makes different types of furniture. Let x ( x1,..., x n. If the firm produces nothing it rents out the entire space and so has a profit of
Joh Riley F Maimizatio with a sigle costrait F3 The Ecoomic approach - - shadow prices Suppose that a firm has a log term retal of uits of factory space The firm ca ret additioal space at a retal rate
More information. (The calculated sample mean is symbolized by x.)
Stat 40, sectio 5.4 The Cetral Limit Theorem otes by Tim Pilachowski If you have t doe it yet, go to the Stat 40 page ad dowload the hadout 5.4 supplemet Cetral Limit Theorem. The homework (both practice
More informationMonetary Economics: Problem Set #5 Solutions
Moetary Ecoomics oblem Set #5 Moetary Ecoomics: oblem Set #5 Solutios This problem set is marked out of 1 poits. The weight give to each part is idicated below. Please cotact me asap if you have ay questios.
More informationx satisfying all regularity conditions. Then
AMS570.01 Practice Midterm Exam Sprig, 018 Name: ID: Sigature: Istructio: This is a close book exam. You are allowed oe-page 8x11 formula sheet (-sided). No cellphoe or calculator or computer is allowed.
More information5 Statistical Inference
5 Statistical Iferece 5.1 Trasitio from Probability Theory to Statistical Iferece 1. We have ow more or less fiished the probability sectio of the course - we ow tur attetio to statistical iferece. I statistical
More informationStatistics for Economics & Business
Statistics for Ecoomics & Busiess Cofidece Iterval Estimatio Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for the mea ad the proportio How to determie
More informationExam 1 Spring 2015 Statistics for Applications 3/5/2015
8.443 Exam Sprig 05 Statistics for Applicatios 3/5/05. Log Normal Distributio: A radom variable X follows a Logormal(θ, σ ) distributio if l(x) follows a Normal(θ, σ ) distributio. For the ormal radom
More informationCHAPTER 8 Estimating with Confidence
CHAPTER 8 Estimatig with Cofidece 8.2 Estimatig a Populatio Proportio The Practice of Statistics, 5th Editio Stares, Tabor, Yates, Moore Bedford Freema Worth Publishers Estimatig a Populatio Proportio
More informationSummary. Recap. Last Lecture. .1 If you know MLE of θ, can you also know MLE of τ(θ) for any function τ?
Last Lecture Biostatistics 60 - Statistical Iferece Lecture Cramer-Rao Theorem Hyu Mi Kag February 9th, 03 If you kow MLE of, ca you also kow MLE of τ() for ay fuctio τ? What are plausible ways to compare
More informationBasic formula for confidence intervals. Formulas for estimating population variance Normal Uniform Proportion
Basic formula for the Chi-square test (Observed - Expected ) Expected Basic formula for cofidece itervals sˆ x ± Z ' Sample size adjustmet for fiite populatio (N * ) (N + - 1) Formulas for estimatig populatio
More informationMath 124: Lecture for Week 10 of 17
What we will do toight 1 Lecture for of 17 David Meredith Departmet of Mathematics Sa Fracisco State Uiversity 2 3 4 April 8, 2008 5 6 II Take the midterm. At the ed aswer the followig questio: To be revealed
More informationUnbiased estimators Estimators
19 Ubiased estimators I Chapter 17 we saw that a dataset ca be modeled as a realizatio of a radom sample from a probability distributio ad that quatities of iterest correspod to features of the model distributio.
More informationChapter 10 - Lecture 2 The independent two sample t-test and. confidence interval
Assumptios Idepedet Samples - ukow σ 1, σ - 30 or m 30 - Upooled case Idepedet Samples - ukow σ 1, σ - 30 or m 30 - Pooled case Idepedet samples - Pooled variace - Large samples Chapter 10 - Lecture The
More informationii. Interval estimation:
1 Types of estimatio: i. Poit estimatio: Example (1) Cosider the sample observatios 17,3,5,1,18,6,16,10 X 8 X i i1 8 17 3 5 118 6 16 10 8 116 8 14.5 14.5 is a poit estimate for usig the estimator X ad
More informationTopic 14: Maximum Likelihood Estimation
Toic 4: November, 009 As before, we begi with a samle X = (X,, X of radom variables chose accordig to oe of a family of robabilities P θ I additio, f(x θ, x = (x,, x will be used to deote the desity fuctio
More informationSampling Distributions and Estimation
Cotets 40 Samplig Distributios ad Estimatio 40.1 Samplig Distributios 40. Iterval Estimatio for the Variace 13 Learig outcomes You will lear about the distributios which are created whe a populatio is
More information1. Suppose X is a variable that follows the normal distribution with known standard deviation σ = 0.3 but unknown mean µ.
Chapter 9 Exercises Suppose X is a variable that follows the ormal distributio with kow stadard deviatio σ = 03 but ukow mea µ (a) Costruct a 95% cofidece iterval for µ if a radom sample of = 6 observatios
More informationA Bayesian perspective on estimating mean, variance, and standard-deviation from data
Brigham Youg Uiversity BYU ScholarsArchive All Faculty Publicatios 006--05 A Bayesia perspective o estimatig mea, variace, ad stadard-deviatio from data Travis E. Oliphat Follow this ad additioal works
More informationDr. Maddah ENMG 624 Financial Eng g I 03/22/06. Chapter 6 Mean-Variance Portfolio Theory
Dr Maddah ENMG 64 Fiacial Eg g I 03//06 Chapter 6 Mea-Variace Portfolio Theory Sigle Period Ivestmets Typically, i a ivestmet the iitial outlay of capital is kow but the retur is ucertai A sigle-period
More informationFINM6900 Finance Theory How Is Asymmetric Information Reflected in Asset Prices?
FINM6900 Fiace Theory How Is Asymmetric Iformatio Reflected i Asset Prices? February 3, 2012 Referece S. Grossma, O the Efficiecy of Competitive Stock Markets where Traders Have Diverse iformatio, Joural
More informationCHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions
CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Meas ad Proportios Itroductio: I this chapter we wat to fid out the value of a parameter for a populatio. We do t kow the value of this parameter for the etire
More informationNOTES ON ESTIMATION AND CONFIDENCE INTERVALS. 1. Estimation
NOTES ON ESTIMATION AND CONFIDENCE INTERVALS MICHAEL N. KATEHAKIS 1. Estimatio Estimatio is a brach of statistics that deals with estimatig the values of parameters of a uderlyig distributio based o observed/empirical
More informationConfidence Intervals Introduction
Cofidece Itervals Itroductio A poit estimate provides o iformatio about the precisio ad reliability of estimatio. For example, the sample mea X is a poit estimate of the populatio mea μ but because of
More informationBASIC STATISTICS ECOE 1323
BASIC STATISTICS ECOE 33 SPRING 007 FINAL EXAM NAME: ID NUMBER: INSTRUCTIONS:. Write your ame ad studet ID.. You have hours 3. This eam must be your ow work etirely. You caot talk to or share iformatio
More information1 Random Variables and Key Statistics
Review of Statistics 1 Radom Variables ad Key Statistics Radom Variable: A radom variable is a variable that takes o differet umerical values from a sample space determied by chace (probability distributio,
More informationSampling Distributions & Estimators
API-209 TF Sessio 2 Teddy Svoroos September 18, 2015 Samplig Distributios & Estimators I. Estimators The Importace of Samplig Radomly Three Properties of Estimators 1. Ubiased 2. Cosistet 3. Efficiet I
More informationChapter 8 Interval Estimation. Estimation Concepts. General Form of a Confidence Interval
Chapter 8 Iterval Estimatio Estimatio Cocepts Usually ca't take a cesus, so we must make decisios based o sample data It imperative that we take the risk of samplig error ito accout whe we iterpret sample
More informationBinomial Model. Stock Price Dynamics. The Key Idea Riskless Hedge
Biomial Model Stock Price Dyamics The value of a optio at maturity depeds o the price of the uderlyig stock at maturity. The value of the optio today depeds o the expected value of the optio at maturity
More informationLecture 4: Probability (continued)
Lecture 4: Probability (cotiued) Desity Curves We ve defied probabilities for discrete variables (such as coi tossig). Probabilities for cotiuous or measuremet variables also are evaluated usig relative
More informationInsurance and Production Function Xingze Wang, Ying Hsuan Lin, and Frederick Jao (2007)
Isurace ad Productio Fuctio Xigze Wag, Yig Hsua Li, ad Frederick Jao (2007) 14.01 Priciples of Microecoomics, Fall 2007 Chia-Hui Che September 28, 2007 Lecture 10 Isurace ad Productio Fuctio Outlie 1.
More informationSimulation Efficiency and an Introduction to Variance Reduction Methods
Mote Carlo Simulatio: IEOR E4703 Columbia Uiversity c 2017 by Marti Haugh Simulatio Efficiecy ad a Itroductio to Variace Reductio Methods I these otes we discuss the efficiecy of a Mote-Carlo estimator.
More informationStatistics for Business and Economics
Statistics for Busiess ad Ecoomics Chapter 8 Estimatio: Additioal Topics Copright 010 Pearso Educatio, Ic. Publishig as Pretice Hall Ch. 8-1 8. Differece Betwee Two Meas: Idepedet Samples Populatio meas,
More informationBayes Estimator for Coefficient of Variation and Inverse Coefficient of Variation for the Normal Distribution
Iteratioal Joural of Statistics ad Systems ISSN 0973-675 Volume, Number 4 (07, pp. 7-73 Research Idia Publicatios http://www.ripublicatio.com Bayes Estimator for Coefficiet of Variatio ad Iverse Coefficiet
More information4.5 Generalized likelihood ratio test
4.5 Geeralized likelihood ratio test A assumptio that is used i the Athlete Biological Passport is that haemoglobi varies equally i all athletes. We wish to test this assumptio o a sample of k athletes.
More informationKernel Density Estimation. Let X be a random variable with continuous distribution F (x) and density f(x) = d
Kerel Desity Estimatio Let X be a radom variable wit cotiuous distributio F (x) ad desity f(x) = d dx F (x). Te goal is to estimate f(x). Wile F (x) ca be estimated by te EDF ˆF (x), we caot set ˆf(x)
More informationThe material in this chapter is motivated by Experiment 9.
Chapter 5 Optimal Auctios The material i this chapter is motivated by Experimet 9. We wish to aalyze the decisio of a seller who sets a reserve price whe auctioig off a item to a group of bidders. We begi
More informationLecture 9: The law of large numbers and central limit theorem
Lecture 9: The law of large umbers ad cetral limit theorem Theorem.4 Let X,X 2,... be idepedet radom variables with fiite expectatios. (i) (The SLLN). If there is a costat p [,2] such that E X i p i i=
More informationLecture 5: Sampling Distribution
Lecture 5: Samplig Distributio Readigs: Sectios 5.5, 5.6 Itroductio Parameter: describes populatio Statistic: describes the sample; samplig variability Samplig distributio of a statistic: A probability
More information5 Decision Theory: Basic Concepts
5 Decisio Theory: Basic Cocepts Poit estimatio of a ukow parameter is geerally cosidered the most basic iferece problem. Speakig geerically, if θ is some ukow parameter takig values i a suitable parameter
More informationBIOSTATS 540 Fall Estimation Page 1 of 72. Unit 6. Estimation. Use at least twelve observations in constructing a confidence interval
BIOSTATS 540 Fall 015 6. Estimatio Page 1 of 7 Uit 6. Estimatio Use at least twelve observatios i costructig a cofidece iterval - Gerald va Belle What is the mea of the blood pressures of all the studets
More informationSampling Distributions and Estimation
Samplig Distributios ad Estimatio T O P I C # Populatio Proportios, π π the proportio of the populatio havig some characteristic Sample proportio ( p ) provides a estimate of π : x p umber of successes
More informationChapter 8: Estimation of Mean & Proportion. Introduction
Chapter 8: Estimatio of Mea & Proportio 8.1 Estimatio, Poit Estimate, ad Iterval Estimate 8.2 Estimatio of a Populatio Mea: σ Kow 8.3 Estimatio of a Populatio Mea: σ Not Kow 8.4 Estimatio of a Populatio
More informationA point estimate is the value of a statistic that estimates the value of a parameter.
Chapter 9 Estimatig the Value of a Parameter Chapter 9.1 Estimatig a Populatio Proportio Objective A : Poit Estimate A poit estimate is the value of a statistic that estimates the value of a parameter.
More informationFOUNDATION ACTED COURSE (FAC)
FOUNDATION ACTED COURSE (FAC) What is the Foudatio ActEd Course (FAC)? FAC is desiged to help studets improve their mathematical skills i preparatio for the Core Techical subjects. It is a referece documet
More informationOutline. Populations. Defs: A (finite) population is a (finite) set P of elements e. A variable is a function v : P IR. Population and Characteristics
Outlie Populatio Characteristics Types of Samples Sample Characterstics Sample Aalogue Estimatio Populatios Defs: A (fiite) populatio is a (fiite) set P of elemets e. A variable is a fuctio v : P IR. Examples
More informationCHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions
CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Meas ad Proportios Itroductio: We wat to kow the value of a parameter for a populatio. We do t kow the value of this parameter for the etire populatio because
More informationB = A x z
114 Block 3 Erdeky == Begi 6.3 ============================================================== 1 / 8 / 2008 1 Correspodig Areas uder a ormal curve ad the stadard ormal curve are equal. Below: Area B = Area
More informationMany Techniques Developed. Uncertainty. Aspects of Uncertainty. Decision Theory = Probability + Utility Theory
Ucertait CSE 47 Ma Techiques Developed Fu Logic Certait Factors No-mootoic logic robabilit Ol oe has stood the test of time! UW CSE AI Facult Aspects of Ucertait Suppose ou have a flight at oo Whe should
More informationProblem Set 1a - Oligopoly
Advaced Idustrial Ecoomics Sprig 2014 Joha Steek 6 may 2014 Problem Set 1a - Oligopoly 1 Table of Cotets 2 Price Competitio... 3 2.1 Courot Oligopoly with Homogeous Goods ad Differet Costs... 3 2.2 Bertrad
More informationResearch Article The Probability That a Measurement Falls within a Range of n Standard Deviations from an Estimate of the Mean
Iteratioal Scholarly Research Network ISRN Applied Mathematics Volume 0, Article ID 70806, 8 pages doi:0.540/0/70806 Research Article The Probability That a Measuremet Falls withi a Rage of Stadard Deviatios
More informationModels of Asset Pricing
APPENDIX 1 TO CHAPTER 4 Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see
More informationModels of Asset Pricing
APPENDIX 1 TO CHAPTER4 Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see
More informationDiscriminating Between The Log-normal and Gamma Distributions
Discrimiatig Betwee The Log-ormal ad Gamma Distributios Debasis Kudu & Aubhav Maglick Abstract For a give data set the problem of selectig either log-ormal or gamma distributio with ukow shape ad scale
More informationModels of Asset Pricing
4 Appedix 1 to Chapter Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see
More informationOnline appendices from Counterparty Risk and Credit Value Adjustment a continuing challenge for global financial markets by Jon Gregory
Olie appedices from Couterparty Risk ad Credit Value Adjustmet a APPENDIX 8A: Formulas for EE, PFE ad EPE for a ormal distributio Cosider a ormal distributio with mea (expected future value) ad stadard
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 2
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 2 (This versio August 7, 204) Stock/Watso - Itroductio to
More informationSolution to Tutorial 6
Solutio to Tutorial 6 2012/2013 Semester I MA4264 Game Theory Tutor: Xiag Su October 12, 2012 1 Review Static game of icomplete iformatio The ormal-form represetatio of a -player static Bayesia game: {A
More informationMath 312, Intro. to Real Analysis: Homework #4 Solutions
Math 3, Itro. to Real Aalysis: Homework #4 Solutios Stephe G. Simpso Moday, March, 009 The assigmet cosists of Exercises 0.6, 0.8, 0.0,.,.3,.6,.0,.,. i the Ross textbook. Each problem couts 0 poits. 0.6.
More informationAY Term 2 Mock Examination
AY 206-7 Term 2 Mock Examiatio Date / Start Time Course Group Istructor 24 March 207 / 2 PM to 3:00 PM QF302 Ivestmet ad Fiacial Data Aalysis G Christopher Tig INSTRUCTIONS TO STUDENTS. This mock examiatio
More information1 Estimating sensitivities
Copyright c 27 by Karl Sigma 1 Estimatig sesitivities Whe estimatig the Greeks, such as the, the geeral problem ivolves a radom variable Y = Y (α) (such as a discouted payoff) that depeds o a parameter
More informationThe Likelihood Ratio Test
LM 05 Likelihood Ratio Test 1 The Likelihood Ratio Test The likelihood ratio test is a geeral purpose test desiged evaluate ested statistical models i a way that is strictly aalogous to the F-test for
More informationThe Idea of a Confidence Interval
AP Statistics Ch. 8 Notes Estimatig with Cofidece I the last chapter, we aswered questios about what samples should look like assumig that we kew the true values of populatio parameters (like μ, σ, ad
More informationOverlapping Generations
Eco. 53a all 996 C. Sims. troductio Overlappig Geeratios We wat to study how asset markets allow idividuals, motivated by the eed to provide icome for their retiremet years, to fiace capital accumulatio
More informationFaculdade de Economia da Universidade de Coimbra
Faculdade de Ecoomia da Uiversidade de Coimbra Grupo de Estudos Moetários e Fiaceiros (GEMF) Av. Dias da Silva, 65 300-5 COIMBRA, PORTUGAL gemf@fe.uc.pt http://www.uc.pt/feuc/gemf PEDRO GODINHO Estimatig
More informationRafa l Kulik and Marc Raimondo. University of Ottawa and University of Sydney. Supplementary material
Statistica Siica 009: Supplemet 1 L p -WAVELET REGRESSION WITH CORRELATED ERRORS AND INVERSE PROBLEMS Rafa l Kulik ad Marc Raimodo Uiversity of Ottawa ad Uiversity of Sydey Supplemetary material This ote
More informationLimits of sequences. Contents 1. Introduction 2 2. Some notation for sequences The behaviour of infinite sequences 3
Limits of sequeces I this uit, we recall what is meat by a simple sequece, ad itroduce ifiite sequeces. We explai what it meas for two sequeces to be the same, ad what is meat by the -th term of a sequece.
More informationA New Constructive Proof of Graham's Theorem and More New Classes of Functionally Complete Functions
A New Costructive Proof of Graham's Theorem ad More New Classes of Fuctioally Complete Fuctios Azhou Yag, Ph.D. Zhu-qi Lu, Ph.D. Abstract A -valued two-variable truth fuctio is called fuctioally complete,
More informationAPPLICATION OF GEOMETRIC SEQUENCES AND SERIES: COMPOUND INTEREST AND ANNUITIES
APPLICATION OF GEOMETRIC SEQUENCES AND SERIES: COMPOUND INTEREST AND ANNUITIES Example: Brado s Problem Brado, who is ow sixtee, would like to be a poker champio some day. At the age of twety-oe, he would
More informationTwitter: @Owe134866 www.mathsfreeresourcelibrary.com Prior Kowledge Check 1) State whether each variable is qualitative or quatitative: a) Car colour Qualitative b) Miles travelled by a cyclist c) Favourite
More informationI. Measures of Central Tendency: -Allow us to summarize an entire data set with a single value (the midpoint).
I. Meaure of Cetral Tedecy: -Allow u to ummarize a etire data et with a igle value (the midpoit.. Mode : The value (core that occur mot ofte i a data et. -Mo x Sample mode -Mo Populatio mode. Media : the
More informationControl Charts for Mean under Shrinkage Technique
Helderma Verlag Ecoomic Quality Cotrol ISSN 0940-5151 Vol 24 (2009), No. 2, 255 261 Cotrol Charts for Mea uder Shrikage Techique J. R. Sigh ad Mujahida Sayyed Abstract: I this paper a attempt is made to
More informationAppendix 1 to Chapter 5
Appedix 1 to Chapter 5 Models of Asset Pricig I Chapter 4, we saw that the retur o a asset (such as a bod) measures how much we gai from holdig that asset. Whe we make a decisio to buy a asset, we are
More informationThese characteristics are expressed in terms of statistical properties which are estimated from the sample data.
0. Key Statistical Measures of Data Four pricipal features which characterize a set of observatios o a radom variable are: (i) the cetral tedecy or the value aroud which all other values are buched, (ii)
More informationCAPITAL ASSET PRICING MODEL
CAPITAL ASSET PRICING MODEL RETURN. Retur i respect of a observatio is give by the followig formula R = (P P 0 ) + D P 0 Where R = Retur from the ivestmet durig this period P 0 = Curret market price P
More informationof Asset Pricing R e = expected return
Appedix 1 to Chapter 5 Models of Asset Pricig EXPECTED RETURN I Chapter 4, we saw that the retur o a asset (such as a bod) measures how much we gai from holdig that asset. Whe we make a decisio to buy
More informationPoint Estimation by MLE Lesson 5
Poit Estimatio b MLE Lesso 5 Review Defied Likelihood Maximum Likelihood Estimatio Step : Costruct Likelihood Step : Maximize fuctio Take Log of likelihood fuctio Take derivative of fuctio Set derivative
More informationChpt 5. Discrete Probability Distributions. 5-3 Mean, Variance, Standard Deviation, and Expectation
Chpt 5 Discrete Probability Distributios 5-3 Mea, Variace, Stadard Deviatio, ad Expectatio 1/23 Homework p252 Applyig the Cocepts Exercises p253 1-19 2/23 Objective Fid the mea, variace, stadard deviatio,
More information