Maximum Empirical Likelihood Estimation (MELE)

Size: px
Start display at page:

Download "Maximum Empirical Likelihood Estimation (MELE)"

Transcription

1 Maximum Empirical Likelihood Estimatio (MELE Natha Smooha Abstract Estimatio of Stadard Liear Model - Maximum Empirical Likelihood Estimator: Combiatio of the idea of imum likelihood method of momets, Maximum Etropy Empirical Likelihood Estimator, Uivariate Iformatioal Measure, Relative Etropy, Kullback Leibler Distace (Discrepacy, Kullback-Leibler Iformatio Cirterio, Cressie-Read Distace (Discrepacy, α-etropy, Geeralized Empirical Likelihood (GEL Maximum Empirical Likelihood Estimatio Let y t, t =,2,...,, be a radom sample from the populatio distributio f (y t ;. The parametric imum likelihood estimatio requires the kowledge of the desity fuctio, ad imizes the log likelihood fuctio l L = l f (y t ; The kowledge of the desity fuctio implies the kowledge about the relatioship betwee the parameters ad the desity fuctio. Cosider a discrete Beroulli distirbutio: f (y t ; = y t ( y t, y t or Sice f (y t ; = P(y t = or P(y t, we may cosider the ML estimatio as a costraied imizatio l( s.t. = y t ( y t The distribtuio fuctio cotais all statistical properties of a radom variable, icludig momets, shape, etc. Suppose that we do ot have complete iformaito cotaied i the distributio fuctio, but have oly iformatio about the momets. Ca we still apply the same optimizatio procedure, replacig the desity fuctio with momet coditios as the costraits, i.e., ubiased estimatig fuctio? For example, l ( s.t. > 0, E(y t Note that we require a strict positivity for each. Otherwise, the joit desity will be zero. I fact, this coditio is already embedded i the object fucito because the object fucito will be egative ifiity if oe of the is zero. Oce problem with this formulatio is that the objective fuctio is ot bouded, while the desity fuctio is bouded. We eed a ormatilizatio costrait o. We will use = as the ormalizatio. Aother problem is how to compute the momet coditio without kowig the distributio fucito. The MME computes it by the sample mea: E(y t = (y t

2 This is equivalet to usig ( as the probability for each observatio. The empirical likelihood estimator uses the empirical probability i the place of ( : E(y t = (y t Uder these two modificatios we ca pose the problem as l( s.t. > 0, ( =, (y t ( Whe we itroduce the momet iformatio we eed to cosider the followig Lagrage equatio ( L = l( κ + (y t First order coditios are oliear i the parameters ad Lagrage multiplies, ad we caot fid the closed form solutios. However, from the first order coditios, we ca still derive importat results κ + (y t (3 κ = (4 (y t (5 Cosider equatio (3: κ κ + (y t κ + (y t (multiplied both sides by + (y t (summig both sides over t κ (by equatios (4 ad (5 Usig the estimate of κ, (6, i equatio (3, we obtai a estimate for : = ˆκ = (6 (2 + (y t = ˆ = + ˆ(y t (7 Whe we plug this estimate for,(7, ito equatio (5, we obtai ˆ as the solutio too: ˆ arg (y t + ˆ(y t (8 This ca be writte as a (-th order polyomial equatio i. The estimate of ca the be foud from the imizatio of the cocetrated objective fuctio l( ˆ (9 Page 2 of 5

3 The example above is the case of oly oe empirical momet. The MELE of distributio parameter i a geeral form ca be summarized as follows. We wish to imize the empirical likelihood fuctio l(l = l( subject to the strict positivity, ormalizatio, ad ubaised estimatig fuctio > 0, =, E(h t ( E[h(y t ;] where h t ( h(y t ; is a m vector for each t. Sice the true distirbutio fuctio is ukow, this is computed by empirical probability E(h t ( = h t ( Thus, the empirical Lagrage equaito ca be writte as L = l( κ ( where is a m-dimesioal vector of Lagrage multipliers. Oce agai, from the first order coditios, we ca derive importat results: + h t ( (0 κ + h t ( ( κ = (2 h t ( (3 Cosider equatio (: κ + h t ( κ + h t ( (multiplied both sides by κ + h t ( (summig both sides over t κ (by equatios (2 ad (3 = ˆκ = (4 Usig the estimate of κ, (4, i equatio (, we ca derive the solutio for for a give ad : + h t ( = ˆ = [ h t (] (5 By pluggig i (5 ito equatio (3, the solutio for for a give is give implicity by: h t ( h t ( (6 Page 3 of 5

4 Substituig the solutio for ito the empirical log-likelihood fuctio, we ca write a cocetrated likelihood fuctio as l(l = l( = l ( [ h t ( ] = Therefore, the origial imizatio problem is equivalet to mi l ( h t ( s.t. l( l ( h t ( (7 h t ( h t ( (8 Note that the costrait equatio that defies the solutio for implicitly is the same as the first order coditio of the imizatio of the followig equatio with respect to : l ( h t ( Hece, we ca write the problem i compact form as ˆ MEL argmi (9 l ( h t ( (20 Maximum Etropy Empirical Likelihood Estimator Uivariate Iformatioal Measure Suppose we have a set of evets E i with a probability p i. If we receive a message that a certai evet has occured, what will be a reasoable measure of the iformatioal cotet of such a message? Shao measured it by l( p i = l(p i. If p i is low (e.g., p i.0, E i is ot expected to occur ofte. If E i did occure, the ews of such a occurece is a surprise ad cotais a great deal of iformatio. This measure is ot symmetric i the sese that the message of occurece ad the message of o-occurece give differet values l( p i ad l( p i. Whe p i is low, the message of the occurece of E i is a big surprise, but the message of o-occurece is ot much of a surprise. Before we receive a message, the expected iformatioal cotet of the message is called Shao s etropy. Whe we have evets with probabilities p i, Shao s etropy is expressed as SE(p = p i l( p i = p i l(p i (2 The imum etropy empirical likelihood (MEEL estimator imizes this objective fuctio subject to the ormalizatio ad empirical momets costraits: ( p i p i l(p i s.t. p i =, where h i ( is a m vector. Settig uhe Lagrage equatio L = p i l(p i κ ( p i From the first order coditios, we ca derive importat results: p i h i ( (22 + p i h i ( (23 (l(p i + κ + h i ( (24 κ p i = (25 p i h i ( (26 Page 4 of 5

5 From equatio (24, we ca obtai a expressio for p i : (l(p i + κ + h i ( l(p i = h i ( κ + = p i = exp [ h i ( (κ + ] Takig this expressio for p i, we ow substitute it i (25: e h i ( e κ+ = = e κ+ = e h i ( Thus, the explicity solutio for p i is give by: ˆp i (, = e h i ( e h i ( (27 Now, substitutig the expressio for p i, (27, ito equatio (26, we derive a solutio for : e h i ( e h i ( h i ( = ˆ ( = e h i ( h i ( (28 Therefore, the origial imizatio problem is equivalet to ( p i ˆp i l( ˆp i s.t. e h i ( h i ( e h i ( (29 Note that the costrait equatio that defies the solutio for implicitly is the same as the first order coditio of the miimizatio of the followig equatio with respect to : mi l( e h i ( (30 Hece, we ca write the problem i compact form as ˆ MEEL arg mi l( e h i ( (3 Page 5 of 5

5. Best Unbiased Estimators

5. Best Unbiased Estimators Best Ubiased Estimators http://www.math.uah.edu/stat/poit/ubiased.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 5. Best Ubiased Estimators Basic Theory Cosider agai

More information

A random variable is a variable whose value is a numerical outcome of a random phenomenon.

A random variable is a variable whose value is a numerical outcome of a random phenomenon. The Practice of Statistics, d ed ates, Moore, ad Stares Itroductio We are ofte more iterested i the umber of times a give outcome ca occur tha i the possible outcomes themselves For example, if we toss

More information

Parametric Density Estimation: Maximum Likelihood Estimation

Parametric Density Estimation: Maximum Likelihood Estimation Parametric Desity stimatio: Maimum Likelihood stimatio C6 Today Itroductio to desity estimatio Maimum Likelihood stimatio Itroducto Bayesia Decisio Theory i previous lectures tells us how to desig a optimal

More information

ECON 5350 Class Notes Maximum Likelihood Estimation

ECON 5350 Class Notes Maximum Likelihood Estimation ECON 5350 Class Notes Maximum Likelihood Estimatio 1 Maximum Likelihood Estimatio Example #1. Cosider the radom sample {X 1 = 0.5, X 2 = 2.0, X 3 = 10.0, X 4 = 1.5, X 5 = 7.0} geerated from a expoetial

More information

point estimator a random variable (like P or X) whose values are used to estimate a population parameter

point estimator a random variable (like P or X) whose values are used to estimate a population parameter Estimatio We have oted that the pollig problem which attempts to estimate the proportio p of Successes i some populatio ad the measuremet problem which attempts to estimate the mea value µ of some quatity

More information

Statistics for Economics & Business

Statistics for Economics & Business Statistics for Ecoomics & Busiess Cofidece Iterval Estimatio Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for the mea ad the proportio How to determie

More information

14.30 Introduction to Statistical Methods in Economics Spring 2009

14.30 Introduction to Statistical Methods in Economics Spring 2009 MIT OpeCourseWare http://ocwmitedu 430 Itroductio to Statistical Methods i Ecoomics Sprig 009 For iformatio about citig these materials or our Terms of Use, visit: http://ocwmitedu/terms 430 Itroductio

More information

CHAPTER 8 Estimating with Confidence

CHAPTER 8 Estimating with Confidence CHAPTER 8 Estimatig with Cofidece 8.2 Estimatig a Populatio Proportio The Practice of Statistics, 5th Editio Stares, Tabor, Yates, Moore Bedford Freema Worth Publishers Estimatig a Populatio Proportio

More information

ii. Interval estimation:

ii. Interval estimation: 1 Types of estimatio: i. Poit estimatio: Example (1) Cosider the sample observatios 17,3,5,1,18,6,16,10 X 8 X i i1 8 17 3 5 118 6 16 10 8 116 8 14.5 14.5 is a poit estimate for usig the estimator X ad

More information

5 Statistical Inference

5 Statistical Inference 5 Statistical Iferece 5.1 Trasitio from Probability Theory to Statistical Iferece 1. We have ow more or less fiished the probability sectio of the course - we ow tur attetio to statistical iferece. I statistical

More information

Chapter 8. Confidence Interval Estimation. Copyright 2015, 2012, 2009 Pearson Education, Inc. Chapter 8, Slide 1

Chapter 8. Confidence Interval Estimation. Copyright 2015, 2012, 2009 Pearson Education, Inc. Chapter 8, Slide 1 Chapter 8 Cofidece Iterval Estimatio Copyright 2015, 2012, 2009 Pearso Educatio, Ic. Chapter 8, Slide 1 Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for

More information

STAT 135 Solutions to Homework 3: 30 points

STAT 135 Solutions to Homework 3: 30 points STAT 35 Solutios to Homework 3: 30 poits Sprig 205 The objective of this Problem Set is to study the Stei Pheomeo 955. Suppose that θ θ, θ 2,..., θ cosists of ukow parameters, with 3. We wish to estimate

More information

Math 124: Lecture for Week 10 of 17

Math 124: Lecture for Week 10 of 17 What we will do toight 1 Lecture for of 17 David Meredith Departmet of Mathematics Sa Fracisco State Uiversity 2 3 4 April 8, 2008 5 6 II Take the midterm. At the ed aswer the followig questio: To be revealed

More information

EVEN NUMBERED EXERCISES IN CHAPTER 4

EVEN NUMBERED EXERCISES IN CHAPTER 4 Joh Riley 7 July EVEN NUMBERED EXERCISES IN CHAPTER 4 SECTION 4 Exercise 4-: Cost Fuctio of a Cobb-Douglas firm What is the cost fuctio of a firm with a Cobb-Douglas productio fuctio? Rather tha miimie

More information

Combining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010

Combining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010 Combiig imperfect data, ad a itroductio to data assimilatio Ross Baister, NCEO, September 00 rbaister@readigacuk The probability desity fuctio (PDF prob that x lies betwee x ad x + dx p (x restrictio o

More information

Sampling Distributions and Estimation

Sampling Distributions and Estimation Cotets 40 Samplig Distributios ad Estimatio 40.1 Samplig Distributios 40. Iterval Estimatio for the Variace 13 Learig outcomes You will lear about the distributios which are created whe a populatio is

More information

FINM6900 Finance Theory How Is Asymmetric Information Reflected in Asset Prices?

FINM6900 Finance Theory How Is Asymmetric Information Reflected in Asset Prices? FINM6900 Fiace Theory How Is Asymmetric Iformatio Reflected i Asset Prices? February 3, 2012 Referece S. Grossma, O the Efficiecy of Competitive Stock Markets where Traders Have Diverse iformatio, Joural

More information

1 Random Variables and Key Statistics

1 Random Variables and Key Statistics Review of Statistics 1 Radom Variables ad Key Statistics Radom Variable: A radom variable is a variable that takes o differet umerical values from a sample space determied by chace (probability distributio,

More information

x satisfying all regularity conditions. Then

x satisfying all regularity conditions. Then AMS570.01 Practice Midterm Exam Sprig, 018 Name: ID: Sigature: Istructio: This is a close book exam. You are allowed oe-page 8x11 formula sheet (-sided). No cellphoe or calculator or computer is allowed.

More information

Estimating Proportions with Confidence

Estimating Proportions with Confidence Aoucemets: Discussio today is review for midterm, o credit. You may atted more tha oe discussio sectio. Brig sheets of otes ad calculator to midterm. We will provide Scatro form. Homework: (Due Wed Chapter

More information

Overlapping Generations

Overlapping Generations Eco. 53a all 996 C. Sims. troductio Overlappig Geeratios We wat to study how asset markets allow idividuals, motivated by the eed to provide icome for their retiremet years, to fiace capital accumulatio

More information

Chapter 8: Estimation of Mean & Proportion. Introduction

Chapter 8: Estimation of Mean & Proportion. Introduction Chapter 8: Estimatio of Mea & Proportio 8.1 Estimatio, Poit Estimate, ad Iterval Estimate 8.2 Estimatio of a Populatio Mea: σ Kow 8.3 Estimatio of a Populatio Mea: σ Not Kow 8.4 Estimatio of a Populatio

More information

Math 312, Intro. to Real Analysis: Homework #4 Solutions

Math 312, Intro. to Real Analysis: Homework #4 Solutions Math 3, Itro. to Real Aalysis: Homework #4 Solutios Stephe G. Simpso Moday, March, 009 The assigmet cosists of Exercises 0.6, 0.8, 0.0,.,.3,.6,.0,.,. i the Ross textbook. Each problem couts 0 poits. 0.6.

More information

Introduction to Probability and Statistics Chapter 7

Introduction to Probability and Statistics Chapter 7 Itroductio to Probability ad Statistics Chapter 7 Ammar M. Sarha, asarha@mathstat.dal.ca Departmet of Mathematics ad Statistics, Dalhousie Uiversity Fall Semester 008 Chapter 7 Statistical Itervals Based

More information

These characteristics are expressed in terms of statistical properties which are estimated from the sample data.

These characteristics are expressed in terms of statistical properties which are estimated from the sample data. 0. Key Statistical Measures of Data Four pricipal features which characterize a set of observatios o a radom variable are: (i) the cetral tedecy or the value aroud which all other values are buched, (ii)

More information

Lecture 4: Parameter Estimation and Confidence Intervals. GENOME 560 Doug Fowler, GS

Lecture 4: Parameter Estimation and Confidence Intervals. GENOME 560 Doug Fowler, GS Lecture 4: Parameter Estimatio ad Cofidece Itervals GENOME 560 Doug Fowler, GS (dfowler@uw.edu) 1 Review: Probability Distributios Discrete: Biomial distributio Hypergeometric distributio Poisso distributio

More information

Unbiased estimators Estimators

Unbiased estimators Estimators 19 Ubiased estimators I Chapter 17 we saw that a dataset ca be modeled as a realizatio of a radom sample from a probability distributio ad that quatities of iterest correspod to features of the model distributio.

More information

Inferential Statistics and Probability a Holistic Approach. Inference Process. Inference Process. Chapter 8 Slides. Maurice Geraghty,

Inferential Statistics and Probability a Holistic Approach. Inference Process. Inference Process. Chapter 8 Slides. Maurice Geraghty, Iferetial Statistics ad Probability a Holistic Approach Chapter 8 Poit Estimatio ad Cofidece Itervals This Course Material by Maurice Geraghty is licesed uder a Creative Commos Attributio-ShareAlike 4.0

More information

A Bayesian perspective on estimating mean, variance, and standard-deviation from data

A Bayesian perspective on estimating mean, variance, and standard-deviation from data Brigham Youg Uiversity BYU ScholarsArchive All Faculty Publicatios 006--05 A Bayesia perspective o estimatig mea, variace, ad stadard-deviatio from data Travis E. Oliphat Follow this ad additioal works

More information

The material in this chapter is motivated by Experiment 9.

The material in this chapter is motivated by Experiment 9. Chapter 5 Optimal Auctios The material i this chapter is motivated by Experimet 9. We wish to aalyze the decisio of a seller who sets a reserve price whe auctioig off a item to a group of bidders. We begi

More information

Summary. Recap. Last Lecture. .1 If you know MLE of θ, can you also know MLE of τ(θ) for any function τ?

Summary. Recap. Last Lecture. .1 If you know MLE of θ, can you also know MLE of τ(θ) for any function τ? Last Lecture Biostatistics 60 - Statistical Iferece Lecture Cramer-Rao Theorem Hyu Mi Kag February 9th, 03 If you kow MLE of, ca you also kow MLE of τ() for ay fuctio τ? What are plausible ways to compare

More information

1. Suppose X is a variable that follows the normal distribution with known standard deviation σ = 0.3 but unknown mean µ.

1. Suppose X is a variable that follows the normal distribution with known standard deviation σ = 0.3 but unknown mean µ. Chapter 9 Exercises Suppose X is a variable that follows the ormal distributio with kow stadard deviatio σ = 03 but ukow mea µ (a) Costruct a 95% cofidece iterval for µ if a radom sample of = 6 observatios

More information

Exam 1 Spring 2015 Statistics for Applications 3/5/2015

Exam 1 Spring 2015 Statistics for Applications 3/5/2015 8.443 Exam Sprig 05 Statistics for Applicatios 3/5/05. Log Normal Distributio: A radom variable X follows a Logormal(θ, σ ) distributio if l(x) follows a Normal(θ, σ ) distributio. For the ormal radom

More information

. The firm makes different types of furniture. Let x ( x1,..., x n. If the firm produces nothing it rents out the entire space and so has a profit of

. The firm makes different types of furniture. Let x ( x1,..., x n. If the firm produces nothing it rents out the entire space and so has a profit of Joh Riley F Maimizatio with a sigle costrait F3 The Ecoomic approach - - shadow prices Suppose that a firm has a log term retal of uits of factory space The firm ca ret additioal space at a retal rate

More information

Topic-7. Large Sample Estimation

Topic-7. Large Sample Estimation Topic-7 Large Sample Estimatio TYPES OF INFERENCE Ò Estimatio: É Estimatig or predictig the value of the parameter É What is (are) the most likely values of m or p? Ò Hypothesis Testig: É Decidig about

More information

Confidence Intervals Introduction

Confidence Intervals Introduction Cofidece Itervals Itroductio A poit estimate provides o iformatio about the precisio ad reliability of estimatio. For example, the sample mea X is a poit estimate of the populatio mea μ but because of

More information

Today: Finish Chapter 9 (Sections 9.6 to 9.8 and 9.9 Lesson 3)

Today: Finish Chapter 9 (Sections 9.6 to 9.8 and 9.9 Lesson 3) Today: Fiish Chapter 9 (Sectios 9.6 to 9.8 ad 9.9 Lesso 3) ANNOUNCEMENTS: Quiz #7 begis after class today, eds Moday at 3pm. Quiz #8 will begi ext Friday ad ed at 10am Moday (day of fial). There will be

More information

Lecture 5 Point Es/mator and Sampling Distribu/on

Lecture 5 Point Es/mator and Sampling Distribu/on Lecture 5 Poit Es/mator ad Samplig Distribu/o Fall 03 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech Road map Poit Es/ma/o Cofidece Iterval

More information

FOUNDATION ACTED COURSE (FAC)

FOUNDATION ACTED COURSE (FAC) FOUNDATION ACTED COURSE (FAC) What is the Foudatio ActEd Course (FAC)? FAC is desiged to help studets improve their mathematical skills i preparatio for the Core Techical subjects. It is a referece documet

More information

4.5 Generalized likelihood ratio test

4.5 Generalized likelihood ratio test 4.5 Geeralized likelihood ratio test A assumptio that is used i the Athlete Biological Passport is that haemoglobi varies equally i all athletes. We wish to test this assumptio o a sample of k athletes.

More information

Rafa l Kulik and Marc Raimondo. University of Ottawa and University of Sydney. Supplementary material

Rafa l Kulik and Marc Raimondo. University of Ottawa and University of Sydney. Supplementary material Statistica Siica 009: Supplemet 1 L p -WAVELET REGRESSION WITH CORRELATED ERRORS AND INVERSE PROBLEMS Rafa l Kulik ad Marc Raimodo Uiversity of Ottawa ad Uiversity of Sydey Supplemetary material This ote

More information

Notes on Expected Revenue from Auctions

Notes on Expected Revenue from Auctions Notes o Epected Reveue from Auctios Professor Bergstrom These otes spell out some of the mathematical details about first ad secod price sealed bid auctios that were discussed i Thursday s lecture You

More information

18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013

18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013 18.S096 Problem Set 5 Fall 2013 Volatility Modelig Due Date: 10/29/2013 1. Sample Estimators of Diffusio Process Volatility ad Drift Let {X t } be the price of a fiacial security that follows a geometric

More information

Subject CT5 Contingencies Core Technical. Syllabus. for the 2011 Examinations. The Faculty of Actuaries and Institute of Actuaries.

Subject CT5 Contingencies Core Technical. Syllabus. for the 2011 Examinations. The Faculty of Actuaries and Institute of Actuaries. Subject CT5 Cotigecies Core Techical Syllabus for the 2011 Examiatios 1 Jue 2010 The Faculty of Actuaries ad Istitute of Actuaries Aim The aim of the Cotigecies subject is to provide a groudig i the mathematical

More information

Online appendices from The xva Challenge by Jon Gregory. APPENDIX 10A: Exposure and swaption analogy.

Online appendices from The xva Challenge by Jon Gregory. APPENDIX 10A: Exposure and swaption analogy. APPENDIX 10A: Exposure ad swaptio aalogy. Sorese ad Bollier (1994), effectively calculate the CVA of a swap positio ad show this ca be writte as: CVA swap = LGD V swaptio (t; t i, T) PD(t i 1, t i ). i=1

More information

Lecture 4: Probability (continued)

Lecture 4: Probability (continued) Lecture 4: Probability (cotiued) Desity Curves We ve defied probabilities for discrete variables (such as coi tossig). Probabilities for cotiuous or measuremet variables also are evaluated usig relative

More information

STRAND: FINANCE. Unit 3 Loans and Mortgages TEXT. Contents. Section. 3.1 Annual Percentage Rate (APR) 3.2 APR for Repayment of Loans

STRAND: FINANCE. Unit 3 Loans and Mortgages TEXT. Contents. Section. 3.1 Annual Percentage Rate (APR) 3.2 APR for Repayment of Loans CMM Subject Support Strad: FINANCE Uit 3 Loas ad Mortgages: Text m e p STRAND: FINANCE Uit 3 Loas ad Mortgages TEXT Cotets Sectio 3.1 Aual Percetage Rate (APR) 3.2 APR for Repaymet of Loas 3.3 Credit Purchases

More information

B = A x z

B = A x z 114 Block 3 Erdeky == Begi 6.3 ============================================================== 1 / 8 / 2008 1 Correspodig Areas uder a ormal curve ad the stadard ormal curve are equal. Below: Area B = Area

More information

SELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION

SELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION 1 SELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION Hyue-Ju Kim 1,, Bibig Yu 2, ad Eric J. Feuer 3 1 Syracuse Uiversity, 2 Natioal Istitute of Agig, ad 3 Natioal Cacer Istitute Supplemetary

More information

Further Pure 1 Revision Topic 5: Sums of Series

Further Pure 1 Revision Topic 5: Sums of Series The OCR syllabus says that cadidates should: Further Pure Revisio Topic 5: Sums of Series Cadidates should be able to: (a) use the stadard results for Σr, Σr, Σr to fid related sums; (b) use the method

More information

Standard Deviations for Normal Sampling Distributions are: For proportions For means _

Standard Deviations for Normal Sampling Distributions are: For proportions For means _ Sectio 9.2 Cofidece Itervals for Proportios We will lear to use a sample to say somethig about the world at large. This process (statistical iferece) is based o our uderstadig of samplig models, ad will

More information

. (The calculated sample mean is symbolized by x.)

. (The calculated sample mean is symbolized by x.) Stat 40, sectio 5.4 The Cetral Limit Theorem otes by Tim Pilachowski If you have t doe it yet, go to the Stat 40 page ad dowload the hadout 5.4 supplemet Cetral Limit Theorem. The homework (both practice

More information

Confidence Intervals. CI for a population mean (σ is known and n > 30 or the variable is normally distributed in the.

Confidence Intervals. CI for a population mean (σ is known and n > 30 or the variable is normally distributed in the. Cofidece Itervals A cofidece iterval is a iterval whose purpose is to estimate a parameter (a umber that could, i theory, be calculated from the populatio, if measuremets were available for the whole populatio).

More information

An Empirical Study of the Behaviour of the Sample Kurtosis in Samples from Symmetric Stable Distributions

An Empirical Study of the Behaviour of the Sample Kurtosis in Samples from Symmetric Stable Distributions A Empirical Study of the Behaviour of the Sample Kurtosis i Samples from Symmetric Stable Distributios J. Marti va Zyl Departmet of Actuarial Sciece ad Mathematical Statistics, Uiversity of the Free State,

More information

A point estimate is the value of a statistic that estimates the value of a parameter.

A point estimate is the value of a statistic that estimates the value of a parameter. Chapter 9 Estimatig the Value of a Parameter Chapter 9.1 Estimatig a Populatio Proportio Objective A : Poit Estimate A poit estimate is the value of a statistic that estimates the value of a parameter.

More information

Control Charts for Mean under Shrinkage Technique

Control Charts for Mean under Shrinkage Technique Helderma Verlag Ecoomic Quality Cotrol ISSN 0940-5151 Vol 24 (2009), No. 2, 255 261 Cotrol Charts for Mea uder Shrikage Techique J. R. Sigh ad Mujahida Sayyed Abstract: I this paper a attempt is made to

More information

BIOSTATS 540 Fall Estimation Page 1 of 72. Unit 6. Estimation. Use at least twelve observations in constructing a confidence interval

BIOSTATS 540 Fall Estimation Page 1 of 72. Unit 6. Estimation. Use at least twelve observations in constructing a confidence interval BIOSTATS 540 Fall 015 6. Estimatio Page 1 of 7 Uit 6. Estimatio Use at least twelve observatios i costructig a cofidece iterval - Gerald va Belle What is the mea of the blood pressures of all the studets

More information

AY Term 2 Mock Examination

AY Term 2 Mock Examination AY 206-7 Term 2 Mock Examiatio Date / Start Time Course Group Istructor 24 March 207 / 2 PM to 3:00 PM QF302 Ivestmet ad Fiacial Data Aalysis G Christopher Tig INSTRUCTIONS TO STUDENTS. This mock examiatio

More information

11.7 (TAYLOR SERIES) NAME: SOLUTIONS 31 July 2018

11.7 (TAYLOR SERIES) NAME: SOLUTIONS 31 July 2018 .7 (TAYLOR SERIES NAME: SOLUTIONS 3 July 08 TAYLOR SERIES ( The power series T(x f ( (c (x c is called the Taylor Series for f(x cetered at x c. If c 0, this is called a Maclauri series. ( The N-th partial

More information

Kernel Density Estimation. Let X be a random variable with continuous distribution F (x) and density f(x) = d

Kernel Density Estimation. Let X be a random variable with continuous distribution F (x) and density f(x) = d Kerel Desity Estimatio Let X be a radom variable wit cotiuous distributio F (x) ad desity f(x) = d dx F (x). Te goal is to estimate f(x). Wile F (x) ca be estimated by te EDF ˆF (x), we caot set ˆf(x)

More information

2.6 Rational Functions and Their Graphs

2.6 Rational Functions and Their Graphs .6 Ratioal Fuctios ad Their Graphs Sectio.6 Notes Page Ratioal Fuctio: a fuctio with a variable i the deoiator. To fid the y-itercept for a ratioal fuctio, put i a zero for. To fid the -itercept for a

More information

Many Techniques Developed. Uncertainty. Aspects of Uncertainty. Decision Theory = Probability + Utility Theory

Many Techniques Developed. Uncertainty. Aspects of Uncertainty. Decision Theory = Probability + Utility Theory Ucertait CSE 47 Ma Techiques Developed Fu Logic Certait Factors No-mootoic logic robabilit Ol oe has stood the test of time! UW CSE AI Facult Aspects of Ucertait Suppose ou have a flight at oo Whe should

More information

Solutions to Problem Sheet 1

Solutions to Problem Sheet 1 Solutios to Problem Sheet ) Use Theorem.4 to prove that p log for all real x 3. This is a versio of Theorem.4 with the iteger N replaced by the real x. Hit Give x 3 let N = [x], the largest iteger x. The,

More information

Subject CT1 Financial Mathematics Core Technical Syllabus

Subject CT1 Financial Mathematics Core Technical Syllabus Subject CT1 Fiacial Mathematics Core Techical Syllabus for the 2018 exams 1 Jue 2017 Subject CT1 Fiacial Mathematics Core Techical Aim The aim of the Fiacial Mathematics subject is to provide a groudig

More information

Chpt 5. Discrete Probability Distributions. 5-3 Mean, Variance, Standard Deviation, and Expectation

Chpt 5. Discrete Probability Distributions. 5-3 Mean, Variance, Standard Deviation, and Expectation Chpt 5 Discrete Probability Distributios 5-3 Mea, Variace, Stadard Deviatio, ad Expectatio 1/23 Homework p252 Applyig the Cocepts Exercises p253 1-19 2/23 Objective Fid the mea, variace, stadard deviatio,

More information

BASIC STATISTICS ECOE 1323

BASIC STATISTICS ECOE 1323 BASIC STATISTICS ECOE 33 SPRING 007 FINAL EXAM NAME: ID NUMBER: INSTRUCTIONS:. Write your ame ad studet ID.. You have hours 3. This eam must be your ow work etirely. You caot talk to or share iformatio

More information

Appendix 1 to Chapter 5

Appendix 1 to Chapter 5 Appedix 1 to Chapter 5 Models of Asset Pricig I Chapter 4, we saw that the retur o a asset (such as a bod) measures how much we gai from holdig that asset. Whe we make a decisio to buy a asset, we are

More information

Topic 14: Maximum Likelihood Estimation

Topic 14: Maximum Likelihood Estimation Toic 4: November, 009 As before, we begi with a samle X = (X,, X of radom variables chose accordig to oe of a family of robabilities P θ I additio, f(x θ, x = (x,, x will be used to deote the desity fuctio

More information

APPLICATION OF GEOMETRIC SEQUENCES AND SERIES: COMPOUND INTEREST AND ANNUITIES

APPLICATION OF GEOMETRIC SEQUENCES AND SERIES: COMPOUND INTEREST AND ANNUITIES APPLICATION OF GEOMETRIC SEQUENCES AND SERIES: COMPOUND INTEREST AND ANNUITIES Example: Brado s Problem Brado, who is ow sixtee, would like to be a poker champio some day. At the age of twety-oe, he would

More information

Models of Asset Pricing

Models of Asset Pricing 4 Appedix 1 to Chapter Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see

More information

of Asset Pricing R e = expected return

of Asset Pricing R e = expected return Appedix 1 to Chapter 5 Models of Asset Pricig EXPECTED RETURN I Chapter 4, we saw that the retur o a asset (such as a bod) measures how much we gai from holdig that asset. Whe we make a decisio to buy

More information

Anomaly Correction by Optimal Trading Frequency

Anomaly Correction by Optimal Trading Frequency Aomaly Correctio by Optimal Tradig Frequecy Yiqiao Yi Columbia Uiversity September 9, 206 Abstract Uder the assumptio that security prices follow radom walk, we look at price versus differet movig averages.

More information

of Asset Pricing APPENDIX 1 TO CHAPTER EXPECTED RETURN APPLICATION Expected Return

of Asset Pricing APPENDIX 1 TO CHAPTER EXPECTED RETURN APPLICATION Expected Return APPENDIX 1 TO CHAPTER 5 Models of Asset Pricig I Chapter 4, we saw that the retur o a asset (such as a bod) measures how much we gai from holdig that asset. Whe we make a decisio to buy a asset, we are

More information

1 Estimating sensitivities

1 Estimating sensitivities Copyright c 27 by Karl Sigma 1 Estimatig sesitivities Whe estimatig the Greeks, such as the, the geeral problem ivolves a radom variable Y = Y (α) (such as a discouted payoff) that depeds o a parameter

More information

Models of Asset Pricing

Models of Asset Pricing APPENDIX 1 TO CHAPTER 4 Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see

More information

Models of Asset Pricing

Models of Asset Pricing APPENDIX 1 TO CHAPTER4 Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see

More information

CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions

CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Meas ad Proportios Itroductio: I this chapter we wat to fid out the value of a parameter for a populatio. We do t kow the value of this parameter for the etire

More information

Monetary Economics: Problem Set #5 Solutions

Monetary Economics: Problem Set #5 Solutions Moetary Ecoomics oblem Set #5 Moetary Ecoomics: oblem Set #5 Solutios This problem set is marked out of 1 poits. The weight give to each part is idicated below. Please cotact me asap if you have ay questios.

More information

r i = a i + b i f b i = Cov[r i, f] The only parameters to be estimated for this model are a i 's, b i 's, σe 2 i

r i = a i + b i f b i = Cov[r i, f] The only parameters to be estimated for this model are a i 's, b i 's, σe 2 i The iformatio required by the mea-variace approach is substatial whe the umber of assets is large; there are mea values, variaces, ad )/2 covariaces - a total of 2 + )/2 parameters. Sigle-factor model:

More information

Sampling Distributions & Estimators

Sampling Distributions & Estimators API-209 TF Sessio 2 Teddy Svoroos September 18, 2015 Samplig Distributios & Estimators I. Estimators The Importace of Samplig Radomly Three Properties of Estimators 1. Ubiased 2. Cosistet 3. Efficiet I

More information

Limits of sequences. Contents 1. Introduction 2 2. Some notation for sequences The behaviour of infinite sequences 3

Limits of sequences. Contents 1. Introduction 2 2. Some notation for sequences The behaviour of infinite sequences 3 Limits of sequeces I this uit, we recall what is meat by a simple sequece, ad itroduce ifiite sequeces. We explai what it meas for two sequeces to be the same, ad what is meat by the -th term of a sequece.

More information

MODIFICATION OF HOLT S MODEL EXEMPLIFIED BY THE TRANSPORT OF GOODS BY INLAND WATERWAYS TRANSPORT

MODIFICATION OF HOLT S MODEL EXEMPLIFIED BY THE TRANSPORT OF GOODS BY INLAND WATERWAYS TRANSPORT The publicatio appeared i Szoste R.: Modificatio of Holt s model exemplified by the trasport of goods by ilad waterways trasport, Publishig House of Rzeszow Uiversity of Techology No. 85, Maagemet ad Maretig

More information

Estimating the Parameters of the Three-Parameter Lognormal Distribution

Estimating the Parameters of the Three-Parameter Lognormal Distribution Florida Iteratioal Uiversity FIU Digital Commos FIU Electroic Theses ad Dissertatios Uiversity Graduate School 3-30-0 Estimatig the Parameters of the Three-Parameter Logormal Distributio Rodrigo J. Aristizabal

More information

NOTES ON ESTIMATION AND CONFIDENCE INTERVALS. 1. Estimation

NOTES ON ESTIMATION AND CONFIDENCE INTERVALS. 1. Estimation NOTES ON ESTIMATION AND CONFIDENCE INTERVALS MICHAEL N. KATEHAKIS 1. Estimatio Estimatio is a brach of statistics that deals with estimatig the values of parameters of a uderlyig distributio based o observed/empirical

More information

Bayes Estimator for Coefficient of Variation and Inverse Coefficient of Variation for the Normal Distribution

Bayes Estimator for Coefficient of Variation and Inverse Coefficient of Variation for the Normal Distribution Iteratioal Joural of Statistics ad Systems ISSN 0973-675 Volume, Number 4 (07, pp. 7-73 Research Idia Publicatios http://www.ripublicatio.com Bayes Estimator for Coefficiet of Variatio ad Iverse Coefficiet

More information

Online appendices from Counterparty Risk and Credit Value Adjustment a continuing challenge for global financial markets by Jon Gregory

Online appendices from Counterparty Risk and Credit Value Adjustment a continuing challenge for global financial markets by Jon Gregory Olie appedices from Couterparty Risk ad Credit Value Adjustmet a APPENDIX 8A: Formulas for EE, PFE ad EPE for a ormal distributio Cosider a ormal distributio with mea (expected future value) ad stadard

More information

Lecture 9: The law of large numbers and central limit theorem

Lecture 9: The law of large numbers and central limit theorem Lecture 9: The law of large umbers ad cetral limit theorem Theorem.4 Let X,X 2,... be idepedet radom variables with fiite expectatios. (i) (The SLLN). If there is a costat p [,2] such that E X i p i i=

More information

ACTUARIAL RESEARCH CLEARING HOUSE 1990 VOL. 2 INTEREST, AMORTIZATION AND SIMPLICITY. by Thomas M. Zavist, A.S.A.

ACTUARIAL RESEARCH CLEARING HOUSE 1990 VOL. 2 INTEREST, AMORTIZATION AND SIMPLICITY. by Thomas M. Zavist, A.S.A. ACTUARIAL RESEARCH CLEARING HOUSE 1990 VOL. INTEREST, AMORTIZATION AND SIMPLICITY by Thomas M. Zavist, A.S.A. 37 Iterest m Amortizatio ad Simplicity Cosider simple iterest for a momet. Suppose you have

More information

INTERVAL GAMES. and player 2 selects 1, then player 2 would give player 1 a payoff of, 1) = 0.

INTERVAL GAMES. and player 2 selects 1, then player 2 would give player 1 a payoff of, 1) = 0. INTERVAL GAMES ANTHONY MENDES Let I ad I 2 be itervals of real umbers. A iterval game is played i this way: player secretly selects x I ad player 2 secretly ad idepedetly selects y I 2. After x ad y are

More information

Twitter: @Owe134866 www.mathsfreeresourcelibrary.com Prior Kowledge Check 1) State whether each variable is qualitative or quatitative: a) Car colour Qualitative b) Miles travelled by a cyclist c) Favourite

More information

1 Basic Growth Models

1 Basic Growth Models UCLA Aderso MGMT37B: Fudametals i Fiace Fall 015) Week #1 rofessor Eduardo Schwartz November 9, 015 Hadout writte by Sheje Hshieh 1 Basic Growth Models 1.1 Cotiuous Compoudig roof: lim 1 + i m = expi)

More information

Problem Set 1a - Oligopoly

Problem Set 1a - Oligopoly Advaced Idustrial Ecoomics Sprig 2014 Joha Steek 6 may 2014 Problem Set 1a - Oligopoly 1 Table of Cotets 2 Price Competitio... 3 2.1 Courot Oligopoly with Homogeous Goods ad Differet Costs... 3 2.2 Bertrad

More information

Lecture 5: Sampling Distribution

Lecture 5: Sampling Distribution Lecture 5: Samplig Distributio Readigs: Sectios 5.5, 5.6 Itroductio Parameter: describes populatio Statistic: describes the sample; samplig variability Samplig distributio of a statistic: A probability

More information

Institute of Actuaries of India Subject CT5 General Insurance, Life and Health Contingencies

Institute of Actuaries of India Subject CT5 General Insurance, Life and Health Contingencies Istitute of Actuaries of Idia Subject CT5 Geeral Isurace, Life ad Health Cotigecies For 2017 Examiatios Aim The aim of the Cotigecies subject is to provide a groudig i the mathematical techiques which

More information

The Idea of a Confidence Interval

The Idea of a Confidence Interval AP Statistics Ch. 8 Notes Estimatig with Cofidece I the last chapter, we aswered questios about what samples should look like assumig that we kew the true values of populatio parameters (like μ, σ, ad

More information

Exam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011

Exam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011 15.075 Exam 2 Istructor: Cythia Rudi TA: Dimitrios Bisias October 25, 2011 Gradig is based o demostratio of coceptual uderstadig, so you eed to show all of your work. Problem 1 You are i charge of a study

More information

CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions

CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Meas ad Proportios Itroductio: We wat to kow the value of a parameter for a populatio. We do t kow the value of this parameter for the etire populatio because

More information

Mixed and Implicit Schemes Implicit Schemes. Exercise: Verify that ρ is unimodular: ρ = 1.

Mixed and Implicit Schemes Implicit Schemes. Exercise: Verify that ρ is unimodular: ρ = 1. Mixed ad Implicit Schemes 3..4 The leapfrog scheme is stable for the oscillatio equatio ad ustable for the frictio equatio. The Euler forward scheme is stable for the frictio equatio but ustable for the

More information

1 The Black-Scholes model

1 The Black-Scholes model The Blac-Scholes model. The model setup I the simplest versio of the Blac-Scholes model the are two assets: a ris-less asset ba accout or bod)withpriceprocessbt) at timet, adarisyasset stoc) withpriceprocess

More information

Binomial Model. Stock Price Dynamics. The Key Idea Riskless Hedge

Binomial Model. Stock Price Dynamics. The Key Idea Riskless Hedge Biomial Model Stock Price Dyamics The value of a optio at maturity depeds o the price of the uderlyig stock at maturity. The value of the optio today depeds o the expected value of the optio at maturity

More information