A New Hybrid Estimation Method for the Generalized Pareto Distribution
|
|
- Marsha Young
- 6 years ago
- Views:
Transcription
1 A New Hybrid Estimation Method for the Generalized Pareto Distribution Chunlin Wang Department of Mathematics and Statistics University of Calgary May 18, 2011 A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
2 1 Introduction The Generalized Pareto Distribution Application 2 Estimation of the GPD Parameters A Review of Literature The Maximum Likelihood Estimation The Maximum Goodness-of-Fit Estimation A New Hybrid Estimation Method 3 Simulation Study Bias and MSE Comparisons 4 An Example An Example: Bilbao waves data 5 Final Conclusions A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
3 The Generalized Pareto Distribution The Generalized Pareto Distribution The Generalized Pareto Distribution (GPD) is a two-parameter family of distributions first introduced by Pickands (1975) with the distribution function (cdf) F σ,k (x) = and the probability density function (pdf) { 1 (1 kx/σ) 1/k, if k 0, 1 e x/σ, if k = 0, (1) f σ,k (x) = { σ 1 (1 kx/σ) 1/k 1, if k 0, σ 1 e x/σ, if k = 0, where the σ > 0 and < k < are the scale and shape parameters, and the domain of x is (0, ) when k 0 or (0, σ/k) when k > 0. We denote the above distribution by GPD(σ, k). (2) A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
4 The Generalized Pareto Distribution The Generalized Pareto Distribution The GPD is important because of its versatility and flexibility. The special cases of GPD are when k = 1, the GPD becomes the uniform distribution in the range [0, σ]; when k = 0, the GPD becomes the exponential distribution with mean σ as taken the limit; when k < 0, the GPD reduces to the Pareto distribution (PD). The mean of the GPD is σ/(1 + k); and the variance of the GPD is σ 2 /[(1 + k) 2 (1 + 2k)], but its mean and variance exist only if k > 1 and k > 1/2, respectively. In general, the rth central moment of the GPD exists only if k > 1/r. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
5 The Generalized Pareto Distribution Graphing the GPD The Figure 1 shows the density functions of the GPD with σ = 1 fixed. Plot of GPD density, with σ = 1 fixed, and k > 0 Plot of GPD density, with σ = 1 fixed, and k <= 0 f(x) k=0.1 k=0.5 k=0.75 k=1 k=1.25 f(x) k = 0 k = 0.5 k = x x Figure 1: The Density functions of the GPD with different k. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
6 Application Application: Peaks Over Thresholds (POT) In extreme value theory, there are generally two methods for modeling the extremes: The classical approach is based on the limiting distribution of the maxima or minima of a sequence of i.i.d. random variables, which turns out to be the generalized extreme value distribution (GEVD). The GPD was introduced to model the exceedences X i t over a high threshold, where {X i } are the sample observations and t is a given threshold: examples are flood levels of rivers, heights of waves, etc. An attractive and useful feature of the GPD in this application is its stability. It may easily be shown that if X follows a GPD(σ, k), then the conditional distribution of X t given that X > t for any level t follows the GPD(σ kt, k). A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
7 A Review of Literature A Review of Literature Given a random sample from the GPD, most of the existing estimation methods for the GPD parameters σ and k can give some theoretical or computational problems. As the most classical and important method of estimation in statistics, the maximum likelihood (ML) method, has been considered by DuMouchel (1983), Davison (1984), Smith (1984, 1985), Grimshaw (1993), Choulakian and Stephens (2001), and the references therein. We will present the ML method in more details in the next section. Hosking and Wallis (1987) and Dupuis and Tsao (1998) studied some alternative estimation methods to the method of moment (MOM), and the probability-weighted moment (PWM) method. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
8 A Review of Literature A Review of Literature Castillo and Hadi (1997) proposed an elemental percentile method (EPM) which was based on the idea to make full use of the order statistics by initially equating the GPD distribution function to all pairs of the order statistics, and then use the median as the overall estimates of σ and k. Luceño (2006) brought out the maximum goodness-of-fit estimation (MGFE) method based on the family of the empirical distribution function (EDF) statistics. In fact, this method can be dated back to Wolfowitz (1953, 1957) under a more general name of minimum distance estimation. We will carefully investigate the MGFE method in the next section, and borrow some of its ideas to develop our new hybrid estimation method. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
9 A Review of Literature A Review of Literature Zhang (2007) suggested the likelihood moment estimation (LME) method for the GPD to overcome the computational problems faced by the ML method. Zhang and Stephens (2009) provided a new efficient estimation method based on the likelihood and the empirical Bayesian method (EBM). But this method is quite sensitive to the choice of the shape of the prior distribution as indicated in their paper. In order to improve the poor performance of the EBM estimators in the heavy-tailed cases, Zhang (2010) introduced a modified EBM (EBM*) by updating a more reliable and adaptive prior. The main conclusion of the paper was that the EBM* generally outperforms the other existing estimation procedures in the range 6 < k < 1/2, in terms of estimation bias and efficiency. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
10 The Maximum Likelihood Estimation The Estimating Equations Given a random sample X = (X 1, X 2,..., X n ) from the GPD with the cdf given in (1), the log-likelihood function is given by ( l(σ, k; X ) = n log σ 1 1 ) n ( log 1 kx ) i. k σ i=1 To find the maximum of the log-likelihood over the parameter space A = {k < 0, σ > 0} {k > 0, σ/k > X (n) }, consider the first derivatives of the GPD log-likelihood with respect to k and σ, and set them to be zero to have the following estimating equations { n n(k 1) = i=1 log ( 1 kx ) i n σ + (k 1) i=1 k = n 1 n i=1 log ( 1 kx ) i σ. ( ) 1 kx i 1 σ, A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
11 The Maximum Likelihood Estimation The Estimating Equations As pointed out by Davison (1984), the above bivariate maximization can be reduced to a one-dimensional search because the two estimating equations are only dependent on the ratio θ = k/σ (θ < 1/X (n) ), and then given a value of θ, a close-form expression for k is available. So it is natural and convenient to reparameterize the (σ, k) to (θ, k). Based on the log-likelihood function of (θ, k) and substituting k with k = n 1 n i=1 log (1 θx i), we have the profile log-likelihood function of θ given by [ ] n l(θ; X ) = n log (1 θx i ) n log 1 n log (1 θx i ). (3) nθ i=1 i=1 A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
12 The Maximum Likelihood Estimation Computing the MLE Supposed a local maximum of (3) can be found at ˆθ MLE numerically over the parameter space B = { θ < 1/X (n) }, then the MLE of σ and k are given by ˆk MLE = n 1 n log(1 ˆθ MLE X i ) and ˆσ MLE = ˆk MLE /ˆθ MLE. (4) i=1 But the numerical solution of ˆθ MLE could be complex since there could have more than one root for the first derivative of (3) to be zero, and some convergence problem may occur when θ gets closer to its boundary, so the constraint θ < 1/X (n) needs to be cared about. An algorithm for computing the MLE for the GPD parameters was designed in Grimshaw (1993). A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
13 The Maximum Likelihood Estimation Computing the MLE When k < 1/2, Smith (1984) proved that the ML estimators given in (4) is asymptotically normally distributed with the asymptotic variances achieving the Cramer-Rao lower bound under some proper regularity conditions. Specifically, we have [ ˆσMLE ˆk MLE ] N ([ σ k ], n 1[ 2σ 2 (1 k) σ(1 k) ]) σ(1 k) (1 k) 2, k < 1/2. When k 1/2, Smith (1984) identified as the non-regular case since the regularity conditions fail to hold, and the convergence problems may occur in this case. When k > 1, the MLE does not exist because the likelihood function near the endpoint tends to infinity as x approaches σ/k. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
14 The Maximum Goodness-of-Fit Estimation EDF Statistics Given a random sample X = (X 1, X 2,..., X n ) from a continuous distribution function F (x; θ), let F n (x) denote the empirical distribution function (EDF), that is F n (x) = 1 n n I Xi (x), i=1 where I Xi (x) = 1 if X i x, and I Xi (x) = 0 if X i > x. Then any statistic that measures the discrepancy between F n (x) and F (x; θ) is called an EDF statistic, which is originally used to test the goodness-of-fit (GOF) of fitting a continuous probability distribution to sample data. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
15 The Maximum Goodness-of-Fit Estimation EDF Statistics There are mainly two classes of EDF statistics: the supremum EDF statistics which include the Kolmogorov-Smirnov (KS) statistic, the Kuiper statistic; and the integral EDF statistics which include the Craḿer-von Mises statistic (CM), the Anderson-Darling (AD) statistic and etc. In Luceño (2006), the idea of GOF was borrowed for the parameter estimation purpose for the GPD. The proposed maximum goodness-of-fit estimator (MGFE) was obtained by minimizing any of the EDF statistics with respect to unknown parameters σ and k. We will only focus on the MGFE based on the AD statistic. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
16 The Maximum Goodness-of-Fit Estimation Computing the MGFE In terms of the GPD with the cdf F (x; σ, k), the definition of the AD statistic A 2 (σ, k) is A 2 (σ, k) = n {F n (x) F (x; σ, k)} 2 {F (x; σ, k)(1 F (x; σ, k)} 1 df (x; σ, k) For computational purposes, the above AD statistic can be expressed in an alternative form since the F n (x) is a step function with jump at each order statistics. By applying the probability integral transformation to the ordered sample, we denote z i = F (x (i) ; σ, k), i = 1,... n. Then the AD statistic A 2 (σ, k) can be written as follows A 2 (σ, k) = n 1 n n {(2i 1) ln z i + (2n + 1 2i) ln(1 z i )}. (5) i=1 A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
17 The Maximum Goodness-of-Fit Estimation Computing the MGFE The final estimates ˆσ MGFE and ˆk MGFE of the GPD are obtained by minimizing the AD statistic A 2 (σ, k; x) given in (5) with respect to the unknown parameters σ and k. The minimization should be carefully performed over the parameter space A = {k < 0, σ > 0} {k > 0, σ/k > X (n) }. In general, the technique of MGFE was shown to be able to deal with the GPD parameters estimation when the MLE and other methods failed, and even in the context of generalized linear model. However, the two-dimensional numerical optimization could be complex and relatively time-consuming, and a well specified starting point (σ (0), k (0) ) could be useful. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
18 A New Hybrid Estimation Method Motivation As we have discussed, the MLE can possess high large-sample efficiency whenever it exists in a restricted parameter space, while the MGFE have small bias and can always be found provided a well chosen initial point. Motivated by the idea to take advantage of both the MGFE and the MLE, we propose a new hybrid estimation method, which primarily relies on the MGFE to maintain the small bias and then improves the efficiency by incorporating the useful maximum likelihood information. At the same time, the computational effort is also greatly reduced. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
19 A New Hybrid Estimation Method Computing the New Hybrid Estimates Under the reparameterization of θ = k/σ for the GPD, the MLE of k and θ must satisfy k = n 1 n i=1 log (1 θx i). For the MGFE based on the AD statistic A 2 (σ, k; X ), we can consider the reparameterized version and substitute the above maximum likelihood relationship into it to have a simplified univariate minimization problem. Specifically, we consider minimizing the target function G, so the problem becomes a univariate minimization given the maximum likelihood relationship as a constraint min G(θ; X ) = min θ B σ,k A A2 (σ, k; X ) θ = k/σ, k = n 1 log (1 θx i ). A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
20 A New Hybrid Estimation Method Computing the New Hybrid Estimates The target function G based on AD statistic can be written in a simple computational form { G(θ; X ) = n 1 n (2i 1) log [1 (1 θx i ) n/ ] j log(1 θx j ) n i=1 } log(1 θx i ) n (2n + 1 2i) j log(1 θx. (6) j) In the POT applications the sample size is usual small. To reduce the bias in such cases, through our extensive simulation, an effective adjustment in the above G(θ; X ) is suggested, which is to replace the first n of the last term by (n 0.5) to ensure that as n gets larger, this adjustment vanishes. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
21 A New Hybrid Estimation Method Computing the New Hybrid Estimates Our new hybrid estimator ˆθ NEW of θ is defined to be the value of θ at which G(θ; X ) is minimized subject to the boundary condition θ < 1/X (n). Finally, the new hybrid estimators ˆσ NEW and ˆk NEW can be calculated as ˆk NEW = n 1 n log(1 ˆθ NEW X i ) and ˆσ NEW = ˆk NEW /ˆθ NEW. (7) i=1 It is easy to see that the new hybrid estimators ˆk NEW and ˆσ NEW will always give valid estimates. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
22 A New Hybrid Estimation Method Inference Because the new hybrid method combines both the maximum goodness-of-fit and the maximum likelihood methods, it seems not easy to derive the asymptotic variances of these new estimators. Fortunately, the bootstrap resampling method introduced by Efron (1977) provides us an alternative to find approximations to the distributions of the new hybrid estimators, and based on the bootstrap samples we can calculate the standard errors of the new estimators. The use of bootstrap method to find the standard error for other different estimators for the GPD has already been suggested by many other authors. A reason for preferring the bootstrap method is that the confidence intervals obtained for the parameters can always make sense by satisfying the endpoint constraints. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
23 Bias and MSE Comparisons Finite Sample Simulation We will only include the classical MLE, the MGFE based on AD statistic and the improved EBM* in the finite-sample comparisons. The range of k considered is 6 < k < 2, which covers all the ranges used previously in the literature, and also the commonly used range 1 < k < 1/2, the non-regular range k > 1/2 where the MLE has trouble and the range k < 1/2 where the GPD has infinite variance. It is already known that the MLE have severe problems when k > 1/2. To deal with such unusual behavior of the MLE as k approaches 1/2 in simulation, we employ a quasi-maximum likelihood (QML) method used in Luceño (2006) which is to replace the MLE of (ˆσ MLE, ˆk MLE ) by n 1 ( k QML = (n 1) 1 log 1 X ) (i) and σ QML = X k QML X (n). (n) i=1 A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
24 Bias and MSE Comparisons Bias Comparison Without loss of generality, the scale parameter σ is taken to be 1 because the estimates for the GPD are invariant with respect to the values of σ. As the widely accepted criteria for measuring the accuracy of an estimator, the estimation bias are calculated for the finite sample sizes n = 50 based on 10, 000 random samples. The biases for different estimators of σ and k are plotted against k in Figure 2. We see that our new hybrid estimators have significantly improved the estimation biases for σ and k, especially when compared with the MGFE and the MLE which supply the original ideas behind it. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
25 Bias and MSE Comparisons Bias Comparison Bias for scale, n=50 Bias for shape, n=50 bias(sigma) NEW(AD) MGFE(AD) MLE EBM* bias(k) NEW(AD) MGFE(AD) MLE EBM* k k A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
26 Bias and MSE Comparisons MSE Comparison As the widely accepted criteria for measuring the overall quality of an estimator, the estimation mean square error (MSE) are calculated for the finite sample sizes n = 50 based on 10, 000 random samples. The MSEs for different estimators of σ and k are plotted against k in Figure 3. From the figure, we see that our new hybrid estimators always possess comparable MSEs, and improve over the MLE for estimating the scale σ, and over the MGFE for estimating the shape k. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
27 Bias and MSE Comparisons MSE Comparison MSE for scale, n=50 MSE for shape, n=50 MSE(sigma) NEW(AD) MGFE(AD) MLE EBM* MSE(k) NEW(AD) MGFE(AD) MLE EBM* k k A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
28 An Example: Bilbao waves data An Example: Bilbao waves data To illustrate the advantages of the new hybrid estimation procedure, we will present a real-world example originally analyzed in Castillo and Hadi (1997), which consists of the zero-crossing hourly mean periods (in seconds) of the sea waves measured in the Bilbao bay, Spain. Later on, this data set was revisited in Luceño (2006) and in Zhang and Stephens (2009). Only the 197 observations with periods above 7 seconds were taken into consideration. We model this data by the GPD using thresholds at t = 7.5 following the above mentioned authors. The table below provides the estimated GPD parameters for Bilbao waves data using different estimators. ˆσ ˆk t m MLE EBM* MGFE Hybrid MLE EBM* MGFE Hybrid A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
29 An Example: Bilbao waves data An Example: Bilbao waves data To check graphically whether the minimum of the target function G defined in (6) is reached at ˆθ NEW = ˆk NEW /ˆσ NEW = , the G(θ; X ) and its first derivative are plotted for the Bilbao waves data at t = 7.5. The boundary condition for this given data set is θ < 1/X (n) = 1/2.4 = The plot of G for the Bilbao waves data The plot of first derivative of G for the Bilbao waves data G(θ) dg/dθ θ A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32 θ
30 An Example: Bilbao waves data An Example: Bilbao waves data The following figure shows the histograms of B = 1000 parametric bootstrap samples of ˆσ NEW and ˆk NEW for the Bilbao waves data. The parametric bootstrap standard errors for the hybrid estimates are se(ˆσ NEW ) = and se(ˆk NEW ) = 0.090, and the corresponding 95% bootstrap confidence intervals for σ and k are (1.288, 1.949) and (0.413, 0.771). Histogram of 1000 parametric bootstrap samples of sigma Histogram of 1000 parametric bootstrap samples of k Frequency Frequency b.se[, 1] b.se[, 2] A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
31 Final Comments The new hybrid estimating procedure has been introduced for the GPD parameters, and it has several advantages. First, the new hybrid estimates are easily obtained by optimizing a single parameter function using some standard algorithms, and the existence and feasibility of the hybrid estimates can even be verified graphically. Second, unlike some other existing methods, the new hybrid estimates can always be found for the entire parameter space. Third, the standard errors and confidence intervals can be easily calculated by the bootstrap method. Finally, the simulation study of bias and MSE showed that the proposed hybrid estimators greatly improve over the MLE and the MGFE, and well compared with the other existing methods. A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
32 Acknowledgements THANK YOU! A New Hybrid Estimation Method for the GPD Chunlin Wang (UCalgary) May 18, /32
Definition 9.1 A point estimate is any function T (X 1,..., X n ) of a random sample. We often write an estimator of the parameter θ as ˆθ.
9 Point estimation 9.1 Rationale behind point estimation When sampling from a population described by a pdf f(x θ) or probability function P [X = x θ] knowledge of θ gives knowledge of the entire population.
More informationSTRESS-STRENGTH RELIABILITY ESTIMATION
CHAPTER 5 STRESS-STRENGTH RELIABILITY ESTIMATION 5. Introduction There are appliances (every physical component possess an inherent strength) which survive due to their strength. These appliances receive
More informationAnalysis of the Oil Spills from Tanker Ships. Ringo Ching and T. L. Yip
Analysis of the Oil Spills from Tanker Ships Ringo Ching and T. L. Yip The Data Included accidents in which International Oil Pollution Compensation (IOPC) Funds were involved, up to October 2009 In this
More informationMeasuring Financial Risk using Extreme Value Theory: evidence from Pakistan
Measuring Financial Risk using Extreme Value Theory: evidence from Pakistan Dr. Abdul Qayyum and Faisal Nawaz Abstract The purpose of the paper is to show some methods of extreme value theory through analysis
More informationPoint Estimation. Some General Concepts of Point Estimation. Example. Estimator quality
Point Estimation Some General Concepts of Point Estimation Statistical inference = conclusions about parameters Parameters == population characteristics A point estimate of a parameter is a value (based
More informationAnalysis of truncated data with application to the operational risk estimation
Analysis of truncated data with application to the operational risk estimation Petr Volf 1 Abstract. Researchers interested in the estimation of operational risk often face problems arising from the structure
More informationMuch of what appears here comes from ideas presented in the book:
Chapter 11 Robust statistical methods Much of what appears here comes from ideas presented in the book: Huber, Peter J. (1981), Robust statistics, John Wiley & Sons (New York; Chichester). There are many
More informationPoint Estimation. Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage
6 Point Estimation Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage Point Estimation Statistical inference: directed toward conclusions about one or more parameters. We will use the generic
More informationIntroduction to Algorithmic Trading Strategies Lecture 8
Introduction to Algorithmic Trading Strategies Lecture 8 Risk Management Haksun Li haksun.li@numericalmethod.com www.numericalmethod.com Outline Value at Risk (VaR) Extreme Value Theory (EVT) References
More informationFinancial Time Series and Their Characteristics
Financial Time Series and Their Characteristics Egon Zakrajšek Division of Monetary Affairs Federal Reserve Board Summer School in Financial Mathematics Faculty of Mathematics & Physics University of Ljubljana
More informationFinancial Risk Forecasting Chapter 9 Extreme Value Theory
Financial Risk Forecasting Chapter 9 Extreme Value Theory Jon Danielsson 2017 London School of Economics To accompany Financial Risk Forecasting www.financialriskforecasting.com Published by Wiley 2011
More informationChapter 7: Estimation Sections
1 / 40 Chapter 7: Estimation Sections 7.1 Statistical Inference Bayesian Methods: Chapter 7 7.2 Prior and Posterior Distributions 7.3 Conjugate Prior Distributions 7.4 Bayes Estimators Frequentist Methods:
More informationEVA Tutorial #1 BLOCK MAXIMA APPROACH IN HYDROLOGIC/CLIMATE APPLICATIONS. Rick Katz
1 EVA Tutorial #1 BLOCK MAXIMA APPROACH IN HYDROLOGIC/CLIMATE APPLICATIONS Rick Katz Institute for Mathematics Applied to Geosciences National Center for Atmospheric Research Boulder, CO USA email: rwk@ucar.edu
More informationChapter 8: Sampling distributions of estimators Sections
Chapter 8 continued Chapter 8: Sampling distributions of estimators Sections 8.1 Sampling distribution of a statistic 8.2 The Chi-square distributions 8.3 Joint Distribution of the sample mean and sample
More informationدرس هفتم یادگیري ماشین. (Machine Learning) دانشگاه فردوسی مشهد دانشکده مهندسی رضا منصفی
یادگیري ماشین توزیع هاي نمونه و تخمین نقطه اي پارامترها Sampling Distributions and Point Estimation of Parameter (Machine Learning) دانشگاه فردوسی مشهد دانشکده مهندسی رضا منصفی درس هفتم 1 Outline Introduction
More informationLecture 10: Point Estimation
Lecture 10: Point Estimation MSU-STT-351-Sum-17B (P. Vellaisamy: MSU-STT-351-Sum-17B) Probability & Statistics for Engineers 1 / 31 Basic Concepts of Point Estimation A point estimate of a parameter θ,
More information12 The Bootstrap and why it works
12 he Bootstrap and why it works For a review of many applications of bootstrap see Efron and ibshirani (1994). For the theory behind the bootstrap see the books by Hall (1992), van der Waart (2000), Lahiri
More information**BEGINNING OF EXAMINATION** A random sample of five observations from a population is:
**BEGINNING OF EXAMINATION** 1. You are given: (i) A random sample of five observations from a population is: 0.2 0.7 0.9 1.1 1.3 (ii) You use the Kolmogorov-Smirnov test for testing the null hypothesis,
More informationModelling Environmental Extremes
19th TIES Conference, Kelowna, British Columbia 8th June 2008 Topics for the day 1. Classical models and threshold models 2. Dependence and non stationarity 3. R session: weather extremes 4. Multivariate
More informationModelling Environmental Extremes
19th TIES Conference, Kelowna, British Columbia 8th June 2008 Topics for the day 1. Classical models and threshold models 2. Dependence and non stationarity 3. R session: weather extremes 4. Multivariate
More informationBack to estimators...
Back to estimators... So far, we have: Identified estimators for common parameters Discussed the sampling distributions of estimators Introduced ways to judge the goodness of an estimator (bias, MSE, etc.)
More informationAn Application of Extreme Value Theory for Measuring Financial Risk in the Uruguayan Pension Fund 1
An Application of Extreme Value Theory for Measuring Financial Risk in the Uruguayan Pension Fund 1 Guillermo Magnou 23 January 2016 Abstract Traditional methods for financial risk measures adopts normal
More informationLikelihood Methods of Inference. Toss coin 6 times and get Heads twice.
Methods of Inference Toss coin 6 times and get Heads twice. p is probability of getting H. Probability of getting exactly 2 heads is 15p 2 (1 p) 4 This function of p, is likelihood function. Definition:
More informationSubject CS1 Actuarial Statistics 1 Core Principles. Syllabus. for the 2019 exams. 1 June 2018
` Subject CS1 Actuarial Statistics 1 Core Principles Syllabus for the 2019 exams 1 June 2018 Copyright in this Core Reading is the property of the Institute and Faculty of Actuaries who are the sole distributors.
More informationChapter 4: Commonly Used Distributions. Statistics for Engineers and Scientists Fourth Edition William Navidi
Chapter 4: Commonly Used Distributions Statistics for Engineers and Scientists Fourth Edition William Navidi 2014 by Education. This is proprietary material solely for authorized instructor use. Not authorized
More informationActuarial Mathematics and Statistics Statistics 5 Part 2: Statistical Inference Tutorial Problems
Actuarial Mathematics and Statistics Statistics 5 Part 2: Statistical Inference Tutorial Problems Spring 2005 1. Which of the following statements relate to probabilities that can be interpreted as frequencies?
More informationChapter 8: Sampling distributions of estimators Sections
Chapter 8: Sampling distributions of estimators Sections 8.1 Sampling distribution of a statistic 8.2 The Chi-square distributions 8.3 Joint Distribution of the sample mean and sample variance Skip: p.
More informationLecture 17: More on Markov Decision Processes. Reinforcement learning
Lecture 17: More on Markov Decision Processes. Reinforcement learning Learning a model: maximum likelihood Learning a value function directly Monte Carlo Temporal-difference (TD) learning COMP-424, Lecture
More informationHomework Problems Stat 479
Chapter 10 91. * A random sample, X1, X2,, Xn, is drawn from a distribution with a mean of 2/3 and a variance of 1/18. ˆ = (X1 + X2 + + Xn)/(n-1) is the estimator of the distribution mean θ. Find MSE(
More informationApplied Statistics I
Applied Statistics I Liang Zhang Department of Mathematics, University of Utah July 14, 2008 Liang Zhang (UofU) Applied Statistics I July 14, 2008 1 / 18 Point Estimation Liang Zhang (UofU) Applied Statistics
More informationMEASURING EXTREME RISKS IN THE RWANDA STOCK MARKET
MEASURING EXTREME RISKS IN THE RWANDA STOCK MARKET 1 Mr. Jean Claude BIZUMUTIMA, 2 Dr. Joseph K. Mung atu, 3 Dr. Marcel NDENGO 1,2,3 Faculty of Applied Sciences, Department of statistics and Actuarial
More informationCan we use kernel smoothing to estimate Value at Risk and Tail Value at Risk?
Can we use kernel smoothing to estimate Value at Risk and Tail Value at Risk? Ramon Alemany, Catalina Bolancé and Montserrat Guillén Riskcenter - IREA Universitat de Barcelona http://www.ub.edu/riskcenter
More informationGPD-POT and GEV block maxima
Chapter 3 GPD-POT and GEV block maxima This chapter is devoted to the relation between POT models and Block Maxima (BM). We only consider the classical frameworks where POT excesses are assumed to be GPD,
More informationPoint Estimators. STATISTICS Lecture no. 10. Department of Econometrics FEM UO Brno office 69a, tel
STATISTICS Lecture no. 10 Department of Econometrics FEM UO Brno office 69a, tel. 973 442029 email:jiri.neubauer@unob.cz 8. 12. 2009 Introduction Suppose that we manufacture lightbulbs and we want to state
More informationFINITE SAMPLE DISTRIBUTIONS OF RISK-RETURN RATIOS
Available Online at ESci Journals Journal of Business and Finance ISSN: 305-185 (Online), 308-7714 (Print) http://www.escijournals.net/jbf FINITE SAMPLE DISTRIBUTIONS OF RISK-RETURN RATIOS Reza Habibi*
More informationStatistical analysis and bootstrapping
Statistical analysis and bootstrapping p. 1/15 Statistical analysis and bootstrapping Michel Bierlaire michel.bierlaire@epfl.ch Transport and Mobility Laboratory Statistical analysis and bootstrapping
More informationPaper Series of Risk Management in Financial Institutions
- December, 007 Paper Series of Risk Management in Financial Institutions The Effect of the Choice of the Loss Severity Distribution and the Parameter Estimation Method on Operational Risk Measurement*
More informationChapter 4: Asymptotic Properties of MLE (Part 3)
Chapter 4: Asymptotic Properties of MLE (Part 3) Daniel O. Scharfstein 09/30/13 1 / 1 Breakdown of Assumptions Non-Existence of the MLE Multiple Solutions to Maximization Problem Multiple Solutions to
More informationRandom Variables and Probability Distributions
Chapter 3 Random Variables and Probability Distributions Chapter Three Random Variables and Probability Distributions 3. Introduction An event is defined as the possible outcome of an experiment. In engineering
More informationA Markov Chain Monte Carlo Approach to Estimate the Risks of Extremely Large Insurance Claims
International Journal of Business and Economics, 007, Vol. 6, No. 3, 5-36 A Markov Chain Monte Carlo Approach to Estimate the Risks of Extremely Large Insurance Claims Wan-Kai Pang * Department of Applied
More informationEstimating the Parameters of Closed Skew-Normal Distribution Under LINEX Loss Function
Australian Journal of Basic Applied Sciences, 5(7): 92-98, 2011 ISSN 1991-8178 Estimating the Parameters of Closed Skew-Normal Distribution Under LINEX Loss Function 1 N. Abbasi, 1 N. Saffari, 2 M. Salehi
More informationChapter 7: Estimation Sections
Chapter 7: Estimation Sections 7.1 Statistical Inference Bayesian Methods: 7.2 Prior and Posterior Distributions 7.3 Conjugate Prior Distributions Frequentist Methods: 7.5 Maximum Likelihood Estimators
More informationAn Introduction to Statistical Extreme Value Theory
An Introduction to Statistical Extreme Value Theory Uli Schneider Geophysical Statistics Project, NCAR January 26, 2004 NCAR Outline Part I - Two basic approaches to extreme value theory block maxima,
More informationGeneralized MLE per Martins and Stedinger
Generalized MLE per Martins and Stedinger Martins ES and Stedinger JR. (March 2000). Generalized maximum-likelihood generalized extreme-value quantile estimators for hydrologic data. Water Resources Research
More informationBusiness Statistics 41000: Probability 3
Business Statistics 41000: Probability 3 Drew D. Creal University of Chicago, Booth School of Business February 7 and 8, 2014 1 Class information Drew D. Creal Email: dcreal@chicagobooth.edu Office: 404
More informationTwo hours. To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER
Two hours MATH20802 To be supplied by the Examinations Office: Mathematical Formula Tables and Statistical Tables THE UNIVERSITY OF MANCHESTER STATISTICAL METHODS Answer any FOUR of the SIX questions.
More informationPoint Estimation. Edwin Leuven
Point Estimation Edwin Leuven Introduction Last time we reviewed statistical inference We saw that while in probability we ask: given a data generating process, what are the properties of the outcomes?
More informationREINSURANCE RATE-MAKING WITH PARAMETRIC AND NON-PARAMETRIC MODELS
REINSURANCE RATE-MAKING WITH PARAMETRIC AND NON-PARAMETRIC MODELS By Siqi Chen, Madeleine Min Jing Leong, Yuan Yuan University of Illinois at Urbana-Champaign 1. Introduction Reinsurance contract is an
More informationLecture Notes 6. Assume F belongs to a family of distributions, (e.g. F is Normal), indexed by some parameter θ.
Sufficient Statistics Lecture Notes 6 Sufficiency Data reduction in terms of a particular statistic can be thought of as a partition of the sample space X. Definition T is sufficient for θ if the conditional
More informationChapter 2 Uncertainty Analysis and Sampling Techniques
Chapter 2 Uncertainty Analysis and Sampling Techniques The probabilistic or stochastic modeling (Fig. 2.) iterative loop in the stochastic optimization procedure (Fig..4 in Chap. ) involves:. Specifying
More informationUnderstanding extreme stock trading volume by generalized Pareto distribution
North Carolina Journal of Mathematics and Statistics Volume 2, Pages 45 60 (Accepted August 4, 2016, published August 19, 2016) ISSN 2380-7539 Understanding extreme stock trading volume by generalized
More informationChapter 7: Point Estimation and Sampling Distributions
Chapter 7: Point Estimation and Sampling Distributions Seungchul Baek Department of Statistics, University of South Carolina STAT 509: Statistics for Engineers 1 / 20 Motivation In chapter 3, we learned
More informationLearning From Data: MLE. Maximum Likelihood Estimators
Learning From Data: MLE Maximum Likelihood Estimators 1 Parameter Estimation Assuming sample x1, x2,..., xn is from a parametric distribution f(x θ), estimate θ. E.g.: Given sample HHTTTTTHTHTTTHH of (possibly
More informationStatistical estimation
Statistical estimation Statistical modelling: theory and practice Gilles Guillot gigu@dtu.dk September 3, 2013 Gilles Guillot (gigu@dtu.dk) Estimation September 3, 2013 1 / 27 1 Introductory example 2
More informationMaximum Likelihood Estimates for Alpha and Beta With Zero SAIDI Days
Maximum Likelihood Estimates for Alpha and Beta With Zero SAIDI Days 1. Introduction Richard D. Christie Department of Electrical Engineering Box 35500 University of Washington Seattle, WA 98195-500 christie@ee.washington.edu
More informationQQ PLOT Yunsi Wang, Tyler Steele, Eva Zhang Spring 2016
QQ PLOT INTERPRETATION: Quantiles: QQ PLOT Yunsi Wang, Tyler Steele, Eva Zhang Spring 2016 The quantiles are values dividing a probability distribution into equal intervals, with every interval having
More informationChapter 7: Estimation Sections
1 / 31 : Estimation Sections 7.1 Statistical Inference Bayesian Methods: 7.2 Prior and Posterior Distributions 7.3 Conjugate Prior Distributions 7.4 Bayes Estimators Frequentist Methods: 7.5 Maximum Likelihood
More informationCambridge University Press Risk Modelling in General Insurance: From Principles to Practice Roger J. Gray and Susan M.
adjustment coefficient, 272 and Cramér Lundberg approximation, 302 existence, 279 and Lundberg s inequality, 272 numerical methods for, 303 properties, 272 and reinsurance (case study), 348 statistical
More informationAN EXTREME VALUE APPROACH TO PRICING CREDIT RISK
AN EXTREME VALUE APPROACH TO PRICING CREDIT RISK SOFIA LANDIN Master s thesis 2018:E69 Faculty of Engineering Centre for Mathematical Sciences Mathematical Statistics CENTRUM SCIENTIARUM MATHEMATICARUM
More informationMVE051/MSG Lecture 7
MVE051/MSG810 2017 Lecture 7 Petter Mostad Chalmers November 20, 2017 The purpose of collecting and analyzing data Purpose: To build and select models for parts of the real world (which can be used for
More informationMaximum Likelihood Estimation
Maximum Likelihood Estimation EPSY 905: Fundamentals of Multivariate Modeling Online Lecture #6 EPSY 905: Maximum Likelihood In This Lecture The basics of maximum likelihood estimation Ø The engine that
More informationFrequency Distribution Models 1- Probability Density Function (PDF)
Models 1- Probability Density Function (PDF) What is a PDF model? A mathematical equation that describes the frequency curve or probability distribution of a data set. Why modeling? It represents and summarizes
More informationThe normal distribution is a theoretical model derived mathematically and not empirically.
Sociology 541 The Normal Distribution Probability and An Introduction to Inferential Statistics Normal Approximation The normal distribution is a theoretical model derived mathematically and not empirically.
More informationTechnology Support Center Issue
United States Office of Office of Solid EPA/600/R-02/084 Environmental Protection Research and Waste and October 2002 Agency Development Emergency Response Technology Support Center Issue Estimation of
More informationModeling of Price. Ximing Wu Texas A&M University
Modeling of Price Ximing Wu Texas A&M University As revenue is given by price times yield, farmers income risk comes from risk in yield and output price. Their net profit also depends on input price, but
More informationSYSM 6304 Risk and Decision Analysis Lecture 2: Fitting Distributions to Data
SYSM 6304 Risk and Decision Analysis Lecture 2: Fitting Distributions to Data M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu September 5, 2015
More informationCSE 312 Winter Learning From Data: Maximum Likelihood Estimators (MLE)
CSE 312 Winter 2017 Learning From Data: Maximum Likelihood Estimators (MLE) 1 Parameter Estimation Given: independent samples x1, x2,..., xn from a parametric distribution f(x θ) Goal: estimate θ. Not
More informationAn Insight Into Heavy-Tailed Distribution
An Insight Into Heavy-Tailed Distribution Annapurna Ravi Ferry Butar Butar ABSTRACT The heavy-tailed distribution provides a much better fit to financial data than the normal distribution. Modeling heavy-tailed
More informationFitting financial time series returns distributions: a mixture normality approach
Fitting financial time series returns distributions: a mixture normality approach Riccardo Bramante and Diego Zappa * Abstract Value at Risk has emerged as a useful tool to risk management. A relevant
More informationSTA 532: Theory of Statistical Inference
STA 532: Theory of Statistical Inference Robert L. Wolpert Department of Statistical Science Duke University, Durham, NC, USA 2 Estimating CDFs and Statistical Functionals Empirical CDFs Let {X i : i n}
More informationSTAT 509: Statistics for Engineers Dr. Dewei Wang. Copyright 2014 John Wiley & Sons, Inc. All rights reserved.
STAT 509: Statistics for Engineers Dr. Dewei Wang Applied Statistics and Probability for Engineers Sixth Edition Douglas C. Montgomery George C. Runger 7 Point CHAPTER OUTLINE 7-1 Point Estimation 7-2
More informationPoint Estimation. Copyright Cengage Learning. All rights reserved.
6 Point Estimation Copyright Cengage Learning. All rights reserved. 6.2 Methods of Point Estimation Copyright Cengage Learning. All rights reserved. Methods of Point Estimation The definition of unbiasedness
More informationIntroduction Dickey-Fuller Test Option Pricing Bootstrapping. Simulation Methods. Chapter 13 of Chris Brook s Book.
Simulation Methods Chapter 13 of Chris Brook s Book Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 April 26, 2017 Christopher
More informationMODELLING OF INCOME AND WAGE DISTRIBUTION USING THE METHOD OF L-MOMENTS OF PARAMETER ESTIMATION
International Days of Statistics and Economics, Prague, September -3, MODELLING OF INCOME AND WAGE DISTRIBUTION USING THE METHOD OF L-MOMENTS OF PARAMETER ESTIMATION Diana Bílková Abstract Using L-moments
More informationSYLLABUS OF BASIC EDUCATION SPRING 2018 Construction and Evaluation of Actuarial Models Exam 4
The syllabus for this exam is defined in the form of learning objectives that set forth, usually in broad terms, what the candidate should be able to do in actual practice. Please check the Syllabus Updates
More informationPractice Exam 1. Loss Amount Number of Losses
Practice Exam 1 1. You are given the following data on loss sizes: An ogive is used as a model for loss sizes. Determine the fitted median. Loss Amount Number of Losses 0 1000 5 1000 5000 4 5000 10000
More informationMarket Risk Analysis Volume I
Market Risk Analysis Volume I Quantitative Methods in Finance Carol Alexander John Wiley & Sons, Ltd List of Figures List of Tables List of Examples Foreword Preface to Volume I xiii xvi xvii xix xxiii
More informationChapter 6 Forecasting Volatility using Stochastic Volatility Model
Chapter 6 Forecasting Volatility using Stochastic Volatility Model Chapter 6 Forecasting Volatility using SV Model In this chapter, the empirical performance of GARCH(1,1), GARCH-KF and SV models from
More informationThe method of Maximum Likelihood.
Maximum Likelihood The method of Maximum Likelihood. In developing the least squares estimator - no mention of probabilities. Minimize the distance between the predicted linear regression and the observed
More informationMongolia s TOP-20 Index Risk Analysis, Pt. 3
Mongolia s TOP-20 Index Risk Analysis, Pt. 3 Federico M. Massari March 12, 2017 In the third part of our risk report on TOP-20 Index, Mongolia s main stock market indicator, we focus on modelling the right
More information2018 AAPM: Normal and non normal distributions: Why understanding distributions are important when designing experiments and analyzing data
Statistical Failings that Keep Us All in the Dark Normal and non normal distributions: Why understanding distributions are important when designing experiments and Conflict of Interest Disclosure I have
More informationFitting parametric distributions using R: the fitdistrplus package
Fitting parametric distributions using R: the fitdistrplus package M. L. Delignette-Muller - CNRS UMR 5558 R. Pouillot J.-B. Denis - INRA MIAJ user! 2009,10/07/2009 Background Specifying the probability
More information[D7] PROBABILITY DISTRIBUTION OF OUTSTANDING LIABILITY FROM INDIVIDUAL PAYMENTS DATA Contributed by T S Wright
Faculty and Institute of Actuaries Claims Reserving Manual v.2 (09/1997) Section D7 [D7] PROBABILITY DISTRIBUTION OF OUTSTANDING LIABILITY FROM INDIVIDUAL PAYMENTS DATA Contributed by T S Wright 1. Introduction
More informationAn Information Based Methodology for the Change Point Problem Under the Non-central Skew t Distribution with Applications.
An Information Based Methodology for the Change Point Problem Under the Non-central Skew t Distribution with Applications. Joint with Prof. W. Ning & Prof. A. K. Gupta. Department of Mathematics and Statistics
More informationUsing Halton Sequences. in Random Parameters Logit Models
Journal of Statistical and Econometric Methods, vol.5, no.1, 2016, 59-86 ISSN: 1792-6602 (print), 1792-6939 (online) Scienpress Ltd, 2016 Using Halton Sequences in Random Parameters Logit Models Tong Zeng
More informationRobust Critical Values for the Jarque-bera Test for Normality
Robust Critical Values for the Jarque-bera Test for Normality PANAGIOTIS MANTALOS Jönköping International Business School Jönköping University JIBS Working Papers No. 00-8 ROBUST CRITICAL VALUES FOR THE
More informationOn Some Test Statistics for Testing the Population Skewness and Kurtosis: An Empirical Study
Florida International University FIU Digital Commons FIU Electronic Theses and Dissertations University Graduate School 8-26-2016 On Some Test Statistics for Testing the Population Skewness and Kurtosis:
More informationSmall Area Estimation of Poverty Indicators using Interval Censored Income Data
Small Area Estimation of Poverty Indicators using Interval Censored Income Data Paul Walter 1 Marcus Groß 1 Timo Schmid 1 Nikos Tzavidis 2 1 Chair of Statistics and Econometrics, Freie Universit?t Berlin
More informationAn Improved Skewness Measure
An Improved Skewness Measure Richard A. Groeneveld Professor Emeritus, Department of Statistics Iowa State University ragroeneveld@valley.net Glen Meeden School of Statistics University of Minnesota Minneapolis,
More informationThe data-driven COS method
The data-driven COS method Á. Leitao, C. W. Oosterlee, L. Ortiz-Gracia and S. M. Bohte Delft University of Technology - Centrum Wiskunde & Informatica Reading group, March 13, 2017 Reading group, March
More informationADVANCED OPERATIONAL RISK MODELLING IN BANKS AND INSURANCE COMPANIES
Small business banking and financing: a global perspective Cagliari, 25-26 May 2007 ADVANCED OPERATIONAL RISK MODELLING IN BANKS AND INSURANCE COMPANIES C. Angela, R. Bisignani, G. Masala, M. Micocci 1
More informationStrategies for Improving the Efficiency of Monte-Carlo Methods
Strategies for Improving the Efficiency of Monte-Carlo Methods Paul J. Atzberger General comments or corrections should be sent to: paulatz@cims.nyu.edu Introduction The Monte-Carlo method is a useful
More informationPIVOTAL QUANTILE ESTIMATES IN VAR CALCULATIONS. Peter Schaller, Bank Austria Creditanstalt (BA-CA) Wien,
PIVOTAL QUANTILE ESTIMATES IN VAR CALCULATIONS Peter Schaller, Bank Austria Creditanstalt (BA-CA) Wien, peter@ca-risc.co.at c Peter Schaller, BA-CA, Strategic Riskmanagement 1 Contents Some aspects of
More informationChapter 7 Sampling Distributions and Point Estimation of Parameters
Chapter 7 Sampling Distributions and Point Estimation of Parameters Part 1: Sampling Distributions, the Central Limit Theorem, Point Estimation & Estimators Sections 7-1 to 7-2 1 / 25 Statistical Inferences
More informationAmath 546/Econ 589 Univariate GARCH Models
Amath 546/Econ 589 Univariate GARCH Models Eric Zivot April 24, 2013 Lecture Outline Conditional vs. Unconditional Risk Measures Empirical regularities of asset returns Engle s ARCH model Testing for ARCH
More informationELEMENTS OF MONTE CARLO SIMULATION
APPENDIX B ELEMENTS OF MONTE CARLO SIMULATION B. GENERAL CONCEPT The basic idea of Monte Carlo simulation is to create a series of experimental samples using a random number sequence. According to the
More informationWeek 7 Quantitative Analysis of Financial Markets Simulation Methods
Week 7 Quantitative Analysis of Financial Markets Simulation Methods Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 November
More informationChapter 4 Variability
Chapter 4 Variability PowerPoint Lecture Slides Essentials of Statistics for the Behavioral Sciences Seventh Edition by Frederick J Gravetter and Larry B. Wallnau Chapter 4 Learning Outcomes 1 2 3 4 5
More informationHardy Weinberg Model- 6 Genotypes
Hardy Weinberg Model- 6 Genotypes Silvelyn Zwanzig Hardy -Weinberg with six genotypes. In a large population of plants (Mimulus guttatus there are possible alleles S, I, F at one locus resulting in six
More informationPARAMETRIC AND NON-PARAMETRIC BOOTSTRAP: A SIMULATION STUDY FOR A LINEAR REGRESSION WITH RESIDUALS FROM A MIXTURE OF LAPLACE DISTRIBUTIONS
PARAMETRIC AND NON-PARAMETRIC BOOTSTRAP: A SIMULATION STUDY FOR A LINEAR REGRESSION WITH RESIDUALS FROM A MIXTURE OF LAPLACE DISTRIBUTIONS Melfi Alrasheedi School of Business, King Faisal University, Saudi
More information