ASYMPTOTIC MEAN SQUARE ERRORS OF VARIANCE ESTIMATORS FOR U-STATISTICS AND THEIR EDGEWORTH EXPANSIONS
|
|
- Lynette Bond
- 5 years ago
- Views:
Transcription
1 J. Japa Statist. Soc. Vol. 8 No ASYMPTOTIC MEAN SQUARE ERRORS OF VARIANCE ESTIMATORS FOR U-STATISTICS AND THEIR EDGEWORTH EXPANSIONS Yoshihiko Maesoo* This paper studies variace estimators for a class of U-statistics. We obtai asymptotic represetatios of jackkife, Hikley s (1978) corrected jackkife, ubiased, Se s (1960) ad ew variace estimators. Ad we ivestigate asymptotic mea square errors of them, theoretically. The Edgeworth expasios of the estimators with remaider term o( 1 ) are also established. We show that the ormalized Hikley s corrected estimator coicides the ormalized ubiased estimator util the order 1/ o p ( 1 ). Key words ad phrases: Edgeworth expasios, estimatio of variace, jackkife estimator, mea square errors, U-statistics. 1. Itroductio Let X 1,, X be idepedetly ad idetically distributed radom vectors with distributio fuctio F (x). Let h(x 1,, x r ) be a real valued fuctio which is symmetric i its argumets. For r let us defie a U-statistic by U = ( ) 1 h(x i1,, X ir ) r C,r where C,r idicates that the summatio is take over all itegers i 1,, i r satisfyig 1 i 1 < < i r. U is a miimum variace ubiased estimator of θ = E[h(X 1,, X r )] ad may statistics i commo use are members of U-statistics or approximated by them. Several variace estimators for the U-statistic are proposed. Se (1960) has discussed a estimator of the domiat term r E[E{h(X 1,, X r ) X 1 } θ] of the variace σ = V ar(u ) i the case of degree ad Se (1977) exteded it to geeral degree r. He also proved the law of large umbers. The jackkife variace estimator ˆσ J is give by ˆσ J = 1 (U (i) U ) where U (i) deotes U-statistic computed from a sample of 1 poits with X i left out. The properties of ˆσ J are precisely studied. Arvese (1969) has obtaied the exact represetatio of ˆσ J, which is complicated, ad Efro ad Stei (1981) have showed that the jackkife variace estimator has positive bias. The bias reductio for the jackkife variace estimator has bee studied by Hikley (1978), ad Efro ad Stei (1981). Received Jue Revised February 4, Accepted November, *Faculty of Ecoomics, Kyushu Uiversity 7 Hakozaki , Higashi-ku, Fukuoka 81-81, Japa.
2 J. JAPAN STATIST. SOC. Vol.8 No I the case of small sample, usig computer simulatio, Schucay ad Bakso (1989) discuss biases ad mea square errors of Se s (1960) estimator, the jackkife estimator ad a ubiased estimator which is costituted from ubiased estimators of each term of the variace expressio. It is easy to see that all above estimators have first order cosistecy, which meas that the ormalized estimators coverge to the domiat term r ξ1 of the variace. Shirahata ad Sakamoto (199) have compared several estimators (ubiased estimator, jackkife estimator, bias modified estimator, ad iterated bootstrap ad bootstrap estimators) by computer simulatios. They have also discussed exact represetatios of the estimators ad reductio of the order of summads to compute the variace estimators. Usig the asymptotic represetatio of the jackkife variace estimator with the residual term o p ( 1/ ), Maesoo (1995b) has obtaied a Edgeworth expasio with remaider term o( 1/ ) for the studetized U-statistic. Obtaiig the asymptotic represetatio of the variace estimator with residual term o p ( 1 ), where P { o p ( 1 ) 1 (log ) 1 } = o( 1 ), Maesoo (1996a) has ivestigated the Edgeworth expasio of the studetized U-statistic with remaider term o( 1 ). He has also proved the Edgeworth expasio with remaider term o( 1/ ) for the jackkife variace estimator ˆσ J. Further, Maesoo (1996b) has discussed the expasio for a liear combiatio of U-statistics. I this paper we will study the variace estimators more precisely ad obtai asymptotic represetatios of the ormalized estimators with residual terms 1/ o p ( 1 ). We show that the ubiased estimator of Schucay ad Bakso (1989) coicides with the Hikley s (1978) corrected jackkife estimator util the order 1/ o p ( 1 ). Usig the asymptotic represetatios we obtai asymptotic mea square errors of the variace estimators. We also propose a ew variace estimator ad obtai its mea square error. We establish Edgeworth expasios of those variace estimators with remaider term o( 1 ). I Sectio, we will review the variace estimators ad propose the ew estimator. I Sectio 3, we will obtai the asymptotic represetatios of the estimators ad discuss the asymptotic mea square errors. The Edgeworth expasios of them are established i Sectio 4. Hereafter for the sake of simplicity, we will cosider the kerel of degree. The geeralizatio to the kerel with arbitrary degree will be obtaied with otatioal complicatios ad tedious calculatios.. Variace estimators At first we will obtai the H-decompositio or the ANOVA-decompositio for the U-statistic. Uder the assumptio that E h(x 1, X ) <, let us defie g 1 (x) = E[h(x, X )] θ, g (x, y) = h(x, y) θ g 1 (x) g 1 (y), A 1 = g 1 (X i ) ad A = g (X i, X j ). C, The we have Note that U θ = A 1 + E[g (X 1, X ) X 1 ] = 0 ( 1) A. a.s.
3 VARIANCE ESTIMATORS FOR U-STATISTICS 3 The if oe of {i 1, i } is ot cotaied i {j 1,, j m }, for ay m-variate fuctio ν which satisfies E νg <, we get (.1) E[g k (X i1, X i )ν(x j1,, X jm )] = 0. Usig this equatio we have the variace σ of U where σ = 4 ξ 1 + ( 1) ξ ξ 1 = E[g 1(X 1 )] ad ξ = E[g (X 1, X )]. Sice we discuss the asymptotic properties, we will study the estimatio of σ. The we cosider the jackkife variace estimator V J = ˆσ J. From the viewpoit of estimatio for 4ξ1, Se (1960, 1977) has proposed the variace estimator V S where Se (1977) also showed that V S = 4 1 S i = 1 1 (.) V S = (S i U ) j=1, i h(x i, X j ). ( ) ( 1) V J. As poited out by Efro (1987, p.00), chagig coefficiets of the estimators will have sigificatly differet effects o the small sample performace of the estimators. Sice V J has positive bias ad ( ) /( 1) = 1 / + O( ), we cosider the ew variace estimator V α give by V α = ( 1 α ) V J for α 0. Note that V ad V S are asymptotically equivalet ad V 0 = V J. If we choose α properly, we ca reduce the bias ad the mea square error, which we will discuss i Sectio 3. Hikley (1978) has discussed the bias correctio of V J. Let us defie Q i,j = U ( 1)(U (i) + U (j) ) + ( )U (i,j) where U (i,j) deotes the value of U whe X i ad X j are deleted from the sample. The the bias corrected jackkife estimator is give by V C = V J 1 (Q i,j + 1 Q) C, where Q = C, Q i,j /[( 1)]. Schucay ad Bakso (1989) proposed the ubiased estimator of σ, which is costituted from ubiased estimators of each term of the variace expressio. Aother variace expressio of σ is (.3) σ = 4( ) 1 a a
4 4 J. JAPAN STATIST. SOC. Vol.8 No where Let us defie ad a 1 = E[h(X 1, X )h(x 1, X 3 )] θ ad a = E[h (X 1, X )] θ. ζ 0 (x 1, x, x 3, x 4 ) = 1 3 {h(x 1, x )h(x 3, x 4 ) + h(x 1, x 3 )h(x, x 4 ) + h(x 1, x 4 )h(x, x 3 )}, ζ 1 (x 1, x, x 3 ) = 1 3 {h(x 1, x )h(x 1, x 3 ) + h(x 1, x )h(x, x 3 ) + h(x 1, x 3 )h(x, x 3 )} ζ (x 1, x ) = h (x 1, x ). The ubiased estimators of θ, E[h(X 1, X )h(x 1, X 3 )] ad E[h (X 1, X )] are give by ( ) 1 ˆθ = ζ 0 (X i1,, X i4 ), 4 C,4 ( ) 1 ˆλ 1 = ζ 1 (X i1, X i, X i3 ) 3 C,3 ad ˆλ = ( ) 1 ζ (X i1, X i ) C, respectively. Substitutig â k = ˆλ k ˆθ for a k ubiased estimator V U of σ as i the equatio (.3), we obtai the V U = 4( ) â â 1. Schucay ad Bakso (1989) compared the estimators V J, V S ad V U by simulatio i small samples = 10. We ca see that all these estimators coverge to 4ξ1 almost surely. We will study the asymptotic properties of the estimator more precisely. 3. Asymptotic represetatios ad mea square errors Maesoo (1995a) has obtaied the asymptotic represetatios of the variace estimators V J, V S, V C ad V U with residual terms o p ( 1 ). Here we will cosider the asymptotic represetatios more precisely. Let us defie δ(x) = E[g (x, X )] ξ, f 1 (x) = g 1(x) ξ 1 + E[g 1 (X )g (x, X )], f (x, y) = g 1 (x)g 1 (y) + g (x, y){g 1 (x) + g 1 (y)} + E[g (x, X 3 )g (y, X 3 ) g (x, X 3 )g 1 (X 3 ) g (y, X 3 )g 1 (X 3 )], f 3 (x, y, z) = g (x, y)g (x, z) + g (x, y)g (y, z) + g (x, z)g (y, z) E[g (x, X 3 )g (y, X 3 ) + g (y, X 3 )g (z, X 3 ) + g (x, X 3 )g (z, X 3 )] {g 1 (x)g (y, z) + g 1 (y)g (x, z) + g 1 (z)g (x, y)
5 ad VARIANCE ESTIMATORS FOR U-STATISTICS 5 V = 4 8 f 1 (X i ) + f (X i, X j ) ( 1) C, 8 + f 3 (X i, X j, X k ). ( 1)( ) C,3 Note that V has already decomposed. For the variace estimators, we have the followig represetatios. (3.1) (3.) (3.3) (3.4) ad Theorem 1. If E h(x 1, X ) 4+ε < for some ε > 0, we have V J = V + 8 V S = V + 8 V α = V + 4 V C = V + 4 δ(x i ) + σ + b J + R 1;, {δ(x i ) f 1 (X i )} + σ + b S + R ;, {δ(x i ) αf 1 (X i )} + σ + b α + R 3;, δ(x i ) + σ + R 4; (3.5) V U = V + 4 δ(x i ) + σ + R 5; where ad b J = ξ, b S = ξ 8ξ 1, b α = ξ 4αξ 1 (3.6) E R k; + ε = O( 4 ε ) (k = 1,, 5). Proof. See appedix. b J, b S ad b α are 1 biases of the jackkife, the Se s estimator ad the ew estimator respectively. Sice R k, = 1/ o p ( 1 ), the ubiased estimator V U coicides the Hikley s (1978) corrected jackkife estimator V C util the order 1/ o p ( 1 ). It is easy to see that (3.7) E[f (X 1, X ) X 1 ] = E[f 3 (X 1, X, X 3 ) X 1, X ] = 0 a.s. ad E[f 1 (X 1 )] = E[δ(X 1 )] = 0. Usig the asymptotic represetatios of Theorem 1, we ca study the asymptotic properties of the variace estimators. Here we will obtai asymptotic mea square errors of V J, V S, V α, V C ad V U up to the order. Let us defie mse(v J ) = 16 E[f 1 (X 1 )] + 1 {b J + 64E[f 1 (X 1 )δ(x 1 )] + 3E[f (X 1, X )]}, mse(v S ) = 16 E[f 1 (X 1 )] + 1 {b S + 64E[f 1 (X 1 )(δ(x 1 ) f 1 (X 1 ))]
6 6 J. JAPAN STATIST. SOC. Vol.8 No E[f (X 1, X )]}, mse(v α ) = 16 E[f 1 (X 1 )] + 1 {b α + 3E[f 1 (X 1 )(δ(x 1 ) αf 1 (X 1 ))] + 3E[f (X 1, X )]} ad mse(v C ) = 16 E[f 1 (X 1 )] + 1 {3E[f 1(X 1 )δ(x 1 )] + 3E[f (X 1, X )]}. Note that mse(v J ) = mse(v 0 ) ad mse(v S ) = mse(v ). We have the followig theorem. Theorem. If E h(x 1, X ) 4+ε < for some ε > 0, we have E(V J σ) = mse(v J ) + O( 5 ), E(V S σ) = mse(v S ) + O( 5 ), E(V α σ) = mse(v α ) + O( 5 ), E(V C σ) = mse(v C ) + O( 5 ) ad E(V U σ ) = mse(v C ) + O( 5 ). Proof. It follows from (3.6) ad (A.) i Lemma 1 (see Appedix) that uder the momet coditio, for 1 k 5, ad E 1 R k; E R k; f 1 (X i ) {E 1 f 1 (X i ) = O( 5 ), δ(x i ) {E δ(x i ) + ε + ε E R k; + ε E R k; + ε = O( 3 ), { E R k; f (X i, X j ) E f (X i, X j ) C, C, = O( 3 ) + ε E R k; {E R k; + ε } 4 4+ε = O( 4 ). Thus, usig these equatios ad (3.7), we ca obtai the equalities. } 4+ε } 4+ε E R k; + ε } 4+ε Remark 1. It is possible to improve the equatios with remaider terms of the order O( 3 ). But it eeds more calculatio, the we leave the equatios as they are. Let us defie e 1 = E[g 4 1(X 1 )], e = E[g 1(X 1 )g (X 1, X )], e 3 = E[g 1(X 1 )g 1 (X )g (X 1, X )], e 4 = E[g 1 (X 1 )g 1 (X )g (X 1, X )], e 5 = E[g 1 (X 1 )g 1 (X )g (X 1, X 3 )g (X, X 3 )], e 6 = E[g 1 (X 1 )g (X 1, X )g (X 1, X 3 )g (X, X 3 )]
7 ad VARIANCE ESTIMATORS FOR U-STATISTICS 7 e 7 = E[g (X 1, X 3 )g (X, X 3 )g (X 1, X 4 )g (X, X 4 )]. The, usig the equatio (.1), it follows from direct computatios that ad E[f 1 (X 1 )] = e 1 ξ e 3 + 4e 5, E[f 1 (X 1 )δ(x 1 )] = e ξ 1ξ + e 3 E[f (X 1, X )] = ξ e 4e 3 + e 4 4e 5 + 4e 6 + e 7. Here we will study the asymptotic mea square errors for the variace ad the covariace estimatio problems. Also, the asymptotic mea square error of the Wilcoxo s siged rak test will be discussed. Example 1. Variace estimatio; Let us cosider the kerel h(x, y) = (x y) /. The if V ar(x 1 ) = σ, the U- statistic ( ) 1 U = h(x i, X j ) C, is a ubiased estimator of σ. It is easy to see that θ = σ, g 1 (x) = 1 (x σ ) ad g (x, y) = xy. For the sake of simplicity, we will cosider the case that the distributio F (x) is symmetric about the origi. Let us defie m k = E[X k 1 ]. The because of symmetry of F, if k is odd umber, m k = 0. Usig this fact, from direct computatios, we ca show that ξ 1 = 1 4 (m 4 σ 4 ), ξ = σ 4, e 1 = 1 16 (m 8 4σ m 6 + 6σ 4 m 4 3σ 8 ), e = σ 4 (m 6 σ m 4 + σ 6 ), e 4 = 1 4 (m 4 σ 4 ), e 6 = σ4 (m 4 σ 4 ), e 7 = σ 8 ad e 3 = e 5 = 0. (Normal distributio:) If the uderlyig distributio is ormal, that is X i N(0, σ ), we ca show that b J = σ 4, b S = σ 4, b α = σ 4 ασ 4, { mse(v J ) = σ }, mse(v S ) = σ 8 { }, mse(v α ) = σ 8 { (α 30α + 67) } ad mse(v C ) = σ 8 { I the case of σ = 1 ad = 10, Schucay ad Bakso (1989) discussed the mea square errors of V J /, V S / ad V C / by simulatio. Correspodig asymptotic mea square errors are give by mse(v J ) 10 = 0.088, mse(v S ) 10 = ad Their estimated mea square errors are close to these values. mse(v C ) 10 = }.
8 8 J. JAPAN STATIST. SOC. Vol.8 No (Logistic distributio:) We cosider the logistic distributio which has the desity fuctio πe πx 3σ. 3σ(1 + e πx 3σ ) I this case we have that V ar(x 1 ) = σ, ad b J = σ 4, b S = 5 σ4, b α = σ 4 16α 5 σ4, { mse(v J ) = σ } { , mse(v S ) = σ 8 { mse(v α ) = σ 8 1 } (10.4α α ) Example. mse(v U ) = σ 8 { Covariace estimatio; } }, Let {X i } i 1 be two dimesioal radom vectors. Ad puttig X i = (Y i, Z i ), we deote ( ) σy ρσ y σ z V ar(x 1 ) = V ar{(y 1, Z 1 )} =. ρσ y σ z Let us cosider a symmetric kerel h(x 1, x ) = (y 1 y )(z 1 z )/. The correspodig U-statistic is a ubiased estimator of ρσ y σ z = Cov(Y 1, Z 1 ). It is easy to see that θ = ρσ y σ z, g 1 (x 1 ) = 1 (y 1z 1 ρσ y σ z ) ad g (x 1, x ) = 1 (y 1z + z 1 y ). Further we assume that X i is bivariate ormal distributio ( ( )) σy ρσ y σ z X i = (Y i, Z i ) N µ,. ρσ y σ z From direct computatios we ca get Thus we have ξ1 = 1 + ρ σ 4 yσz, ξ = 1 + ρ σ yσz, e 1 = 3 16 (3ρ4 + 14ρ + 3)σyσ 4 z, 4 e = 1 8 (3ρ4 + 14ρ + 3)σ 4 yσ 4 z, e 3 = 0, e 4 = 1 8 (ρ4 + 6ρ + 1)σ 4 yσ 4 z, e 5 = 0, e 6 = 1 8 (ρ4 + 6ρ + 1)σ 4 yσ 4 z ad e 7 = 1 8 (ρ4 + 6ρ + 1)σ 4 yσ 4 z. b J = σyσ z(1 + ρ ), b S = σyσ z(1 + ρ ), b α = (1 α)(1 + ρ )σyσ z, { 8 mse(v J ) = σyσ 4 z 4 (ρ4 + 5ρ + 1) + 1 } (39ρ ρ + 39), { 8 mse(v S ) = σyσ 4 z 4 (ρ4 + 5ρ + 1) + 1 } (7ρ4 + 30ρ + 7) { 8 mse(v α ) = σyσ 4 z 4 (ρ4 + 5ρ + 1) + 1 [α (ρ + 1) } 6α(3ρ ρ + 3) + 39ρ ρ + 39] σ z σ z
9 VARIANCE ESTIMATORS FOR U-STATISTICS 9 ad mse(v C ) = σ 4 yσ 4 z{ 8 (ρ4 + 5ρ + 1) + 1 (30ρ ρ + 30)}. Remark. I the cases of the above tow examples, mse(v S ) < mse(v C ) < mse(v J ). As discussed i Schucay ad Bakso (1989), though Se s estimator V S has small mea square error, it has substatial egative bias. V C ad V U are asymptotically ubiased ad have smaller mea square error tha V J. But V C ad V U sometimes take egative values i small sample case. Schucay ad Bakso (1989) also poited out by simulatio that from the viewpoit of Pitma closeess V J is closer to σ tha V U. If we take α = 1 of V α, both biases ad mea square errors are relatively small. Especially i the case of the ormal distributio, the biases of V 1 are 0. Note that V 1 is asymptotically equivalet to (V J + V S )/ ad always takes a o-egative value. Example 3. Wilcoxo s siged rak test; I order to compare the mea square errors of the variace estimators, let us discuss the variace estimatio of the Wilcoxo s siged rak statistic. Let X 1,, X be a radom sample from the distributio F (x η), where F (x) satisfies F ( x) = 1 F (x) for ay x. So, the distributio F (x) is symmetric about origi. The Wilcoxo s siged rak statistic is very popular to test or to estimate η. For the sake of simplicity, we cosider the followig statistic ( ) 1 M = Ψ(X i + X j ) C, where Ψ(x) = 1, 0 if x 0, < 0. M is asymptotically equivalet to the Wilcoxo s statistic. Let us assume η = 0 ad F (x) has a desity fuctio. From direct computatio, we ca show that Thus we have θ = 1, σ = 1 6( 1), g 1(x) = F (x) 1, ξ 1 = 1 1, ξ = 1 1, e 1 = 1 80, e = 1 144, e 3 = 1 360, e 4 = 1 360, e 5 = 1 70, e 6 = ad e 7 = b J = 1 6, b S = 1, b α = 1 6 α 3, mse(v J ) = , mse(v S) = 31 60, [ mse(v α ) = 1 ( 1 α 1 ) ] + 4 ad mse(v C ) = It follows from the above calculatio that mse(v J ) < mse(u C ) < mse(v S ). Whe α = 1/, mse(v 1/ ) takes a miimum value 4/(15 ) ad mse(v 1/ ) < mse(v J ). Remark 3. Example 1 ad Example give us the same coclusio. But it is differet i the case of the Wilcoxo s statistic. So, we had better to check the mea square errors of the variace estimators usig Theorem i each case.
10 10 J. JAPAN STATIST. SOC. Vol.8 No Edgeworth expasios From Theorem 1, we ca regard the variace estimators as sum of U-statistics ad 1 term. For asymptotic U-statistics, Lai ad Wag (1993) have established the Edgeworth expasio with remaider term o( 1 ). Applyig their result, we ca get Edgeworth expasios of the variace estimators. Let us assume the followig coditios. (C 1 ) E h(x 1, X ) 8 < (C ) lim sup t E[exp{itf 1 (X 1 )}] < 1 (C 3 ) E f (X 1, X ) s < (s > 0) ad there exist K Borel fuctios ψ ν :R R such that E[ψν(X 1 )] < (ν = 1,, K), K(s ) > 4s+(8s 40)I {E f3 (X 1,X,X 3 ) >0}, ad the covariace matrix of (W 1,, W K ) is positive defiite, where W ν = (Lψ ν )(X 1 ) ad (Lψ ν )(y) = E[f (y, X )ψ ν (X )], ad I {.} is a idicator fuctio. The coditio C 3 is cocered with the umber of ozero eige fuctio of f (x, y). Alteratively Lai ad Wag (1993) have proved the validity of the Edgeworth expasio uder the followig coditio ( C 3 ). ( C 3 ) There exist costats c ν ad Borel fuctios w ν :R R such that E[w ν (X 1 )] = 0, E w ν (X 1 ) s < for some s 5 ad f (X 1, X ) = K ν=1 c νw ν (X 1 )w ν (X )a.s.; moreover, for some 0 < γ < mi{1, (1 11/ (3s))}, [ ( { lim sup t Let us defie sup u u K t γ E exp it f 1 (X 1 ) + K u ν w ν (X 1 )})] < 1. ν=1 τ = E[f 1 (X 1 )], d 1 = E[f (X 1, X )], d = E[f 1 (X 1 )δ(x 1 )], d 3 = E[f 3 1 (X 1 )], d 4 = E[f 1 (X 1 )f 1 (X )f (X 1, X )], d 5 = E[f 4 1 (X 1 )], d 6 = E[f 1 (X 1 )f 1 (X )f (X 1, X )], d 7 = E[f 1 (X 1 )f 1 (X )f (X 1, X 3 )f (X, X 3 )], d 8 = E[f 1 (X 1 )f 1 (X )f 1 (X 3 )f 3 (X 1, X, X 3 )], κ 3 = τ 3 (d 3 + 1d 4 ), κ 4 = τ 4 (d 5 3τ 4 + 4d d 7 + 8d 8 ), P 1C (x) = x 1 6 κ 3, P 1S (x) = P 1C (x) b S 4τ, P J (x) = x τ (d 1 + d + b J 3 P 1J (x) = P 1C (x) b J 4τ, + κ 3 7 (x5 10x x), P S (x) = x ( ) τ d 1 + d τ + b S 3 + κ 3 7 (x5 10x x), P α (x) = x ( ) τ d 1 + d ατ + b α 3 + κ 3 7 (x5 10x x) P 1α(x) = P 1C (x) b α 4τ, ) + κ 4 b J κ 3 (x 3 3x) 4 + κ 4 b S κ 3 (x 3 3x) 4 + κ 4 b S κ 3 (x 3 3x) 4
11 ad VARIANCE ESTIMATORS FOR U-STATISTICS 11 P C (x) = x τ (d 1 + d ) + κ 4 4 (x3 3x) + κ 3 7 (x5 10x x). We have the followig theorem. Theorem 3. Assume that the coditios C 1 ad C hold. If either coditio C 3 or C 3 is satisfied, we have { (VJ σ } P ) x = Φ(x) φ(x)p 1J(x) φ(x)p J(x) + o( 1 ), 4τ { (VS σ } P ) x = Φ(x) φ(x)p 1S(x) φ(x)p S(x) + o( 1 ), 4τ { (Vα σ } P ) x = Φ(x) φ(x)p 1α(x) φ(x)p α(x) + o( 1 ), 4τ { (VC σ } P ) x = Φ(x) φ(x)p 1C(x) φ(x)p C(x) + o( 1 ) 4τ ad { (VU σ P ) 4τ } x = Φ(x) φ(x)p 1C(x) φ(x)p C(x) + o( 1 ). Proof. It is sufficiet to prove the case of V J. Sice Ũ = {V +8 δ(x i)/ + R 1; } is a asymptotic U-statistic, it follows from Lai ad Wag (1993) that } {Ũ P 4τ x = Φ(x) φ(x)p 1C(x) φ(x) P (x) + o( 1 ) where Sice P (x) = x τ (d 1 + d ) + κ 4 4 (x3 3x) + κ 3 7 (x5 10x x). { (VJ σ } P ) {Ũ x = P 4τ 4τ x b } J 4τ, expadig by b J /(4τ ), we have the Edgeworth expasio for V J. Example 4. Let us cosider the case of variace estimatio i Example 1. From direct computatio, we ca show that f 1 (x) = 1 4 (x σ ) 1 4 ξ 1 ad f (x, y) = 1 4 (x σ )(y σ ) xy (x + y σ ) + σ xy = 1 4 (x σ )(y σ ) 1 (x3 + x)(y 3 + y) + 1 x3 y 3 ( + σ + 1 ) xy.
12 1 J. JAPAN STATIST. SOC. Vol.8 No Thus puttig we have c 1 = 1 4, w 1(x) = x σ, c = 1, w (x) = x 3 + x, c 3 = 1, w 3(x) = x 3, c 4 = σ + 1 ad w 4(x) = x, f (X 1, X ) = 3 c ν w ν (X 1 )w ν (X ) ν=1 Assume that E X 1 < ad the uderlyig distributio F (x) has a desity fuctio. We ca show that [ ( { 4 lim sup sup t E exp it f 1 (X 1 ) + u ν w ν (X 1 )})] < 1. u u 4 t 1 Hece the coditios (C 1 ), (C ) ad ( C 3 ) are satisfied. Appedix A First we review the momet evaluatios of the H-decompositio, which is very useful for discussig asymptotic properties. Let ν(x 1,, x r ) be a fuctio which is symmetric i its argumets ad E[ν(X 1,, X r )] = 0. Let us defie ad ρ 1 (x 1 ) = E[ν(x 1, X,, X r )], ν=1 a.s. ρ (x 1, x ) = E[ν(x 1, x,, X r )] ρ 1 (x 1 ) ρ 1 (x ),, r 1 ρ r (x 1, x,, x r ) = ν(x 1, x,, x r ) ρ k (x i1, x i,, x ik ). C r,k The we ca show that k=1 (A.1) E[ρ k (X 1,, X k ) X 1,, X k 1 ] = 0 a.s. ad where C,r ν(x i1,, X ir ) = r k=1 ( ) k Λ k r k Λ k = C,k ρ k (X i1,, X ik ). Usig the equatio (11) ad momet evaluatios of martigales (Dharmadhikari, Fabia ad Jogdeo (1968)), we have the upper bouds of the absolute momets of Λ k as follows. Lemma 1. For q, if E ν(x 1,, X r ) q <, there exists a positive costat c, which may deped o ν ad F but ot o, such that (A.) E Λ k q c qk. For the simplicity we use a symbol o p( 3/ ) which may be differet i each case but satisfies E o p( 3 ) + ε = O( 4 ε ).
13 VARIANCE ESTIMATORS FOR U-STATISTICS 13 It follows from Markov s iequality that o p( 3/ ) = 1/ o p ( 1 ). From Markov s iequality ad (1), we ca easily obtai the followig lemma which is useful for obtaiig the asymptotic represetatios. Lemma. have that If E[ν(X 1,, X r )] = 0 ad E ν(x 1,, X r ) +ε < for ε > 0, we (A.3) r 1 C,r ν(x i1,, X ir ) = ad (A.4) r r k=4 1 (r 1)! Λ 1 + o p( 3 ). ( ) k Λ k = o r k p( 3 ). Usig the above lemmas, we will prove Theorem. Approximatio of V J At first we will obtai the approximatio of V J. Let us defie D 1 = g1(x i ), D = g 1 (X i )g 1 (X j ), C, D 3 = C,{g 1 (X i ) + g 1 (X j )}g (X i, X j ), D 4 = C,3{g 1 (X i )g (X j, X k ) + g 1 (X j )g (X i, X k ) + g 1 (X k )g (X i, X j )}, D 5 = C, g (X i, X j ), D 6 = C,3{g (X i, X j )g (X i, X k ) + g (X i, X j )g (X j, X k ) + g (X i, X k )g (X j, X k )} ad D 7 = C,4{g (X i, X j )g (X k, X l ) + g (X i, X k )g (X j, X l ) From Maesoo (1995, p.18), we have (U (i) U ) = + g (X i, X l )g (X j, X k )}. 4 ( 1) D 1 8 ( 1) D + 8 ( 1) D 3 16 ( 1) ( ) D ( 1) ( ) D 5 8( 4) + ( 1) ( ) D 16 6 ( 1) ( ) D 7.
14 14 J. JAPAN STATIST. SOC. Vol.8 No Note that V J = ( 1) Lemma, we have that 4 D 1 = 4ξ ( 1) D 3 = 8 + (i) (U {g1(x i ) ξ1}, U ). Usig the H-decompositio, Lemma 1 ad E[g 1 (X 0 )g (X i, X 0 ) X i ] 8 ( 1) C, {[g 1 (X i ) + g 1 (X j )]g (X i, X j ) E[g 1 (X 0 )g (X i, X 0 ) X i ] E[g 1 (X 0 )g (X j, X 0 ) X j ]}, 8 ( 1)( ) D 5 = 4ξ + 8 δ(x i ) + o p( 3 ), 8( 4) ( 1)( ) D 8 6 = E[g (X i, X 0 )g (X j, X 0 ) X i, X j ] ( 1) C, 8 + β(x i, X j, X k ) + o ( 1)( ) p( 3 C,3 ) ad 16 ( 1)( ) D 7 = o p( 3 ) where X 0 is a radom vector with distributio F (x) ad is idepedet of X 1,, X ad β(x, y, z) = g (x, y)g (x, z) + g (x, y)g (y, z) + g (x, z)g (y, z) E[g (x, X 0 )g (y, X 0 ) + g (y, X 0 )g (z, X 0 ) + g (x, X 0 )g (z, X 0 )]. Thus we have the equatio (3.1). Approximatio of V S It follows from the equatio (.) that { V S = 1 } + O( ) V J. From the equatio (A.3), we ca show that ad V J = 8ξ 1 8 Thus we have the equatio (3.). f 1 (X i ) + o p( 3 ) O( )V J = o p( 3 ). Approximatio of V α Similarly as V S, we ca easily obtai the equatio (3.3). Approximatio of V C
15 VARIANCE ESTIMATORS FOR U-STATISTICS 15 To obtai the equatio (3.4), it is sufficiet to prove the followig lemma which is a improvemet of Lemma A4 i Maesoo (1995). Lemma 3. If E h(x 1, X ) 4+ε < for some ε > 0, we have i<j (Q i,j Q) = ξ + 4 δ(x i ) + o p( 3 ). Proof From the proof of Lemma A4 i Maesoo (1995), we have = 1 i<j (Q i,j Q) 4 ( + 1)( 1)( 3) D 8 5 ( + 1)( 1)( )( 3) D ( + 1)( 1)( )( 3) D 7. Usig the H-decompositio ad the equatios (A.3) ad (A.4), we get that ad 4 ( + 1)( 1)( 3) D 5 = ξ + 4 δ(x i ) + o p( 3 ), 8 ( + 1)( 1)( )( 3) D 6 = o p( 3 ) Thus we have the equatio (3.5). 8 ( + 1)( 1)( )( 3) D 7 = o p( 3 ). Approximatio of V U Fially we will cosider the ubiased estimator V U. We will obtai approximatios of â 1 ad â. Let us cosider ˆλ 1. From the defiitio, we ca get E[h(x, X )] = g 1 (x) + θ, h(x, y) = g (x, y) + g 1 (x) + g 1 (y) + θ. Usig these equatios ad (.1), we ca show that We also have E[ζ 1 (x, y, X 3 )] = 1 3 {g (x, y)[g 1 (x) + g 1 (y)] + 3g 1 (x)g 1 (y) + g 1(x) + g 1(y) E[ζ 1 (x, X, X 3 )] + E[g (x, X 3 )g (y, X 3 ) + (g (x, X 3 ) + g (y, X 3 ))g 1 (X 3 )] + θg (x, y) + 4θg 1 (x) + 4θg 1 (y) + ξ 1 + 3θ }. = 3 {E[g (x, X 3 )g 1 (X 3 )] + ξ 1} θg 1(x) + θ g 1(x)
16 16 J. JAPAN STATIST. SOC. Vol.8 No ad E[ζ 1 (X 1, X, X 3 )] = ξ1 + θ. Here we have E[ζ 1 (x, X, X 3 )] ξ1 θ = 3 E[g (x, X )g 1 (X )] θg 1(x) {g 1(x) ξ1} = g 1 (x) (say), E[ζ 1 (x, y, X 3 )] ξ1 θ g 1 (x) g 1 (y) = 1 3 E[g (x, X 3 )g (y, X 3 ) {g (x, X 3 ) + g (y, X 3 )}g 1 (X 3 )] + g 1 (x)g 1 (y) {g 1(x) + g 1 (y) + θ}g (x, y) = g (x, y) (say) ad ζ 1 (x, y, z) ξ1 θ g (x, y) g (x, z) g (y, z) g 1 (x) g 1 (y) g 1 (z) = 1 3 {g (x, y)g (x, z) + g (x, y)g (y, z) + g (x, z)g (y, z) E[g (x, X 3 )g (y, X 3 ) g (x, X 3 )g (z, X 3 ) g (y, X 3 )g (z, X 3 )]} + 3 {g 1(x)g (y, z) + g 1 (y)g (x, z) + g 1 (z)g (x, y)} = g 3 (x, y, z) (say). Thus usig the H-decompositio, we ca show that (A.5) ˆλ 1 = ξ1 + θ g 1 (X i ) + g (X i, X j ) ( 1) C, 6 + g 3 (X i, X j, X k ). ( 1)( ) C, Next we will obtai a approximatio of ˆθ. Similarly as ˆλ 1, we ca get E[ζ 0 (x, y, z, X 4 )] = 1 3 {g 1(x)g (y, z) + g 1 (y)g (x, z) + g 1 (z)g (x, y) E[ζ 0 (x, y, X 3, X 4 )] + θg (x, y) + θg (x, z) + θg (y, z) + g 1 (x)g 1 (y) + g 1 (x)g 1 (z) + g 1 (y)g 1 (z)} + θg 1 (x) + θg 1 (y) + θg 1 (z) + θ, = 1 3 {g 1(x)g 1 (y) + θg (x, y)} + θg 1 (x) + θg 1 (y) + θ ad E[ζ 0 (x, X, X 3, X 4 )] = θ{g 1 (x) + θ}.
17 VARIANCE ESTIMATORS FOR U-STATISTICS 17 Thus from the H-decompositio ad the equatio (A.4), we have (A.6) ˆθ = θ θg 1 (X i ) 4 ( 1) 8 ( 1)( ) {g 1 (X i )g 1 (X j ) + θg (X i, X j )} C, C,3 {g 1 (X i )g (X j, X k ) + g 1 (X j )g (X i, X k ) + g 1 (X k )g (X i, X j )} + o p( 3 ). Combiig the equatios (A.5) ad (A.6), we have the approximatio of â 1 as (A.7) 4( ) 1 â 1 = 4ξ 1 4ξ 1 4 f 1 (X i ) + V + o p( 3 ). Sice E[h (X 1, X )] = ξ 1 + ξ + θ, usig the H-decompositio ad the equatio (13), we obtai 1ˆλ = ξ 1 + ξ + θ + {δ(x i ) + f 1 (X i ) + θg 1 (X i )} + o p( 3 ). From the H-decompositio ad the equatios (A.3) ad (A.4), we ca show that (A.8) â 1 = 4 {δ(x i ) + f 1 (X i )} + 4ξ 1 + ξ + o p( 3 ). Combiig the above evaluatios (A.7) ad (A.8), we have the desired approximatio (3.5). Ackowledgemets The author wishes to thak the referee for helpful commets. He is also grateful to the hospitality of the Cetre for Mathematics ad its Applicatios at the Australia Natioal Uiversity, where he carried out a part of this study. Refereces [1] Arvese, J. N. (1969). Jackkifig U-statistics. A. Math. Statist., 40, [] Dharmadhikari, S. W., Fabia, V. ad Jogdeo, K. (1968). Bouds o the momets of martigales. A. Math. Statist., 39, [3] Efro, B. (1987). Better bootstrap cofidece itervals (with discussio). Jour. Amer. Statist. Assoc., 8, [4] Efro, B. ad Stei, C. (1981). The jackkife estimate of variace. A. Statist., 9, [5] Hikley, D. V. (1978). Improvig the jackkife with special referece to correlatio estimatio. Biometrika, 65, [6] Lai, T. L. ad Wag, J. Q. (1993). Edgeworth expasio for symmetric statistics with applicatios to bootstrap methods. Statistica Siica, 3,
18 18 J. JAPAN STATIST. SOC. Vol.8 No [7] Maesoo, Y. (1995a). Comparisos of variace estimators ad their effects for studetized U-statistics. The Australia Natioal Uiversity Statistics Research Report, No. SRR [8] Maesoo, Y. (1995b). O the ormal approximatio of a studetized U-statistic. Jour. Jap. Statist. Soc., 5, [9] Maesoo, Y. (1996a). Edgeworth expasios of a studetized ad a jackkife estimator of variace. to appear i Jour. Statist. Pla. If. [10] Maesoo, Y. (1996b). A Edgeworth expasio of a liear combiatio of U-statistics. Jour. Jap. Statist. Soc., 6, [11] Schucay, W. R. ad Bakso, D. M. (1989). Small sample variace estimators for U- statistics. Austral. J. Statist., 31, [1] Se, P. K. (1960). O some covergece properties of U-statistics. Calcutta Statist. Assoc. Bull., 10, [13] Se, P. K. (1977). Some ivariace priciples relatig to jackkifig ad their role i sequetial aalysis. A. Statist., 5, [14] Shirahata, S. ad Sakamoto, Y. (199). Estimate of variace of U-statistics. Commu. Statist.-Theory Meth., 1,
5. Best Unbiased Estimators
Best Ubiased Estimators http://www.math.uah.edu/stat/poit/ubiased.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 5. Best Ubiased Estimators Basic Theory Cosider agai
More informationRafa l Kulik and Marc Raimondo. University of Ottawa and University of Sydney. Supplementary material
Statistica Siica 009: Supplemet 1 L p -WAVELET REGRESSION WITH CORRELATED ERRORS AND INVERSE PROBLEMS Rafa l Kulik ad Marc Raimodo Uiversity of Ottawa ad Uiversity of Sydey Supplemetary material This ote
More informationSELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION
1 SELECTING THE NUMBER OF CHANGE-POINTS IN SEGMENTED LINE REGRESSION Hyue-Ju Kim 1,, Bibig Yu 2, ad Eric J. Feuer 3 1 Syracuse Uiversity, 2 Natioal Istitute of Agig, ad 3 Natioal Cacer Istitute Supplemetary
More informationLecture 9: The law of large numbers and central limit theorem
Lecture 9: The law of large umbers ad cetral limit theorem Theorem.4 Let X,X 2,... be idepedet radom variables with fiite expectatios. (i) (The SLLN). If there is a costat p [,2] such that E X i p i i=
More informationBayes Estimator for Coefficient of Variation and Inverse Coefficient of Variation for the Normal Distribution
Iteratioal Joural of Statistics ad Systems ISSN 0973-675 Volume, Number 4 (07, pp. 7-73 Research Idia Publicatios http://www.ripublicatio.com Bayes Estimator for Coefficiet of Variatio ad Iverse Coefficiet
More information5 Statistical Inference
5 Statistical Iferece 5.1 Trasitio from Probability Theory to Statistical Iferece 1. We have ow more or less fiished the probability sectio of the course - we ow tur attetio to statistical iferece. I statistical
More informationParametric Density Estimation: Maximum Likelihood Estimation
Parametric Desity stimatio: Maimum Likelihood stimatio C6 Today Itroductio to desity estimatio Maimum Likelihood stimatio Itroducto Bayesia Decisio Theory i previous lectures tells us how to desig a optimal
More information14.30 Introduction to Statistical Methods in Economics Spring 2009
MIT OpeCourseWare http://ocwmitedu 430 Itroductio to Statistical Methods i Ecoomics Sprig 009 For iformatio about citig these materials or our Terms of Use, visit: http://ocwmitedu/terms 430 Itroductio
More informationx satisfying all regularity conditions. Then
AMS570.01 Practice Midterm Exam Sprig, 018 Name: ID: Sigature: Istructio: This is a close book exam. You are allowed oe-page 8x11 formula sheet (-sided). No cellphoe or calculator or computer is allowed.
More informationpoint estimator a random variable (like P or X) whose values are used to estimate a population parameter
Estimatio We have oted that the pollig problem which attempts to estimate the proportio p of Successes i some populatio ad the measuremet problem which attempts to estimate the mea value µ of some quatity
More informationAsymptotics: Consistency and Delta Method
ad Delta Method MIT 18.655 Dr. Kempthore Sprig 2016 1 MIT 18.655 ad Delta Method Outlie Asymptotics 1 Asymptotics 2 MIT 18.655 ad Delta Method Cosistecy Asymptotics Statistical Estimatio Problem X 1,...,
More informationECON 5350 Class Notes Maximum Likelihood Estimation
ECON 5350 Class Notes Maximum Likelihood Estimatio 1 Maximum Likelihood Estimatio Example #1. Cosider the radom sample {X 1 = 0.5, X 2 = 2.0, X 3 = 10.0, X 4 = 1.5, X 5 = 7.0} geerated from a expoetial
More informationA random variable is a variable whose value is a numerical outcome of a random phenomenon.
The Practice of Statistics, d ed ates, Moore, ad Stares Itroductio We are ofte more iterested i the umber of times a give outcome ca occur tha i the possible outcomes themselves For example, if we toss
More informationEXERCISE - BINOMIAL THEOREM
BINOMIAL THOEREM / EXERCISE - BINOMIAL THEOREM LEVEL I SUBJECTIVE QUESTIONS. Expad the followig expressios ad fid the umber of term i the expasio of the expressios. (a) (x + y) 99 (b) ( + a) 9 + ( a) 9
More information1 Random Variables and Key Statistics
Review of Statistics 1 Radom Variables ad Key Statistics Radom Variable: A radom variable is a variable that takes o differet umerical values from a sample space determied by chace (probability distributio,
More informationSequences and Series
Sequeces ad Series Matt Rosezweig Cotets Sequeces ad Series. Sequeces.................................................. Series....................................................3 Rudi Chapter 3 Exercises........................................
More informationSolutions to Problem Sheet 1
Solutios to Problem Sheet ) Use Theorem.4 to prove that p log for all real x 3. This is a versio of Theorem.4 with the iteger N replaced by the real x. Hit Give x 3 let N = [x], the largest iteger x. The,
More informationMaximum Empirical Likelihood Estimation (MELE)
Maximum Empirical Likelihood Estimatio (MELE Natha Smooha Abstract Estimatio of Stadard Liear Model - Maximum Empirical Likelihood Estimator: Combiatio of the idea of imum likelihood method of momets,
More informationMonetary Economics: Problem Set #5 Solutions
Moetary Ecoomics oblem Set #5 Moetary Ecoomics: oblem Set #5 Solutios This problem set is marked out of 1 poits. The weight give to each part is idicated below. Please cotact me asap if you have ay questios.
More informationIntroduction to Probability and Statistics Chapter 7
Itroductio to Probability ad Statistics Chapter 7 Ammar M. Sarha, asarha@mathstat.dal.ca Departmet of Mathematics ad Statistics, Dalhousie Uiversity Fall Semester 008 Chapter 7 Statistical Itervals Based
More informationCombining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010
Combiig imperfect data, ad a itroductio to data assimilatio Ross Baister, NCEO, September 00 rbaister@readigacuk The probability desity fuctio (PDF prob that x lies betwee x ad x + dx p (x restrictio o
More informationThe Limit of a Sequence (Brief Summary) 1
The Limit of a Sequece (Brief Summary). Defiitio. A real umber L is a it of a sequece of real umbers if every ope iterval cotaiig L cotais all but a fiite umber of terms of the sequece. 2. Claim. A sequece
More informationr i = a i + b i f b i = Cov[r i, f] The only parameters to be estimated for this model are a i 's, b i 's, σe 2 i
The iformatio required by the mea-variace approach is substatial whe the umber of assets is large; there are mea values, variaces, ad )/2 covariaces - a total of 2 + )/2 parameters. Sigle-factor model:
More informationFINM6900 Finance Theory How Is Asymmetric Information Reflected in Asset Prices?
FINM6900 Fiace Theory How Is Asymmetric Iformatio Reflected i Asset Prices? February 3, 2012 Referece S. Grossma, O the Efficiecy of Competitive Stock Markets where Traders Have Diverse iformatio, Joural
More informationLecture 5 Point Es/mator and Sampling Distribu/on
Lecture 5 Poit Es/mator ad Samplig Distribu/o Fall 03 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech Road map Poit Es/ma/o Cofidece Iterval
More informationStatistics for Economics & Business
Statistics for Ecoomics & Busiess Cofidece Iterval Estimatio Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for the mea ad the proportio How to determie
More informationA Bayesian perspective on estimating mean, variance, and standard-deviation from data
Brigham Youg Uiversity BYU ScholarsArchive All Faculty Publicatios 006--05 A Bayesia perspective o estimatig mea, variace, ad stadard-deviatio from data Travis E. Oliphat Follow this ad additioal works
More informationSummary. Recap. Last Lecture. .1 If you know MLE of θ, can you also know MLE of τ(θ) for any function τ?
Last Lecture Biostatistics 60 - Statistical Iferece Lecture Cramer-Rao Theorem Hyu Mi Kag February 9th, 03 If you kow MLE of, ca you also kow MLE of τ() for ay fuctio τ? What are plausible ways to compare
More informationAn Empirical Study of the Behaviour of the Sample Kurtosis in Samples from Symmetric Stable Distributions
A Empirical Study of the Behaviour of the Sample Kurtosis i Samples from Symmetric Stable Distributios J. Marti va Zyl Departmet of Actuarial Sciece ad Mathematical Statistics, Uiversity of the Free State,
More informationNOTES ON ESTIMATION AND CONFIDENCE INTERVALS. 1. Estimation
NOTES ON ESTIMATION AND CONFIDENCE INTERVALS MICHAEL N. KATEHAKIS 1. Estimatio Estimatio is a brach of statistics that deals with estimatig the values of parameters of a uderlyig distributio based o observed/empirical
More informationEstimation of Population Variance Utilizing Auxiliary Information
Iteratioal Joural of Statistics ad Systems ISSN 0973-675 Volume 1, Number (017), pp. 303-309 Research Idia Publicatios http://www.ripublicatio.com Estimatio of Populatio Variace Utilizig Auxiliary Iformatio
More informationMath 312, Intro. to Real Analysis: Homework #4 Solutions
Math 3, Itro. to Real Aalysis: Homework #4 Solutios Stephe G. Simpso Moday, March, 009 The assigmet cosists of Exercises 0.6, 0.8, 0.0,.,.3,.6,.0,.,. i the Ross textbook. Each problem couts 0 poits. 0.6.
More informationDiscriminating Between The Log-normal and Gamma Distributions
Discrimiatig Betwee The Log-ormal ad Gamma Distributios Debasis Kudu & Aubhav Maglick Abstract For a give data set the problem of selectig either log-ormal or gamma distributio with ukow shape ad scale
More information1 Estimating sensitivities
Copyright c 27 by Karl Sigma 1 Estimatig sesitivities Whe estimatig the Greeks, such as the, the geeral problem ivolves a radom variable Y = Y (α) (such as a discouted payoff) that depeds o a parameter
More informationSTAT 135 Solutions to Homework 3: 30 points
STAT 35 Solutios to Homework 3: 30 poits Sprig 205 The objective of this Problem Set is to study the Stei Pheomeo 955. Suppose that θ θ, θ 2,..., θ cosists of ukow parameters, with 3. We wish to estimate
More informationA New Constructive Proof of Graham's Theorem and More New Classes of Functionally Complete Functions
A New Costructive Proof of Graham's Theorem ad More New Classes of Fuctioally Complete Fuctios Azhou Yag, Ph.D. Zhu-qi Lu, Ph.D. Abstract A -valued two-variable truth fuctio is called fuctioally complete,
More informationExam 1 Spring 2015 Statistics for Applications 3/5/2015
8.443 Exam Sprig 05 Statistics for Applicatios 3/5/05. Log Normal Distributio: A radom variable X follows a Logormal(θ, σ ) distributio if l(x) follows a Normal(θ, σ ) distributio. For the ormal radom
More informationOnline appendices from Counterparty Risk and Credit Value Adjustment a continuing challenge for global financial markets by Jon Gregory
Olie appedices from Couterparty Risk ad Credit Value Adjustmet a APPENDIX 8A: Formulas for EE, PFE ad EPE for a ormal distributio Cosider a ormal distributio with mea (expected future value) ad stadard
More information0.1 Valuation Formula:
0. Valuatio Formula: 0.. Case of Geeral Trees: q = er S S S 3 S q = er S S 4 S 5 S 4 q 3 = er S 3 S 6 S 7 S 6 Therefore, f (3) = e r [q 3 f (7) + ( q 3 ) f (6)] f () = e r [q f (5) + ( q ) f (4)] = f ()
More informationChapter 10 - Lecture 2 The independent two sample t-test and. confidence interval
Assumptios Idepedet Samples - ukow σ 1, σ - 30 or m 30 - Upooled case Idepedet Samples - ukow σ 1, σ - 30 or m 30 - Pooled case Idepedet samples - Pooled variace - Large samples Chapter 10 - Lecture The
More informationExam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011
15.075 Exam 2 Istructor: Cythia Rudi TA: Dimitrios Bisias October 25, 2011 Gradig is based o demostratio of coceptual uderstadig, so you eed to show all of your work. Problem 1 You are i charge of a study
More information. (The calculated sample mean is symbolized by x.)
Stat 40, sectio 5.4 The Cetral Limit Theorem otes by Tim Pilachowski If you have t doe it yet, go to the Stat 40 page ad dowload the hadout 5.4 supplemet Cetral Limit Theorem. The homework (both practice
More informationUnbiased estimators Estimators
19 Ubiased estimators I Chapter 17 we saw that a dataset ca be modeled as a realizatio of a radom sample from a probability distributio ad that quatities of iterest correspod to features of the model distributio.
More informationAn Improved Estimator of Population Variance using known Coefficient of Variation
J. Stat. Appl. Pro. Lett. 4, No. 1, 11-16 (017) 11 Joural of Statistics Applicatios & Probability Letters A Iteratioal Joural http://dx.doi.org/10.18576/jsapl/04010 A Improved Estimator of Populatio Variace
More informationInferential Statistics and Probability a Holistic Approach. Inference Process. Inference Process. Chapter 8 Slides. Maurice Geraghty,
Iferetial Statistics ad Probability a Holistic Approach Chapter 8 Poit Estimatio ad Cofidece Itervals This Course Material by Maurice Geraghty is licesed uder a Creative Commos Attributio-ShareAlike 4.0
More informationLecture 4: Parameter Estimation and Confidence Intervals. GENOME 560 Doug Fowler, GS
Lecture 4: Parameter Estimatio ad Cofidece Itervals GENOME 560 Doug Fowler, GS (dfowler@uw.edu) 1 Review: Probability Distributios Discrete: Biomial distributio Hypergeometric distributio Poisso distributio
More information18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013
18.S096 Problem Set 5 Fall 2013 Volatility Modelig Due Date: 10/29/2013 1. Sample Estimators of Diffusio Process Volatility ad Drift Let {X t } be the price of a fiacial security that follows a geometric
More informationTopic 14: Maximum Likelihood Estimation
Toic 4: November, 009 As before, we begi with a samle X = (X,, X of radom variables chose accordig to oe of a family of robabilities P θ I additio, f(x θ, x = (x,, x will be used to deote the desity fuctio
More informationHopscotch and Explicit difference method for solving Black-Scholes PDE
Mälardale iversity Fiacial Egieerig Program Aalytical Fiace Semiar Report Hopscotch ad Explicit differece method for solvig Blac-Scholes PDE Istructor: Ja Röma Team members: A Gog HaiLog Zhao Hog Cui 0
More informationBOUNDS FOR TAIL PROBABILITIES OF MARTINGALES USING SKEWNESS AND KURTOSIS. January 2008
BOUNDS FOR TAIL PROBABILITIES OF MARTINGALES USING SKEWNESS AND KURTOSIS V. Betkus 1,2 ad T. Juškevičius 1 Jauary 2008 Abstract. Let M = X 1 + + X be a sum of idepedet radom variables such that X k 1,
More information1 The Black-Scholes model
The Blac-Scholes model. The model setup I the simplest versio of the Blac-Scholes model the are two assets: a ris-less asset ba accout or bod)withpriceprocessbt) at timet, adarisyasset stoc) withpriceprocess
More informationResearch Article The Probability That a Measurement Falls within a Range of n Standard Deviations from an Estimate of the Mean
Iteratioal Scholarly Research Network ISRN Applied Mathematics Volume 0, Article ID 70806, 8 pages doi:0.540/0/70806 Research Article The Probability That a Measuremet Falls withi a Rage of Stadard Deviatios
More information1 Basic Growth Models
UCLA Aderso MGMT37B: Fudametals i Fiace Fall 015) Week #1 rofessor Eduardo Schwartz November 9, 015 Hadout writte by Sheje Hshieh 1 Basic Growth Models 1.1 Cotiuous Compoudig roof: lim 1 + i m = expi)
More informationRandom Sequences Using the Divisor Pairs Function
Radom Sequeces Usig the Divisor Pairs Fuctio Subhash Kak Abstract. This paper ivestigates the radomess properties of a fuctio of the divisor pairs of a atural umber. This fuctio, the atecedets of which
More informationSUPPLEMENTAL MATERIAL
A SULEMENTAL MATERIAL Theorem (Expert pseudo-regret upper boud. Let us cosider a istace of the I-SG problem ad apply the FL algorithm, where each possible profile A is a expert ad receives, at roud, a
More informationTopic-7. Large Sample Estimation
Topic-7 Large Sample Estimatio TYPES OF INFERENCE Ò Estimatio: É Estimatig or predictig the value of the parameter É What is (are) the most likely values of m or p? Ò Hypothesis Testig: É Decidig about
More informationNORMALIZATION OF BEURLING GENERALIZED PRIMES WITH RIEMANN HYPOTHESIS
Aales Uiv. Sci. Budapest., Sect. Comp. 39 2013) 459 469 NORMALIZATION OF BEURLING GENERALIZED PRIMES WITH RIEMANN HYPOTHESIS We-Bi Zhag Chug Ma Pig) Guagzhou, People s Republic of Chia) Dedicated to Professor
More informationProblem Set 1a - Oligopoly
Advaced Idustrial Ecoomics Sprig 2014 Joha Steek 6 may 2014 Problem Set 1a - Oligopoly 1 Table of Cotets 2 Price Competitio... 3 2.1 Courot Oligopoly with Homogeous Goods ad Differet Costs... 3 2.2 Bertrad
More informationControl Charts for Mean under Shrinkage Technique
Helderma Verlag Ecoomic Quality Cotrol ISSN 0940-5151 Vol 24 (2009), No. 2, 255 261 Cotrol Charts for Mea uder Shrikage Techique J. R. Sigh ad Mujahida Sayyed Abstract: I this paper a attempt is made to
More informationKernel Density Estimation. Let X be a random variable with continuous distribution F (x) and density f(x) = d
Kerel Desity Estimatio Let X be a radom variable wit cotiuous distributio F (x) ad desity f(x) = d dx F (x). Te goal is to estimate f(x). Wile F (x) ca be estimated by te EDF ˆF (x), we caot set ˆf(x)
More informationSimulation Efficiency and an Introduction to Variance Reduction Methods
Mote Carlo Simulatio: IEOR E4703 Columbia Uiversity c 2017 by Marti Haugh Simulatio Efficiecy ad a Itroductio to Variace Reductio Methods I these otes we discuss the efficiecy of a Mote-Carlo estimator.
More informationAY Term 2 Mock Examination
AY 206-7 Term 2 Mock Examiatio Date / Start Time Course Group Istructor 24 March 207 / 2 PM to 3:00 PM QF302 Ivestmet ad Fiacial Data Aalysis G Christopher Tig INSTRUCTIONS TO STUDENTS. This mock examiatio
More informationSubject CT1 Financial Mathematics Core Technical Syllabus
Subject CT1 Fiacial Mathematics Core Techical Syllabus for the 2018 exams 1 Jue 2017 Subject CT1 Fiacial Mathematics Core Techical Aim The aim of the Fiacial Mathematics subject is to provide a groudig
More informationChapter 8. Confidence Interval Estimation. Copyright 2015, 2012, 2009 Pearson Education, Inc. Chapter 8, Slide 1
Chapter 8 Cofidece Iterval Estimatio Copyright 2015, 2012, 2009 Pearso Educatio, Ic. Chapter 8, Slide 1 Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for
More informationSampling Distributions and Estimation
Cotets 40 Samplig Distributios ad Estimatio 40.1 Samplig Distributios 40. Iterval Estimatio for the Variace 13 Learig outcomes You will lear about the distributios which are created whe a populatio is
More informationSupplement to Adaptive Estimation of High Dimensional Partially Linear Model
Supplemet to Adaptive Estimatio o High Dimesioal Partially Liear Model Fag Ha Zhao Re ad Yuxi Zhu May 6 017 This supplemetary material provides the techical proos as well as some auxiliary lemmas. For
More informationConfidence Intervals based on Absolute Deviation for Population Mean of a Positively Skewed Distribution
Iteratioal Joural of Computatioal ad Theoretical Statistics ISSN (220-59) It. J. Comp. Theo. Stat. 5, No. (May-208) http://dx.doi.org/0.2785/ijcts/0500 Cofidece Itervals based o Absolute Deviatio for Populatio
More information4.5 Generalized likelihood ratio test
4.5 Geeralized likelihood ratio test A assumptio that is used i the Athlete Biological Passport is that haemoglobi varies equally i all athletes. We wish to test this assumptio o a sample of k athletes.
More informationIntroduction to Econometrics (3 rd Updated Edition) Solutions to Odd- Numbered End- of- Chapter Exercises: Chapter 2
Itroductio to Ecoometrics (3 rd Updated Editio) by James H. Stock ad Mark W. Watso Solutios to Odd- Numbered Ed- of- Chapter Exercises: Chapter 2 (This versio August 7, 204) Stock/Watso - Itroductio to
More informationSampling Distributions & Estimators
API-209 TF Sessio 2 Teddy Svoroos September 18, 2015 Samplig Distributios & Estimators I. Estimators The Importace of Samplig Radomly Three Properties of Estimators 1. Ubiased 2. Cosistet 3. Efficiet I
More informationNon-Inferiority Logrank Tests
Chapter 706 No-Iferiority Lograk Tests Itroductio This module computes the sample size ad power for o-iferiority tests uder the assumptio of proportioal hazards. Accrual time ad follow-up time are icluded
More informationBootstrapping high-frequency jump tests
Bootstrappig high-frequecy jump tests Prosper Dovoo Departmet of Ecoomics, Cocordia Uiversity Sílvia Goçalves Departmet of Ecoomics, Uiversity of Wester Otario Ulrich Houyo CREATES, Departmet of Ecoomics
More information1. Suppose X is a variable that follows the normal distribution with known standard deviation σ = 0.3 but unknown mean µ.
Chapter 9 Exercises Suppose X is a variable that follows the ormal distributio with kow stadard deviatio σ = 03 but ukow mea µ (a) Costruct a 95% cofidece iterval for µ if a radom sample of = 6 observatios
More informationModels of Asset Pricing
4 Appedix 1 to Chapter Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see
More informationThe Valuation of the Catastrophe Equity Puts with Jump Risks
The Valuatio of the Catastrophe Equity Puts with Jump Risks Shih-Kuei Li Natioal Uiversity of Kaohsiug Joit work with Chia-Chie Chag Outlie Catastrophe Isurace Products Literatures ad Motivatios Jump Risk
More informationON DIFFERENTIATION AND HARMONIC NUMBERS
ON DIFFERENTIATION AND HARMONIC NUMBERS ERIC MORTENSON Abstract. I a paper of Adrews ad Uchimura [AU, it is show how differetiatio applied to hypergeometric idetities produces formulas for harmoic ad q-harmoic
More informationCreditRisk + Download document from CSFB web site:
CreditRis + Dowload documet from CSFB web site: http://www.csfb.com/creditris/ Features of CreditRis+ pplies a actuarial sciece framewor to the derivatio of the loss distributio of a bod/loa portfolio.
More informationFOUNDATION ACTED COURSE (FAC)
FOUNDATION ACTED COURSE (FAC) What is the Foudatio ActEd Course (FAC)? FAC is desiged to help studets improve their mathematical skills i preparatio for the Core Techical subjects. It is a referece documet
More informationThese characteristics are expressed in terms of statistical properties which are estimated from the sample data.
0. Key Statistical Measures of Data Four pricipal features which characterize a set of observatios o a radom variable are: (i) the cetral tedecy or the value aroud which all other values are buched, (ii)
More informationModels of Asset Pricing
APPENDIX 1 TO CHAPTER 4 Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see
More informationModels of Asset Pricing
APPENDIX 1 TO CHAPTER4 Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see
More informationSupersedes: 1.3 This procedure assumes that the minimal conditions for applying ISO 3301:1975 have been met, but additional criteria can be used.
Procedures Category: STATISTICAL METHODS Procedure: P-S-01 Page: 1 of 9 Paired Differece Experiet Procedure 1.0 Purpose 1.1 The purpose of this procedure is to provide istructios that ay be used for perforig
More informationINTERVAL GAMES. and player 2 selects 1, then player 2 would give player 1 a payoff of, 1) = 0.
INTERVAL GAMES ANTHONY MENDES Let I ad I 2 be itervals of real umbers. A iterval game is played i this way: player secretly selects x I ad player 2 secretly ad idepedetly selects y I 2. After x ad y are
More informationFourier Transform in L p (R) Spaces, p 1
Ge. Math. Notes, Vol. 3, No., March 20, pp.4-25 ISSN 229-784; Copyright c ICSS Publicatio, 200 www.i-csrs.org Available free olie at http://www.gema.i Fourier Trasform i L p () Spaces, p Devedra Kumar
More informationThe material in this chapter is motivated by Experiment 9.
Chapter 5 Optimal Auctios The material i this chapter is motivated by Experimet 9. We wish to aalyze the decisio of a seller who sets a reserve price whe auctioig off a item to a group of bidders. We begi
More informationCHAPTER 8 Estimating with Confidence
CHAPTER 8 Estimatig with Cofidece 8.2 Estimatig a Populatio Proportio The Practice of Statistics, 5th Editio Stares, Tabor, Yates, Moore Bedford Freema Worth Publishers Estimatig a Populatio Proportio
More informationModel checks for the volatility under microstructure noise
Model checks for the volatility uder microstructure oise Mathias Vetter ad Holger Dette Ruhr-Uiversität Bochum Fakultät für Mathematik 4478 Bochum Germay email: mathias.vetter@rub.de; holger.dette@rub.de
More informationStochastic Processes and their Applications in Financial Pricing
Stochastic Processes ad their Applicatios i Fiacial Pricig Adrew Shi Jue 3, 1 Cotets 1 Itroductio Termiology.1 Fiacial.............................................. Stochastics............................................
More informationBootstrapping high-frequency jump tests
Bootstrappig high-frequecy jump tests Prosper Dovoo Departmet of Ecoomics, Cocordia Uiversity Sílvia Goçalves Departmet of Ecoomics, McGill Uiversity Ulrich Houyo Departmet of Ecoomics, Uiversity at Albay,
More informationNotes on Expected Revenue from Auctions
Notes o Epected Reveue from Auctios Professor Bergstrom These otes spell out some of the mathematical details about first ad secod price sealed bid auctios that were discussed i Thursday s lecture You
More informationDESCRIPTION OF MATHEMATICAL MODELS USED IN RATING ACTIVITIES
July 2014, Frakfurt am Mai. DESCRIPTION OF MATHEMATICAL MODELS USED IN RATING ACTIVITIES This documet outlies priciples ad key assumptios uderlyig the ratig models ad methodologies of Ratig-Agetur Expert
More informationEcient estimation of log-normal means with application to pharmacokinetic data
STATISTICS IN MEDICINE Statist. Med. 006; 5:303 3038 Published olie 3 December 005 i Wiley IterSciece (www.itersciece.wiley.com. DOI: 0.00/sim.456 Eciet estimatio of log-ormal meas with applicatio to pharmacokietic
More informationCHANGE POINT TREND ANALYSIS OF GNI PER CAPITA IN SELECTED EUROPEAN COUNTRIES AND ISRAEL
The 9 th Iteratioal Days of Statistics ad Ecoomics, Prague, September 0-, 05 CHANGE POINT TREND ANALYSIS OF GNI PER CAPITA IN SELECTED EUROPEAN COUNTRIES AND ISRAEL Lia Alatawa Yossi Yacu Gregory Gurevich
More informationProceedings of the 5th WSEAS Int. Conf. on SIMULATION, MODELING AND OPTIMIZATION, Corfu, Greece, August 17-19, 2005 (pp )
Proceedigs of the 5th WSEAS It. Cof. o SIMULATION, MODELING AND OPTIMIZATION, Corfu, Greece, August 7-9, 005 (pp488-49 Realized volatility estimatio: ew simulatio approach ad empirical study results JULIA
More informationFaculdade de Economia da Universidade de Coimbra
Faculdade de Ecoomia da Uiversidade de Coimbra Grupo de Estudos Moetários e Fiaceiros (GEMF) Av. Dias da Silva, 65 300-5 COIMBRA, PORTUGAL gemf@fe.uc.pt http://www.uc.pt/feuc/gemf PEDRO GODINHO Estimatig
More informationREVISIT OF STOCHASTIC MESH METHOD FOR PRICING AMERICAN OPTIONS. Guangwu Liu L. Jeff Hong
Proceedigs of the 2008 Witer Simulatio Coferece S. J. Maso, R. R. Hill, L. Möch, O. Rose, T. Jefferso, J. W. Fowler eds. REVISIT OF STOCHASTIC MESH METHOD FOR PRICING AMERICAN OPTIONS Guagwu Liu L. Jeff
More informationResearch Article The Average Lower Connectivity of Graphs
Applied Mathematics, Article ID 807834, 4 pages http://dx.doi.org/10.1155/2014/807834 Research Article The Average Lower Coectivity of Graphs Ersi Asla Turgutlu Vocatioal Traiig School, Celal Bayar Uiversity,
More informationStandard Deviations for Normal Sampling Distributions are: For proportions For means _
Sectio 9.2 Cofidece Itervals for Proportios We will lear to use a sample to say somethig about the world at large. This process (statistical iferece) is based o our uderstadig of samplig models, ad will
More informationST 305: Exam 2 Fall 2014
ST 305: Exam Fall 014 By hadig i this completed exam, I state that I have either give or received assistace from aother perso durig the exam period. I have used o resources other tha the exam itself ad
More informationCalculation of the Annual Equivalent Rate (AER)
Appedix to Code of Coduct for the Advertisig of Iterest Bearig Accouts. (31/1/0) Calculatio of the Aual Equivalet Rate (AER) a) The most geeral case of the calculatio is the rate of iterest which, if applied
More information