Probability and statistics
|
|
- Mae Logan
- 6 years ago
- Views:
Transcription
1 4 Probability ad statistics Basic deitios Statistics is a mathematical disciplie that allows us to uderstad pheomea shaped by may evets that we caot keep track of. Sice we miss iformatio to predict the idividual evets, we cosider them radom. However, the collective eect of may such evets ca usually be uderstood ad predicted. Precisely this problem is the subject of statistical mechaics, which applies mathematical statistics to describe physical systems with may degrees of freedom whose dyamics appears radom to us due to complexity. Evets or outcomes are mathematically represeted by values that a radom variable x ca take i a measuremet. Most geerally, if the radom variable ca have ay value from a set X, the a evet is deed by a subset A X. If oe measures x ad ds x A, the the evet A occurred. The most elemetary evet {x} is specied by a sigle value that x ca take. Esemble ad probability: Oe assumes that every measuremet is doe i exactly the same coditios ad idepedetly of all other measuremets. A way to facilitate such a complete equality of all measuremets is to prepare a esemble of idetical systems ad perform oe measuremet of x o each. If oe obtais x times a measuremet outcome x, the the objective probability px of this outcome is deed as: x px p{x} lim For o-elemetary evets: pa x A p{x} lim x A where x A is the umber of evets A i measuremets the umber of times it was foud that x A. Oe must ofte estimate a objective probability usig fudametal priciples, as i statistical mechaics; such estimates ca be cosidered subjective probabilities. I geeral, probability has the followig properties which trivially follow from the deitio: px x X px px x X A evet represeted by the uio A B of two sets A ad B occurs if either oe of the evets A or B occurs. It is possible for both evets A ad B to occur at the same time if their itersectio A B is ot a empty set. However, we cosider A ad B as outcomes of a sigle measuremet o a scalar radom variable. The evets A ad B are ot idepedet sice the occurrece of oe ca exclude the other whe their itersectio is empty. Uder these assumptios, the followig ca be easily deduced from the deitio of probability: pa B pa + pb pa B Two evets A ad B are idepedet if they correspod to the measuremets of two ucorrelated radom variables a X a ad b X b. The evet A occurs if a A ad the evet B occurs if b B. If we label by AB or A B the evet i which both A ad B happe mathematically, a, b A B, the it ca be easily show from the deitio of probability that: pab papb Coditioal probability. If a evet B occurs ad oe observes it, the the coditioal probability pa B that a evet A would occur as well at the same time is: pa B pab pb If A ad B are idepedet, the the probability of A has othig to do with B ad pa B pa.
2 5 If the radom variable x takes values from a cotiuous set X such as real umbers, the oe ca sesibly dee probability oly for a rage of values, e.g.: x x < x 2 px, x 2 lim where x x < x 2 is the umber of outcomes x x < x 2 amog experimets. Cumulative probability fuctio: P x p, x is the probability that a measuremet outcome will be smaller tha x. The most direct substitute of the probability fuctio itself is probability distributio fuctio PDF, or probability desity: fx dp x dx The probability that a measuremet outcome will be i the iterval x, x + dx is fxdx. The PDF is ormalized: fxdx The average, or expectatio value, of the radom variable x X is labeled as x or x, ad deed by: x ˆ xpx or x dx xfx x X for discrete ad cotiuous distributios respectively. It is the sigle value that represets best the etire distributio of radom outcomes. If the distributio scatters little about the most probable outcome x most, the x x most but they are geerally ot equal. If the distributio scatters symmetrically about x which eed ot be equal to x most, the x x. The average value is especially useful for learig about the statistics of the sum of radom variables. Oe similarly dees the expectatio value of ay fuctio of x: gx ˆ gxpx or gx dx gxfx x X The variace of a radom distributio is deed by: Varx x x 2 x Xx x 2 px It is usually more coveiet to calculate it as: Stadard deviatio x x 2 x 2 2x x + x 2 x 2 2 x x + x 2 x 2 x 2 σ Varx x x 2 is the measure of how much the radom outcomes scatter about the average value of the distributio the average of the deviatio from the mea; this is squared iside the average i order to avoid the cacellatio of scatters i opposite directios, but the square root evetually udoes this squarig ad makes σ directly comparable to the outcomes of x. A sharp distributio that scatters little has a small σ.
3 6 Uiform distributio The radom variable x whose all possible outcomes are equally likely belogs to the uiform probability distributio UX. If the set X of all possible outcomes is ite ad has elemets, the: px x X Otherwise, if X a, b is a cotiuous rage of real umbers betwee a ad b, the: Biomial distributio The radom variable where x ˆb a x i fx b a dx xfx ˆb dx x b 2 a 2 b + a b a b a 2 2 a x i {, with probability p, with probability p belogs to the biomial distributio: B, p. This distributio describes the statistics of the umber m of radom evets x i, which idepedetly occur with probability p. Example applicatios are tossig a coi, throwig a dice how may times oe gets a particular umber o the dice with p 6 i attempts, radom walk how far does a radom walker reach after steps if the probability of a forward step is p, etc. Let W be the probability that evets will occur i attempts. I order to determie W experimetally, oe must carry out M times a sequece of measuremets of the radom variables x i, ad cout how may times M there were positive x i outcomes i a sequece. We will determie this probability aalytically. Cosider a sigle sequece. The probability that the sequece will be, for example, is equal to the probability that x p ad x 2 p ad x 3 p ad... x p ad x p. Sice all idividual evets are idepedet, the probability of the whole sequece is the product of idividual evet probabilities: W p p p p p The probability of a particular log sequece ca be very small because the umber of possible sequeces is very large. If there were outcomes x i i the sequece, ad hece outcomes x i, the: W sequece p p } i There are dieret sequeces that have the same umber of positive outcomes. idepedet ad o-overlappig, so their probabilities add up: W p p They are also where the biomial coeciet! + + 2!!!
4 is the umber of sequeces that have positive outcomes, i.e. the umber of ways oe ca select elemets from a set of elemets there are ways to select the st elemet, the ways to select the 2 d elemet, dow to + ways to select the last th elemet from the remaiig oes; the umerator o the right is the umber of possible selectios, but amog them each group of selected elemets is assembled i! dieret orders ad we do ot care about the order. ormalizatio: W p p p + p] To see this, just cosider brute-force expadig the square brackets above without disassemblig the brackets for p. There are copies of p + p] that are multiplied together ad geerate the sum of all possible products of factors that ca be either p or p... The expectatio value of biomial distributio B, p is p, which ca be easily uderstood give that it represets the umber of positive outcomes of probability p out of attempts recall the very deitio of objective probability. Formally: W p p p!!! p p!! ]! p p p p!! p p The last lie follows from the ormalizatio of the biomial distributio B, p. The variace of B, p is p p. We d this from: 2 ad!!! p p 2 p 2 p 2 p !! p p 2! 2! 2 2]! p 2 p p p 2 Var p 2 + p p 2 2 p p Poisso distributio Cosider a physical system that experieces radom ucorrelated evets of certai kid with average rate of λ evets per uit time for example, a sample of radioactive atoms whose lifetime is τ λ will experiece decay evets with rate λ. Sice the evets are ucorrelated, their umber t i a time iterval t does ot deped o the istat t at which oe begis to cout them. The statistics of the radom variable t is described by the Poisso distributio, t Poisλ, t.
5 8 The probability W λ,t to observe evets i a time iterval t ca be obtaied from the biomial distributio. Divide the time iterval t ito iitesimal itervals t t/. If p is the probability of a sigle evet to occur i a time iterval t, the the average umber of evets that occur i t is: t p + p p λ t λt We computed this rst as a statistical expectatio value of the radom variable t that couts how may evets occurred i the iterval t. I doig so, we eglected the possibility that more tha oe evet could have happeed i such a small iterval t, ad treated t was a biary variable that takes oly values or. The, we used the deitio of rate λ to express t i terms of t. ow, sice t is biary, we ca regard the total umber of evet i the period t t i t as a radom variable from the biomial distributio B, p i the limit, p λt/. Each idividual measuremet i the equivalet B, p distributio refers to whether a evet i t occurred with probability p i a iitesimal iterval i t t < i t. Therefore, W λ,t lim p p lim!!!! λt!! λt λt lim 2 + λt lim lim λt e λt! λt λt λt λt λt λt! λt λt lim λt I the 2 d lie we just caceled out the commo factors i! ad! ad reorgaized the terms ivolvig λ, without makig ay approximatios. I 3 rd lie we eglected all appearaces of ext to, sice is ite ad. ext, we pulled the factor of ito the term, ad the approximated λt/ i the deomiator. I the last step, we used the deitio of the expoetial fuctio expx lim + x/. The expectatio value ad variace of Poisλ, t ca be computed brute-force usig the obtaied probability W λ,t, or elegatly from the Biomial distributio results: t lim p lim λt λt Var t lim p p lim λt λt λt We see that the average has the expected value from the deitio of the rate λ as the average umber of evets per uit time, ad the variace is equal to the average. Expoetial distributio The time iterval τ > betwee two successive evets that occur with a averate rate λ is a radom variable belogig to the expoetial distributio Expλ. This distributio is cotiuous.
6 9 If fτ is the expoetial PDF, the fτdτ is the probability that a evet will occur i the time iterval τ t < τ + dτ after the previous evet. We ca obtai this probability as the product of Poisso probabilities for two idepedet outcomes: o evet occurs i t < τ, ad 2 oe evet occurs i τ t < τ + dτ: I the limit δτ, we d: fτdτ W λ,τ W λ,dτ λτ! fτ λe λτ Verify by ormalizatio usig the chage of variables x λτ: dτ fτ λ dτ e λτ e λτ λdτ e λdτ! dx e x The average time iterval betwee two successive Poisso evets is as expected from the deitio of rate λ: The variace is: τ dτ τfτ λ dτ τe λτ λ Varτ τ 2 τ 2 λ dτ τ 2 e λτ λ 2 λ 2 dx xe x λ dx x 2 e x λ 2 2 λ 2 λ 2 λ 2 so the stadard deviatio is equal to the mea. The last itegral is solved usig itegratio by parts, ad is kow as the Gamma fuctio: Γ + Gaussia distributio dx x e x x e x + dx x e x! dx e x! Gaussia distributio is of fudametal importace i mathematics ad statistical mechaics because of the cetral limit theorem proved later: the average of may idepedet radom variables always coverges to a Gaussia distributio. May quatities of iterest i statistical mechaics will be averages over may degrees of freedom i macroscopic systems e.g. the average velocity of a particle i a gas, so their statistics will be described by Gaussia distributios. Gaussia or ormal distributio µ, σ is a cotiuous probability distributio deed o x, by the PDF: fx σ 2π exp x µ2 2σ 2 The mea ad stadard deviatio are µ ad σ respectively. The coeciet /σ 2π is required by ormalizatio: dx fx σ 2π x µ2 dx exp 2σ 2 σ 2π 2σ 2 dξ e ξ2 σ 2π 2σ 2 π Here, we chaged variables to ξ x µ/ 2σ 2 ad used the well kow itegral: I dξ e ξ2 π
7 which ca be derived from: ˆ2π I 2 dx dy e x2 +y 2 dθ rdr e r2 2π dr 2 e r2 π 2 by switchig from Cartesia x, y to polar r, θ coordiates. The mea is: x dx xfx σ 2π σ 2π x µ2 dx x µ + µ exp 2σ 2 x µ2 dx x µ exp 2σ 2 + µ dx fx µ Usig the trick x x µ + µ we separated the iitial itegral ito two. The rst oe vaishes because it's a itegral of a odd fuctio x µ exp over a symmetric iterval. The secod itegral is simply µ multiplied by the ormalizatio of the PDF. The variace is: Varx x x 2 σ 2π 2σ2 3 2 dx x µ 2 fx σ 2π σ 2π 2σ2 3 2 so that stadard deviatio is σ. Cetral limit theorem dξ ξ 2 e ξ2 σ 2π 2σ2 3 2 π 2 σ2 dx x µ 2 x µ2 exp 2σ 2 ξ e ξ2 2 The th momet of the probability distributio of a radom variable x is deed by: µ x The zeroth momet is always, the rst momet is the mea of the distributio, etc. All momets ca be obtaied by takig derivatives of the geeratig fuctio Gt at t : Gt e tx µ d G dt t This follows from the Taylor expasio of the expoetial fuctio: Gt e tx xt m x m t m m! m! m Whe we take the th derivative term-by-term, usig m + 2 dξ e ξ2 d dt tm mt m for m, d 2 dt 2 tm d dt mtm mm t m 2 for m 2 etc.
8 2 we get a sum of various o-egative powers of t: d G dt m x m m! d t m dt m x m m! mm m 2 m + t m The, evaluatig this th derivative at t kills all terms with o-zero powers of t, leavig behid just the rst term t : d G t x ] dt 2 + t + t + t 2 t + x! µ! t! Cumulats κ of the probability distributio of a radom variable x are deed by the geeratig fuctio Kt: Kt log e tx κ d K t dt The rst few cumulats are: κ dk dt κ 2 d2 K t dt 2 d ] dg dt G dt { κ 3 d3 K t dt 3 d dt G 2 κ K log e x log d Gt t dt log t G t G 2 d 2 G dt 2 G d 2 G dt 2 G dg µ dt t e x x ] 2 dg µ dt 2 µ 2 Varx t ]} 2 dg µ dt 3 3µ 2 µ + 2µ 3 t We see that the zeroth cumulat vaishes, the rst cumulat is the mea, ad the secod cumulat is the variace. Homogeeity of momets ad cumulats: If µ x variable x respectively, the for ay costat c: Proof: For momets: µ cx µ cx ad κ x c µ x, κ cx c κ x cx c x c µ x are momets ad cumulats of the radom For cumulats: The cumulat κ x is geerated by the th derivative of the geeratig fuctio Kt at t. Whe expaded i terms of the geeratig fuctio Gt for momets, κ x becomes a sum of various combiatios of G derivatives which always have the same total power of dt i the deomiators see the example for κ 2 above. Therefore, each such term becomes a product of several momets, e.g. µ x... µ x µ x 2 but always with k. Sice µ cx κ cx C k µ cx k after substitutig t which makes Gt, c µ x, the: µ cx 2... µ cx k c + + k C k µ x c C k µ x c κ x µ x 2 µ x 2... µ x k... µ x k If oe kows all momets of a probability distributio, or alteratively all cumulats, oe ca recostruct the PDF.
9 22 Proof: If all momets x m, m {,, 2... } are kow, the oe ca costruct a auxiliary fuctio gt Git usig the Taylor expasio of the geeratig fuctio Gt: gt Git e itx m x m i m t m m! Here, i is the imagiary uit. The fuctio gt is useful because it is related to the Fourier trasform of the Dirac delta fuctio δt: dt e itx 2πδx where δx is deed by: δx {, x, x }, dx δx The above relatioship betwee gt ad δt ca be prove by calculatig a well-deed Gaussia itegral Dx; α dt expitx αx 2 with a ite positive α, ad the showig that Dx; α coverges to δx i the α limit. The Dirac delta fuctio has the followig essetial property for ay fuctio fx: dx δx x fx fx which follows directly from its deitio. Applied to the PDF fx, it allows us to calculate fx at ay desired poit x : fx δx x dt e itx x dt e itx e itx dt gte itx if we ca obtai gt, i.e. if we kow all momets. This completes the proof. Sice Gt e Kt ad Kt is fully determied by the kowledge of all cumulats, we ca similarly recostruct the PDF from the cumulats. The Gaussia distributio µ, σ has cumulats κ µ, κ 2 σ 2, ad all other cumulats equal to zero. Proof: First, calculate the geeratig fuctio for momets: Gt e tx σ 2π σ 2π 2σ 2 eµt π e µt e 2 σ2 t 2 x µ2 dx exp 2σ 2 + tx dξ e ξ2 +tξ 2σ 2 +µ eµt π dξ e ξ 2 t 2σ t2 2σ 2 dξ e ξ2 +tξ 2σ 2 We chaged variables from x to ξ x µ/ 2σ 2 i the secod lie. The we completed the square i the expoet i the third lie: the expoets of e are equal i the third lie ad the
10 last itegral of the secod lie, but the third lie becomes a costat exp 2 σ2 t 2 times a pure Gaussia itegral that evaluates to π as we saw before. ow that we kow Gt, we immediately kow the geeratig fuctio for cumulats: Kt log Gt µt + 2 σ2 t 2 The derivatives of Kt geerate the cumulats ad we clearly reproduce the stated result: all cumulats are zero except κ µ ad κ 2 σ 2. Cetral limit theorem: Let x i, be idepedet radom variables from the same probability distributio with mea µ ad variace σ 2. Let X be the radom variable deed by: X σ x i µ I the limit, the statistics of X coverges to the Gaussia distributio, with mea ad variace, regardless of the distributio of x i. Proof: Costruct the geeratig fuctio for the cumulats of X: ] K X t log e tx t log exp σ ] txi µ x i µ log exp σ ] txi µ log exp σ txi log exp σ exp tµ σ t K i σ tµ t σ K x σ tµ ] σ We are able to pull the product symbol outside of the averagig brackets at the begiig of the secod lie oly because the radom variables x i are idepedet: the average of a product of radom idepedet values equals the product of their averages. Goig through the ed, we d that the cumulat geeratig fuctio K X for X equals a shifted sum of aalogous geeratig fuctios K x for idividual radom variables x i, although evaluated at the rescaled parameter t/σ. Sice all x i have the same distributio, the last expressio is simply proportioal to. ow we ca calculate the cumulats of X substitutig τ t/σ : d K X t t dt κ X σ κx /2 µδ, σ d K t/σ ] dt t µδ, σ ] The zeroth cumulat always vaishes. The rst cumulat is the mea: κ X σ κx µ ] σ The secod cumulat is the variace: κ X 2 ] σ 2 κx 2 The higher order cumulats κ X become egligible whe. κ X 2 >2 d K τ τ σ /2 dτ µδ, σ We showed earlier that the probability distributio of X is completely determied by the cumulats, ad the distributio i which oly the rst ad secod cumulats are ite is Gaussia. This proves the cetral limit theorem. ]
5. Best Unbiased Estimators
Best Ubiased Estimators http://www.math.uah.edu/stat/poit/ubiased.xhtml 1 of 7 7/16/2009 6:13 AM Virtual Laboratories > 7. Poit Estimatio > 1 2 3 4 5 6 5. Best Ubiased Estimators Basic Theory Cosider agai
More informationA random variable is a variable whose value is a numerical outcome of a random phenomenon.
The Practice of Statistics, d ed ates, Moore, ad Stares Itroductio We are ofte more iterested i the umber of times a give outcome ca occur tha i the possible outcomes themselves For example, if we toss
More informationLecture 4: Parameter Estimation and Confidence Intervals. GENOME 560 Doug Fowler, GS
Lecture 4: Parameter Estimatio ad Cofidece Itervals GENOME 560 Doug Fowler, GS (dfowler@uw.edu) 1 Review: Probability Distributios Discrete: Biomial distributio Hypergeometric distributio Poisso distributio
More information14.30 Introduction to Statistical Methods in Economics Spring 2009
MIT OpeCourseWare http://ocwmitedu 430 Itroductio to Statistical Methods i Ecoomics Sprig 009 For iformatio about citig these materials or our Terms of Use, visit: http://ocwmitedu/terms 430 Itroductio
More informationx satisfying all regularity conditions. Then
AMS570.01 Practice Midterm Exam Sprig, 018 Name: ID: Sigature: Istructio: This is a close book exam. You are allowed oe-page 8x11 formula sheet (-sided). No cellphoe or calculator or computer is allowed.
More information. (The calculated sample mean is symbolized by x.)
Stat 40, sectio 5.4 The Cetral Limit Theorem otes by Tim Pilachowski If you have t doe it yet, go to the Stat 40 page ad dowload the hadout 5.4 supplemet Cetral Limit Theorem. The homework (both practice
More information0.1 Valuation Formula:
0. Valuatio Formula: 0.. Case of Geeral Trees: q = er S S S 3 S q = er S S 4 S 5 S 4 q 3 = er S 3 S 6 S 7 S 6 Therefore, f (3) = e r [q 3 f (7) + ( q 3 ) f (6)] f () = e r [q f (5) + ( q ) f (4)] = f ()
More informationEXERCISE - BINOMIAL THEOREM
BINOMIAL THOEREM / EXERCISE - BINOMIAL THEOREM LEVEL I SUBJECTIVE QUESTIONS. Expad the followig expressios ad fid the umber of term i the expasio of the expressios. (a) (x + y) 99 (b) ( + a) 9 + ( a) 9
More informationCombining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010
Combiig imperfect data, ad a itroductio to data assimilatio Ross Baister, NCEO, September 00 rbaister@readigacuk The probability desity fuctio (PDF prob that x lies betwee x ad x + dx p (x restrictio o
More informationBinomial Model. Stock Price Dynamics. The Key Idea Riskless Hedge
Biomial Model Stock Price Dyamics The value of a optio at maturity depeds o the price of the uderlyig stock at maturity. The value of the optio today depeds o the expected value of the optio at maturity
More informationr i = a i + b i f b i = Cov[r i, f] The only parameters to be estimated for this model are a i 's, b i 's, σe 2 i
The iformatio required by the mea-variace approach is substatial whe the umber of assets is large; there are mea values, variaces, ad )/2 covariaces - a total of 2 + )/2 parameters. Sigle-factor model:
More informationIntroduction to Probability and Statistics Chapter 7
Itroductio to Probability ad Statistics Chapter 7 Ammar M. Sarha, asarha@mathstat.dal.ca Departmet of Mathematics ad Statistics, Dalhousie Uiversity Fall Semester 008 Chapter 7 Statistical Itervals Based
More informationLecture 9: The law of large numbers and central limit theorem
Lecture 9: The law of large umbers ad cetral limit theorem Theorem.4 Let X,X 2,... be idepedet radom variables with fiite expectatios. (i) (The SLLN). If there is a costat p [,2] such that E X i p i i=
More informationExam 1 Spring 2015 Statistics for Applications 3/5/2015
8.443 Exam Sprig 05 Statistics for Applicatios 3/5/05. Log Normal Distributio: A radom variable X follows a Logormal(θ, σ ) distributio if l(x) follows a Normal(θ, σ ) distributio. For the ormal radom
More informationLecture 4: Probability (continued)
Lecture 4: Probability (cotiued) Desity Curves We ve defied probabilities for discrete variables (such as coi tossig). Probabilities for cotiuous or measuremet variables also are evaluated usig relative
More informationLecture 5: Sampling Distribution
Lecture 5: Samplig Distributio Readigs: Sectios 5.5, 5.6 Itroductio Parameter: describes populatio Statistic: describes the sample; samplig variability Samplig distributio of a statistic: A probability
More information1 Estimating sensitivities
Copyright c 27 by Karl Sigma 1 Estimatig sesitivities Whe estimatig the Greeks, such as the, the geeral problem ivolves a radom variable Y = Y (α) (such as a discouted payoff) that depeds o a parameter
More informationStatistics for Economics & Business
Statistics for Ecoomics & Busiess Cofidece Iterval Estimatio Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for the mea ad the proportio How to determie
More information4.5 Generalized likelihood ratio test
4.5 Geeralized likelihood ratio test A assumptio that is used i the Athlete Biological Passport is that haemoglobi varies equally i all athletes. We wish to test this assumptio o a sample of k athletes.
More informationpoint estimator a random variable (like P or X) whose values are used to estimate a population parameter
Estimatio We have oted that the pollig problem which attempts to estimate the proportio p of Successes i some populatio ad the measuremet problem which attempts to estimate the mea value µ of some quatity
More informationRafa l Kulik and Marc Raimondo. University of Ottawa and University of Sydney. Supplementary material
Statistica Siica 009: Supplemet 1 L p -WAVELET REGRESSION WITH CORRELATED ERRORS AND INVERSE PROBLEMS Rafa l Kulik ad Marc Raimodo Uiversity of Ottawa ad Uiversity of Sydey Supplemetary material This ote
More informationChapter 8. Confidence Interval Estimation. Copyright 2015, 2012, 2009 Pearson Education, Inc. Chapter 8, Slide 1
Chapter 8 Cofidece Iterval Estimatio Copyright 2015, 2012, 2009 Pearso Educatio, Ic. Chapter 8, Slide 1 Learig Objectives I this chapter, you lear: To costruct ad iterpret cofidece iterval estimates for
More informationSolutions to Problem Sheet 1
Solutios to Problem Sheet ) Use Theorem.4 to prove that p log for all real x 3. This is a versio of Theorem.4 with the iteger N replaced by the real x. Hit Give x 3 let N = [x], the largest iteger x. The,
More information18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013
18.S096 Problem Set 5 Fall 2013 Volatility Modelig Due Date: 10/29/2013 1. Sample Estimators of Diffusio Process Volatility ad Drift Let {X t } be the price of a fiacial security that follows a geometric
More informationFINM6900 Finance Theory How Is Asymmetric Information Reflected in Asset Prices?
FINM6900 Fiace Theory How Is Asymmetric Iformatio Reflected i Asset Prices? February 3, 2012 Referece S. Grossma, O the Efficiecy of Competitive Stock Markets where Traders Have Diverse iformatio, Joural
More informationLecture 5 Point Es/mator and Sampling Distribu/on
Lecture 5 Poit Es/mator ad Samplig Distribu/o Fall 03 Prof. Yao Xie, yao.xie@isye.gatech.edu H. Milto Stewart School of Idustrial Systems & Egieerig Georgia Tech Road map Poit Es/ma/o Cofidece Iterval
More informationOnline appendices from Counterparty Risk and Credit Value Adjustment a continuing challenge for global financial markets by Jon Gregory
Olie appedices from Couterparty Risk ad Credit Value Adjustmet a APPENDIX 8A: Formulas for EE, PFE ad EPE for a ormal distributio Cosider a ormal distributio with mea (expected future value) ad stadard
More informationEstimating Proportions with Confidence
Aoucemets: Discussio today is review for midterm, o credit. You may atted more tha oe discussio sectio. Brig sheets of otes ad calculator to midterm. We will provide Scatro form. Homework: (Due Wed Chapter
More information11.7 (TAYLOR SERIES) NAME: SOLUTIONS 31 July 2018
.7 (TAYLOR SERIES NAME: SOLUTIONS 3 July 08 TAYLOR SERIES ( The power series T(x f ( (c (x c is called the Taylor Series for f(x cetered at x c. If c 0, this is called a Maclauri series. ( The N-th partial
More informationMaximum Empirical Likelihood Estimation (MELE)
Maximum Empirical Likelihood Estimatio (MELE Natha Smooha Abstract Estimatio of Stadard Liear Model - Maximum Empirical Likelihood Estimator: Combiatio of the idea of imum likelihood method of momets,
More informationToday: Finish Chapter 9 (Sections 9.6 to 9.8 and 9.9 Lesson 3)
Today: Fiish Chapter 9 (Sectios 9.6 to 9.8 ad 9.9 Lesso 3) ANNOUNCEMENTS: Quiz #7 begis after class today, eds Moday at 3pm. Quiz #8 will begi ext Friday ad ed at 10am Moday (day of fial). There will be
More informationParametric Density Estimation: Maximum Likelihood Estimation
Parametric Desity stimatio: Maimum Likelihood stimatio C6 Today Itroductio to desity estimatio Maimum Likelihood stimatio Itroducto Bayesia Decisio Theory i previous lectures tells us how to desig a optimal
More informationInferential Statistics and Probability a Holistic Approach. Inference Process. Inference Process. Chapter 8 Slides. Maurice Geraghty,
Iferetial Statistics ad Probability a Holistic Approach Chapter 8 Poit Estimatio ad Cofidece Itervals This Course Material by Maurice Geraghty is licesed uder a Creative Commos Attributio-ShareAlike 4.0
More informationSampling Distributions & Estimators
API-209 TF Sessio 2 Teddy Svoroos September 18, 2015 Samplig Distributios & Estimators I. Estimators The Importace of Samplig Radomly Three Properties of Estimators 1. Ubiased 2. Cosistet 3. Efficiet I
More informationOnline appendices from The xva Challenge by Jon Gregory. APPENDIX 10A: Exposure and swaption analogy.
APPENDIX 10A: Exposure ad swaptio aalogy. Sorese ad Bollier (1994), effectively calculate the CVA of a swap positio ad show this ca be writte as: CVA swap = LGD V swaptio (t; t i, T) PD(t i 1, t i ). i=1
More informationNotes on Expected Revenue from Auctions
Notes o Epected Reveue from Auctios Professor Bergstrom These otes spell out some of the mathematical details about first ad secod price sealed bid auctios that were discussed i Thursday s lecture You
More information1 Random Variables and Key Statistics
Review of Statistics 1 Radom Variables ad Key Statistics Radom Variable: A radom variable is a variable that takes o differet umerical values from a sample space determied by chace (probability distributio,
More informationUnbiased estimators Estimators
19 Ubiased estimators I Chapter 17 we saw that a dataset ca be modeled as a realizatio of a radom sample from a probability distributio ad that quatities of iterest correspod to features of the model distributio.
More informationAsymptotics: Consistency and Delta Method
ad Delta Method MIT 18.655 Dr. Kempthore Sprig 2016 1 MIT 18.655 ad Delta Method Outlie Asymptotics 1 Asymptotics 2 MIT 18.655 ad Delta Method Cosistecy Asymptotics Statistical Estimatio Problem X 1,...,
More informationST 305: Exam 2 Fall 2014
ST 305: Exam Fall 014 By hadig i this completed exam, I state that I have either give or received assistace from aother perso durig the exam period. I have used o resources other tha the exam itself ad
More informationAMS Portfolio Theory and Capital Markets
AMS 69.0 - Portfolio Theory ad Capital Markets I Class 6 - Asset yamics Robert J. Frey Research Professor Stoy Brook iversity, Applied Mathematics ad Statistics frey@ams.suysb.edu http://www.ams.suysb.edu/~frey/
More informationCreditRisk + Download document from CSFB web site:
CreditRis + Dowload documet from CSFB web site: http://www.csfb.com/creditris/ Features of CreditRis+ pplies a actuarial sciece framewor to the derivatio of the loss distributio of a bod/loa portfolio.
More informationThe Valuation of the Catastrophe Equity Puts with Jump Risks
The Valuatio of the Catastrophe Equity Puts with Jump Risks Shih-Kuei Li Natioal Uiversity of Kaohsiug Joit work with Chia-Chie Chag Outlie Catastrophe Isurace Products Literatures ad Motivatios Jump Risk
More informationCHAPTER 8 Estimating with Confidence
CHAPTER 8 Estimatig with Cofidece 8.2 Estimatig a Populatio Proportio The Practice of Statistics, 5th Editio Stares, Tabor, Yates, Moore Bedford Freema Worth Publishers Estimatig a Populatio Proportio
More information5 Statistical Inference
5 Statistical Iferece 5.1 Trasitio from Probability Theory to Statistical Iferece 1. We have ow more or less fiished the probability sectio of the course - we ow tur attetio to statistical iferece. I statistical
More informationConfidence Intervals. CI for a population mean (σ is known and n > 30 or the variable is normally distributed in the.
Cofidece Itervals A cofidece iterval is a iterval whose purpose is to estimate a parameter (a umber that could, i theory, be calculated from the populatio, if measuremets were available for the whole populatio).
More informationThese characteristics are expressed in terms of statistical properties which are estimated from the sample data.
0. Key Statistical Measures of Data Four pricipal features which characterize a set of observatios o a radom variable are: (i) the cetral tedecy or the value aroud which all other values are buched, (ii)
More informationSampling Distributions and Estimation
Cotets 40 Samplig Distributios ad Estimatio 40.1 Samplig Distributios 40. Iterval Estimatio for the Variace 13 Learig outcomes You will lear about the distributios which are created whe a populatio is
More informationSubject CT5 Contingencies Core Technical. Syllabus. for the 2011 Examinations. The Faculty of Actuaries and Institute of Actuaries.
Subject CT5 Cotigecies Core Techical Syllabus for the 2011 Examiatios 1 Jue 2010 The Faculty of Actuaries ad Istitute of Actuaries Aim The aim of the Cotigecies subject is to provide a groudig i the mathematical
More informationQuantitative Analysis
EduPristie www.edupristie.com Modellig Mea Variace Skewess Kurtosis Mea: X i = i Mode: Value that occurs most frequetly Media: Midpoit of data arraged i ascedig/ descedig order s Avg. of squared deviatios
More information1 The Black-Scholes model
The Blac-Scholes model. The model setup I the simplest versio of the Blac-Scholes model the are two assets: a ris-less asset ba accout or bod)withpriceprocessbt) at timet, adarisyasset stoc) withpriceprocess
More informationMonetary Economics: Problem Set #5 Solutions
Moetary Ecoomics oblem Set #5 Moetary Ecoomics: oblem Set #5 Solutios This problem set is marked out of 1 poits. The weight give to each part is idicated below. Please cotact me asap if you have ay questios.
More informationSequences and Series
Sequeces ad Series Matt Rosezweig Cotets Sequeces ad Series. Sequeces.................................................. Series....................................................3 Rudi Chapter 3 Exercises........................................
More informationB = A x z
114 Block 3 Erdeky == Begi 6.3 ============================================================== 1 / 8 / 2008 1 Correspodig Areas uder a ormal curve ad the stadard ormal curve are equal. Below: Area B = Area
More informationStandard Deviations for Normal Sampling Distributions are: For proportions For means _
Sectio 9.2 Cofidece Itervals for Proportios We will lear to use a sample to say somethig about the world at large. This process (statistical iferece) is based o our uderstadig of samplig models, ad will
More informationECON 5350 Class Notes Maximum Likelihood Estimation
ECON 5350 Class Notes Maximum Likelihood Estimatio 1 Maximum Likelihood Estimatio Example #1. Cosider the radom sample {X 1 = 0.5, X 2 = 2.0, X 3 = 10.0, X 4 = 1.5, X 5 = 7.0} geerated from a expoetial
More informationA Bayesian perspective on estimating mean, variance, and standard-deviation from data
Brigham Youg Uiversity BYU ScholarsArchive All Faculty Publicatios 006--05 A Bayesia perspective o estimatig mea, variace, ad stadard-deviatio from data Travis E. Oliphat Follow this ad additioal works
More informationQuantitative Analysis
EduPristie FRM I \ Quatitative Aalysis EduPristie www.edupristie.com Momets distributio Samplig Testig Correlatio & Regressio Estimatio Simulatio Modellig EduPristie FRM I \ Quatitative Aalysis 2 Momets
More informationInstitute of Actuaries of India Subject CT5 General Insurance, Life and Health Contingencies
Istitute of Actuaries of Idia Subject CT5 Geeral Isurace, Life ad Health Cotigecies For 2017 Examiatios Aim The aim of the Cotigecies subject is to provide a groudig i the mathematical techiques which
More informationNOTES ON ESTIMATION AND CONFIDENCE INTERVALS. 1. Estimation
NOTES ON ESTIMATION AND CONFIDENCE INTERVALS MICHAEL N. KATEHAKIS 1. Estimatio Estimatio is a brach of statistics that deals with estimatig the values of parameters of a uderlyig distributio based o observed/empirical
More informationOutline. Plotting discrete-time signals. Sampling Process. Discrete-Time Signal Representations Important D-T Signals Digital Signals
Outlie Discrete-Time Sigals-Itroductio. Plottig discrete-time sigals. Samplig Process. Discrete-Time Sigal Represetatios Importat D-T Sigals Digital Sigals Discrete-Time Sigals-Itroductio The time variable
More informationBASIC STATISTICS ECOE 1323
BASIC STATISTICS ECOE 33 SPRING 007 FINAL EXAM NAME: ID NUMBER: INSTRUCTIONS:. Write your ame ad studet ID.. You have hours 3. This eam must be your ow work etirely. You caot talk to or share iformatio
More informationA point estimate is the value of a statistic that estimates the value of a parameter.
Chapter 9 Estimatig the Value of a Parameter Chapter 9.1 Estimatig a Populatio Proportio Objective A : Poit Estimate A poit estimate is the value of a statistic that estimates the value of a parameter.
More informationTopic-7. Large Sample Estimation
Topic-7 Large Sample Estimatio TYPES OF INFERENCE Ò Estimatio: É Estimatig or predictig the value of the parameter É What is (are) the most likely values of m or p? Ò Hypothesis Testig: É Decidig about
More informationSubject CT1 Financial Mathematics Core Technical Syllabus
Subject CT1 Fiacial Mathematics Core Techical Syllabus for the 2018 exams 1 Jue 2017 Subject CT1 Fiacial Mathematics Core Techical Aim The aim of the Fiacial Mathematics subject is to provide a groudig
More informationResearch Article The Probability That a Measurement Falls within a Range of n Standard Deviations from an Estimate of the Mean
Iteratioal Scholarly Research Network ISRN Applied Mathematics Volume 0, Article ID 70806, 8 pages doi:0.540/0/70806 Research Article The Probability That a Measuremet Falls withi a Rage of Stadard Deviatios
More informationSOLUTION QUANTITATIVE TOOLS IN BUSINESS NOV 2011
SOLUTION QUANTITATIVE TOOLS IN BUSINESS NOV 0 (i) Populatio: Collectio of all possible idividual uits (persos, objects, experimetal outcome whose characteristics are to be studied) Sample: A part of populatio
More informationThe material in this chapter is motivated by Experiment 9.
Chapter 5 Optimal Auctios The material i this chapter is motivated by Experimet 9. We wish to aalyze the decisio of a seller who sets a reserve price whe auctioig off a item to a group of bidders. We begi
More informationChapter 8: Estimation of Mean & Proportion. Introduction
Chapter 8: Estimatio of Mea & Proportio 8.1 Estimatio, Poit Estimate, ad Iterval Estimate 8.2 Estimatio of a Populatio Mea: σ Kow 8.3 Estimatio of a Populatio Mea: σ Not Kow 8.4 Estimatio of a Populatio
More informationSummary. Recap. Last Lecture. .1 If you know MLE of θ, can you also know MLE of τ(θ) for any function τ?
Last Lecture Biostatistics 60 - Statistical Iferece Lecture Cramer-Rao Theorem Hyu Mi Kag February 9th, 03 If you kow MLE of, ca you also kow MLE of τ() for ay fuctio τ? What are plausible ways to compare
More informationBayes Estimator for Coefficient of Variation and Inverse Coefficient of Variation for the Normal Distribution
Iteratioal Joural of Statistics ad Systems ISSN 0973-675 Volume, Number 4 (07, pp. 7-73 Research Idia Publicatios http://www.ripublicatio.com Bayes Estimator for Coefficiet of Variatio ad Iverse Coefficiet
More information1. Suppose X is a variable that follows the normal distribution with known standard deviation σ = 0.3 but unknown mean µ.
Chapter 9 Exercises Suppose X is a variable that follows the ormal distributio with kow stadard deviatio σ = 03 but ukow mea µ (a) Costruct a 95% cofidece iterval for µ if a radom sample of = 6 observatios
More informationExam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011
15.075 Exam 2 Istructor: Cythia Rudi TA: Dimitrios Bisias October 25, 2011 Gradig is based o demostratio of coceptual uderstadig, so you eed to show all of your work. Problem 1 You are i charge of a study
More informationTwitter: @Owe134866 www.mathsfreeresourcelibrary.com Prior Kowledge Check 1) State whether each variable is qualitative or quatitative: a) Car colour Qualitative b) Miles travelled by a cyclist c) Favourite
More informationKernel Density Estimation. Let X be a random variable with continuous distribution F (x) and density f(x) = d
Kerel Desity Estimatio Let X be a radom variable wit cotiuous distributio F (x) ad desity f(x) = d dx F (x). Te goal is to estimate f(x). Wile F (x) ca be estimated by te EDF ˆF (x), we caot set ˆf(x)
More informationConfidence Intervals Introduction
Cofidece Itervals Itroductio A poit estimate provides o iformatio about the precisio ad reliability of estimatio. For example, the sample mea X is a poit estimate of the populatio mea μ but because of
More informationTopic 14: Maximum Likelihood Estimation
Toic 4: November, 009 As before, we begi with a samle X = (X,, X of radom variables chose accordig to oe of a family of robabilities P θ I additio, f(x θ, x = (x,, x will be used to deote the desity fuctio
More informationMath 312, Intro. to Real Analysis: Homework #4 Solutions
Math 3, Itro. to Real Aalysis: Homework #4 Solutios Stephe G. Simpso Moday, March, 009 The assigmet cosists of Exercises 0.6, 0.8, 0.0,.,.3,.6,.0,.,. i the Ross textbook. Each problem couts 0 poits. 0.6.
More informationBIOSTATS 540 Fall Estimation Page 1 of 72. Unit 6. Estimation. Use at least twelve observations in constructing a confidence interval
BIOSTATS 540 Fall 015 6. Estimatio Page 1 of 7 Uit 6. Estimatio Use at least twelve observatios i costructig a cofidece iterval - Gerald va Belle What is the mea of the blood pressures of all the studets
More information= α e ; x 0. Such a random variable is said to have an exponential distribution, with parameter α. [Here, view X as time-to-failure.
1 Homewor 1 AERE 573 Fall 018 DUE 8/9 (W) Name ***NOTE: A wor MUST be placed directly beeath the associated part of a give problem.*** PROBEM 1. (5pts) [Boo 3 rd ed. 1.1 / 4 th ed. 1.13] et ~Uiform[0,].
More informationWe learned: $100 cash today is preferred over $100 a year from now
Recap from Last Week Time Value of Moey We leared: $ cash today is preferred over $ a year from ow there is time value of moey i the form of willigess of baks, busiesses, ad people to pay iterest for its
More informationINTERVAL GAMES. and player 2 selects 1, then player 2 would give player 1 a payoff of, 1) = 0.
INTERVAL GAMES ANTHONY MENDES Let I ad I 2 be itervals of real umbers. A iterval game is played i this way: player secretly selects x I ad player 2 secretly ad idepedetly selects y I 2. After x ad y are
More informationAPPLICATION OF GEOMETRIC SEQUENCES AND SERIES: COMPOUND INTEREST AND ANNUITIES
APPLICATION OF GEOMETRIC SEQUENCES AND SERIES: COMPOUND INTEREST AND ANNUITIES Example: Brado s Problem Brado, who is ow sixtee, would like to be a poker champio some day. At the age of twety-oe, he would
More information1 Estimating the uncertainty attached to a sample mean: s 2 vs.
Political Sciece 100a/200a Fall 2001 Cofidece itervals ad hypothesis testig, Part I 1 1 Estimatig the ucertaity attached to a sample mea: s 2 vs. σ 2 Recall the problem of descriptive iferece: We wat to
More informationCHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions
CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Meas ad Proportios Itroductio: I this chapter we wat to fid out the value of a parameter for a populatio. We do t kow the value of this parameter for the etire
More informationDr. Maddah ENMG 624 Financial Eng g I 03/22/06. Chapter 6 Mean-Variance Portfolio Theory
Dr Maddah ENMG 64 Fiacial Eg g I 03//06 Chapter 6 Mea-Variace Portfolio Theory Sigle Period Ivestmets Typically, i a ivestmet the iitial outlay of capital is kow but the retur is ucertai A sigle-period
More informationAnomaly Correction by Optimal Trading Frequency
Aomaly Correctio by Optimal Tradig Frequecy Yiqiao Yi Columbia Uiversity September 9, 206 Abstract Uder the assumptio that security prices follow radom walk, we look at price versus differet movig averages.
More informationACTUARIAL RESEARCH CLEARING HOUSE 1990 VOL. 2 INTEREST, AMORTIZATION AND SIMPLICITY. by Thomas M. Zavist, A.S.A.
ACTUARIAL RESEARCH CLEARING HOUSE 1990 VOL. INTEREST, AMORTIZATION AND SIMPLICITY by Thomas M. Zavist, A.S.A. 37 Iterest m Amortizatio ad Simplicity Cosider simple iterest for a momet. Suppose you have
More informationSTAT 135 Solutions to Homework 3: 30 points
STAT 35 Solutios to Homework 3: 30 poits Sprig 205 The objective of this Problem Set is to study the Stei Pheomeo 955. Suppose that θ θ, θ 2,..., θ cosists of ukow parameters, with 3. We wish to estimate
More informationChpt 5. Discrete Probability Distributions. 5-3 Mean, Variance, Standard Deviation, and Expectation
Chpt 5 Discrete Probability Distributios 5-3 Mea, Variace, Stadard Deviatio, ad Expectatio 1/23 Homework p252 Applyig the Cocepts Exercises p253 1-19 2/23 Objective Fid the mea, variace, stadard deviatio,
More informationSCHOOL OF ACCOUNTING AND BUSINESS BSc. (APPLIED ACCOUNTING) GENERAL / SPECIAL DEGREE PROGRAMME
All Right Reserved No. of Pages - 10 No of Questios - 08 SCHOOL OF ACCOUNTING AND BUSINESS BSc. (APPLIED ACCOUNTING) GENERAL / SPECIAL DEGREE PROGRAMME YEAR I SEMESTER I (Group B) END SEMESTER EXAMINATION
More informationii. Interval estimation:
1 Types of estimatio: i. Poit estimatio: Example (1) Cosider the sample observatios 17,3,5,1,18,6,16,10 X 8 X i i1 8 17 3 5 118 6 16 10 8 116 8 14.5 14.5 is a poit estimate for usig the estimator X ad
More informationAY Term 2 Mock Examination
AY 206-7 Term 2 Mock Examiatio Date / Start Time Course Group Istructor 24 March 207 / 2 PM to 3:00 PM QF302 Ivestmet ad Fiacial Data Aalysis G Christopher Tig INSTRUCTIONS TO STUDENTS. This mock examiatio
More informationAn Empirical Study of the Behaviour of the Sample Kurtosis in Samples from Symmetric Stable Distributions
A Empirical Study of the Behaviour of the Sample Kurtosis i Samples from Symmetric Stable Distributios J. Marti va Zyl Departmet of Actuarial Sciece ad Mathematical Statistics, Uiversity of the Free State,
More informationFOUNDATION ACTED COURSE (FAC)
FOUNDATION ACTED COURSE (FAC) What is the Foudatio ActEd Course (FAC)? FAC is desiged to help studets improve their mathematical skills i preparatio for the Core Techical subjects. It is a referece documet
More informationA New Constructive Proof of Graham's Theorem and More New Classes of Functionally Complete Functions
A New Costructive Proof of Graham's Theorem ad More New Classes of Fuctioally Complete Fuctios Azhou Yag, Ph.D. Zhu-qi Lu, Ph.D. Abstract A -valued two-variable truth fuctio is called fuctioally complete,
More informationSection Mathematical Induction and Section Strong Induction and Well-Ordering
Sectio 4.1 - Mathematical Iductio ad Sectio 4. - Strog Iductio ad Well-Orderig A very special rule of iferece! Defiitio: A set S is well ordered if every subset has a least elemet. Note: [0, 1] is ot well
More informationFourier Transform in L p (R) Spaces, p 1
Ge. Math. Notes, Vol. 3, No., March 20, pp.4-25 ISSN 229-784; Copyright c ICSS Publicatio, 200 www.i-csrs.org Available free olie at http://www.gema.i Fourier Trasform i L p () Spaces, p Devedra Kumar
More informationModels of Asset Pricing
4 Appedix 1 to Chapter Models of Asset Pricig I this appedix, we first examie why diversificatio, the holdig of may risky assets i a portfolio, reduces the overall risk a ivestor faces. The we will see
More informationCHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Means and Proportions
CHAPTER 8: CONFIDENCE INTERVAL ESTIMATES for Meas ad Proportios Itroductio: We wat to kow the value of a parameter for a populatio. We do t kow the value of this parameter for the etire populatio because
More information