Central Limit Thm, Normal Approximations
|
|
- Virginia Lawson
- 5 years ago
- Views:
Transcription
1 Central Limit Thm, Normal Approximations Engineering Statistics Section 5.4 Josh Engwer TTU 23 March 2016 Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
2 PART I PART I: CENTRAL LIMIT THEOREM Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
3 Expected Value & Variance of a Sum of iid rv s Proposition Let X 1,..., X n be a random sample from a population and c 1,..., c n 0. Then: E[c 1 X c n X n ] = c 1 E[X 1 ] + + c n E[X n ] V[c 1 X c n X n ] = c 2 1 V[X 1] + + c 2 nv[x n ] iid PROOF: CASE I (n = 2): X 1, X 2 (discrete population) E[c 1 X 1 + c 2 X 2 ] := (c 1 j + c 2 k) p (X1,X 2)(j, k) iid = (j,k) Supp(X 1,X 2) j Supp(X 1) k Supp(X 2) = c 1 j Supp(X 1) := c 1 E[X 1 ] + c 2 E[X 2 ] j p X1 (j) + c 2 (c 1 j + c 2 k) p X1 (j) p X2 (k) k Supp(X 2) k p X2 (k) Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
4 Expected Value & Variance of a Sum of iid rv s Proposition Let X 1,..., X n be a random sample from a population and c 1,..., c n 0. Then: PROOF: E[c 1 X c n X n ] = c 1 E[X 1 ] + + c n E[X n ] V[c 1 X c n X n ] = c 2 1 V[X 1] + + c 2 nv[x n ] E[c 1 X 1 + c 2 X 2 ] := CASE II (n = 2): X 1, X 2 iid (continuous population) iid = Supp(X 1,X 2) = c 1 Supp(X 1) (c 1 x 1 + c 2 x 2 ) f (X1,X 2)(x 1, x 2 ) dx 1 dx 2 Supp(X 1) Supp(X 2) := c 1 E[X 1 ] + c 2 E[X 2 ] (requires independence) (c 1 x 1 + c 2 x 2 ) f X1 (x 1 ) f X2 (x 2 ) dx 1 dx 2 x 1 f X1 (x 1 ) dx 1 + c 2 Supp(X 2) x 2 f X2 (x 2 ) dx 2 Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
5 Properties of Sample Mean Proposition Let X 1,..., X n be a random sample from a distribution with mean µ and variance σ 2. Then: PROOF: µ X = E[X] = µ σ 2 X = V[X] = σ2 /n σ X = σ/ n E[X] = E [ 1 n (X X n ) ] = 1 n [E[X 1] + + E[X n ]] = 1 n [µ + + µ] = 1 n [nµ] = µ V[X] = V [ 1 n (X X n ) ] = 1 [V[X n 2 1 ] + + V[X n ]] = 1 [σ σ 2 ] = 1 [nσ 2 ] = σ 2 /n n 2 n 2 σ X = V[X] = σ 2 /n = σ/ n Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
6 Properties of Sample Total Proposition Let X 1,..., X n be a random sample from a distribution with mean µ and variance σ 2. Then: PROOF: µ X1+ +X n = E[X X n ] = nµ σ 2 X 1+ +X n = V[X X n ] = nσ 2 σ X1+ +X n = σ n E[X X n ] = E [ nx ] = ne [ X ] = n µ = nµ V[X X n ] = V [ nx ] = n 2 V [ X ] = n 2 [σ 2 /n] = nσ 2 σ X1+ +X n = V[X X n ] = nσ 2 = σ n Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
7 Sample Mean & Sample Total of a Random Sample from a Normal Population The proceeding properties of sample means & sample variances can be applied to particular population distributions: Proposition Let random sample X 1,..., X n iid Normal(µ, σ 2 ). For any sample size n > 1, Then: X Normal(µ, σ 2 /n) For any sample size n > 1, X X n Normal(nµ, nσ 2 ) PROOF: X Normal(µ, σ 2 ) = E[X] = µ, V[X] = σ 2 E[X] = E [ 1 n (X X n ) ] = 1 n [E[X 1] + + E[X n ]] = 1 n [µ + + µ] = 1 n [nµ] = µ V[X] = V [ 1 n (X X n ) ] = 1 [V[X n 2 1 ] + + V[X n ]] = 1 [σ σ 2 ] = 1 [nσ 2 ] = σ 2 /n n 2 n 2 X Normal(µ, σ 2 /n) Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
8 Sample Mean & Sample Total of a Random Sample from a Normal Population The proceeding properties of sample means & sample variances can be applied to particular population distributions: Proposition Let random sample X 1,..., X n iid Normal(µ, σ 2 ). For any sample size n > 1, Then: X Normal(µ, σ 2 /n) For any sample size n > 1, X X n Normal(nµ, nσ 2 ) PROOF: X Normal(µ, σ 2 ) = E[X] = µ, V[X] = σ 2 E[X X n ] = E [ nx ] = ne [ X ] = n µ = nµ V[X X n ] = V [ nx ] = n 2 V [ X ] = n 2 [σ 2 /n] = nσ 2 X X n Normal(nµ, nσ 2 ) Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
9 Central Limit Theorem (CLT) The Central Limit Thm is considered a fundamental theorem of Statistics: Theorem (Central Limit Theorem) Let X 1,..., X n be a random sample from a non-normal distribution with mean µ and variance σ 2. Then: The sample mean X is approximately normal as follows: X approx Normal(µ, σ 2 /n) The sample total X X n is approximately normal as follows: X X n approx Normal(nµ, nσ 2 ) Requirement for this normal approximation to be valid: n > 30 The larger the sample size n, the better the approximation. PROOF: Beyond the scope of this course. Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
10 PART II PART II: NORMAL APPROXIMATION TO THE BINOMIAL Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
11 The Sum of several iid Bernoulli(p) rv s Proposition Let random sample X 1,..., X m iid Bernoulli(p). Then: For any sample size n > 1, X X n Binomial(n, p) PROOF: X Bernoulli(p) = E[X] = p, V[X] = pq (q = 1 p) E[X X n ] = E[X 1 ] + + E[X n ] iid = n E[X 1 ] = n p = np V[X X n ] iid = V[X 1 ] + + V[X n ] iid = n V[X 1 ] = n pq = npq X X n Binomial(n, p) Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
12 Normal Approximation to the Binomial Corollary Let X Binomial(n, p). Then: X approx Normal(µ = np, σ 2 = npq) (where q = 1 p) Requirement for this normal approximation to be valid: min{np, nq} 10 i.e. It s required that both np 10 and nq 10. NOTE: Remember that normal distributions are symmetric. If min{np, nq} < 10, then the binomial distribution is too skewed. PROOF: Let X 1,..., X n Bernoulli(p) = µ X1 = E[X 1 ] = p and σ 2 X 1 = V[X 1 ] = pq. Then X := X X n Binomial(n, p). Moreover, the CLT asserts that X X n approx Normal(µ = nµ X1, σ 2 = nσ 2 X 1 ) X Binomial(n, p) = X approx Normal(µ = np, σ 2 = npq) Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
13 Normal Approximation to Binomial Probability Corollary Let X Binomial(n, p). Then: P(X x) = Bi(x; n, p) Φ ( ) x np npq (where q = 1 p) Requirement for this normal approximation to be valid: min{np, nq} 10 NOTE: The continuity correction term improves the approximation. PROOF: Assume that the requirement min{np, nq} 10 is satisfied. Then: X Binomial(n, p) = X approx Normal(µ = np, σ 2 = npq) ( = Bi(x; n, p) = P(X x) P Z x µ ) ( ) ( ) x µ x np = Φ = Φ σ σ npq Add continuity correction in numerator of Φ to better the approximation. Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
14 Binomial Density Plots (pmf s) for Sample Size n = 2 Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
15 Binomial Density Plots (pmf s) for Sample Size n = 5 Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
16 Binomial Density Plots (pmf s) for Sample Size n = 10 Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
17 Binomial Density Plots (pmf s) for Sample Size n = 20 Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
18 Binomial Density Plots (pmf s) for Sample Size n = 50 Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
19 PART III PART III: NORMAL APPROXIMATION TO THE POISSON Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
20 The Sum of several iid Poisson(λ) rv s The proceeding properties of sample totals can be applied to particular population distributions: Proposition Let random sample X 1,..., X n iid Poisson(λ). For any sample size n > 1, Then: X X n Poisson(nλ) PROOF: X Poisson(λ) = E[X] = λ, V[X] = λ E[X X n ] = E[X 1 ] + + E[X n ] iid = n E[X 1 ] = n λ = nλ V[X X n ] iid = V[X 1 ] + + V[X n ] iid = n V[X 1 ] = n λ = nλ X X n Poisson(nλ) Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
21 Normal Approximation to the Poisson Corollary Let X Poisson(λ). Then: X approx Normal(µ = λ, σ 2 = λ) Requirement for this normal approximation to be valid: λ > 20 NOTE: Remember that normal distributions are symmetric. If λ 20, then the binomial distribution is too skewed. PROOF: Let X 1,..., X n Poisson(λ/n) = µ X1 = E[X 1 ] = λ/n and σ 2 X 1 = V[X 1 ] = λ/n. Then X := X X n Poisson(λ). Moreover, the CLT asserts that X X n approx Normal(µ = nµ X1, σ 2 = nσ 2 X 1 ) X Poisson(λ) = X approx Normal(µ = λ, σ 2 = λ) Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
22 Normal Approximation to Poisson Probability Corollary Let X Poisson(λ). Then: P(X x) = Pois(x; λ) Φ ( ) x λ λ Requirement for this normal approximation to be valid: λ > 20 NOTE: The continuity correction term improves the approximation. PROOF: Assume that the requirement λ > 20 is satisfied. Then: X Poisson(λ) = X approx Normal(µ = λ, σ 2 = λ) ( = Pois(x; λ) = P(X x) P Z x µ ) ( ) ( ) x µ x λ = Φ = Φ σ σ λ Add continuity correction in numerator of Φ to better the approximation. Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
23 Poisson Density Plots (pmf s) Notice the Poisson density curves for λ = 1, 2, 5, 10, 15 are skewed. Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
24 Poisson Density Plots (pmf s) Notice the Poisson density curves for λ 20 are nearly symmetric. Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
25 Textbook Logistics for Section 5.4 Difference(s) in Notation: CONCEPT TEXTBOOK NOTATION SLIDES/OUTLINE NOTATION Probability of Event P(A) P(A) Support of a r.v. All possible values of X Supp(X) pmf of a r.v. p X (x) p X (k) Expected Value of r.v. E(X) E[X] Variance of r.v. V(X) V[X] Sample Total T o Xk pmf of Sample Mean p X (x) p X (k) pmf of Sample Variance p S 2(s 2 ) p S 2(k) Ignore Lognormal Approximation (bottom of pg 236) The Lognormal distribution was part of Section 4.5 that was skipped Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
26 Fin Fin. Josh Engwer (TTU) Central Limit Thm, Normal Approximations 23 March / 26
Bernoulli and Binomial Distributions
Bernoulli and Binomial Distributions Bernoulli Distribution a flipped coin turns up either heads or tails an item on an assembly line is either defective or not defective a piece of fruit is either damaged
More informationSTAT Chapter 7: Central Limit Theorem
STAT 251 - Chapter 7: Central Limit Theorem In this chapter we will introduce the most important theorem in statistics; the central limit theorem. What have we seen so far? First, we saw that for an i.i.d
More informationNo, because np = 100(0.02) = 2. The value of np must be greater than or equal to 5 to use the normal approximation.
1) If n 100 and p 0.02 in a binomial experiment, does this satisfy the rule for a normal approximation? Why or why not? No, because np 100(0.02) 2. The value of np must be greater than or equal to 5 to
More informationGeometric & Negative Binomial Distributions
Geometric & Negative Binomial Distributions Engineering Statistics Section 3.5 Josh Engwer TTU 02 May 2016 Josh Engwer (TTU) Geometric & Negative Binomial Distributions 02 May 2016 1 / 12 PART I PART I:
More informationSTAT 241/251 - Chapter 7: Central Limit Theorem
STAT 241/251 - Chapter 7: Central Limit Theorem In this chapter we will introduce the most important theorem in statistics; the central limit theorem. What have we seen so far? First, we saw that for an
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 10: Continuous RV Families. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 10: Continuous RV Families Prof. Vince Calhoun 1 Reading This class: Section 4.4-4.5 Next class: Section 4.6-4.7 2 Homework 3.9, 3.49, 4.5,
More informationMath 14 Lecture Notes Ch The Normal Approximation to the Binomial Distribution. P (X ) = nc X p X q n X =
6.4 The Normal Approximation to the Binomial Distribution Recall from section 6.4 that g A binomial experiment is a experiment that satisfies the following four requirements: 1. Each trial can have only
More information4-1. Chapter 4. Commonly Used Distributions by The McGraw-Hill Companies, Inc. All rights reserved.
4-1 Chapter 4 Commonly Used Distributions 2014 by The Companies, Inc. All rights reserved. Section 4.1: The Bernoulli Distribution 4-2 We use the Bernoulli distribution when we have an experiment which
More informationLecture Notes 6. Assume F belongs to a family of distributions, (e.g. F is Normal), indexed by some parameter θ.
Sufficient Statistics Lecture Notes 6 Sufficiency Data reduction in terms of a particular statistic can be thought of as a partition of the sample space X. Definition T is sufficient for θ if the conditional
More informationEngineering Statistics ECIV 2305
Engineering Statistics ECIV 2305 Section 5.3 Approximating Distributions with the Normal Distribution Introduction A very useful property of the normal distribution is that it provides good approximations
More informationSTAT 111 Recitation 4
STAT 111 Recitation 4 Linjun Zhang http://stat.wharton.upenn.edu/~linjunz/ September 29, 2017 Misc. Mid-term exam time: 6-8 pm, Wednesday, Oct. 11 The mid-term break is Oct. 5-8 The next recitation class
More informationMATH 3200 Exam 3 Dr. Syring
. Suppose n eligible voters are polled (randomly sampled) from a population of size N. The poll asks voters whether they support or do not support increasing local taxes to fund public parks. Let M be
More informationTutorial 11: Limit Theorems. Baoxiang Wang & Yihan Zhang bxwang, April 10, 2017
Tutorial 11: Limit Theorems Baoxiang Wang & Yihan Zhang bxwang, yhzhang@cse.cuhk.edu.hk April 10, 2017 1 Outline The Central Limit Theorem (CLT) Normal Approximation Based on CLT De Moivre-Laplace Approximation
More information5.3 Statistics and Their Distributions
Chapter 5 Joint Probability Distributions and Random Samples Instructor: Lingsong Zhang 1 Statistics and Their Distributions 5.3 Statistics and Their Distributions Statistics and Their Distributions Consider
More informationLecture 23. STAT 225 Introduction to Probability Models April 4, Whitney Huang Purdue University. Normal approximation to Binomial
Lecture 23 STAT 225 Introduction to Probability Models April 4, 2014 approximation Whitney Huang Purdue University 23.1 Agenda 1 approximation 2 approximation 23.2 Characteristics of the random variable:
More informationSTAT 111 Recitation 3
STAT 111 Recitation 3 Linjun Zhang stat.wharton.upenn.edu/~linjunz/ September 23, 2017 Misc. The unpicked-up homeworks will be put in the STAT 111 box in the Stats Department lobby (It s on the 4th floor
More informationChapter 4: Commonly Used Distributions. Statistics for Engineers and Scientists Fourth Edition William Navidi
Chapter 4: Commonly Used Distributions Statistics for Engineers and Scientists Fourth Edition William Navidi 2014 by Education. This is proprietary material solely for authorized instructor use. Not authorized
More informationBusiness Statistics 41000: Probability 4
Business Statistics 41000: Probability 4 Drew D. Creal University of Chicago, Booth School of Business February 14 and 15, 2014 1 Class information Drew D. Creal Email: dcreal@chicagobooth.edu Office:
More informationNormal Distribution. Definition A continuous rv X is said to have a normal distribution with. the pdf of X is
Normal Distribution Normal Distribution Definition A continuous rv X is said to have a normal distribution with parameter µ and σ (µ and σ 2 ), where < µ < and σ > 0, if the pdf of X is f (x; µ, σ) = 1
More information6 Central Limit Theorem. (Chs 6.4, 6.5)
6 Central Limit Theorem (Chs 6.4, 6.5) Motivating Example In the next few weeks, we will be focusing on making statistical inference about the true mean of a population by using sample datasets. Examples?
More informationcontinuous rv Note for a legitimate pdf, we have f (x) 0 and f (x)dx = 1. For a continuous rv, P(X = c) = c f (x)dx = 0, hence
continuous rv Let X be a continuous rv. Then a probability distribution or probability density function (pdf) of X is a function f(x) such that for any two numbers a and b with a b, P(a X b) = b a f (x)dx.
More informationPoint Estimation. Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage
6 Point Estimation Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage Point Estimation Statistical inference: directed toward conclusions about one or more parameters. We will use the generic
More informationCIVL Discrete Distributions
CIVL 3103 Discrete Distributions Learning Objectives Define discrete distributions, and identify common distributions applicable to engineering problems. Identify the appropriate distribution (i.e. binomial,
More informationCentral Limit Theorem, Joint Distributions Spring 2018
Central Limit Theorem, Joint Distributions 18.5 Spring 218.5.4.3.2.1-4 -3-2 -1 1 2 3 4 Exam next Wednesday Exam 1 on Wednesday March 7, regular room and time. Designed for 1 hour. You will have the full
More informationBinomial Distribution. Normal Approximation to the Binomial
Binomial Distribution Normal Approximation to the Binomial /29 Homework Read Sec 6-6. Discussion Question pg 337 Do Ex 6-6 -4 2 /29 Objectives Objective: Use the normal approximation to calculate 3 /29
More informationIEOR 3106: Introduction to OR: Stochastic Models. Fall 2013, Professor Whitt. Class Lecture Notes: Tuesday, September 10.
IEOR 3106: Introduction to OR: Stochastic Models Fall 2013, Professor Whitt Class Lecture Notes: Tuesday, September 10. The Central Limit Theorem and Stock Prices 1. The Central Limit Theorem (CLT See
More informationStatistics for Business and Economics
Statistics for Business and Economics Chapter 5 Continuous Random Variables and Probability Distributions Ch. 5-1 Probability Distributions Probability Distributions Ch. 4 Discrete Continuous Ch. 5 Probability
More informationSTAT/MATH 395 PROBABILITY II
STAT/MATH 395 PROBABILITY II Distribution of Random Samples & Limit Theorems Néhémy Lim University of Washington Winter 2017 Outline Distribution of i.i.d. Samples Convergence of random variables The Laws
More informationVersion A. Problem 1. Let X be the continuous random variable defined by the following pdf: 1 x/2 when 0 x 2, f(x) = 0 otherwise.
Math 224 Q Exam 3A Fall 217 Tues Dec 12 Version A Problem 1. Let X be the continuous random variable defined by the following pdf: { 1 x/2 when x 2, f(x) otherwise. (a) Compute the mean µ E[X]. E[X] x
More informationCentral Limit Theorem (cont d) 7/28/2006
Central Limit Theorem (cont d) 7/28/2006 Central Limit Theorem for Binomial Distributions Theorem. For the binomial distribution b(n, p, j) we have lim npq b(n, p, np + x npq ) = φ(x), n where φ(x) is
More informationBIOL The Normal Distribution and the Central Limit Theorem
BIOL 300 - The Normal Distribution and the Central Limit Theorem In the first week of the course, we introduced a few measures of center and spread, and discussed how the mean and standard deviation are
More informationUnit 5: Sampling Distributions of Statistics
Unit 5: Sampling Distributions of Statistics Statistics 571: Statistical Methods Ramón V. León 6/12/2004 Unit 5 - Stat 571 - Ramon V. Leon 1 Definitions and Key Concepts A sample statistic used to estimate
More informationUnit 5: Sampling Distributions of Statistics
Unit 5: Sampling Distributions of Statistics Statistics 571: Statistical Methods Ramón V. León 6/12/2004 Unit 5 - Stat 571 - Ramon V. Leon 1 Definitions and Key Concepts A sample statistic used to estimate
More informationNormal Distribution. Notes. Normal Distribution. Standard Normal. Sums of Normal Random Variables. Normal. approximation of Binomial.
Lecture 21,22, 23 Text: A Course in Probability by Weiss 8.5 STAT 225 Introduction to Probability Models March 31, 2014 Standard Sums of Whitney Huang Purdue University 21,22, 23.1 Agenda 1 2 Standard
More informationSection 7.5 The Normal Distribution. Section 7.6 Application of the Normal Distribution
Section 7.6 Application of the Normal Distribution A random variable that may take on infinitely many values is called a continuous random variable. A continuous probability distribution is defined by
More informationSTAT 830 Convergence in Distribution
STAT 830 Convergence in Distribution Richard Lockhart Simon Fraser University STAT 830 Fall 2013 Richard Lockhart (Simon Fraser University) STAT 830 Convergence in Distribution STAT 830 Fall 2013 1 / 31
More informationStatistical Tables Compiled by Alan J. Terry
Statistical Tables Compiled by Alan J. Terry School of Science and Sport University of the West of Scotland Paisley, Scotland Contents Table 1: Cumulative binomial probabilities Page 1 Table 2: Cumulative
More informationThe Bernoulli distribution
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More informationExam 2 Spring 2015 Statistics for Applications 4/9/2015
18.443 Exam 2 Spring 2015 Statistics for Applications 4/9/2015 1. True or False (and state why). (a). The significance level of a statistical test is not equal to the probability that the null hypothesis
More informationBIO5312 Biostatistics Lecture 5: Estimations
BIO5312 Biostatistics Lecture 5: Estimations Yujin Chung September 27th, 2016 Fall 2016 Yujin Chung Lec5: Estimations Fall 2016 1/34 Recap Yujin Chung Lec5: Estimations Fall 2016 2/34 Today s lecture and
More informationUQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions.
UQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions. Random Variables 2 A random variable X is a numerical (integer, real, complex, vector etc.) summary of the outcome of the random experiment.
More informationAMS7: WEEK 4. CLASS 3
AMS7: WEEK 4. CLASS 3 Sampling distributions and estimators. Central Limit Theorem Normal Approximation to the Binomial Distribution Friday April 24th, 2015 Sampling distributions and estimators REMEMBER:
More informationME3620. Theory of Engineering Experimentation. Spring Chapter III. Random Variables and Probability Distributions.
ME3620 Theory of Engineering Experimentation Chapter III. Random Variables and Probability Distributions Chapter III 1 3.2 Random Variables In an experiment, a measurement is usually denoted by a variable
More information5. In fact, any function of a random variable is also a random variable
Random Variables - Class 11 October 14, 2012 Debdeep Pati 1 Random variables 1.1 Expectation of a function of a random variable 1. Expectation of a function of a random variable 2. We know E(X) = x xp(x)
More informationCentral Limit Theorem (CLT) RLS
Central Limit Theorem (CLT) RLS Central Limit Theorem (CLT) Definition The sampling distribution of the sample mean is approximately normal with mean µ and standard deviation (of the sampling distribution
More informationThe Normal Probability Distribution
1 The Normal Probability Distribution Key Definitions Probability Density Function: An equation used to compute probabilities for continuous random variables where the output value is greater than zero
More information4.3 Normal distribution
43 Normal distribution Prof Tesler Math 186 Winter 216 Prof Tesler 43 Normal distribution Math 186 / Winter 216 1 / 4 Normal distribution aka Bell curve and Gaussian distribution The normal distribution
More informationSTA258H5. Al Nosedal and Alison Weir. Winter Al Nosedal and Alison Weir STA258H5 Winter / 41
STA258H5 Al Nosedal and Alison Weir Winter 2017 Al Nosedal and Alison Weir STA258H5 Winter 2017 1 / 41 NORMAL APPROXIMATION TO THE BINOMIAL DISTRIBUTION. Al Nosedal and Alison Weir STA258H5 Winter 2017
More information15.063: Communicating with Data Summer Recitation 4 Probability III
15.063: Communicating with Data Summer 2003 Recitation 4 Probability III Today s Content Normal RV Central Limit Theorem (CLT) Statistical Sampling 15.063, Summer '03 2 Normal Distribution Any normal RV
More informationElementary Statistics Lecture 5
Elementary Statistics Lecture 5 Sampling Distributions Chong Ma Department of Statistics University of South Carolina Chong Ma (Statistics, USC) STAT 201 Elementary Statistics 1 / 24 Outline 1 Introduction
More informationStatistics 251: Statistical Methods Sampling Distributions Module
Statistics 251: Statistical Methods Sampling Distributions Module 7 2018 Three Types of Distributions data distribution the distribution of a variable in a sample population distribution the probability
More informationProblems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman:
Math 224 Fall 207 Homework 5 Drew Armstrong Problems from 9th edition of Probability and Statistical Inference by Hogg, Tanis and Zimmerman: Section 3., Exercises 3, 0. Section 3.3, Exercises 2, 3, 0,.
More informationLecture 8. The Binomial Distribution. Binomial Distribution. Binomial Distribution. Probability Distributions: Normal and Binomial
Lecture 8 The Binomial Distribution Probability Distributions: Normal and Binomial 1 2 Binomial Distribution >A binomial experiment possesses the following properties. The experiment consists of a fixed
More informationChapter 5. Statistical inference for Parametric Models
Chapter 5. Statistical inference for Parametric Models Outline Overview Parameter estimation Method of moments How good are method of moments estimates? Interval estimation Statistical Inference for Parametric
More informationCIVL Learning Objectives. Definitions. Discrete Distributions
CIVL 3103 Discrete Distributions Learning Objectives Define discrete distributions, and identify common distributions applicable to engineering problems. Identify the appropriate distribution (i.e. binomial,
More informationProbability Distributions for Discrete RV
Probability Distributions for Discrete RV Probability Distributions for Discrete RV Definition The probability distribution or probability mass function (pmf) of a discrete rv is defined for every number
More informationNormal distribution Approximating binomial distribution by normal 2.10 Central Limit Theorem
1.1.2 Normal distribution 1.1.3 Approimating binomial distribution by normal 2.1 Central Limit Theorem Prof. Tesler Math 283 Fall 216 Prof. Tesler 1.1.2-3, 2.1 Normal distribution Math 283 / Fall 216 1
More informationMA131 Lecture 9.1. = µ = 25 and σ X P ( 90 < X < 100 ) = = /// σ X
The Central Limit Theorem (CLT): As the sample size n increases, the shape of the distribution of the sample means taken with replacement from the population with mean µ and standard deviation σ will approach
More informationThe graph of a normal curve is symmetric with respect to the line x = µ, and has points of
Stat 400, section 4.3 Normal Random Variables notes prepared by Tim Pilachowski Another often-useful probability density function is the normal density function, which graphs as the familiar bell-shaped
More informationMidTerm 1) Find the following (round off to one decimal place):
MidTerm 1) 68 49 21 55 57 61 70 42 59 50 66 99 Find the following (round off to one decimal place): Mean = 58:083, round off to 58.1 Median = 58 Range = max min = 99 21 = 78 St. Deviation = s = 8:535,
More informationChapter 7: Point Estimation and Sampling Distributions
Chapter 7: Point Estimation and Sampling Distributions Seungchul Baek Department of Statistics, University of South Carolina STAT 509: Statistics for Engineers 1 / 20 Motivation In chapter 3, we learned
More informationRandom Variables Handout. Xavier Vilà
Random Variables Handout Xavier Vilà Course 2004-2005 1 Discrete Random Variables. 1.1 Introduction 1.1.1 Definition of Random Variable A random variable X is a function that maps each possible outcome
More informationSampling Distribution
MAT 2379 (Spring 2012) Sampling Distribution Definition : Let X 1,..., X n be a collection of random variables. We say that they are identically distributed if they have a common distribution. Definition
More informationCommonly Used Distributions
Chapter 4: Commonly Used Distributions 1 Introduction Statistical inference involves drawing a sample from a population and analyzing the sample data to learn about the population. We often have some knowledge
More informationPoint Estimation. Some General Concepts of Point Estimation. Example. Estimator quality
Point Estimation Some General Concepts of Point Estimation Statistical inference = conclusions about parameters Parameters == population characteristics A point estimate of a parameter is a value (based
More informationReview. Binomial random variable
Review Discrete RV s: prob y fctn: p(x) = Pr(X = x) cdf: F(x) = Pr(X x) E(X) = x x p(x) SD(X) = E { (X - E X) 2 } Binomial(n,p): no. successes in n indep. trials where Pr(success) = p in each trial If
More informationFavorite Distributions
Favorite Distributions Binomial, Poisson and Normal Here we consider 3 favorite distributions in statistics: Binomial, discovered by James Bernoulli in 1700 Poisson, a limiting form of the Binomial, found
More informationPopulations and Samples Bios 662
Populations and Samples Bios 662 Michael G. Hudgens, Ph.D. mhudgens@bios.unc.edu http://www.bios.unc.edu/ mhudgens 2008-08-22 16:29 BIOS 662 1 Populations and Samples Random Variables Random sample: result
More informationHomework Assignments
Homework Assignments Week 1 (p. 57) #4.1, 4., 4.3 Week (pp 58 6) #4.5, 4.6, 4.8(a), 4.13, 4.0, 4.6(b), 4.8, 4.31, 4.34 Week 3 (pp 15 19) #1.9, 1.1, 1.13, 1.15, 1.18 (pp 9 31) #.,.6,.9 Week 4 (pp 36 37)
More informationTaylor Series & Binomial Series
Taylor Series & Binomial Series Calculus II Josh Engwer TTU 09 April 2014 Josh Engwer (TTU) Taylor Series & Binomial Series 09 April 2014 1 / 20 Continuity & Differentiability of a Function (Notation)
More informationThe Normal Approximation to the Binomial
Lecture 16 The Normal Approximation to the Binomial We can calculate l binomial i probabilities bbilii using The binomial formula The cumulative binomial tables When n is large, and p is not too close
More informationWhat was in the last lecture?
What was in the last lecture? Normal distribution A continuous rv with bell-shaped density curve The pdf is given by f(x) = 1 2πσ e (x µ)2 2σ 2, < x < If X N(µ, σ 2 ), E(X) = µ and V (X) = σ 2 Standard
More informationCovariance and Correlation. Def: If X and Y are JDRVs with finite means and variances, then. Example Sampling
Definitions Properties E(X) µ X Transformations Linearity Monotonicity Expectation Chapter 7 xdf X (x). Expectation Independence Recall: µ X minimizes E[(X c) ] w.r.t. c. The Prediction Problem The Problem:
More informationStatistics for Business and Economics: Random Variables:Continuous
Statistics for Business and Economics: Random Variables:Continuous STT 315: Section 107 Acknowledgement: I d like to thank Dr. Ashoke Sinha for allowing me to use and edit the slides. Murray Bourne (interactive
More informationChapter 7: SAMPLING DISTRIBUTIONS & POINT ESTIMATION OF PARAMETERS
Chapter 7: SAMPLING DISTRIBUTIONS & POINT ESTIMATION OF PARAMETERS Part 1: Introduction Sampling Distributions & the Central Limit Theorem Point Estimation & Estimators Sections 7-1 to 7-2 Sample data
More informationStatistics and Their Distributions
Statistics and Their Distributions Deriving Sampling Distributions Example A certain system consists of two identical components. The life time of each component is supposed to have an expentional distribution
More informationExpectations. Definition Let X be a discrete rv with set of possible values D and pmf p(x). The expected value or mean value of X, denoted by E(X ) or
Definition Let X be a discrete rv with set of possible values D and pmf p(x). The expected value or mean value of X, denoted by E(X ) or µ X, is E(X ) = µ X = x D x p(x) Definition Let X be a discrete
More informationBinomial Random Variables. Binomial Random Variables
Bernoulli Trials Definition A Bernoulli trial is a random experiment in which there are only two possible outcomes - success and failure. 1 Tossing a coin and considering heads as success and tails as
More informationPROBABILITY DISTRIBUTIONS
CHAPTER 3 PROBABILITY DISTRIBUTIONS Page Contents 3.1 Introduction to Probability Distributions 51 3.2 The Normal Distribution 56 3.3 The Binomial Distribution 60 3.4 The Poisson Distribution 64 Exercise
More informationChapter 5. Continuous Random Variables and Probability Distributions. 5.1 Continuous Random Variables
Chapter 5 Continuous Random Variables and Probability Distributions 5.1 Continuous Random Variables 1 2CHAPTER 5. CONTINUOUS RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Probability Distributions Probability
More informationWeek 7. Texas A& M University. Department of Mathematics Texas A& M University, College Station Section 3.2, 3.3 and 3.4
Week 7 Oğuz Gezmiş Texas A& M University Department of Mathematics Texas A& M University, College Station Section 3.2, 3.3 and 3.4 Oğuz Gezmiş (TAMU) Topics in Contemporary Mathematics II Week7 1 / 19
More informationMidterm Exam III Review
Midterm Exam III Review Dr. Joseph Brennan Math 148, BU Dr. Joseph Brennan (Math 148, BU) Midterm Exam III Review 1 / 25 Permutations and Combinations ORDER In order to count the number of possible ways
More informationIntroduction to Statistical Data Analysis II
Introduction to Statistical Data Analysis II JULY 2011 Afsaneh Yazdani Preface Major branches of Statistics: - Descriptive Statistics - Inferential Statistics Preface What is Inferential Statistics? Preface
More informationChapter 4 Continuous Random Variables and Probability Distributions
Chapter 4 Continuous Random Variables and Probability Distributions Part 2: More on Continuous Random Variables Section 4.5 Continuous Uniform Distribution Section 4.6 Normal Distribution 1 / 28 One more
More informationIntroduction to Probability
August 18, 2006 Contents Outline. Contents.. Contents.. Contents.. Application: 1-d diffusion Definition Outline Consider M discrete events x = x i, i = 1,2,,M. The probability for the occurrence of x
More informationECO220Y Continuous Probability Distributions: Normal Readings: Chapter 9, section 9.10
ECO220Y Continuous Probability Distributions: Normal Readings: Chapter 9, section 9.10 Fall 2011 Lecture 8 Part 2 (Fall 2011) Probability Distributions Lecture 8 Part 2 1 / 23 Normal Density Function f
More informationChapter 3 - Lecture 4 Moments and Moment Generating Funct
Chapter 3 - Lecture 4 and s October 7th, 2009 Chapter 3 - Lecture 4 and Moment Generating Funct Central Skewness Chapter 3 - Lecture 4 and Moment Generating Funct Central Skewness The expected value of
More informationMath 227 Elementary Statistics. Bluman 5 th edition
Math 227 Elementary Statistics Bluman 5 th edition CHAPTER 6 The Normal Distribution 2 Objectives Identify distributions as symmetrical or skewed. Identify the properties of the normal distribution. Find
More informationConfidence Intervals Introduction
Confidence Intervals Introduction A point estimate provides no information about the precision and reliability of estimation. For example, the sample mean X is a point estimate of the population mean μ
More informationDiscrete Random Variables and Probability Distributions. Stat 4570/5570 Based on Devore s book (Ed 8)
3 Discrete Random Variables and Probability Distributions Stat 4570/5570 Based on Devore s book (Ed 8) Random Variables We can associate each single outcome of an experiment with a real number: We refer
More informationProbability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016
Probability Theory Probability and Statistics for Data Science CSE594 - Spring 2016 What is Probability? 2 What is Probability? Examples outcome of flipping a coin (seminal example) amount of snowfall
More informationData Analysis and Statistical Methods Statistics 651
Review of previous lecture: Why confidence intervals? Data Analysis and Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasini/teaching.html Suhasini Subba Rao Suppose you want to know the
More informationProbability Theory. Mohamed I. Riffi. Islamic University of Gaza
Probability Theory Mohamed I. Riffi Islamic University of Gaza Table of contents 1. Chapter 2 Discrete Distributions The binomial distribution 1 Chapter 2 Discrete Distributions Bernoulli trials and the
More informationSOME MOST POPULAR DISTRIBUTIONS OF RANDOM VARIABLES
SOME MOST POPULAR DISTRIBUTIONS OF RANDOM VARIABLES ... OF THE DISCRETE TYPE 1.ONE-POINT (single-valued) RV: P(X = x 0 ) = 1 { 0 x x0 F (x) = 1 x > x 0 E{X} = x 0 ; VAR(X) = 0. 2.TWO-POINT (two-valued):
More informationINDIAN INSTITUTE OF SCIENCE STOCHASTIC HYDROLOGY. Lecture -5 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc.
INDIAN INSTITUTE OF SCIENCE STOCHASTIC HYDROLOGY Lecture -5 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc. Summary of the previous lecture Moments of a distribubon Measures of
More informationDrunken Birds, Brownian Motion, and Other Random Fun
Drunken Birds, Brownian Motion, and Other Random Fun Michael Perlmutter Department of Mathematics Purdue University 1 M. Perlmutter(Purdue) Brownian Motion and Martingales Outline Review of Basic Probability
More informationChapter 3 Common Families of Distributions. Definition 3.4.1: A family of pmfs or pdfs is called exponential family if it can be expressed as
Lecture 0 on BST 63: Statistical Theory I Kui Zhang, 09/9/008 Review for the previous lecture Definition: Several continuous distributions, including uniform, gamma, normal, Beta, Cauchy, double exponential
More informationSTAT Chapter 5: Continuous Distributions. Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s.
STAT 515 -- Chapter 5: Continuous Distributions Probability distributions are used a bit differently for continuous r.v. s than for discrete r.v. s. Continuous distributions typically are represented by
More informationLecture Stat 302 Introduction to Probability - Slides 15
Lecture Stat 30 Introduction to Probability - Slides 15 AD March 010 AD () March 010 1 / 18 Continuous Random Variable Let X a (real-valued) continuous r.v.. It is characterized by its pdf f : R! [0, )
More informationRandom Variable: Definition
Random Variables Random Variable: Definition A Random Variable is a numerical description of the outcome of an experiment Experiment Roll a die 10 times Inspect a shipment of 100 parts Open a gas station
More information