STAT 111 Recitation 3

Similar documents
STAT 111 Recitation 4

STAT 111 Recitation 2

Confidence Intervals Introduction

Lecture 23. STAT 225 Introduction to Probability Models April 4, Whitney Huang Purdue University. Normal approximation to Binomial

Chapter 3 - Lecture 5 The Binomial Probability Distribution

Discrete Random Variables

Statistics 511 Additional Materials

Normal Distribution. Notes. Normal Distribution. Standard Normal. Sums of Normal Random Variables. Normal. approximation of Binomial.

Chapter 8. Introduction to Statistical Inference

Central Limit Theorem (cont d) 7/28/2006

Chapter 5. Statistical inference for Parametric Models

Section 7.5 The Normal Distribution. Section 7.6 Application of the Normal Distribution

STAT Chapter 7: Central Limit Theorem

ECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 10: Continuous RV Families. Prof. Vince Calhoun

Elementary Statistics Lecture 5

Statistical Methods in Practice STAT/MATH 3379

MA 1125 Lecture 12 - Mean and Standard Deviation for the Binomial Distribution. Objectives: Mean and standard deviation for the binomial distribution.

Midterm Exam III Review

Statistics Class 15 3/21/2012

Chapter 7 - Lecture 1 General concepts and criteria

Chapter 3 - Lecture 3 Expected Values of Discrete Random Va

No, because np = 100(0.02) = 2. The value of np must be greater than or equal to 5 to use the normal approximation.

ECO220Y Continuous Probability Distributions: Normal Readings: Chapter 9, section 9.10

Statistics, Their Distributions, and the Central Limit Theorem

Class 13. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

15.063: Communicating with Data Summer Recitation 4 Probability III

Chapter 8: The Binomial and Geometric Distributions

Tutorial 11: Limit Theorems. Baoxiang Wang & Yihan Zhang bxwang, April 10, 2017

Chapter 4 Continuous Random Variables and Probability Distributions

Chapter 7: Estimation Sections

Central Limit Thm, Normal Approximations

Probability. An intro for calculus students P= Figure 1: A normal integral

Chapter 7: Estimation Sections

Class 12. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Chapter 7: Point Estimation and Sampling Distributions

Statistics 6 th Edition

STAT 241/251 - Chapter 7: Central Limit Theorem

Shifting our focus. We were studying statistics (data, displays, sampling...) The next few lectures focus on probability (randomness) Why?

Chapter 4 Continuous Random Variables and Probability Distributions

4 Random Variables and Distributions

Statistics 511 Supplemental Materials

Unit 5: Sampling Distributions of Statistics

Unit 5: Sampling Distributions of Statistics

MAS1403. Quantitative Methods for Business Management. Semester 1, Module leader: Dr. David Walshaw

Chapter 8: Sampling distributions of estimators Sections

Engineering Statistics ECIV 2305

Examples: Random Variables. Discrete and Continuous Random Variables. Probability Distributions

MLLunsford 1. Activity: Central Limit Theorem Theory and Computations

Sampling Distribution

Expectations. Definition Let X be a discrete rv with set of possible values D and pmf p(x). The expected value or mean value of X, denoted by E(X ) or

Probability Distributions: Discrete

Conjugate priors: Beta and normal Class 15, Jeremy Orloff and Jonathan Bloom

MA : Introductory Probability

5.3 Interval Estimation

Class 16. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

STA258H5. Al Nosedal and Alison Weir. Winter Al Nosedal and Alison Weir STA258H5 Winter / 41

Lecture Notes 6. Assume F belongs to a family of distributions, (e.g. F is Normal), indexed by some parameter θ.

Chapter 7: Estimation Sections

Chapter 5. Continuous Random Variables and Probability Distributions. 5.1 Continuous Random Variables

continuous rv Note for a legitimate pdf, we have f (x) 0 and f (x)dx = 1. For a continuous rv, P(X = c) = c f (x)dx = 0, hence

UQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions.

Math 14 Lecture Notes Ch. 4.3

The Bernoulli distribution

Probability: Week 4. Kwonsang Lee. University of Pennsylvania February 13, 2015

MTH6154 Financial Mathematics I Stochastic Interest Rates

Section The Sampling Distribution of a Sample Mean

Class 11. Daniel B. Rowe, Ph.D. Department of Mathematics, Statistics, and Computer Science. Marquette University MATH 1700

Simple Random Sampling. Sampling Distribution

A continuous random variable is one that can theoretically take on any value on some line interval. We use f ( x)

Statistical analysis and bootstrapping

Chapter 4 Probability Distributions

Statistics for Managers Using Microsoft Excel 7 th Edition

5.3 Statistics and Their Distributions

Binomial Random Variables. Binomial Random Variables

Introduction to Probability and Inference HSSP Summer 2017, Instructor: Alexandra Ding July 19, 2017

7. For the table that follows, answer the following questions: x y 1-1/4 2-1/2 3-3/4 4

MATH 264 Problem Homework I

As you draw random samples of size n, as n increases, the sample means tend to be normally distributed.

Chapter 16. Random Variables. Copyright 2010, 2007, 2004 Pearson Education, Inc.

What was in the last lecture?

ME3620. Theory of Engineering Experimentation. Spring Chapter III. Random Variables and Probability Distributions.

Bernoulli and Binomial Distributions

Point Estimation. Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage

THE UNIVERSITY OF TEXAS AT AUSTIN Department of Information, Risk, and Operations Management

The Multistep Binomial Model

Statistical Intervals. Chapter 7 Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage

Uniform Probability Distribution. Continuous Random Variables &

Section Random Variables and Histograms

1. Covariance between two variables X and Y is denoted by Cov(X, Y) and defined by. Cov(X, Y ) = E(X E(X))(Y E(Y ))

Back to estimators...

Stats SB Notes 6.3 Completed.notebook April 03, Mar 23 5:22 PM. Chapter Outline. 6.1 Confidence Intervals for the Mean (σ Known)

Chapter 4: Asymptotic Properties of MLE (Part 3)

The normal distribution is a theoretical model derived mathematically and not empirically.

5.2 Random Variables, Probability Histograms and Probability Distributions

Statistical Tables Compiled by Alan J. Terry

GETTING STARTED. To OPEN MINITAB: Click Start>Programs>Minitab14>Minitab14 or Click Minitab 14 on your Desktop

Section 0: Introduction and Review of Basic Concepts

Marquette University MATH 1700 Class 8 Copyright 2018 by D.B. Rowe

Discrete Probability Distributions

AMS7: WEEK 4. CLASS 3

Transcription:

STAT 111 Recitation 3 Linjun Zhang stat.wharton.upenn.edu/~linjunz/ September 23, 2017

Misc. The unpicked-up homeworks will be put in the STAT 111 box in the Stats Department lobby (It s on the 4th floor of JMHH. Turn right when you exit the elevator). 1

Misc. The unpicked-up homeworks will be put in the STAT 111 box in the Stats Department lobby (It s on the 4th floor of JMHH. Turn right when you exit the elevator). 2

Homework Problem Problem Show that if A and B are independent events then A c and B c are also independent events. 3

Homework Problem Problem Show that if A and B are independent events then A c and B c are also independent events. Solutions Goal: Prob(A c B c ) = Prob(A c ) Prob(B c ). 3

Homework Problem Problem Show that if A and B are independent events then A c and B c are also independent events. Solutions Goal: Prob(A c B c ) = Prob(A c ) Prob(B c ). Prob(A c B c ) = 1 Prob(A B). 3

Homework Problem Problem Show that if A and B are independent events then A c and B c are also independent events. Solutions Goal: Prob(A c B c ) = Prob(A c ) Prob(B c ). Prob(A c B c ) = 1 Prob(A B). 1 Prob(A B) = 1 (Prob(A) + Prob(B) Prob(A B)) = 1 (Prob(A) + Prob(B) Prob(A) Prob(B)) = 1 Prob(A) Prob(B) + Prob(A) Prob(B)). 3

Homework Problem Problem Show that if A and B are independent events then A c and B c are also independent events. Solutions Goal: Prob(A c B c ) = Prob(A c ) Prob(B c ). Prob(A c B c ) = 1 Prob(A B). 1 Prob(A B) = 1 (Prob(A) + Prob(B) Prob(A B)) = 1 (Prob(A) + Prob(B) Prob(A) Prob(B)) = 1 Prob(A) Prob(B) + Prob(A) Prob(B)). On the other hand, Prob(A c ) Prob(B c ) = (1 Prob(A))(1 Prob(B)) = 1 Prob(A) Prob(B) + Prob(A) Prob(B)) 3

Homework Problem Problem Show that if A and B are independent events then A c and B c are also independent events. Solutions Goal: Prob(A c B c ) = Prob(A c ) Prob(B c ). Prob(A c B c ) = 1 Prob(A B). 1 Prob(A B) = 1 (Prob(A) + Prob(B) Prob(A B)) = 1 (Prob(A) + Prob(B) Prob(A) Prob(B)) = 1 Prob(A) Prob(B) + Prob(A) Prob(B)). On the other hand, Prob(A c ) Prob(B c ) = (1 Prob(A))(1 Prob(B)) = 1 Prob(A) Prob(B) + Prob(A) Prob(B)) Therefore, Prob(A c B c ) = Prob(A c ) Prob(B c ). 3

Recap Random variables (X ; before the experiment) and data (x; after experiment) Parameters: θ, µ... Discrete random variables and probability distribution Binomial distribution: Prob(X = x) = ( ) n θ x (1 θ) n x, x = 0, 1, 2,..., n. x Binomial Chart (What if θ > 0.5?) 4

This class Mean and variance of a discrete random variable Special case: Mean and variance of a binomial random variable Die rolling example Many random variables: sum and average 5

The mean of a discrete random variable Recall that the probability distribution of a discrete R.V. X can be written as 6

The mean of a discrete random variable Recall that the probability distribution of a discrete R.V. X can be written as The mean of X is defined as µ = v 1Prob(X = v 1) +... + v k Prob(X = v k ) = k v i Prob(X = v i ). i=1 6

The mean of a discrete random variable Recall that the probability distribution of a discrete R.V. X can be written as The mean of X is defined as µ = v 1Prob(X = v 1) +... + v k Prob(X = v k ) = k v i Prob(X = v i ). i=1 Intuition: center of gravity of a probability distribution 6

The mean of a discrete random variable Recall that the probability distribution of a discrete R.V. X can be written as The mean of X is defined as µ = v 1Prob(X = v 1) +... + v k Prob(X = v k ) = k v i Prob(X = v i ). i=1 Intuition: center of gravity of a probability distribution Notation µ is often used for mean. 6

The mean of a discrete random variable Recall that the probability distribution of a discrete R.V. X can be written as The mean of X is defined as µ = v 1Prob(X = v 1) +... + v k Prob(X = v k ) = k v i Prob(X = v i ). i=1 Intuition: center of gravity of a probability distribution Notation µ is often used for mean. A mean is not an average. 6

The variance of a discrete random variable The variance of X is defined as σ 2 = (v 1 µ) 2 Prob(X = v 1) +... + (v k µ) 2 Prob(X = v k ) k = (v i µ) 2 Prob(X = v i ). i=1 The variance is a measure of the dispersion (spread-out-ness) of the probability distribution of the random variable around its mean. The larger the variance, the more spread out the probability distribution is. Notation σ 2 is often used for variance (a variance is a parameter), with σ being its standard deviation. 7

The variance of a discrete random variable The variance of X is defined as σ 2 = (v 1 µ) 2 Prob(X = v 1) +... + (v k µ) 2 Prob(X = v k ) k = (v i µ) 2 Prob(X = v i ). i=1 The variance is a measure of the dispersion (spread-out-ness) of the probability distribution of the random variable around its mean. The larger the variance, the more spread out the probability distribution is. Notation σ 2 is often used for variance (a variance is a parameter), with σ being its standard deviation. An alternative formula σ 2 = k i=1 v 2 i Prob(X = v i ) µ 2 7

The variance of a discrete random variable Proof: 8

Mean and variance Which is which? {(µ = 0, σ 2 = 1), (µ = 0, σ 2 = 3), (µ = 2, σ 2 = 1), (µ = 2, σ 2 = 3)}. 9

Practice Problems Practice Problem Let X be a random variable with the following probability distribution: Possible values of X 0 1 2 3 Probabilities 1 6 1 4 1 3 1 4 Find the mean and standard deviation of X. 10

Practice Problems Practice Problem Let X be a random variable with the following probability distribution: Possible values of X 0 1 2 3 Probabilities 1 6 1 4 1 3 1 4 Find the mean and standard deviation of X. Solution µ = 0 1 6 + 1 1 4 + 2 1 3 + 3 1 4 = 3 12 + 8 12 + 9 12 = 20 12 = 5 3. σ 2 = 1 1 4 + 22 1 3 + 32 1 4 ( 5 3 )2 = 1 4 + 4 3 + 9 4 25 9 19 σ = 18. = 9+48+81 100 36 = 19 18. 10

Binomial Distribution A random variable X is said to have a Binomial(n, θ) distribution if it has the probability distribution ( ) Prob(X = x) = n x θ x (1 θ) n x, x = 0, 1, 2,..., n. (We call n the index of the distribution, θ the parameter of the distribution.) 11

Binomial Distribution A random variable X is said to have a Binomial(n, θ) distribution if it has the probability distribution ( ) Prob(X = x) = n x θ x (1 θ) n x, x = 0, 1, 2,..., n. (We call n the index of the distribution, θ the parameter of the distribution.) Mean µ = nθ; Variance σ 2 = nθ(1 θ). This is the short formula for binomial distribution ONLY! 11

Practice Problems Practice Problem Calculate the mean and variance of a r.v. X with binomial distribution Binomial(2, 0.7) by the binomial charts; by the probability distribution formula P(X = x) = ( n x) θ x (1 θ) n x ; by the short formula. 12

Die rolling example Let X i be the number that will turn up in the i-th rolling (i = 1, 2,..., 1000). 13

Die rolling example Let X i be the number that will turn up in the i-th rolling (i = 1, 2,..., 1000). i.i.d: Random variables which are independent of each other, and which all have the same probability distribution, are said to be i.i.d (independently and identically distributed). 13

Die rolling example Let X i be the number that will turn up in the i-th rolling (i = 1, 2,..., 1000). i.i.d: Random variables which are independent of each other, and which all have the same probability distribution, are said to be i.i.d (independently and identically distributed). The mean is not an average: mean µ, observed data average x, random variable average X. (parameter, data, random variable). 13

Die rolling example Let X i be the number that will turn up in the i-th rolling (i = 1, 2,..., 1000). i.i.d: Random variables which are independent of each other, and which all have the same probability distribution, are said to be i.i.d (independently and identically distributed). The mean is not an average: mean µ, observed data average x, random variable average X. (parameter, data, random variable). Probabilities that are used in statistics, if we roll a die 1000 times, assuming the die is fair, then with probability 0.95, the average lies in the interval [3.392, 3.608], that is, Prob(3.392 X 3.608) 0.95. 13

Die rolling example Let X i be the number that will turn up in the i-th rolling (i = 1, 2,..., 1000). i.i.d: Random variables which are independent of each other, and which all have the same probability distribution, are said to be i.i.d (independently and identically distributed). The mean is not an average: mean µ, observed data average x, random variable average X. (parameter, data, random variable). Probabilities that are used in statistics, if we roll a die 1000 times, assuming the die is fair, then with probability 0.95, the average lies in the interval [3.392, 3.608], that is, Prob(3.392 X 3.608) 0.95. In general, Prob(µ( X ) 2σ( X ) X µ( X ) + 2σ( X )) 0.95, where µ( X ), σ( X ) denote the mean and standard deviation of X, and this probability statement is called two-standard-deviation rule. 13

Many random variables Given n random variables X 1, X 2,..., X n, we can define two other random variables: The sum, denoted by T n : T n = X 1 + X 2 +... + X n ; The average, denoted by X, X = X1+X2+...+Xn n = Tn n. Both the sum and the average, being random variables, each have a probability distribution, and thus each has a mean and variance. An average is a totally different concept from a mean a mean is a parameter. 14

Mean and Variance of X Given n i.i.d. random variables X 1, X 2,..., X n with mean µ and variance σ 2, we define two other random variables: The sum, denoted by T n : T n = X 1 + X 2 +... + X n ; The average, denoted by X, X = X1+X2+...+Xn n = Tn n. Must-know formula for T n and X Mean of T n = nµ; Variance of T n = nσ 2 ; Mean of X = µ; Variance of X = σ 2 /n. 15

Practice problem Let X i be the number that will turn up in the i -th rolling (i = 1, 2,..., 1000). Assuming the die is fair. Calculate the mean and variance of X. 16

Practice problem Let X i be the number that will turn up in the i -th rolling (i = 1, 2,..., 1000). Assuming the die is fair. Calculate the mean and variance of X. Solution µ = 1 6 (1 + 2 + 3 + 4 + 5 + 6) = 3.5 16

Practice problem Let X i be the number that will turn up in the i -th rolling (i = 1, 2,..., 1000). Assuming the die is fair. Calculate the mean and variance of X. Solution µ = 1 6 (1 + 2 + 3 + 4 + 5 + 6) = 3.5 σ 2 = 1 6 (12 + 2 2 + 3 2 + 4 2 + 5 2 + 6 2 ) 3.5 2 = 35 12 16

Practice problem Let X i be the number that will turn up in the i -th rolling (i = 1, 2,..., 1000). Assuming the die is fair. Calculate the mean and variance of X. Solution µ = 1 6 (1 + 2 + 3 + 4 + 5 + 6) = 3.5 σ 2 = 1 6 (12 + 2 2 + 3 2 + 4 2 + 5 2 + 6 2 ) 3.5 2 = 35 12 µ( X ) = µ = 3.5; σ 2 ( X ) = σ2 n = 35 12000 = 7 2400. 16