Unit 2: Probability and distributions Lecture 4: Binomial distribution Statistics 101 Thomas Leininger May 24, 2013
Announcements Announcements No class on Monday PS #3 due Wednesday Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 2 / 28
Binary outcomes Milgram experiment Stanley Milgram, a Yale University psychologist, conducted a series of experiments on obedience to authority starting in 1963. Experimenter (E) orders the teacher (T), the subject of the experiment, to give severe electric shocks to a learner (L) each time the learner answers a question incorrectly. The learner is actually an actor, and the electric shocks are not real, but a prerecorded sound is played each time the teacher administers an electric shock. Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 3 / 28
Binary outcomes Milgram experiment (cont.) These experiments measured the willingness of study participants to obey an authority figure who instructed them to perform acts that conflicted with their personal conscience. Milgram found that about 65% of people would obey authority and give such shocks, and only 35% refused. Over the years, additional research suggested this number is approximately consistent across communities and time. Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 4 / 28
Binary outcomes Binary outcomes Each person in Milgram s experiment can be thought of as a trial. A person is labeled a success if she refuses to administer a severe shock, and failure if she administers such shock. Since only 35% of people refused to administer a shock, probability of success is p = 0.35. When an individual trial has only two possible outcomes, it is also called a Bernoulli random variable. Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 5 / 28
Considering many scenarios Suppose we randomly select four individuals to participate in this experiment. What is the probability that exactly 1 of them will refuse to administer the shock? Let s call these people Allen (A), Brittany (B), Caroline (C), and Damian (D). Each one of the four scenarios below will satisfy the condition of exactly 1 of them refuses to administer the shock : Scenario 1: 0.35 (A) refuse 0.65 (B) shock 0.65 (C) shock 0.65 (D) shock = 0.0961 Scenario 2: 0.65 (A) shock 0.35 (B) refuse 0.65 (C) shock 0.65 (D) shock = 0.0961 Scenario 3: 0.65 (A) shock 0.65 (B) shock 0.35 (C) refuse 0.65 (D) shock = 0.0961 Scenario 4: 0.65 (A) shock 0.65 (B) shock 0.65 (C) shock 0.35 (D) refuse = 0.0961 The probability of exactly one 1 of 4 people refusing to administer the shock is the sum of all of these probabilities. 0.0961 + 0.0961 + 0.0961 + 0.0961 = 4 0.0961 = 0.3844 Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 6 / 28
The binomial distribution Binomial distribution The question from the prior slide asked for the probability of given number of successes, k, in a given number of trials, n, (k = 1 success in n = 4 trials), and we calculated this probability as # of scenarios P(single scenario) # of scenarios: there is a less tedious way to figure this out, we ll get to that shortly... P(single scenario) = p k (1 p) (n k) (probability of success to the power of number of successes, probability of failure to the power of number of failures) The Binomial distribution describes the probability of having exactly k successes in n independent Bernouilli trials with probability of success p. Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 7 / 28
The binomial distribution Counting the # of scenarios Earlier we wrote out all possible scenarios that fit the condition of exactly one person refusing to administer the shock. If n was larger and/or k was different than 1, for example, n = 9 and k = 2: RRSSSSSSS SRRSSSSSS SSRRSSSSS SSRSSRSSS SSSSSSSRR writing out all possible scenarios would be incredibly tedious and prone to errors. Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 8 / 28
The binomial distribution Calculating the # of scenarios Choose function The choose function is useful for calculating the number of ways to choose k successes in n trials. ( ) n n! = k k!(n k)! k = 1, n = ( ) 4 4: 1 = 4! k = 2, n = ( ) 9 9: 2 = 9! 1!(4 1)! = 4 3 2 1 2!(9 1)! = 9 8 7! 1 (3 2 1) = 4 2 1 7! = 72 2 = 36 Note: You can also use R for these calculations: > choose(9,2) [1] 36 Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 9 / 28
The binomial distribution Binomial distribution (cont.) Binomial probabilities If p represents probability of success, (1 p) represents probability of failure, n represents number of independent trials, and k represents number of successes ( ) n P(k successes in n trials) = p k (1 p) (n k) k Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 10 / 28
The binomial distribution Question Which of the following is not a condition that needs to be met for the binomial distribution to be applicable? (a) the trials must be independent (b) the number of trials, n, must be fixed (c) each trial outcome must be classified as a success or a failure (d) the number of desired successes, k, must be greater than the number of trials (e) the probability of success, p, must be the same for each trial Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 11 / 28
The binomial distribution Question A 2012 Gallup survey suggests that 26.2% of Americans are obese. Among a random sample of 10 Americans, what is the probability that exactly 8 are obese? (a) pretty high (b) pretty low Gallup: http:// www.gallup.com/ poll/ 160061/ obesity-rate-stable-2012.aspx, January 23, 2013. Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 12 / 28
The binomial distribution Question A 2012 Gallup survey suggests that 26.2% of Americans are obese. Among a random sample of 10 Americans, what is the probability that exactly 8 are obese? (a) 0.262 ( 8 0.738 ) 2 8 (b) 10 0.262 ( 8 0.738 ) 2 10 (c) 8 0.262 8 0.738 2 ( ) 10 (d) 8 0.262 2 0.738 8 Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 13 / 28
Aside: The birthday problem What is the probability that 2 randomly chosen people share a birthday? Pretty low, 1 365 0.0027. What is the probability that at least 2 people out of 366 people share a birthday? Exactly 1! Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 14 / 28
Aside: The birthday problem What is the probability that at least 2 people (1 match) out of 16 people share a birthday? Somewhat complicated to calculate, but we can think of it as the complement of the probability that there are no matches in 16 people. P(no matches) = 0.72 P(at least 1 match) 0.28 365 364 350 365 16 If we had 30 people, then P(at least 1 match) 0.71 Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 15 / 28
Expected value and variability of successes Expected value A 2012 Gallup survey suggests that 26.2% of Americans are obese. Among a random sample of 100 Americans, how many would you expect to be obese? Easy enough, 100 0.262 = 26.2. Or more formally, µ = np = 100 0.262 = 26.2. But this doesn t mean in every random sample of 100 people exactly 26.2 will be obese. In fact, that s not even possible. In some samples this value will be less, and in others more. How much would we expect this value to vary? Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 16 / 28
Expected value and variability of successes Expected value and its variability Mean and standard deviation of binomial distribution µ = np σ = np(1 p) Going back to the obesity rate: σ = np(1 p) = 100 0.262 0.738 4.4 We would expect 26.2 out of 100 randomly sampled American to be obese, give or take 4.4. Note: Mean and standard deviation of a binomial might not always be whole numbers, and that is okay. These values represent what we would expect to see on average. Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 17 / 28
Expected value and variability of successes Unusual observations Using the notion that observations that are more than 2 standard deviations away from the mean are considered unusual and the mean and the standard deviation we just computed, we can calculate a range for the plausible number of obese Americans in random samples of 100. 26.2 ± (2 4.4) = (17.4, 35) Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 18 / 28
Expected value and variability of successes Question An August 2012 Gallup poll suggests that 13% of Americans think home schooling provides an excellent education for children. Would a random sample of 1,000 Americans where only 100 share this opinion be considered unusual? (a) No (b) Yes http:// www.gallup.com/ poll/ 156974/ private-schools-top-marks-educating-children.aspx Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 19 / 28
Activity Application exercise: Shapes of binomial distributions 1 Let s simulate a Binomial distribution with n = 10 and p = 0.5. 1 Flip a penny 10 times and record the number of heads. 2 Repeat step 1. 3 Record your number of heads (from each trial) on the dotplot on the board. 2 What happens when we change n or p? 1 Go to StatKey: http:// lock5stat.com/ statkey/. In the Sampling Distributions category, select Proportion. Change the proportion (p) and sample size n and simulate new data. In R: > binom_sim <- rbinom(100,10,0.8) > barplot(table(binom_sim)) Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 20 / 28
Normal approximation to the binomial Histograms of number of successes Hollow histograms of samples from the binomial model where p = 0.10 and n = 10, 30, 100, and 300. What happens as n increases? 0 2 4 6 n = 10 0 2 4 6 8 10 n = 30 0 5 10 15 20 n = 100 10 20 30 40 50 n = 300 Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 21 / 28
Normal approximation to the binomial Normal probability plots of number of successes Normal probability plots of samples from the binomial model where p = 0.10 and n = 10, 30, 100, and 300. What happens as n increases? 2 1 0 1 2 0.0 0.5 1.0 1.5 2.0 2.5 3.0 n = 10 2 1 0 1 2 0 2 4 6 8 n = 30 2 1 0 1 2 5 10 15 n = 100 2 1 0 1 2 20 25 30 35 40 n = 300 Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 22 / 28
Normal approximation to the binomial Low large is large enough? The sample size is considered large enough if the expected number of successes and failures are both at least 10. np 10 and n(1 p) 10 We can rewrite this to say that n should satisfy: n (10/p) and n 10/(1 p) Are these conditions satisfied in the Gallup poll example? Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 23 / 28
Normal approximation to the binomial Question Below are four pairs of Binomial distribution parameters. Which distribution can be approximated by the normal distribution? (a) n = 100, p = 0.95 (b) n = 25, p = 0.45 (c) n = 150, p = 0.05 (d) n = 500, p = 0.015 Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 24 / 28
Normal approximation to the binomial An analysis of Facebook users A recent study found that Facebook users get more than they give. For example: 40% of Facebook users in our sample made a friend request, but 63% received at least one request Users in our sample pressed the like button next to friends content an average of 14 times, but had their content liked an average of 20 times Users sent 9 personal messages, but received 12 12% of users tagged a friend in a photo, but 35% were themselves tagged in a photo Any guesses for how this pattern can be explained? http:// www.pewinternet.org/ Reports/ 2012/ Facebook-users/ Summary.aspx Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 25 / 28
Normal approximation to the binomial This study also found that approximately 25% of Facebook users are considered power users. The same study found that the average Facebook user has 245 friends. What is the probability that the average Facebook user with 245 friends has 70 or more friends who would be considered power users? We are given that n = 245, p = 0.25, and we are asked for the probability P(K 70). P(X 70) = P(K = 70 or K = 71 or K = 72 or or K = 245) = P(K = 70) + P(K = 71) + P(K = 72) + + P(K = 245) This seems like an awful lot of work... Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 26 / 28
Normal approximation to the binomial Normal approximation to the binomial When the sample size is large enough, the binomial distribution with parameters n and p can be approximated by the normal model with parameters µ = np and σ = np(1 p). In the case of the Facebook power users, n = 245 and p = 0.25. µ = 245 0.25 = 61.25 σ = 245 0.25 0.75 = 6.78 Bin(n = 245, p = 0.25) N(µ = 61.25, σ = 6.78). 0.06 0.05 Bin(245,0.25) N(61.5,6.78) 0.04 0.03 0.02 0.01 0.00 20 40 60 80 100 k Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 27 / 28
Normal approximation to the binomial Question What is the probability that the average Facebook user with 245 friends has 70 or more friends who would be considered power users? (a) 0.0251 (b) 0.0985 (c) 0.1128 (d) 0.9015 Statistics 101 (Thomas Leininger) U2 - L4: Binomial distribution May 24, 2013 28 / 28