Binomial Approximation and Joint Distributions Chris Piech CS109, Stanford University
|
|
- Susan Newman
- 5 years ago
- Views:
Transcription
1 Binomial Approximation and Joint Distributions Chris Piech CS109, Stanford University
2 Four Prototypical Trajectories Review
3 The Normal Distribution X is a Normal Random Variable: X ~ N(µ, s 2 ) Probability Density Function (PDF): 1 f ( x) = e s 2p E[X ] = µ 2 Var( X ) = s 2 2 -( x-µ ) / s Also called Gaussian Note: f(x) is symmetric about µ 2 where - < x f (x) < µ x
4 Simplicity is Humble µ Simple. Will generalize probability σ 2 value * A Gaussian maximizes entropy for a given mean and variance
5 Density vs Cumulative 1 CDF of a Normal F(x) PDF of a Normal f(x) f(x) = derivative of probability F(x) = P(X < x)
6 Probability Density Function N (µ, 2 ) exponential the distance to the mean f(x) = 1 p 2 e (x µ) probability density at x a constant sigma shows up twice
7 Cumulative Density Function N (µ, 2 ) CDF of Standard Normal: A function that has been solved for numerically F (x) = x µ The cumulative density function (CDF) of any normal Table of F(z) values in textbook, p. 201 and handout
8 Four Prototypical Trajectories Great questions!
9 Four Prototypical Trajectories 68% rule only for Gaussians?
10 68% Rule? What is the probability that a normal variable X N(µ, has a value within one standard deviation of its mean? µ µ X µ µ + µ P (µ <X<µ+ )=P < < = P ( 1 <Z<1) = (1) ( 1) = (1) [1 (1)] =2 (1) 1 = 2[0.8413] 1 = Only applies to normal 2 )
11 68% Rule? Counter example: Uniform X Uni(, ) Var(X) = ( )2 12 = p Var(X) = p P (µ <X<µ+ ) = 1 apple 2( ) p 12 = p 2 apple p 12 =0.58
12 Four Prototypical Trajectories How does python sample from a Gaussian?
13 from random import * for i in range(10): mean = 5 std = 1 sample = gauss(mean, std) print sample How does this work?
14 How Does a Computer Sample Normal? Inverse Transform Sampling 1 CDF of the Standard Normal (x)
15 How Does a Computer Sample Normal? Step 1: pick a uniform number y between 0,1-5 Inverse Transform Sampling 1 0 Step 2: Find the x such that (x) =y x = 1 (y) CDF of the Standard Normal (x) Further reading: Box Muller transform 5
16 Continuous RV Relative Probability f(x) X = time to finish pset 3 X ~ N(10, 2) Time to finish pset 3 x How much more likely are you to complete in 10 hours than in 5? P (X = 10) P (X = 5) = = = = "f(x = 10) "f(x = 5) f(x = 10) f(x = 5) 1 p 2 2 p p 4 e p 1 4 e 0 = e0 e 25 4 (10 µ)2 2 e 2 2 (5 µ)2 e 2 2 (10 10)2 4 (5 10)2 4 = 518
17 Four Prototypical Trajectories Imagine you are sitting a test
18 Website Testing 100 people are given a new website design X = # people whose time on site increases CEO will endorse new design if X 65 What is P(CEO endorses change it has no effect)? X ~ Bin(100, 0.5). Want to calculate P(X 65) Give a numerical answer X P (X 65) = (0.5) i (1 0.5) 100 i i i=65
19 Normal Approximates Binomial There is a deep reason for the Binomial/Normal similarity
20 Normal Approximates Binomial
21 Four Prototypical Trajectories Let s invent an approximation!
22 Website Testing 100 people are given a new website design X = # people whose time on site increases CEO will endorse new design if X 65 What is P(CEO endorses change it has no effect)? X ~ Bin(100, 0.5). Want to calculate P(X 65) P(X = x) What is variance? E[X] = 50 x
23 Website Testing 100 people are given a new website design X = # people whose time on site increases CEO will endorse new design if X 65 What is P(CEO endorses change it has no effect)? X ~ Bin(100, 0.5). Want to calculate P(X 65) np = 50 np( 1 p) = 25 np( 1 p) = 5 Use Normal approximation: Y ~ N(50, 25) P (Y 65) = P Y 50 5 > = P (Z >3) = 1 (3) Using Binomial: P( X ³ 65)»
24 Website Testing P(X = x) E[X] = 50 x
25 Continuity Correction If Y (normal) approximates X (binomial) P (X 65) What about 64.9? P (Y 64.5) p(x) or f(x) Bin(100, 0.5) Normal(50, 25) x
26 Continuity Correction If Y (normal) approximates X (binomial) Discrete (eg Binomial) probability question Continuous (Normal) probability question X = < Y < 6.5 X >= 6 Y > 5.5 X > 6 Y > 6.5 X < 6 Y < 5.5 X <= 6 Y < 6.5 * Note: Binomial is always defined in units of 1
27 Comparison when n = 100, p = 0.5 P(X = k) k
28 Who Gets to Approximate? X ~ Bin(n, p) Poisson approx. n large (> 20), p small (< 0.05) Normal approx. n large (> 20), p is mid-ranged np(1-p) > 10 If there is a choice, go with the normal approximation
29 Stanford Admissions Stanford accepts 2050 students this year Each accepted student has 84% chance of attending X = # students who will attend. X ~ Bin(2050, 0.84) What is P(X > 1745)? np = 1722 np(1 p) = 276 p np(1 p) = 16.6 Use Normal approximation: Y ~ N(1722, 276) P (X >1745) P (Y > ) P (Y ) = P Y > = P (Z >1.4) 0.08
30 Changes in Stanford Admissions Class of 2021 Admit Rates Lowest in University History Fewer students were admitted to the Class of 2021 than the Class of 2019, due to the increase in Stanford s yield rate which has increased over 5 percent in the past four years, according to Colleen Lim M.A. 80, Director of Undergraduate Admission. 68% 10 years ago 84% last year
31 Continuous Random Variables Uniform Random Variable X Uni(, ) All values of x between alpha and beta are equally likely. Normal Random Variable X N (µ, Aka Gaussian. Defined by mean and variance. Goldilocks distribution. 2 ) Exponential Random Variable X Exp( ) Time until an event happens. Parameterized by lambda (same as Poisson). Beta Random Variable How mysterious and curious. You must wait a few classes J.
32 Four Prototypical Trajectories Joint Distributions
33 CS109 Joint Go to this URL:
34 Four Prototypical Trajectories Events occur with other events
35 Probability Table for Discrete States all possible outcomes with several discrete variables A probability table is not parametric If #variables is > 2, you can have a probability table, but you can t draw it on a slide All values of A All values of B P(A = 1, B = 1) Here, means and Every outcome falls into a bucket
36 Discrete Joint Mass Function For two discrete random variables X and Y, the Joint Probability Mass Function is: p X Y = Marginal distributions:, ( a, b) = P( X = a, Y b) p = = = å X ( a) P( X a) px, Y ( a, y) Example: X = value of die D 1, Y = value of die D 2 y =å p b) = P( Y = b) p ( x, b) Y ( X, Y x 6 6 p X, Y (1, y) = y= 1 y= 1 = å å 1 36 P( X 1) = = 1 6
37 A Computer (or Three) In Every House Consider households in Silicon Valley A household has X Macs and Y PCs Can t have more than 3 Macs or 3 PCs Y X p Y (y) ? p X (x)
38 A Computer (or Three) In Every House Consider households in Silicon Valley A household has X Macs and Y PCs Can t have more than 3 Macs or 3 PCs Y X p Y (y) p X (x)
39 A Computer (or Three) In Every House Consider households in Silicon Valley A household has X Macs and Y PCs Can t have more than 3 Macs or 3 PCs Y X p Y (y) p X (x) Marginal distributions
40 CS109 Joint Results Go to this URL:
41 Four Prototypical Trajectories Way Back
42 Permutations How many ways are there to order n distinct objects? n!
43 Binomial How many ways are there to make an unordered selection of r objects from n objects? How many ways are there to order n objects such that: r are the same (indistinguishable) (n r) are the same (indistinguishable)? r!(n n! r)! = n r Called the binomial because of something from Algebra
44 Multinomial How many ways are there to order n objects such that: n 1 are the same (indistinguishable) n 2 are the same (indistinguishable) n r are the same (indistinguishable)? n! n 1!n 2!...n r! = n n 1,n 2,...,n r Note: Multinomial > Binomial
45 Binomial Distribution Consider n independent trials of Ber(p) rand. var. X is number of successes in n trials X is a Binomial Random Variable: X ~ Bin(n, p) Probability of exactly i successes Binomial # ways of ordering the successes ænö i n-i P( X = i) = p( i) = ç p (1 - p) i = è i ø 0,1,..., n Probability of each ordering of i successes is equal + mutually exclusive
46 Four Prototypical Trajectories End Way Back
47 The Multinomial Multinomial distribution n independent trials of experiment performed Each trial results in one of m outcomes, with respective probabilities: p 1, p 2,, p m where X i = number of trials with outcome i m å i = 1 p i = 1 P c1 c2 ( X = c1, X 2 = c2,..., X m = cm) = ç p1 p2 c1, c2,..., cm where æ n 1 ö ç è ø Joint distribution m åci = i=1 n and Multinomial # ways of ordering the successes æ ç èc, c n,..., c ö ø = c! c n!! c 1 2 m 1 2 m!... p c m m Probabilities of each ordering are equal and mutually exclusive
48 6-sided die is rolled 7 times Roll results: 1 one, 1 two, 0 three, 2 four, 0 five, 3 six This is generalization of Binomial distribution Binomial: each trial had 2 possible outcomes Multinomial: each trial has m possible outcomes !1!0!2!0!3! 7! 3) 0, 2, 0, 1, 1, ( ø ö ç è æ = ø ö ç è æ ø ö ç è æ ø ö ç è æ ø ö ç è æ ø ö ç è æ ø ö ç è æ = = = = = = = X X X X X X P Hello Die Rolls, My Old Friends
49 Probabilistic Text Analysis Ignoring order of words, what is probability of any given word you write in English? P(word = the ) > P(word = transatlantic ) P(word = Stanford ) > P(word = Cal ) Probability of each word is just multinomial distribution What about probability of those same words in someone else s writing? P(word = probability writer = you) > P(word = probability writer = non-cs109 student) After estimating P(word writer) from known writings, use Bayes Theorem to determine P(writer word) for new writings!
50 A Document is a Large Multinomial According to the Global Language Monitor there are 988,968 words in the english language used on the internet. The
51 Text is a Multinomial P Example document: Pay for Viagra with a credit-card. Viagra is great. So are credit-cards. Risk free Viagra. Click for free. n = 18 Viagra = 2 Free = 2 Risk = 1 Credit-card: 2 For = 2 Probability of seeing this document spam spam = It s a Multinomial! n! 2!2!...2! p2 viagrap 2 free...p 2 for The probability of a word in spam being viagra
52 Four Prototypical Trajectories Who wrote the federalist papers?
53
54 Old and New Analysis Authorship of Federalist Papers 85 essays advocating ratification of US constitution Written under pseudonym Publius o Really, Alexander Hamilton, James Madison and John Jay Who wrote which essays? o Analyzed probability of words in each essay versus word distributions from known writings of three authors
55 Four Prototypical Trajectories Let s write a program!
The Normal Distribution
Will Monroe CS 09 The Normal Distribution Lecture Notes # July 9, 207 Based on a chapter by Chris Piech The single most important random variable type is the normal a.k.a. Gaussian) random variable, parametrized
More information6. Continous Distributions
6. Continous Distributions Chris Piech and Mehran Sahami May 17 So far, all random variables we have seen have been discrete. In all the cases we have seen in CS19 this meant that our RVs could only take
More informationProbability Theory and Simulation Methods. April 9th, Lecture 20: Special distributions
April 9th, 2018 Lecture 20: Special distributions Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters 4, 6: Random variables Week 9 Chapter
More informationLecture 23. STAT 225 Introduction to Probability Models April 4, Whitney Huang Purdue University. Normal approximation to Binomial
Lecture 23 STAT 225 Introduction to Probability Models April 4, 2014 approximation Whitney Huang Purdue University 23.1 Agenda 1 approximation 2 approximation 23.2 Characteristics of the random variable:
More informationNormal Distribution. Notes. Normal Distribution. Standard Normal. Sums of Normal Random Variables. Normal. approximation of Binomial.
Lecture 21,22, 23 Text: A Course in Probability by Weiss 8.5 STAT 225 Introduction to Probability Models March 31, 2014 Standard Sums of Whitney Huang Purdue University 21,22, 23.1 Agenda 1 2 Standard
More informationLecture 8. The Binomial Distribution. Binomial Distribution. Binomial Distribution. Probability Distributions: Normal and Binomial
Lecture 8 The Binomial Distribution Probability Distributions: Normal and Binomial 1 2 Binomial Distribution >A binomial experiment possesses the following properties. The experiment consists of a fixed
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 10: Continuous RV Families. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 10: Continuous RV Families Prof. Vince Calhoun 1 Reading This class: Section 4.4-4.5 Next class: Section 4.6-4.7 2 Homework 3.9, 3.49, 4.5,
More information4 Random Variables and Distributions
4 Random Variables and Distributions Random variables A random variable assigns each outcome in a sample space. e.g. called a realization of that variable to Note: We ll usually denote a random variable
More informationChapter 5. Continuous Random Variables and Probability Distributions. 5.1 Continuous Random Variables
Chapter 5 Continuous Random Variables and Probability Distributions 5.1 Continuous Random Variables 1 2CHAPTER 5. CONTINUOUS RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Probability Distributions Probability
More informationIEOR 165 Lecture 1 Probability Review
IEOR 165 Lecture 1 Probability Review 1 Definitions in Probability and Their Consequences 1.1 Defining Probability A probability space (Ω, F, P) consists of three elements: A sample space Ω is the set
More informationSection 7.5 The Normal Distribution. Section 7.6 Application of the Normal Distribution
Section 7.6 Application of the Normal Distribution A random variable that may take on infinitely many values is called a continuous random variable. A continuous probability distribution is defined by
More informationCentral Limit Theorem, Joint Distributions Spring 2018
Central Limit Theorem, Joint Distributions 18.5 Spring 218.5.4.3.2.1-4 -3-2 -1 1 2 3 4 Exam next Wednesday Exam 1 on Wednesday March 7, regular room and time. Designed for 1 hour. You will have the full
More informationCommonly Used Distributions
Chapter 4: Commonly Used Distributions 1 Introduction Statistical inference involves drawing a sample from a population and analyzing the sample data to learn about the population. We often have some knowledge
More informationChapter 3 Discrete Random Variables and Probability Distributions
Chapter 3 Discrete Random Variables and Probability Distributions Part 3: Special Discrete Random Variable Distributions Section 3.5 Discrete Uniform Section 3.6 Bernoulli and Binomial Others sections
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationProbability Distributions II
Probability Distributions II Summer 2017 Summer Institutes 63 Multinomial Distribution - Motivation Suppose we modified assumption (1) of the binomial distribution to allow for more than two outcomes.
More informationUQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions.
UQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions. Random Variables 2 A random variable X is a numerical (integer, real, complex, vector etc.) summary of the outcome of the random experiment.
More informationChapter 6 Continuous Probability Distributions. Learning objectives
Chapter 6 Continuous s Slide 1 Learning objectives 1. Understand continuous probability distributions 2. Understand Uniform distribution 3. Understand Normal distribution 3.1. Understand Standard normal
More informationSimulation Wrap-up, Statistics COS 323
Simulation Wrap-up, Statistics COS 323 Today Simulation Re-cap Statistics Variance and confidence intervals for simulations Simulation wrap-up FYI: No class or office hours Thursday Simulation wrap-up
More informationRandom Variable: Definition
Random Variables Random Variable: Definition A Random Variable is a numerical description of the outcome of an experiment Experiment Roll a die 10 times Inspect a shipment of 100 parts Open a gas station
More informationChapter 3 - Lecture 5 The Binomial Probability Distribution
Chapter 3 - Lecture 5 The Binomial Probability October 12th, 2009 Experiment Examples Moments and moment generating function of a Binomial Random Variable Outline Experiment Examples A binomial experiment
More informationChapter 4 Continuous Random Variables and Probability Distributions
Chapter 4 Continuous Random Variables and Probability Distributions Part 2: More on Continuous Random Variables Section 4.5 Continuous Uniform Distribution Section 4.6 Normal Distribution 1 / 28 One more
More informationII - Probability. Counting Techniques. three rules of counting. 1multiplication rules. 2permutations. 3combinations
II - Probability Counting Techniques three rules of counting 1multiplication rules 2permutations 3combinations Section 2 - Probability (1) II - Probability Counting Techniques 1multiplication rules In
More informationProbability Theory. Probability and Statistics for Data Science CSE594 - Spring 2016
Probability Theory Probability and Statistics for Data Science CSE594 - Spring 2016 What is Probability? 2 What is Probability? Examples outcome of flipping a coin (seminal example) amount of snowfall
More informationChapter 4 Continuous Random Variables and Probability Distributions
Chapter 4 Continuous Random Variables and Probability Distributions Part 2: More on Continuous Random Variables Section 4.5 Continuous Uniform Distribution Section 4.6 Normal Distribution 1 / 27 Continuous
More informationME3620. Theory of Engineering Experimentation. Spring Chapter III. Random Variables and Probability Distributions.
ME3620 Theory of Engineering Experimentation Chapter III. Random Variables and Probability Distributions Chapter III 1 3.2 Random Variables In an experiment, a measurement is usually denoted by a variable
More informationCS 237: Probability in Computing
CS 237: Probability in Computing Wayne Snyder Computer Science Department Boston University Lecture 12: Continuous Distributions Uniform Distribution Normal Distribution (motivation) Discrete vs Continuous
More informationPROBABILITY DISTRIBUTIONS
CHAPTER 3 PROBABILITY DISTRIBUTIONS Page Contents 3.1 Introduction to Probability Distributions 51 3.2 The Normal Distribution 56 3.3 The Binomial Distribution 60 3.4 The Poisson Distribution 64 Exercise
More informationReview for Final Exam Spring 2014 Jeremy Orloff and Jonathan Bloom
Review for Final Exam 18.05 Spring 2014 Jeremy Orloff and Jonathan Bloom THANK YOU!!!! JON!! PETER!! RUTHI!! ERIKA!! ALL OF YOU!!!! Probability Counting Sets Inclusion-exclusion principle Rule of product
More information4.3 Normal distribution
43 Normal distribution Prof Tesler Math 186 Winter 216 Prof Tesler 43 Normal distribution Math 186 / Winter 216 1 / 4 Normal distribution aka Bell curve and Gaussian distribution The normal distribution
More informationINF FALL NATURAL LANGUAGE PROCESSING. Jan Tore Lønning, Lecture 3, 1.9
INF5830 015 FALL NATURAL LANGUAGE PROCESSING Jan Tore Lønning, Lecture 3, 1.9 Today: More statistics Binomial distribution Continuous random variables/distributions Normal distribution Sampling and sampling
More informationConverting to the Standard Normal rv: Exponential PDF and CDF for x 0 Chapter 7: expected value of x
Key Formula Sheet ASU ECN 22 ASWCC Chapter : no key formulas Chapter 2: Relative Frequency=freq of the class/n Approx Class Width: =(largest value-smallest value) /number of classes Chapter 3: sample and
More informationSTATISTICS and PROBABILITY
Introduction to Statistics Atatürk University STATISTICS and PROBABILITY LECTURE: PROBABILITY DISTRIBUTIONS Prof. Dr. İrfan KAYMAZ Atatürk University Engineering Faculty Department of Mechanical Engineering
More informationStatistics for Business and Economics
Statistics for Business and Economics Chapter 5 Continuous Random Variables and Probability Distributions Ch. 5-1 Probability Distributions Probability Distributions Ch. 4 Discrete Continuous Ch. 5 Probability
More informationA random variable (r. v.) is a variable whose value is a numerical outcome of a random phenomenon.
Chapter 14: random variables p394 A random variable (r. v.) is a variable whose value is a numerical outcome of a random phenomenon. Consider the experiment of tossing a coin. Define a random variable
More informationReview. Binomial random variable
Review Discrete RV s: prob y fctn: p(x) = Pr(X = x) cdf: F(x) = Pr(X x) E(X) = x x p(x) SD(X) = E { (X - E X) 2 } Binomial(n,p): no. successes in n indep. trials where Pr(success) = p in each trial If
More informationSession Window. Variable Name Row. Worksheet Window. Double click on MINITAB icon. You will see a split screen: Getting Started with MINITAB
STARTING MINITAB: Double click on MINITAB icon. You will see a split screen: Session Window Worksheet Window Variable Name Row ACTIVE WINDOW = BLUE INACTIVE WINDOW = GRAY f(x) F(x) Getting Started with
More informationChapter 8: The Binomial and Geometric Distributions
Chapter 8: The Binomial and Geometric Distributions 8.1 Binomial Distributions 8.2 Geometric Distributions 1 Let me begin with an example My best friends from Kent School had three daughters. What is the
More information15.063: Communicating with Data Summer Recitation 4 Probability III
15.063: Communicating with Data Summer 2003 Recitation 4 Probability III Today s Content Normal RV Central Limit Theorem (CLT) Statistical Sampling 15.063, Summer '03 2 Normal Distribution Any normal RV
More informationRandom Variables Handout. Xavier Vilà
Random Variables Handout Xavier Vilà Course 2004-2005 1 Discrete Random Variables. 1.1 Introduction 1.1.1 Definition of Random Variable A random variable X is a function that maps each possible outcome
More informationSampling Distribution
MAT 2379 (Spring 2012) Sampling Distribution Definition : Let X 1,..., X n be a collection of random variables. We say that they are identically distributed if they have a common distribution. Definition
More information2017 Fall QMS102 Tip Sheet 2
Chapter 5: Basic Probability 2017 Fall QMS102 Tip Sheet 2 (Covering Chapters 5 to 8) EVENTS -- Each possible outcome of a variable is an event, including 3 types. 1. Simple event = Described by a single
More informationStatistics & Flood Frequency Chapter 3. Dr. Philip B. Bedient
Statistics & Flood Frequency Chapter 3 Dr. Philip B. Bedient Predicting FLOODS Flood Frequency Analysis n Statistical Methods to evaluate probability exceeding a particular outcome - P (X >20,000 cfs)
More information15.063: Communicating with Data Summer Recitation 3 Probability II
15.063: Communicating with Data Summer 2003 Recitation 3 Probability II Today s Goal Binomial Random Variables (RV) Covariance and Correlation Sums of RV Normal RV 15.063, Summer '03 2 Random Variables
More informationLecture III. 1. common parametric models 2. model fitting 2a. moment matching 2b. maximum likelihood 3. hypothesis testing 3a. p-values 3b.
Lecture III 1. common parametric models 2. model fitting 2a. moment matching 2b. maximum likelihood 3. hypothesis testing 3a. p-values 3b. simulation Parameters Parameters are knobs that control the amount
More informationWelcome to Stat 410!
Welcome to Stat 410! Personnel Instructor: Liang, Feng TA: Gan, Gary (Lingrui) Instructors/TAs from two other sessions Websites: Piazza and Compass Homework When, where and how to submit your homework
More informationMAS187/AEF258. University of Newcastle upon Tyne
MAS187/AEF258 University of Newcastle upon Tyne 2005-6 Contents 1 Collecting and Presenting Data 5 1.1 Introduction...................................... 5 1.1.1 Examples...................................
More informationSTA258H5. Al Nosedal and Alison Weir. Winter Al Nosedal and Alison Weir STA258H5 Winter / 41
STA258H5 Al Nosedal and Alison Weir Winter 2017 Al Nosedal and Alison Weir STA258H5 Winter 2017 1 / 41 NORMAL APPROXIMATION TO THE BINOMIAL DISTRIBUTION. Al Nosedal and Alison Weir STA258H5 Winter 2017
More informationEngineering Statistics ECIV 2305
Engineering Statistics ECIV 2305 Section 5.3 Approximating Distributions with the Normal Distribution Introduction A very useful property of the normal distribution is that it provides good approximations
More informationVersion A. Problem 1. Let X be the continuous random variable defined by the following pdf: 1 x/2 when 0 x 2, f(x) = 0 otherwise.
Math 224 Q Exam 3A Fall 217 Tues Dec 12 Version A Problem 1. Let X be the continuous random variable defined by the following pdf: { 1 x/2 when x 2, f(x) otherwise. (a) Compute the mean µ E[X]. E[X] x
More information. (i) What is the probability that X is at most 8.75? =.875
Worksheet 1 Prep-Work (Distributions) 1)Let X be the random variable whose c.d.f. is given below. F X 0 0.3 ( x) 0.5 0.8 1.0 if if if if if x 5 5 x 10 10 x 15 15 x 0 0 x Compute the mean, X. (Hint: First
More informationNormal distribution Approximating binomial distribution by normal 2.10 Central Limit Theorem
1.1.2 Normal distribution 1.1.3 Approimating binomial distribution by normal 2.1 Central Limit Theorem Prof. Tesler Math 283 Fall 216 Prof. Tesler 1.1.2-3, 2.1 Normal distribution Math 283 / Fall 216 1
More informationEcon 250 Fall Due at November 16. Assignment 2: Binomial Distribution, Continuous Random Variables and Sampling
Econ 250 Fall 2010 Due at November 16 Assignment 2: Binomial Distribution, Continuous Random Variables and Sampling 1. Suppose a firm wishes to raise funds and there are a large number of independent financial
More informationINF FALL NATURAL LANGUAGE PROCESSING. Jan Tore Lønning, Lecture 3, 1.9
1 INF5830 2015 FALL NATURAL LANGUAGE PROCESSING Jan Tore Lønning, Lecture 3, 1.9 Today: More statistics 2 Recap Probability distributions Categorical distributions Bernoulli trial Binomial distribution
More informationA random variable (r. v.) is a variable whose value is a numerical outcome of a random phenomenon.
Chapter 14: random variables p394 A random variable (r. v.) is a variable whose value is a numerical outcome of a random phenomenon. Consider the experiment of tossing a coin. Define a random variable
More informationWhat was in the last lecture?
What was in the last lecture? Normal distribution A continuous rv with bell-shaped density curve The pdf is given by f(x) = 1 2πσ e (x µ)2 2σ 2, < x < If X N(µ, σ 2 ), E(X) = µ and V (X) = σ 2 Standard
More informationProbability Distributions for Discrete RV
Probability Distributions for Discrete RV Probability Distributions for Discrete RV Definition The probability distribution or probability mass function (pmf) of a discrete rv is defined for every number
More informationSampling & populations
Sampling & populations Sample proportions Sampling distribution - small populations Sampling distribution - large populations Sampling distribution - normal distribution approximation Mean & variance of
More informationChapter 4: Commonly Used Distributions. Statistics for Engineers and Scientists Fourth Edition William Navidi
Chapter 4: Commonly Used Distributions Statistics for Engineers and Scientists Fourth Edition William Navidi 2014 by Education. This is proprietary material solely for authorized instructor use. Not authorized
More informationStandard Normal, Inverse Normal and Sampling Distributions
Standard Normal, Inverse Normal and Sampling Distributions Section 5.5 & 6.6 Cathy Poliak, Ph.D. cathy@math.uh.edu Office in Fleming 11c Department of Mathematics University of Houston Lecture 9-3339 Cathy
More informationModule 4: Probability
Module 4: Probability 1 / 22 Probability concepts in statistical inference Probability is a way of quantifying uncertainty associated with random events and is the basis for statistical inference. Inference
More informationINDIAN INSTITUTE OF SCIENCE STOCHASTIC HYDROLOGY. Lecture -5 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc.
INDIAN INSTITUTE OF SCIENCE STOCHASTIC HYDROLOGY Lecture -5 Course Instructor : Prof. P. P. MUJUMDAR Department of Civil Engg., IISc. Summary of the previous lecture Moments of a distribubon Measures of
More information4.2 Bernoulli Trials and Binomial Distributions
Arkansas Tech University MATH 3513: Applied Statistics I Dr. Marcel B. Finan 4.2 Bernoulli Trials and Binomial Distributions A Bernoulli trial 1 is an experiment with exactly two outcomes: Success and
More informationCH 5 Normal Probability Distributions Properties of the Normal Distribution
Properties of the Normal Distribution Example A friend that is always late. Let X represent the amount of minutes that pass from the moment you are suppose to meet your friend until the moment your friend
More informationLecture 2. Probability Distributions Theophanis Tsandilas
Lecture 2 Probability Distributions Theophanis Tsandilas Comment on measures of dispersion Why do common measures of dispersion (variance and standard deviation) use sums of squares: nx (x i ˆµ) 2 i=1
More informationIntroduction to Statistics I
Introduction to Statistics I Keio University, Faculty of Economics Continuous random variables Simon Clinet (Keio University) Intro to Stats November 1, 2018 1 / 18 Definition (Continuous random variable)
More informationLecture Notes 6. Assume F belongs to a family of distributions, (e.g. F is Normal), indexed by some parameter θ.
Sufficient Statistics Lecture Notes 6 Sufficiency Data reduction in terms of a particular statistic can be thought of as a partition of the sample space X. Definition T is sufficient for θ if the conditional
More informationFavorite Distributions
Favorite Distributions Binomial, Poisson and Normal Here we consider 3 favorite distributions in statistics: Binomial, discovered by James Bernoulli in 1700 Poisson, a limiting form of the Binomial, found
More informationDepartment of Quantitative Methods & Information Systems. Business Statistics. Chapter 6 Normal Probability Distribution QMIS 120. Dr.
Department of Quantitative Methods & Information Systems Business Statistics Chapter 6 Normal Probability Distribution QMIS 120 Dr. Mohammad Zainal Chapter Goals After completing this chapter, you should
More informationChapter 5: Probability models
Chapter 5: Probability models 1. Random variables: a) Idea. b) Discrete and continuous variables. c) The probability function (density) and the distribution function. d) Mean and variance of a random variable.
More informationDiscrete Probability Distributions and application in Business
http://wiki.stat.ucla.edu/socr/index.php/socr_courses_2008_thomson_econ261 Discrete Probability Distributions and application in Business By Grace Thomson DISCRETE PROBALITY DISTRIBUTIONS Discrete Probabilities
More informationSTAT Chapter 7: Central Limit Theorem
STAT 251 - Chapter 7: Central Limit Theorem In this chapter we will introduce the most important theorem in statistics; the central limit theorem. What have we seen so far? First, we saw that for an i.i.d
More informationBusiness Statistics 41000: Probability 3
Business Statistics 41000: Probability 3 Drew D. Creal University of Chicago, Booth School of Business February 7 and 8, 2014 1 Class information Drew D. Creal Email: dcreal@chicagobooth.edu Office: 404
More informationCHAPTER 6 Random Variables
CHAPTER 6 Random Variables 6.3 Binomial and Geometric Random Variables The Practice of Statistics, 5th Edition Starnes, Tabor, Yates, Moore Bedford Freeman Worth Publishers Binomial and Geometric Random
More informationUseful Probability Distributions
Useful Probability Distributions Standard Normal Distribution Binomial Multinomial Hypergeometric Poisson Beta Binomial Student s t Beta Gamma Dirichlet Multivariate Normal and Correlation Standard Normal
More informationTopic 6 - Continuous Distributions I. Discrete RVs. Probability Density. Continuous RVs. Background Reading. Recall the discrete distributions
Topic 6 - Continuous Distributions I Discrete RVs Recall the discrete distributions STAT 511 Professor Bruce Craig Binomial - X= number of successes (x =, 1,...,n) Geometric - X= number of trials (x =,...)
More informationReview of the Topics for Midterm I
Review of the Topics for Midterm I STA 100 Lecture 9 I. Introduction The objective of statistics is to make inferences about a population based on information contained in a sample. A population is the
More informationObjective: To understand similarities and differences between geometric and binomial scenarios and to solve problems related to these scenarios.
AP Statistics: Geometric and Binomial Scenarios Objective: To understand similarities and differences between geometric and binomial scenarios and to solve problems related to these scenarios. Everything
More information4-1. Chapter 4. Commonly Used Distributions by The McGraw-Hill Companies, Inc. All rights reserved.
4-1 Chapter 4 Commonly Used Distributions 2014 by The Companies, Inc. All rights reserved. Section 4.1: The Bernoulli Distribution 4-2 We use the Bernoulli distribution when we have an experiment which
More informationThe Bernoulli distribution
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike License. Your use of this material constitutes acceptance of that license and the conditions of use of materials on this
More informationSTAT 830 Convergence in Distribution
STAT 830 Convergence in Distribution Richard Lockhart Simon Fraser University STAT 830 Fall 2013 Richard Lockhart (Simon Fraser University) STAT 830 Convergence in Distribution STAT 830 Fall 2013 1 / 31
More informationStatistical Models of Word Frequency and Other Count Data
Statistical Models of Word Frequency and Other Count Data Martin Jansche 2004-02-12 Motivation Item counts are commonly used in NLP as independent variables in many applications: information retrieval,
More information5. In fact, any function of a random variable is also a random variable
Random Variables - Class 11 October 14, 2012 Debdeep Pati 1 Random variables 1.1 Expectation of a function of a random variable 1. Expectation of a function of a random variable 2. We know E(X) = x xp(x)
More informationRandom Variables and Probability Functions
University of Central Arkansas Random Variables and Probability Functions Directory Table of Contents. Begin Article. Stephen R. Addison Copyright c 001 saddison@mailaps.org Last Revision Date: February
More informationTOPIC: PROBABILITY DISTRIBUTIONS
TOPIC: PROBABILITY DISTRIBUTIONS There are two types of random variables: A Discrete random variable can take on only specified, distinct values. A Continuous random variable can take on any value within
More informationProbability and Random Variables A FINANCIAL TIMES COMPANY
Probability Basics Probability and Random Variables A FINANCIAL TIMES COMPANY 2 Probability Probability of union P[A [ B] =P[A]+P[B] P[A \ B] Conditional Probability A B P[A B] = Bayes Theorem P[A \ B]
More informationBinomial Distributions
Binomial Distributions (aka Bernouli s Trials) Chapter 8 Binomial Distribution an important class of probability distributions, which occur under the following Binomial Setting (1) There is a number n
More informationDefinition 9.1 A point estimate is any function T (X 1,..., X n ) of a random sample. We often write an estimator of the parameter θ as ˆθ.
9 Point estimation 9.1 Rationale behind point estimation When sampling from a population described by a pdf f(x θ) or probability function P [X = x θ] knowledge of θ gives knowledge of the entire population.
More information4-2 Probability Distributions and Probability Density Functions. Figure 4-2 Probability determined from the area under f(x).
4-2 Probability Distributions and Probability Density Functions Figure 4-2 Probability determined from the area under f(x). 4-2 Probability Distributions and Probability Density Functions Definition 4-2
More informationWeek 7. Texas A& M University. Department of Mathematics Texas A& M University, College Station Section 3.2, 3.3 and 3.4
Week 7 Oğuz Gezmiş Texas A& M University Department of Mathematics Texas A& M University, College Station Section 3.2, 3.3 and 3.4 Oğuz Gezmiş (TAMU) Topics in Contemporary Mathematics II Week7 1 / 19
More informationProbability is the tool used for anticipating what the distribution of data should look like under a given model.
AP Statistics NAME: Exam Review: Strand 3: Anticipating Patterns Date: Block: III. Anticipating Patterns: Exploring random phenomena using probability and simulation (20%-30%) Probability is the tool used
More informationProbability Theory. Mohamed I. Riffi. Islamic University of Gaza
Probability Theory Mohamed I. Riffi Islamic University of Gaza Table of contents 1. Chapter 2 Discrete Distributions The binomial distribution 1 Chapter 2 Discrete Distributions Bernoulli trials and the
More informationChapter 4 Probability Distributions
Slide 1 Chapter 4 Probability Distributions Slide 2 4-1 Overview 4-2 Random Variables 4-3 Binomial Probability Distributions 4-4 Mean, Variance, and Standard Deviation for the Binomial Distribution 4-5
More informationProbability. An intro for calculus students P= Figure 1: A normal integral
Probability An intro for calculus students.8.6.4.2 P=.87 2 3 4 Figure : A normal integral Suppose we flip a coin 2 times; what is the probability that we get more than 2 heads? Suppose we roll a six-sided
More informationThe binomial distribution p314
The binomial distribution p314 Example: A biased coin (P(H) = p = 0.6) ) is tossed 5 times. Let X be the number of H s. Fine P(X = 2). This X is a binomial r. v. The binomial setting p314 1. There are
More information7. The random variable X is the number of cars entering the campus from 1 to 1:05 A.M. Assign probabilities according to the formula:
Operations Research Models and Methods Paul A. Jensen and Jonathan F. Bard Probability Models.S5 Exercises 1. From the daily newspaper identify five quantities that are variable in time and uncertain for
More informationIntroduction to Business Statistics QM 120 Chapter 6
DEPARTMENT OF QUANTITATIVE METHODS & INFORMATION SYSTEMS Introduction to Business Statistics QM 120 Chapter 6 Spring 2008 Chapter 6: Continuous Probability Distribution 2 When a RV x is discrete, we can
More informationContinuous Probability Distributions & Normal Distribution
Mathematical Methods Units 3/4 Student Learning Plan Continuous Probability Distributions & Normal Distribution 7 lessons Notes: Students need practice in recognising whether a problem involves a discrete
More informationMarch 21, Fractal Friday: Sign up & pay now!
Welcome to the Fourth Quarter. We did Discrete Random Variables at the start of HL1 (1516) Q4 We did Continuous RVs at the end of HL2 (1617) Q3 and start of Q4 7½ weeks plus finals Three Units: Discrete
More informationStatistical Methods in Practice STAT/MATH 3379
Statistical Methods in Practice STAT/MATH 3379 Dr. A. B. W. Manage Associate Professor of Mathematics & Statistics Department of Mathematics & Statistics Sam Houston State University Overview 6.1 Discrete
More information