CS134: Networks Spring Random Variables and Independence. 1.2 Probability Distribution Function (PDF) Number of heads Probability 2 0.
|
|
- Conrad Little
- 5 years ago
- Views:
Transcription
1 CS134: Networks Spring 2017 Prof. Yaron Singer Section 0 1 Probability 1.1 Random Variables and Independence A real-valued random variable is a variable that can take each of a set of possible values in R with a certain probability. Two random variables, X and Y are said to be independent if P (X = x Y = y) = P (X = x) for all values x of X and y of Y. 1.2 Probability Distribution Function (PDF) The probability distribution of a real-valued random variable X species the probability that X takes each of its possible values. For example, suppose you ip a coin two times. This simple statistical experiment can have four possible outcomes: HH, HT, TH, and TT. Now, let the variable X represent the number of Heads that result from this experiment. X is a random variable that can take the values 0, 1, and 2. The table below, which associates each outcome with its probability, is the probability distribution of the discrete random variable X: Number of heads Probability Cumulative Probability Distributions (CDF) The cumulative probability distribution of a real-valued random variable X species, for each of the possible values x that X can take, the probability that X takes a value equal to or smaller than x. Let us return to the coin ip experiment. If we ip a coin two times, we might ask: What is the probability that the coin ips would result in one or fewer heads? It would be the probability that the coin ip experiment results in zero heads plus the probability that the experiment results in one head. P (X 1) = P (X = 0) + P (X = 1) = =
2 The table below gives the cumulative probability distribution of the discrete random variable X: Number of heads ProbabilityP (X = x) Cumulative ProbabilityP (X < x) Sanity Test: Are PDF's guaranteed to be non-decreasing? What about CDF's? Solution: PDF's are not guaranteed to be non-decreasing (for example, the PDF for any normal distribution is not non-decreasing). In contrast, CDF's are always non-decreasing The Mean of a Discrete Random Variable The mean or expectation of a real-valued random variable X is a weighted average of the possible values that the random variable can take. For example, if the random variable X can take values in a nite 2 set A R, its mean E(X) is dened by E(X) := x AP (x)x Unlike the sample mean of a group of observations, which gives each observation equal weight, the mean of a random variable weights each outcome x according to its probability, P (x). The mean of a random variable provides the long-run average of the variable, or the expected average outcome over many observations. For example, suppose an individual plays a gambling game where it is possible to lose $1, break even, win $3 or win $10 each time she plays. Let Y be the random variable that takes the value y { 1, 0, 3, 5} when the outcome of the gamble is y. The probability distribution of Y is provided by the following table: Calculate the expectation of Y. y P robability Solution: The mean of the random variable Y can be calculated as follows: µ(y ) = ( 1.3) + (0.4) + (3.2) + (5.1) = = To see this, consider that the CDF is a sum (or integral) over an interval of the PDF; specically, for a discrete random variable dened over (a, b), P (X x) = x P (X = x) and for a continuous random variable, P (X x) = i=a x f(x) where f(x) is the PDF of X. PDFs are nonnegative, so x1 < x2 implies P (X x1) P (X x2), since f(x 2) = P (X = x 2) 0; therefore, CDFs are non-decreasing. 2 If A is innite, we replace sums for integrals. 2
3 In the long run, then, the player can expect to win about 80 cents playing this game the odds are in her favor. Properties of Expectation For any two random variables X and Y, E(X + Y ) = E(X) + E(Y ). For two independent random variables X and Y, E(XY ) = E(X)E(Y ). 1.5 The Variance of a Discrete Random Variable The variance of a real-valued random variable X measures the spread, or variability, of the distribution of X. For example, suppose X can take values in a nite 3 set A R. Then the variance Var(X) of X is dened by Var(X) := x A P (x)(x E(X)) 2 For example, in the gambling game above, the variance of the random variable Y may be calculated as follows: Var(Y ) = ( 1 0.8) (0 0.8) (3 0.8) (5 0.8) = ( 1.8) ( 0.8) (2.2) (4.2) = = = Hence, the variance and standard deviation of Y are 3.96 and 3.96 = 1.99 respectively. Unlike the sample variance of a group of observations, which gives each observation equal weight, the variance of a random variable weighs each outcome x according to its probability, P (x). The standard deviation of the random variable X is the square root of its variance and is sometimes denoted by σ. Note that standard deviation has a more natural interpretation than variance. This is because variance is measured in squared units, whereas standard deviation is in the same units as those in which the random variable itself is measured. Properties of Variance For independent random variables X and Y : Var(X) 0 Var(X) = E(X 2 ) E(X) 2 Var(X + Y ) = Var(X Y ) = Var(X) + Var(Y ) 3 If A is innite, we replace sums for integrals. 3
4 2 Examples of Common Probability Distributions 2.1 Uniform Probability Distribution The simplest probability distribution occurs when all of the values of a random variable occur with equal probability. This probability distribution is called the uniform distribution. For example, suppose that a fair die is tossed. Let X be the random variable that takes the value x when the die lands on x, for x {1, 2, 3, 4, 5, 6}. Since the probability that a fair die lands on each the possible numbers is the same, the random variable X has a uniform distribution. 2.2 Binomial Distribution A Bernoulli trial is a random experiment with exactly two possible outcomes, "success" and "failure", in which the probability of success p is the same every time the experiment is conducted. Closely related to a Bernoulli trial is a binomial experiment, which consists of a xed number of statistically independent Bernoulli trials, each with a probability of success p, and counts the number of successes. A random variable corresponding to a binomial experiment with n Bernoulli trials is denoted by B(n, p), and is said to have a binomial distribution. The probability of exactly k successes in the binomial experiment is given by: ( ) n P (X = k) = p k (1 p) n k k where ( ) n k := n! (n k)!k!, which reads n choose k, is the number of dierent sets of k elements we can choose out of a set of n elements. For example, suppose we create edges between each pair of a set nodes of nodes {a, b, c, d} with probability p. The random variable number of edges in the network is distributed according to a binomial distribution B(n, p) Poisson Distribution The random variable X has a Poisson distribution with parameter λ > 0 if, for k = 0, 1, 2,... : P (X = k) = λk e λ The positive real number λ is equal to the mean and variance of the random variable X. That is, µ(x) = λ and Var(X) = λ. The Poisson distribution can be derived as a limiting case of the binomial distribution as the number of trials goes to innity and the expected number of successes remains xed. Therefore it can be used as an approximation to the binomial distribution if n is suciently large and p is suciently small. There is a rule of thumb stating that the Poisson distribution with λ = np is a good approximation of the binomial distribution B(n, p) if n is at least 20 and p is smaller than or equal to 0.05, and an excellent approximation if n is at least 100 and np is smaller than 10. k! 4
5 Figure 1: graph A a c e b d f a Figure 2: Graphgraph B c e g i k b d f h j l 3 The Exponential and Logarithm Functions The exponential function e x can be dened in various ways that provide useful formulas. Fixing x R, ( lim 1 + x ) n = e x n n The identity above will frequently prove useful in the analysis of networks. When you see an expression like ( 1 + n) x n, remember that you can approximate this expression by e x when n is large. Another denition of e x is given by e x = k=0 The logarithm function log(x) is the inverse of the exponential function e x. That is, for all x we have log(e x ) = x and for all x > 0 we have e log(x) = x. x k k! 4 Graph Theory 4.1 Graph representations. (Jackson and 2.1.2) A graph G = (V, E) is a set of nodes V and a set of node pairs E, called edges. An undirected graph is a graph in which the existence of an edge from a node u to a node v implies the existence of an edge from v to u. A directed graph is a graph in which the existence of an edge from u to v does not necessarily imply the existence of an edge from v to u. Unless stated otherwise, assume the graph is undirected. There are three ways to represent a graph: Picture: A graph can be represented via a picture. For example, Figures 1 and 2 represent 5
6 two dierent graphs 4. Adjacency matrix: A graph can be represented by listing its nodes {1, 2,..., n} and a realvalued n n matrix g, where g ij equals 1 if there is an edge between i and j and equals 0 otherwise 5. For example, graph A in Figure 1 can be represented by listing its nodes {a, b, c, d, e, f} and the adjacency matrix: List of nodes and edges: A graph can be represented by listing its nodes and edges. example, graph A can be represented as a list: 6 For ({a, b, c, d, e, f}, {ac, bd, de, df, ef}) Exercises a. Represent graph B in Figure 2 via its adjacency matrix and via the list of its nodes and edges. b. Graph C has nodes {1, 2, 3, 4, 5, 6} and the adjacency matrix: Represent graph C via a picture and via the list of its nodes and edges 7. c. The representation of graph D in terms of a list of its nodes and edges is: ({a, b, c, d}, {ab, ac, ad, bc, bd, cd}) Represent graph D via a picture and via its adjacency matrix. Solution: 4 Figures are located in the last page of this document. 5 A weighted graph is one whose adjacency matrix contains numbers other than 0 and 1, but for now we will focus on unweighted graphs. 6 Convention: for any objects x1, x 2,..., x n, we denote by {x 1, x 2,..., x n} the set that contains the elements x 1, x 2,..., x n and we denote by (x 1, x 2,..., x n) the ordered set (or list) that contains x 1 as its rst element, x 2 as its second element, and x i as its ith element. The distinction is important. For example, we have {x 1, x 2} = {x 2, x 1}, but in general (x 1, x 2) (x 2, x 1). 7 This type of graph is sometimes called star graph. 6
7 3 4 5 Figure 3: Network C c d Figure 4: Network D a b a. Adjacency matrix: List of nodes and edges: ({a, b, c, d, e, f, g, h, i, j, k, l}, {ab, ac, ad, bc, bc, cd, ef, eg, fh, gh, hj, ik, il, jl, lk}) b. Picture: See Figure 3. List of nodes and edges: c. Picture: See Figure 4. Adjacency matrix: ({1, 2, 3, 4, 5, 6}, {12, 13, 14, 15, 16}) Subgraphs. A subgraph of a given graph G is a graph that can be obtained from G by deleting some of its nodes and edges. For example, the graph ({a, c}, {ac}) is a subgraph of graph A, but the graph 7
8 ({a, b, c}, {bc}) is not. Represent a subgraph of graph B via a picture, via its adjacency matrix, and via the list of its nodes and edges. 4.3 Paths and Cycles (Jackson 2.1.3) A walk in a graph G between nodes i and j is a sequence of edges in G, say (i 1 i 2, i 2 i 3,..., i k 1 i k ), with i 1 = i and i k = j. A path in a graph G between nodes i and j is a sequence of edges in G, say (i 1 i 2, i 2 i 3,..., i k 1 i k ), with i 1 = i and i k = j, and such that each node in the sequence (i 1, i 2,..., i k ) is distinct. A cycle is a walk that starts and ends at the same node, with no node appearing more than once except the starting node, which also appears as the ending node. For example, (uv, vw, wu) is a cycle in graph A. A geodesic between two nodes is a shortest path between them; that is, a path with no more edges than any other path between these nodes. For example, in graph A, (df) is a geodesic between nodes d and f, but (de, ef) is not. 4.4 Components and Connected Subgraphs. (Jackson 2.1.5) A graph is connected if every two nodes are connected by some path. For example, graph A is not connected, but its subgraph ({b, d, e, f}, {bd, df, de, ef}) is connected. A graph is completely connected if it is has an edge between every two nodes. A component C of graph G is a (nonempty) subgraph that (i) is connected and that (ii) is maximal i.e. it is such that all other connected subgraphs of G with some node in common with C are subgraphs of C. 8 For example, both ({a, c}, {ac}) and ({b, d, e, f}, {bd, de, df, ef}) are components of graph A, but ({d, e, f}, {de, df, ef}) is not, since it is a subgraph of the component ({b, d, e, f}, {bd, df, de, ef}) and hence not maximal. a. Write down all the components of graph B via a list of their nodes and edges. Solution: a. and ({a, b, c, d}, {ab, ac, ad, bc, bd, cd}) ({e, f, g, h, i, j, k, l}, {ef, eg, fh, gh, hj, ik, il, jl, kl}) 8 Intuitively, a component is a piece of the graph not connected to anything else. 8
9 4.5 Neighborhood. (Jackson 2.1.7) The neighborhood of a node i is the set of nodes that i is linked to. For example, the neighborhood of the node f in the graph A is {d, e}. Given a set of nodes S, the neighborhood of S is the union of the neighborhoods of all of its members that is, the set of nodes that have at least one edge to some node in S. For example, the neighborhood of the nodes {a, b} in graph A is {c, d}. a. What is the neighborhood of node d in graph B? b. What is the neighborhood of the set of nodes {e, g} in graph B? Solution: a. {a, b, c} b. {e, g, f, h}. Note that {e, g} is a subset of the neighborhood of {e, g} since e neighbors g and vice versa. 4.6 Degree and Graph Density. (Jackson 2.1.8) The degree of a node is the number of links that involve that node. For example, the degree of the nodes a and d in graph A are 1 and 3 respectively. In graph B: a. What is the degree of node a? b. What is the average degree of all the nodes in the graph? c. What is the average degree of node a's neighbors? Solution: a. 3 b. In alphabetical order, each nodes degree is 3,3,3,3,2,2,2,3,2,2,2,3. The average degree is then 2.5. c. The average degree of a's neighbors is 3. 5 Big-O Notation 5.1 Formal Denition Big-O notation is mathematical notation used to describe the behavior of a function as their arguments approach innity. Formally, O( ) is dened as follows: f(x) = O(g(x)) as x if there 9
10 exists a positive constant M such that for all x x, f(x) M g(x). Using this denition, we can see that two linear functions, e.g. f(x) = 5x and g(x) = x, follow the relationship f(x) = O(x) because for M = 5 the denition holds. In fact, for any monomial f(x) = ax b (x 7, 6x, 9, etc.), f(x) = O(x b ). It is useful to think of O( ) as an inequality, i.e. g(x) upper bounds f(x): f(x) " " g(x) in the limit. Then we denote " " with Ω: f(x) = Ω(g(x)) if there exists a positive constant M such that for all x x, f(x) M g(x). For strict inequalities, We say that f(x) = o(g(x)) (small o) if f(x) < M g(x) for x x and similarly for ω. Finally, we say that f(x) = Θ(g(x)) if f(x) = O(g(x)) and f(x) = Ω(g(x)), which can be thought of as "equality". 5.2 In Practice In practice, it is cumbersome to deal with the denition of big-o notation, so we employ a number of rules to simplify our analysis: if f(x) is a sum of terms, we only need to consider the term with the largest growth rate. For polynomials, this means only considering the term with the highest exponent. if f(x) is a product of terms, we can ignore multiplicative constants 5.3 The Growth of Some One-Variable Functions Given two increasing functions, f, g : R R we are interested in answering the question of which of the two functions is larger for large x. Here we will provide some illustrations using the functions x (yellow), x + 5 (magenta), x 5 (cyan), x 5 (red), e x (green), log(x) (blue) and x (black). 10
11 Figure 5: Figure 6: 11
12 Figure 7: Figure 8: 12
13 Figure 9: 13
5. In fact, any function of a random variable is also a random variable
Random Variables - Class 11 October 14, 2012 Debdeep Pati 1 Random variables 1.1 Expectation of a function of a random variable 1. Expectation of a function of a random variable 2. We know E(X) = x xp(x)
More informationChapter 3 - Lecture 5 The Binomial Probability Distribution
Chapter 3 - Lecture 5 The Binomial Probability October 12th, 2009 Experiment Examples Moments and moment generating function of a Binomial Random Variable Outline Experiment Examples A binomial experiment
More informationMA : Introductory Probability
MA 320-001: Introductory Probability David Murrugarra Department of Mathematics, University of Kentucky http://www.math.uky.edu/~dmu228/ma320/ Spring 2017 David Murrugarra (University of Kentucky) MA 320:
More informationVersion A. Problem 1. Let X be the continuous random variable defined by the following pdf: 1 x/2 when 0 x 2, f(x) = 0 otherwise.
Math 224 Q Exam 3A Fall 217 Tues Dec 12 Version A Problem 1. Let X be the continuous random variable defined by the following pdf: { 1 x/2 when x 2, f(x) otherwise. (a) Compute the mean µ E[X]. E[X] x
More informationIEOR 165 Lecture 1 Probability Review
IEOR 165 Lecture 1 Probability Review 1 Definitions in Probability and Their Consequences 1.1 Defining Probability A probability space (Ω, F, P) consists of three elements: A sample space Ω is the set
More informationRandom Variables Handout. Xavier Vilà
Random Variables Handout Xavier Vilà Course 2004-2005 1 Discrete Random Variables. 1.1 Introduction 1.1.1 Definition of Random Variable A random variable X is a function that maps each possible outcome
More informationSTOR Lecture 7. Random Variables - I
STOR 435.001 Lecture 7 Random Variables - I Shankar Bhamidi UNC Chapel Hill 1 / 31 Example 1a: Suppose that our experiment consists of tossing 3 fair coins. Let Y denote the number of heads that appear.
More informationDiscrete Random Variables and Probability Distributions. Stat 4570/5570 Based on Devore s book (Ed 8)
3 Discrete Random Variables and Probability Distributions Stat 4570/5570 Based on Devore s book (Ed 8) Random Variables We can associate each single outcome of an experiment with a real number: We refer
More informationSimple Random Sample
Simple Random Sample A simple random sample (SRS) of size n consists of n elements from the population chosen in such a way that every set of n elements has an equal chance to be the sample actually selected.
More informationChapter 5 Discrete Probability Distributions. Random Variables Discrete Probability Distributions Expected Value and Variance
Chapter 5 Discrete Probability Distributions Random Variables Discrete Probability Distributions Expected Value and Variance.40.30.20.10 0 1 2 3 4 Random Variables A random variable is a numerical description
More informationBinomial Random Variables. Binomial Random Variables
Bernoulli Trials Definition A Bernoulli trial is a random experiment in which there are only two possible outcomes - success and failure. 1 Tossing a coin and considering heads as success and tails as
More informationBinomial Distributions
Binomial Distributions (aka Bernouli s Trials) Chapter 8 Binomial Distribution an important class of probability distributions, which occur under the following Binomial Setting (1) There is a number n
More informationSTA 6166 Fall 2007 Web-based Course. Notes 10: Probability Models
STA 6166 Fall 2007 Web-based Course 1 Notes 10: Probability Models We first saw the normal model as a useful model for the distribution of some quantitative variables. We ve also seen that if we make a
More informationII - Probability. Counting Techniques. three rules of counting. 1multiplication rules. 2permutations. 3combinations
II - Probability Counting Techniques three rules of counting 1multiplication rules 2permutations 3combinations Section 2 - Probability (1) II - Probability Counting Techniques 1multiplication rules In
More informationPart 1 In which we meet the law of averages. The Law of Averages. The Expected Value & The Standard Error. Where Are We Going?
1 The Law of Averages The Expected Value & The Standard Error Where Are We Going? Sums of random numbers The law of averages Box models for generating random numbers Sums of draws: the Expected Value Standard
More informationReview for Final Exam Spring 2014 Jeremy Orloff and Jonathan Bloom
Review for Final Exam 18.05 Spring 2014 Jeremy Orloff and Jonathan Bloom THANK YOU!!!! JON!! PETER!! RUTHI!! ERIKA!! ALL OF YOU!!!! Probability Counting Sets Inclusion-exclusion principle Rule of product
More informationLecture 23: April 10
CS271 Randomness & Computation Spring 2018 Instructor: Alistair Sinclair Lecture 23: April 10 Disclaimer: These notes have not been subjected to the usual scrutiny accorded to formal publications. They
More informationME3620. Theory of Engineering Experimentation. Spring Chapter III. Random Variables and Probability Distributions.
ME3620 Theory of Engineering Experimentation Chapter III. Random Variables and Probability Distributions Chapter III 1 3.2 Random Variables In an experiment, a measurement is usually denoted by a variable
More informationA useful modeling tricks.
.7 Joint models for more than two outcomes We saw that we could write joint models for a pair of variables by specifying the joint probabilities over all pairs of outcomes. In principal, we could do this
More informationBusiness Statistics 41000: Probability 3
Business Statistics 41000: Probability 3 Drew D. Creal University of Chicago, Booth School of Business February 7 and 8, 2014 1 Class information Drew D. Creal Email: dcreal@chicagobooth.edu Office: 404
More informationStatistics for Business and Economics
Statistics for Business and Economics Chapter 5 Continuous Random Variables and Probability Distributions Ch. 5-1 Probability Distributions Probability Distributions Ch. 4 Discrete Continuous Ch. 5 Probability
More informationMATH/STAT 3360, Probability FALL 2012 Toby Kenney
MATH/STAT 3360, Probability FALL 2012 Toby Kenney In Class Examples () August 31, 2012 1 / 81 A statistics textbook has 8 chapters. Each chapter has 50 questions. How many questions are there in total
More informationStatistical Tables Compiled by Alan J. Terry
Statistical Tables Compiled by Alan J. Terry School of Science and Sport University of the West of Scotland Paisley, Scotland Contents Table 1: Cumulative binomial probabilities Page 1 Table 2: Cumulative
More informationEcon 6900: Statistical Problems. Instructor: Yogesh Uppal
Econ 6900: Statistical Problems Instructor: Yogesh Uppal Email: yuppal@ysu.edu Lecture Slides 4 Random Variables Probability Distributions Discrete Distributions Discrete Uniform Probability Distribution
More informationCentral Limit Theorem 11/08/2005
Central Limit Theorem 11/08/2005 A More General Central Limit Theorem Theorem. Let X 1, X 2,..., X n,... be a sequence of independent discrete random variables, and let S n = X 1 + X 2 + + X n. For each
More informationMAS187/AEF258. University of Newcastle upon Tyne
MAS187/AEF258 University of Newcastle upon Tyne 2005-6 Contents 1 Collecting and Presenting Data 5 1.1 Introduction...................................... 5 1.1.1 Examples...................................
More informationWeek 1 Quantitative Analysis of Financial Markets Basic Statistics A
Week 1 Quantitative Analysis of Financial Markets Basic Statistics A Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg : 6828 0364 : LKCSB 5036 October
More informationMS-E2114 Investment Science Exercise 10/2016, Solutions
A simple and versatile model of asset dynamics is the binomial lattice. In this model, the asset price is multiplied by either factor u (up) or d (down) in each period, according to probabilities p and
More informationTOPIC: PROBABILITY DISTRIBUTIONS
TOPIC: PROBABILITY DISTRIBUTIONS There are two types of random variables: A Discrete random variable can take on only specified, distinct values. A Continuous random variable can take on any value within
More information(Practice Version) Midterm Exam 1
EECS 126 Probability and Random Processes University of California, Berkeley: Fall 2014 Kannan Ramchandran September 19, 2014 (Practice Version) Midterm Exam 1 Last name First name SID Rules. DO NOT open
More informationStatistics 6 th Edition
Statistics 6 th Edition Chapter 5 Discrete Probability Distributions Chap 5-1 Definitions Random Variables Random Variables Discrete Random Variable Continuous Random Variable Ch. 5 Ch. 6 Chap 5-2 Discrete
More informationMAS187/AEF258. University of Newcastle upon Tyne
MAS187/AEF258 University of Newcastle upon Tyne 2005-6 Contents 1 Collecting and Presenting Data 5 1.1 Introduction...................................... 5 1.1.1 Examples...................................
More informationBasic Data Analysis. Stephen Turnbull Business Administration and Public Policy Lecture 4: May 2, Abstract
Basic Data Analysis Stephen Turnbull Business Administration and Public Policy Lecture 4: May 2, 2013 Abstract Introduct the normal distribution. Introduce basic notions of uncertainty, probability, events,
More information***SECTION 8.1*** The Binomial Distributions
***SECTION 8.1*** The Binomial Distributions CHAPTER 8 ~ The Binomial and Geometric Distributions In practice, we frequently encounter random phenomenon where there are two outcomes of interest. For example,
More informationChapter 4: Commonly Used Distributions. Statistics for Engineers and Scientists Fourth Edition William Navidi
Chapter 4: Commonly Used Distributions Statistics for Engineers and Scientists Fourth Edition William Navidi 2014 by Education. This is proprietary material solely for authorized instructor use. Not authorized
More informationChapter 2: Random Variables (Cont d)
Chapter : Random Variables (Cont d) Section.4: The Variance of a Random Variable Problem (1): Suppose that the random variable X takes the values, 1, 4, and 6 with probability values 1/, 1/6, 1/, and 1/6,
More informationPROBABILITY DISTRIBUTIONS
CHAPTER 3 PROBABILITY DISTRIBUTIONS Page Contents 3.1 Introduction to Probability Distributions 51 3.2 The Normal Distribution 56 3.3 The Binomial Distribution 60 3.4 The Poisson Distribution 64 Exercise
More informationDiscrete Random Variables
Discrete Random Variables ST 370 A random variable is a numerical value associated with the outcome of an experiment. Discrete random variable When we can enumerate the possible values of the variable
More informationDiscrete Random Variables and Probability Distributions
Chapter 4 Discrete Random Variables and Probability Distributions 4.1 Random Variables A quantity resulting from an experiment that, by chance, can assume different values. A random variable is a variable
More informationProbability Theory and Simulation Methods. April 9th, Lecture 20: Special distributions
April 9th, 2018 Lecture 20: Special distributions Week 1 Chapter 1: Axioms of probability Week 2 Chapter 3: Conditional probability and independence Week 4 Chapters 4, 6: Random variables Week 9 Chapter
More informationMathematics of Finance Final Preparation December 19. To be thoroughly prepared for the final exam, you should
Mathematics of Finance Final Preparation December 19 To be thoroughly prepared for the final exam, you should 1. know how to do the homework problems. 2. be able to provide (correct and complete!) definitions
More informationProbability. An intro for calculus students P= Figure 1: A normal integral
Probability An intro for calculus students.8.6.4.2 P=.87 2 3 4 Figure : A normal integral Suppose we flip a coin 2 times; what is the probability that we get more than 2 heads? Suppose we roll a six-sided
More informationStatistics. Marco Caserta IE University. Stats 1 / 56
Statistics Marco Caserta marco.caserta@ie.edu IE University Stats 1 / 56 1 Random variables 2 Binomial distribution 3 Poisson distribution 4 Hypergeometric Distribution 5 Jointly Distributed Discrete Random
More informationSTA 220H1F LEC0201. Week 7: More Probability: Discrete Random Variables
STA 220H1F LEC0201 Week 7: More Probability: Discrete Random Variables Recall: A sample space for a random experiment is the set of all possible outcomes of the experiment. Random Variables A random variable
More informationMath489/889 Stochastic Processes and Advanced Mathematical Finance Homework 5
Math489/889 Stochastic Processes and Advanced Mathematical Finance Homework 5 Steve Dunbar Due Fri, October 9, 7. Calculate the m.g.f. of the random variable with uniform distribution on [, ] and then
More informationStatistics for Managers Using Microsoft Excel 7 th Edition
Statistics for Managers Using Microsoft Excel 7 th Edition Chapter 5 Discrete Probability Distributions Statistics for Managers Using Microsoft Excel 7e Copyright 014 Pearson Education, Inc. Chap 5-1 Learning
More informationProbability Models.S2 Discrete Random Variables
Probability Models.S2 Discrete Random Variables Operations Research Models and Methods Paul A. Jensen and Jonathan F. Bard Results of an experiment involving uncertainty are described by one or more random
More informationProbability Distributions for Discrete RV
Probability Distributions for Discrete RV Probability Distributions for Discrete RV Definition The probability distribution or probability mass function (pmf) of a discrete rv is defined for every number
More informationCounting Basics. Venn diagrams
Counting Basics Sets Ways of specifying sets Union and intersection Universal set and complements Empty set and disjoint sets Venn diagrams Counting Inclusion-exclusion Multiplication principle Addition
More information9 Expectation and Variance
9 Expectation and Variance Two numbers are often used to summarize a probability distribution for a random variable X. The mean is a measure of the center or middle of the probability distribution, and
More informationUQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions.
UQ, STAT2201, 2017, Lectures 3 and 4 Unit 3 Probability Distributions. Random Variables 2 A random variable X is a numerical (integer, real, complex, vector etc.) summary of the outcome of the random experiment.
More information6.1 Binomial Theorem
Unit 6 Probability AFM Valentine 6.1 Binomial Theorem Objective: I will be able to read and evaluate binomial coefficients. I will be able to expand binomials using binomial theorem. Vocabulary Binomial
More informationMA 1125 Lecture 14 - Expected Values. Wednesday, October 4, Objectives: Introduce expected values.
MA 5 Lecture 4 - Expected Values Wednesday, October 4, 27 Objectives: Introduce expected values.. Means, Variances, and Standard Deviations of Probability Distributions Two classes ago, we computed the
More informationRandom Variables and Applications OPRE 6301
Random Variables and Applications OPRE 6301 Random Variables... As noted earlier, variability is omnipresent in the business world. To model variability probabilistically, we need the concept of a random
More informationP (X = x) = x=25
Chapter 2 Random variables Exercise 2. (Uniform distribution) Let X be uniformly distributed on 0,,..., 99. Calculate P(X 25). Solution of Exercise 2. : We have P(X 25) P(X 24) F (24) 25 00 3 4. Alternative
More informationCS145: Probability & Computing
CS145: Probability & Computing Lecture 8: Variance of Sums, Cumulative Distribution, Continuous Variables Instructor: Eli Upfal Brown University Computer Science Figure credits: Bertsekas & Tsitsiklis,
More informationSTAT/MATH 395 PROBABILITY II
STAT/MATH 395 PROBABILITY II Distribution of Random Samples & Limit Theorems Néhémy Lim University of Washington Winter 2017 Outline Distribution of i.i.d. Samples Convergence of random variables The Laws
More informationDiscrete Random Variables
Discrete Random Variables In this chapter, we introduce a new concept that of a random variable or RV. A random variable is a model to help us describe the state of the world around us. Roughly, a RV can
More informationModel Paper Statistics Objective. Paper Code Time Allowed: 20 minutes
Model Paper Statistics Objective Intermediate Part I (11 th Class) Examination Session 2012-2013 and onward Total marks: 17 Paper Code Time Allowed: 20 minutes Note:- You have four choices for each objective
More informationCS 237: Probability in Computing
CS 237: Probability in Computing Wayne Snyder Computer Science Department Boston University Lecture 12: Continuous Distributions Uniform Distribution Normal Distribution (motivation) Discrete vs Continuous
More informationLecture 23. STAT 225 Introduction to Probability Models April 4, Whitney Huang Purdue University. Normal approximation to Binomial
Lecture 23 STAT 225 Introduction to Probability Models April 4, 2014 approximation Whitney Huang Purdue University 23.1 Agenda 1 approximation 2 approximation 23.2 Characteristics of the random variable:
More informationIEOR 3106: Introduction to OR: Stochastic Models. Fall 2013, Professor Whitt. Class Lecture Notes: Tuesday, September 10.
IEOR 3106: Introduction to OR: Stochastic Models Fall 2013, Professor Whitt Class Lecture Notes: Tuesday, September 10. The Central Limit Theorem and Stock Prices 1. The Central Limit Theorem (CLT See
More informationWrite legibly. Unreadable answers are worthless.
MMF 2021 Final Exam 1 December 2016. This is a closed-book exam: no books, no notes, no calculators, no phones, no tablets, no computers (of any kind) allowed. Do NOT turn this page over until you are
More informationBusiness Statistics 41000: Probability 4
Business Statistics 41000: Probability 4 Drew D. Creal University of Chicago, Booth School of Business February 14 and 15, 2014 1 Class information Drew D. Creal Email: dcreal@chicagobooth.edu Office:
More informationCase Study: Heavy-Tailed Distribution and Reinsurance Rate-making
Case Study: Heavy-Tailed Distribution and Reinsurance Rate-making May 30, 2016 The purpose of this case study is to give a brief introduction to a heavy-tailed distribution and its distinct behaviors in
More informationChapter 5. Sampling Distributions
Lecture notes, Lang Wu, UBC 1 Chapter 5. Sampling Distributions 5.1. Introduction In statistical inference, we attempt to estimate an unknown population characteristic, such as the population mean, µ,
More information. (i) What is the probability that X is at most 8.75? =.875
Worksheet 1 Prep-Work (Distributions) 1)Let X be the random variable whose c.d.f. is given below. F X 0 0.3 ( x) 0.5 0.8 1.0 if if if if if x 5 5 x 10 10 x 15 15 x 0 0 x Compute the mean, X. (Hint: First
More informationProbability Theory. Mohamed I. Riffi. Islamic University of Gaza
Probability Theory Mohamed I. Riffi Islamic University of Gaza Table of contents 1. Chapter 2 Discrete Distributions The binomial distribution 1 Chapter 2 Discrete Distributions Bernoulli trials and the
More informationRandom Variable: Definition
Random Variables Random Variable: Definition A Random Variable is a numerical description of the outcome of an experiment Experiment Roll a die 10 times Inspect a shipment of 100 parts Open a gas station
More informationChapter 3 Discrete Random Variables and Probability Distributions
Chapter 3 Discrete Random Variables and Probability Distributions Part 2: Mean and Variance of a Discrete Random Variable Section 3.4 1 / 16 Discrete Random Variable - Expected Value In a random experiment,
More informationStatistics Chapter 8
Statistics Chapter 8 Binomial & Geometric Distributions Time: 1.5 + weeks Activity: A Gaggle of Girls The Ferrells have 3 children: Jennifer, Jessica, and Jaclyn. If we assume that a couple is equally
More informationChapter 4 Discrete Random variables
Chapter 4 Discrete Random variables A is a variable that assumes numerical values associated with the random outcomes of an experiment, where only one numerical value is assigned to each sample point.
More informationData Analytics (CS40003) Practice Set IV (Topic: Probability and Sampling Distribution)
Data Analytics (CS40003) Practice Set IV (Topic: Probability and Sampling Distribution) I. Concept Questions 1. Give an example of a random variable in the context of Drawing a card from a deck of cards.
More informationSYLLABUS AND SAMPLE QUESTIONS FOR MSQE (Program Code: MQEK and MQED) Syllabus for PEA (Mathematics), 2013
SYLLABUS AND SAMPLE QUESTIONS FOR MSQE (Program Code: MQEK and MQED) 2013 Syllabus for PEA (Mathematics), 2013 Algebra: Binomial Theorem, AP, GP, HP, Exponential, Logarithmic Series, Sequence, Permutations
More information5.2 Random Variables, Probability Histograms and Probability Distributions
Chapter 5 5.2 Random Variables, Probability Histograms and Probability Distributions A random variable (r.v.) can be either continuous or discrete. It takes on the possible values of an experiment. It
More informationCommonly Used Distributions
Chapter 4: Commonly Used Distributions 1 Introduction Statistical inference involves drawing a sample from a population and analyzing the sample data to learn about the population. We often have some knowledge
More informationChapter 5. Continuous Random Variables and Probability Distributions. 5.1 Continuous Random Variables
Chapter 5 Continuous Random Variables and Probability Distributions 5.1 Continuous Random Variables 1 2CHAPTER 5. CONTINUOUS RANDOM VARIABLES AND PROBABILITY DISTRIBUTIONS Probability Distributions Probability
More informationRandom variables. Contents
Random variables Contents 1 Random Variable 2 1.1 Discrete Random Variable............................ 3 1.2 Continuous Random Variable........................... 5 1.3 Measures of Location...............................
More informationShifting our focus. We were studying statistics (data, displays, sampling...) The next few lectures focus on probability (randomness) Why?
Probability Introduction Shifting our focus We were studying statistics (data, displays, sampling...) The next few lectures focus on probability (randomness) Why? What is Probability? Probability is used
More informationEngineering Statistics ECIV 2305
Engineering Statistics ECIV 2305 Section 5.3 Approximating Distributions with the Normal Distribution Introduction A very useful property of the normal distribution is that it provides good approximations
More informationSection 7.5 The Normal Distribution. Section 7.6 Application of the Normal Distribution
Section 7.6 Application of the Normal Distribution A random variable that may take on infinitely many values is called a continuous random variable. A continuous probability distribution is defined by
More informationThe Binomial Distribution
Patrick Breheny September 13 Patrick Breheny University of Iowa Biostatistical Methods I (BIOS 5710) 1 / 16 Outcomes and summary statistics Random variables Distributions So far, we have discussed the
More information6. Continous Distributions
6. Continous Distributions Chris Piech and Mehran Sahami May 17 So far, all random variables we have seen have been discrete. In all the cases we have seen in CS19 this meant that our RVs could only take
More informationChapter 2. Random variables. 2.3 Expectation
Random processes - Chapter 2. Random variables 1 Random processes Chapter 2. Random variables 2.3 Expectation 2.3 Expectation Random processes - Chapter 2. Random variables 2 Among the parameters representing
More informationMATH 264 Problem Homework I
MATH Problem Homework I Due to December 9, 00@:0 PROBLEMS & SOLUTIONS. A student answers a multiple-choice examination question that offers four possible answers. Suppose that the probability that the
More informationStatistical Methods in Practice STAT/MATH 3379
Statistical Methods in Practice STAT/MATH 3379 Dr. A. B. W. Manage Associate Professor of Mathematics & Statistics Department of Mathematics & Statistics Sam Houston State University Overview 6.1 Discrete
More informationChapter 3 Discrete Random Variables and Probability Distributions
Chapter 3 Discrete Random Variables and Probability Distributions Part 3: Special Discrete Random Variable Distributions Section 3.5 Discrete Uniform Section 3.6 Bernoulli and Binomial Others sections
More informationLecture Slides. Elementary Statistics Tenth Edition. by Mario F. Triola. and the Triola Statistics Series
Lecture Slides Elementary Statistics Tenth Edition and the Triola Statistics Series by Mario F. Triola Slide 1 Chapter 5 Probability Distributions 5-1 Overview 5-2 Random Variables 5-3 Binomial Probability
More informationUNIT 4 MATHEMATICAL METHODS
UNIT 4 MATHEMATICAL METHODS PROBABILITY Section 1: Introductory Probability Basic Probability Facts Probabilities of Simple Events Overview of Set Language Venn Diagrams Probabilities of Compound Events
More informationECE 340 Probabilistic Methods in Engineering M/W 3-4:15. Lecture 10: Continuous RV Families. Prof. Vince Calhoun
ECE 340 Probabilistic Methods in Engineering M/W 3-4:15 Lecture 10: Continuous RV Families Prof. Vince Calhoun 1 Reading This class: Section 4.4-4.5 Next class: Section 4.6-4.7 2 Homework 3.9, 3.49, 4.5,
More informationProbability Distributions
Chapter 6 Discrete Probability Distributions Section 6-2 Probability Distributions Definitions Let S be the sample space of a probability experiment. A random variable X is a function from the set S into
More informationvariance risk Alice & Bob are gambling (again). X = Alice s gain per flip: E[X] = Time passes... Alice (yawning) says let s raise the stakes
Alice & Bob are gambling (again). X = Alice s gain per flip: risk E[X] = 0... Time passes... Alice (yawning) says let s raise the stakes E[Y] = 0, as before. Are you (Bob) equally happy to play the new
More informationMAT 4250: Lecture 1 Eric Chung
1 MAT 4250: Lecture 1 Eric Chung 2Chapter 1: Impartial Combinatorial Games 3 Combinatorial games Combinatorial games are two-person games with perfect information and no chance moves, and with a win-or-lose
More informationCMPSCI 311: Introduction to Algorithms Second Midterm Practice Exam SOLUTIONS
CMPSCI 311: Introduction to Algorithms Second Midterm Practice Exam SOLUTIONS November 17, 2016. Name: ID: Instructions: Answer the questions directly on the exam pages. Show all your work for each question.
More informationThe Binomial Distribution
MATH 382 The Binomial Distribution Dr. Neal, WKU Suppose there is a fixed probability p of having an occurrence (or success ) on any single attempt, and a sequence of n independent attempts is made. Then
More informationBinomial Distributions
Binomial Distributions Binomial Experiment The experiment is repeated for a fixed number of trials, where each trial is independent of the other trials There are only two possible outcomes of interest
More informationStatistical Intervals. Chapter 7 Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage
7 Statistical Intervals Chapter 7 Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage Confidence Intervals The CLT tells us that as the sample size n increases, the sample mean X is close to
More informationLecture Notes 6. Assume F belongs to a family of distributions, (e.g. F is Normal), indexed by some parameter θ.
Sufficient Statistics Lecture Notes 6 Sufficiency Data reduction in terms of a particular statistic can be thought of as a partition of the sample space X. Definition T is sufficient for θ if the conditional
More informationMATH MW Elementary Probability Course Notes Part IV: Binomial/Normal distributions Mean and Variance
MATH 2030 3.00MW Elementary Probability Course Notes Part IV: Binomial/Normal distributions Mean and Variance Tom Salisbury salt@yorku.ca York University, Dept. of Mathematics and Statistics Original version
More informationPoint Estimation. Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage
6 Point Estimation Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage Point Estimation Statistical inference: directed toward conclusions about one or more parameters. We will use the generic
More information