The Kalman filter - and other methods
|
|
- August Matthews
- 5 years ago
- Views:
Transcription
1 The Kalman filter - and other methods Anders Ringgaard Kristensen Slide 1 Outline Filtering techniques applied to monitoring of daily gain in slaughter pigs: Introduction Basic monitoring Shewart control charts DLM and the Kalman filter Simple case Seasonality Online monitoring Used as input to decision support Slide 2 1
2 E-kontrol, slaughter pigs Quarterly calculated production results Presented as a table A result for each of the most recent quarters and aggregated Sometimes comparison with expected (target) values Offered by two companies: Dansk Landbrugsrådgivning, Landscentret (as shown) AgroSoft A/S One of the most important key figures: Average daily gain Slide 3 Average daily gain, slaughter pigs We have: 4 quarterly results 1 annual result 1 target value How do we interpret the results? Question 1: How is the figure calculated? Slide 4 2
3 How is the figure calculated? The basic principles are: Total (live) weight of pigs delivered: xxxx Total weight of piglets inserted: xxxx Valuation weight at end of the quarter: +xxxx Valuation weight at beginning of the quarter: xxxx Total gain during the quarter yyyy Daily gain = (Total gain)/(days in feed) Registration sources? * Slaughter house rather precise ** Scale very precise ***??? anything from very precise to very uncertain * ** *** *** Slide 5 First finding: Observation error All measurements are encumbered with uncertainty (error), but it is most prevalent for the valuation weights. We define a (very simple) model: κ = τ + e o, where: κ is the calculated daily gain (as it appears in the report) τ is the true daily gain (which we wish to estimate) e o is the observation error which we assume is normally distributed N(0, σo 2) The structure of the model (qualitative knowledge) is the equation The parameters (quantitative knowledge) is the value of σ o (the standard deviation of the observation error). It depends on the observation method. Slide 6 3
4 Observation error τ κ κ = τ + e o, e o N(0, σ o 2 ) What we measure is κ What we wish to know is τ The difference between the two variables is undesired noise We wish to filter the noise away, i.e. we wish to estimate τ from κ Slide 7 Second finding: Randomness The true daily gains τ vary at random. Even if we produce under exactly the same conditions in two successive quarters the results will differ. We shall denote the phenomenon as the sample error. We have, τ = θ + e s, where e s is the sample error expressing random variation. We assume e s N(0, σ s 2) θ is the underlying permanent (and true) value This supplementary qualitative knowledge should be reflected in the stucture of the model: κ = τ + e = θ + e + e o s o The parameters of the model are now: σ og σ o s Slide 8 4
5 Sample error and measurement error θ τ κ What we measure is κ What we wish to know is θ The difference between the two variables is undesired noise: Sample noise Observation noise We wish to filter the noise away, i.e. we wish to estimate θ from κ Slide 9 The model in practice: Preconditions The model is necessary for any meaningful interpretation of calculated production results. The standard deviation on the sample error, σ s, depends on the natural individual variation between pigs in a herd and the herd size. The standard deviation of the observation error, σ o, depends on the measurement method of valuation weights. For the interpretation of the calculated results, it is the total uncertainty, σ, that matters (σ 2 = σ s 2 + σ ο 2 ) Competent guesses of the value of σ using different observation methods (1250 pigs): Weighing of all pigs: σ = 3 g Stratified sample: σ = 7 g Random sample: σ = 20 g Visual assessment: σ = 29 g Slide 10 5
6 Different observation methods θ τ κ κ κ κ σ = 3 g σ = 7 g σ = 20 g σ = 29 g Slide 11 The model in practice: Interpretation Calculated daily gain in a herd was 750 g, whereas the expected target value was 775 g. Shall we be worried? It depends on the observation method! A lower control limit (LCL) is the target minus 2 times the standard deviation, i.e σ Using each of the 4 observation methods, we obtain the following LCLs: Weighing of all pigs: 775 g 2 x 3 g = 769 Stratified sample: 775 g 2 x 7 g = 761 Random sample: 775 g 2 x 20 g = 735 Visual assessment: 775 g 2 x 29 g = 717 Slide 12 6
7 Third finding: Dynamics, time Daily gain, slaughter pigs g quarter quarter quarter quarter quarter quarter quarter quarter quarter quarter quarter quarter quarter quarter quarter quarter quarter 01 Quarter Daily gain in a herd over 4 years. Is this good or bad? Slide 13 Modeling dynamics We extend our model to include time. At time n we model the calculated result as follows: κ n = τ sn + e on = θ + e sn + e on Only change from before is that we know we have a new result each quarter. We can calculate control limits for each quarter and plot everything in a diagram: A Shewart Control Chart θ τ 1 τ 2 τ 3 τ 4 κ 1 κ 2 κ 3 κ 4 Slide 14 7
8 A simple Shewart control chart: Weighing all pigs Daily gain, slaughter pigs g kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal 01 Period Periode Observed gain Upper control limit Expected Lower control limit Slide 15 Simple Shewart control chart: Visual assessment Daily gain, slaughter pigs g kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal 01 Period Periode Observed gain Upper control limit Expected Lower control limit Slide 16 8
9 Interpretation: Conclusion Something is wrong! Possible explanations: The pig farmer has serious problems with fluctuating daily gains. Something is wrong with the model: Structure our qualitative knowledge Parameters the quantitative knowledge (standard deviations). Slide 17 More findings: κ n = θ + e sn + e on The true underlying daily gain in the herd, θ, may change over time: Trend Seasonal variation The sample error e sn may be auto correlated Temporary influences The observation error e on is obviously auto correlated: Valuation weight at the end of Quarter n is the same as the valuation weight at the start of Quarter n+1 Slide 18 9
10 Dynamisk e-kontrol Developed and described by Madsen & Ruby (2000). Principles: Avoid labor intensive valuation weighing. Calculate new daily gain every time pigs have been sent to slaughter (typically weekly) Use a simple Dynamic Linear Model to monitor daily gain κ n = θ n + e sn + e on = θ n + v n, where v n N(0, σ v2 ) θ n = θ n-1 + w n, where w n N(0, σ w2 ) The calculated results are filtered by the Kalman filter in order to remove random noise (sample error + observation error) Slide 19 Dynamisk E-kontrol, results Raw data to the left filtered data to the right Figures from: Madsen & Ruby (2000). An application for early detection of growth rate changes in the slaughter pig production unit. Computers and Electronics in Agriculture 25, Still: Results only available after slaughter Slide 20 10
11 The Dynamic Linear Model (DLM) Example Observation equation κ n = θ n + v n, v n N(0, σ v2 ) System equation θ n = θ n-1 + w n, w n N(0, σ w2 ) General, first order Observation equation Y t = µ t + v t, v n N(0, σ v2 ) System equation µ t = µ t-1 + w n, w n N(0,σ w2 ) θ 1 θ 2 θ 3 θ 4 µ 1 µ 2 µ 3 µ 4 τ 1 τ 2 τ 3 τ 4 Y 1 Y 2 Y 3 Y 4 κ 1 κ 2 κ 3 κ 4 Slide 21 Extending the model F n θ n is the true level described as a vector product. A general level, θ 0n, and 4 seasonal effects θ 1n, θ 2n, θ 3n and θ 4n are included in the model. From the model we are able to predict the expected daily gain for next quarter. As long as the forecast errors are small, production is in control (no large change in true underlying level)! Slide 22 11
12 Observed and predicted Daily gain g Blue: Observed Pink: Predicted 2. kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal 00 Quarter Slide 23 Analysis of prediction errors Daily gain g kvartal kvartal kvartal kvartal kvartal kvartal kvartal kvartal 00 Quarter Slide 24 12
13 The last model Dynamic Linear Model Structure of the model (qualitative knowledge): Seasonal variation allowed (no assumption about the size). The general level as well as the seasonal pattern may change over time. Are those assumptions correct? Parameters of the model: The observation and sample variance and the system variance. The model learns as observations are done, and adapts to the observations over time. Seasonal varation may be modeled more sophistically as demonstrated by Thomas Nejsum Madsen in Farm Watch Slide 25 Moral If we wish to analyze the daily gain of a herd you need to: Know exactly how the observations are done (and know the precision). Know how it may naturally develop over time. Without professional knowledge you may conclude anything. Without a model you may interpret the results inadequately. Through the structure of the model we apply our professional knowledge to the problem. Slide 26 13
14 On-line monitoring of slaughter pigs: PigVision Innovation project led by Danish Pig Production: Danish Institute of Agricultural Sciences Videometer (external assistance) Skov A/S LIFE, IPH, Production and Health Continuous monitoring of daily gain while still in herd: Dynamic Linear Models Chance of interference in the fattening period Adaptation of delivery policy Slide 27 PigVision: Principles A camera is placed above the pen. In case of movements a series of pictures are recorded and sent to a computer. The computer automatically identifies the pig (by use of a model) and calculates the area (seen from above). If the computer doesn t belief that a pig has been identified, the picture is ignored. The area is converted to live weight (using a model). Through many pictures, the average weight and the standard deviation are estimated. Figure by Teresia Heiskanen Slide 28 14
15 What is online weight assessment used for? Continuous monitoring of gain. Collection of evidence about growth capacity (learning) Adaptation of delivery policies depending on: Whether the pigs grow fast or slowly Whether the uniformity is small or big Whether a new batch of piglets is ready Prices Direct advice about pigs to deliver Slide 29 The decision support model Technique: A hierarchical Markov Decision Process (dynamic programming) with a Dynamic Linear Model (DLM) embedded. Every week, the average weight and the standard deviation is observed After each observation the parameters of the DLM are opdated using Kalman filtering: Permanent growth capacity of pigs, L Temporary deviation, e(t) Within-pen standard deviation, ρ(t) Decisions based on (state space): Number of pigs left Estimated values of the 3 parameters Decision: Deliver all pigs with live weight bigger than a threshold Uncertainty of knowledge is directly built into the model through the DLM Slide 30 15
16 On-line weight assessment Pen with n pigs is monitored. No identification of pigs. At any time t we have: The precision 1/σ 2 is assumed known Slide 31 Objectives Given the on-line weight estimates to assign an optimal delivery policy for the pigs in the pen. Sequential (weekly) decision problem with decisions at two levels: Slaughtering of individual pigs (the price is highest in a rather narrow interval) Terminating the batch (slaughter all remaining pigs and insert a new batch of weaners) Slide 32 16
17 Dynamic linear models Slide 33 A dynamic linear weight model, I Known average herd specific growth curve: True weights at time t distributed as: Slide 34 17
18 The scaling factor L In principle unknown and not directly observable Initial belief: The belief is updated each time we observe a set of live weights from the pen. Let L N(1, σ L 2 ) be the true average weight Then Slide 35 Observation & system equation 1 Full observation equation for mean: Auto-correlated sample error (system eq.): Slide 36 18
19 Observation & system equation 2 Far more information available from the observed live weights Sample variance not normally distributed. Use the 0.16 sample quantile: The symbol ρ(t) is the standard deviation of the observed values. System equation: Slide 37 Full equation set Slide 38 19
20 Learning, permanent growth capacity L = 1,00 1,15 L= 0,85 1,15 1,05 1,05 0, , ,85 0,85 Sand værdi Lært værdi Sand værdi Lært værdi L = 1,07 L = 1,12 1,15 1,15 1,05 1,05 0, , ,85 0,85 Sand værdi Lært værdi Sand værdi Lært værdi Slide 39 Learning: Homogeneity (standard deviation) Spredning = 3 Spredning = Sand værdi Lært værdi Sand værdi Lært værdi Slide 40 20
The Kalman filter - and other methods
The Kalman filter - and other methods Anders Ringgaard Kristensen Slide 1 Outline Filtering techniques applied to monitoring of daily gain in slaughter pigs: Introduction Basic monitoring Shewart control
More informationMonitoring - revisited
Monitoring - revisited Anders Ringgaard Kristensen Slide 1 Outline Filtering techniques applied to monitoring of daily gain in slaughter pigs: Introduction Basic monitoring Shewart control charts DLM and
More informationInterval estimation. September 29, Outline Basic ideas Sampling variation and CLT Interval estimation using X More general problems
Interval estimation September 29, 2017 STAT 151 Class 7 Slide 1 Outline of Topics 1 Basic ideas 2 Sampling variation and CLT 3 Interval estimation using X 4 More general problems STAT 151 Class 7 Slide
More informationMonitoring and data filtering I. Classical Methods
Monitoring and data filtering I. Classical Methods Advanced Herd Management Dan Børge Jensen, IPH Dias 1 Outline Framework and Introduction Shewart Control chart Basic principles Examples: milk yield and
More informationIntroduction to Statistics I
Introduction to Statistics I Keio University, Faculty of Economics Continuous random variables Simon Clinet (Keio University) Intro to Stats November 1, 2018 1 / 18 Definition (Continuous random variable)
More informationDistribution of state of nature: Main problem
State of nature concept Monte Carlo Simulation II Advanced Herd Management Anders Ringgaard Kristensen The hyper distribution: An infinite population of flocks each having its own state of nature defining
More informationCharacterization of the Optimum
ECO 317 Economics of Uncertainty Fall Term 2009 Notes for lectures 5. Portfolio Allocation with One Riskless, One Risky Asset Characterization of the Optimum Consider a risk-averse, expected-utility-maximizing
More informationStatistics and Probability
Statistics and Probability Continuous RVs (Normal); Confidence Intervals Outline Continuous random variables Normal distribution CLT Point estimation Confidence intervals http://www.isrec.isb-sib.ch/~darlene/geneve/
More informationPoint Estimation. Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage
6 Point Estimation Stat 4570/5570 Material from Devore s book (Ed 8), and Cengage Point Estimation Statistical inference: directed toward conclusions about one or more parameters. We will use the generic
More informationEstimation of Volatility of Cross Sectional Data: a Kalman filter approach
Estimation of Volatility of Cross Sectional Data: a Kalman filter approach Cristina Sommacampagna University of Verona Italy Gordon Sick University of Calgary Canada This version: 4 April, 2004 Abstract
More informationCSC Advanced Scientific Programming, Spring Descriptive Statistics
CSC 223 - Advanced Scientific Programming, Spring 2018 Descriptive Statistics Overview Statistics is the science of collecting, organizing, analyzing, and interpreting data in order to make decisions.
More informationChapter 14 : Statistical Inference 1. Note : Here the 4-th and 5-th editions of the text have different chapters, but the material is the same.
Chapter 14 : Statistical Inference 1 Chapter 14 : Introduction to Statistical Inference Note : Here the 4-th and 5-th editions of the text have different chapters, but the material is the same. Data x
More informationWeek 2 Quantitative Analysis of Financial Markets Hypothesis Testing and Confidence Intervals
Week 2 Quantitative Analysis of Financial Markets Hypothesis Testing and Confidence Intervals Christopher Ting http://www.mysmu.edu/faculty/christophert/ Christopher Ting : christopherting@smu.edu.sg :
More informationConfidence Intervals Introduction
Confidence Intervals Introduction A point estimate provides no information about the precision and reliability of estimation. For example, the sample mean X is a point estimate of the population mean μ
More informationLecture # 35. Prof. John W. Sutherland. Nov. 16, 2005
Lecture # 35 Prof. John W. Sutherland Nov. 16, 2005 More on Control Charts for Individuals Last time we worked with X and Rm control charts. Remember -- only makes sense to use such a chart when the formation
More informationSTAT Chapter 7: Confidence Intervals
STAT 515 -- Chapter 7: Confidence Intervals With a point estimate, we used a single number to estimate a parameter. We can also use a set of numbers to serve as reasonable estimates for the parameter.
More informationμ: ESTIMATES, CONFIDENCE INTERVALS, AND TESTS Business Statistics
μ: ESTIMATES, CONFIDENCE INTERVALS, AND TESTS Business Statistics CONTENTS Estimating parameters The sampling distribution Confidence intervals for μ Hypothesis tests for μ The t-distribution Comparison
More informationFEEG6017 lecture: The normal distribution, estimation, confidence intervals. Markus Brede,
FEEG6017 lecture: The normal distribution, estimation, confidence intervals. Markus Brede, mb8@ecs.soton.ac.uk The normal distribution The normal distribution is the classic "bell curve". We've seen that
More informationSTAT 157 HW1 Solutions
STAT 157 HW1 Solutions http://www.stat.ucla.edu/~dinov/courses_students.dir/10/spring/stats157.dir/ Problem 1. 1.a: (6 points) Determine the Relative Frequency and the Cumulative Relative Frequency (fill
More informationReading the Tea Leaves: Model Uncertainty, Robust Foreca. Forecasts, and the Autocorrelation of Analysts Forecast Errors
Reading the Tea Leaves: Model Uncertainty, Robust Forecasts, and the Autocorrelation of Analysts Forecast Errors December 1, 2016 Table of Contents Introduction Autocorrelation Puzzle Hansen-Sargent Autocorrelation
More informationBusiness Statistics 41000: Probability 3
Business Statistics 41000: Probability 3 Drew D. Creal University of Chicago, Booth School of Business February 7 and 8, 2014 1 Class information Drew D. Creal Email: dcreal@chicagobooth.edu Office: 404
More informationRisk Management, Qualtity Control & Statistics, part 2. Article by Kaan Etem August 2014
Risk Management, Qualtity Control & Statistics, part 2 Article by Kaan Etem August 2014 Risk Management, Quality Control & Statistics, part 2 BY KAAN ETEM Kaan Etem These statistical techniques, used consistently
More informationOf the tools in the technician's arsenal, the moving average is one of the most popular. It is used to
Building A Variable-Length Moving Average by George R. Arrington, Ph.D. Of the tools in the technician's arsenal, the moving average is one of the most popular. It is used to eliminate minor fluctuations
More informationVolatility of Asset Returns
Volatility of Asset Returns We can almost directly observe the return (simple or log) of an asset over any given period. All that it requires is the observed price at the beginning of the period and the
More informationSTA Module 3B Discrete Random Variables
STA 2023 Module 3B Discrete Random Variables Learning Objectives Upon completing this module, you should be able to 1. Determine the probability distribution of a discrete random variable. 2. Construct
More informationChapter 16. Random Variables. Copyright 2010 Pearson Education, Inc.
Chapter 16 Random Variables Copyright 2010 Pearson Education, Inc. Expected Value: Center A random variable assumes a value based on the outcome of a random event. We use a capital letter, like X, to denote
More informationMaking Hard Decision. ENCE 627 Decision Analysis for Engineering. Identify the decision situation and understand objectives. Identify alternatives
CHAPTER Duxbury Thomson Learning Making Hard Decision Third Edition RISK ATTITUDES A. J. Clark School of Engineering Department of Civil and Environmental Engineering 13 FALL 2003 By Dr. Ibrahim. Assakkaf
More informationLikelihood-based Optimization of Threat Operation Timeline Estimation
12th International Conference on Information Fusion Seattle, WA, USA, July 6-9, 2009 Likelihood-based Optimization of Threat Operation Timeline Estimation Gregory A. Godfrey Advanced Mathematics Applications
More informationChaos Barometer. Chaos Measurement Oscillator for Financial Markets.
Chaos Barometer Chaos Measurement Oscillator for Financial Markets http://www.quant-trade.com/ 6/4/2015 Table of contents 1 Chaos Barometer Defined Functionality 2 2 Chaos Barometer Trend 4 3 Chaos Barometer
More informationConfidence Intervals. σ unknown, small samples The t-statistic /22
Confidence Intervals σ unknown, small samples The t-statistic 1 /22 Homework Read Sec 7-3. Discussion Question pg 365 Do Ex 7-3 1-4, 6, 9, 12, 14, 15, 17 2/22 Objective find the confidence interval for
More informationChapter 4: Estimation
Slide 4.1 Chapter 4: Estimation Estimation is the process of using sample data to draw inferences about the population Sample information x, s Inferences Population parameters µ,σ Slide 4. Point and interval
More information6.041SC Probabilistic Systems Analysis and Applied Probability, Fall 2013 Transcript Lecture 23
6.041SC Probabilistic Systems Analysis and Applied Probability, Fall 2013 Transcript Lecture 23 The following content is provided under a Creative Commons license. Your support will help MIT OpenCourseWare
More informationChapter 8. Introduction to Statistical Inference
Chapter 8. Introduction to Statistical Inference Point Estimation Statistical inference is to draw some type of conclusion about one or more parameters(population characteristics). Now you know that a
More informationyuimagui: A graphical user interface for the yuima package. User Guide yuimagui v1.0
yuimagui: A graphical user interface for the yuima package. User Guide yuimagui v1.0 Emanuele Guidotti, Stefano M. Iacus and Lorenzo Mercuri February 21, 2017 Contents 1 yuimagui: Home 3 2 yuimagui: Data
More informationIntroduction to Statistical Data Analysis II
Introduction to Statistical Data Analysis II JULY 2011 Afsaneh Yazdani Preface Major branches of Statistics: - Descriptive Statistics - Inferential Statistics Preface What is Inferential Statistics? Preface
More information5.3 Interval Estimation
5.3 Interval Estimation Ulrich Hoensch Wednesday, March 13, 2013 Confidence Intervals Definition Let θ be an (unknown) population parameter. A confidence interval with confidence level C is an interval
More informationTime Observations Time Period, t
Operations Research Models and Methods Paul A. Jensen and Jonathan F. Bard Time Series and Forecasting.S1 Time Series Models An example of a time series for 25 periods is plotted in Fig. 1 from the numerical
More informationSampling and sampling distribution
Sampling and sampling distribution September 12, 2017 STAT 101 Class 5 Slide 1 Outline of Topics 1 Sampling 2 Sampling distribution of a mean 3 Sampling distribution of a proportion STAT 101 Class 5 Slide
More informationThe Assumption(s) of Normality
The Assumption(s) of Normality Copyright 2000, 2011, 2016, J. Toby Mordkoff This is very complicated, so I ll provide two versions. At a minimum, you should know the short one. It would be great if you
More informationTo apply SP models we need to generate scenarios which represent the uncertainty IN A SENSIBLE WAY, taking into account
Scenario Generation To apply SP models we need to generate scenarios which represent the uncertainty IN A SENSIBLE WAY, taking into account the goal of the model and its structure, the available information,
More informationSensitivity analysis for risk-related decision-making
Sensitivity analysis for risk-related decision-making Eric Marsden What are the key drivers of my modelling results? Sensitivity analysis: intuition X is a sensitive
More informationCounting Basics. Venn diagrams
Counting Basics Sets Ways of specifying sets Union and intersection Universal set and complements Empty set and disjoint sets Venn diagrams Counting Inclusion-exclusion Multiplication principle Addition
More informationCopyright 2011 Pearson Education, Inc. Publishing as Addison-Wesley.
Appendix: Statistics in Action Part I Financial Time Series 1. These data show the effects of stock splits. If you investigate further, you ll find that most of these splits (such as in May 1970) are 3-for-1
More informationStatistics Class 15 3/21/2012
Statistics Class 15 3/21/2012 Quiz 1. Cans of regular Pepsi are labeled to indicate that they contain 12 oz. Data Set 17 in Appendix B lists measured amounts for a sample of Pepsi cans. The same statistics
More informationChapter 4 Variability
Chapter 4 Variability PowerPoint Lecture Slides Essentials of Statistics for the Behavioral Sciences Seventh Edition by Frederick J Gravetter and Larry B. Wallnau Chapter 4 Learning Outcomes 1 2 3 4 5
More informationValue at Risk Ch.12. PAK Study Manual
Value at Risk Ch.12 Related Learning Objectives 3a) Apply and construct risk metrics to quantify major types of risk exposure such as market risk, credit risk, liquidity risk, regulatory risk etc., and
More informationMartingales, Part II, with Exercise Due 9/21
Econ. 487a Fall 1998 C.Sims Martingales, Part II, with Exercise Due 9/21 1. Brownian Motion A process {X t } is a Brownian Motion if and only if i. it is a martingale, ii. t is a continuous time parameter
More informationRISK ANALYSIS OF LIFE INSURANCE PRODUCTS
RISK ANALYSIS OF LIFE INSURANCE PRODUCTS by Christine Zelch B. S. in Mathematics, The Pennsylvania State University, State College, 2002 B. S. in Statistics, The Pennsylvania State University, State College,
More informationSampling variability. Data Science Team
Sampling variability Data Science Team What we have learned so far Often the data is a sample from a population and we want to use it to learn something about this bigger population A summary of the data
More informationChapter 8 Statistical Intervals for a Single Sample
Chapter 8 Statistical Intervals for a Single Sample Part 1: Confidence intervals (CI) for population mean µ Section 8-1: CI for µ when σ 2 known & drawing from normal distribution Section 8-1.2: Sample
More informationMeasuring the Amount of Asymmetric Information in the Foreign Exchange Market
Measuring the Amount of Asymmetric Information in the Foreign Exchange Market Esen Onur 1 and Ufuk Devrim Demirel 2 September 2009 VERY PRELIMINARY & INCOMPLETE PLEASE DO NOT CITE WITHOUT AUTHORS PERMISSION
More informationEstimation of dynamic term structure models
Estimation of dynamic term structure models Greg Duffee Haas School of Business, UC-Berkeley Joint with Richard Stanton, Haas School Presentation at IMA Workshop, May 2004 (full paper at http://faculty.haas.berkeley.edu/duffee)
More informationStatistics for Business and Economics
Statistics for Business and Economics Chapter 7 Estimation: Single Population Copyright 010 Pearson Education, Inc. Publishing as Prentice Hall Ch. 7-1 Confidence Intervals Contents of this chapter: Confidence
More informationthe display, exploration and transformation of the data are demonstrated and biases typically encountered are highlighted.
1 Insurance data Generalized linear modeling is a methodology for modeling relationships between variables. It generalizes the classical normal linear model, by relaxing some of its restrictive assumptions,
More informationPortfolio Analysis with Random Portfolios
pjb25 Portfolio Analysis with Random Portfolios Patrick Burns http://www.burns-stat.com stat.com September 2006 filename 1 1 Slide 1 pjb25 This was presented in London on 5 September 2006 at an event sponsored
More informationComments on Foreign Effects of Higher U.S. Interest Rates. James D. Hamilton. University of California at San Diego.
1 Comments on Foreign Effects of Higher U.S. Interest Rates James D. Hamilton University of California at San Diego December 15, 2017 This is a very interesting and ambitious paper. The authors are trying
More informationStatistical estimation
Statistical estimation Statistical modelling: theory and practice Gilles Guillot gigu@dtu.dk September 3, 2013 Gilles Guillot (gigu@dtu.dk) Estimation September 3, 2013 1 / 27 1 Introductory example 2
More informationUNIVERSITY OF OSLO. Please make sure that your copy of the problem set is complete before you attempt to answer anything.
UNIVERSITY OF OSLO Faculty of Mathematics and Natural Sciences Examination in: STK4540 Non-Life Insurance Mathematics Day of examination: Wednesday, December 4th, 2013 Examination hours: 14.30 17.30 This
More informationThe test has 13 questions. Answer any four. All questions carry equal (25) marks.
2014 Booklet No. TEST CODE: QEB Afternoon Questions: 4 Time: 2 hours Write your Name, Registration Number, Test Code, Question Booklet Number etc. in the appropriate places of the answer booklet. The test
More informationHomework: Due Wed, Nov 3 rd Chapter 8, # 48a, 55c and 56 (count as 1), 67a
Homework: Due Wed, Nov 3 rd Chapter 8, # 48a, 55c and 56 (count as 1), 67a Announcements: There are some office hour changes for Nov 5, 8, 9 on website Week 5 quiz begins after class today and ends at
More informationThe Control Chart for Attributes
The Control Chart for Attributes Topic The Control charts for attributes The p and np charts Variable sample size Sensitivity of the p chart 1 Types of Data Variable data Product characteristic that can
More informationPortfolio Optimization
Portfolio Optimization Stephen Boyd EE103 Stanford University December 8, 2017 Outline Return and risk Portfolio investment Portfolio optimization Return and risk 2 Return of an asset over one period asset
More informationThis homework assignment uses the material on pages ( A moving average ).
Module 2: Time series concepts HW Homework assignment: equally weighted moving average This homework assignment uses the material on pages 14-15 ( A moving average ). 2 Let Y t = 1/5 ( t + t-1 + t-2 +
More informationRandom Variables and Probability Distributions
Chapter 3 Random Variables and Probability Distributions Chapter Three Random Variables and Probability Distributions 3. Introduction An event is defined as the possible outcome of an experiment. In engineering
More informationChapter 4 Probability Distributions
Slide 1 Chapter 4 Probability Distributions Slide 2 4-1 Overview 4-2 Random Variables 4-3 Binomial Probability Distributions 4-4 Mean, Variance, and Standard Deviation for the Binomial Distribution 4-5
More informationData Analysis and Statistical Methods Statistics 651
Data Analysis and Statistical Methods Statistics 651 http://www.stat.tamu.edu/~suhasini/teaching.html Lecture 14 (MWF) The t-distribution Suhasini Subba Rao Review of previous lecture Often the precision
More informationSTA 220H1F LEC0201. Week 7: More Probability: Discrete Random Variables
STA 220H1F LEC0201 Week 7: More Probability: Discrete Random Variables Recall: A sample space for a random experiment is the set of all possible outcomes of the experiment. Random Variables A random variable
More informationDiploma in Business Administration Part 2. Quantitative Methods. Examiner s Suggested Answers
Cumulative frequency Diploma in Business Administration Part Quantitative Methods Examiner s Suggested Answers Question 1 Cumulative Frequency Curve 1 9 8 7 6 5 4 3 1 5 1 15 5 3 35 4 45 Weeks 1 (b) x f
More informationExpected Value of a Random Variable
Knowledge Article: Probability and Statistics Expected Value of a Random Variable Expected Value of a Discrete Random Variable You're familiar with a simple mean, or average, of a set. The mean value of
More information19. CONFIDENCE INTERVALS FOR THE MEAN; KNOWN VARIANCE
19. CONFIDENCE INTERVALS FOR THE MEAN; KNOWN VARIANCE We assume here that the population variance σ 2 is known. This is an unrealistic assumption, but it allows us to give a simplified presentation which
More information5.3 Statistics and Their Distributions
Chapter 5 Joint Probability Distributions and Random Samples Instructor: Lingsong Zhang 1 Statistics and Their Distributions 5.3 Statistics and Their Distributions Statistics and Their Distributions Consider
More informationSTA Rev. F Learning Objectives. What is a Random Variable? Module 5 Discrete Random Variables
STA 2023 Module 5 Discrete Random Variables Learning Objectives Upon completing this module, you should be able to: 1. Determine the probability distribution of a discrete random variable. 2. Construct
More informationVersion A. Problem 1. Let X be the continuous random variable defined by the following pdf: 1 x/2 when 0 x 2, f(x) = 0 otherwise.
Math 224 Q Exam 3A Fall 217 Tues Dec 12 Version A Problem 1. Let X be the continuous random variable defined by the following pdf: { 1 x/2 when x 2, f(x) otherwise. (a) Compute the mean µ E[X]. E[X] x
More informationLecture 9. Probability Distributions. Outline. Outline
Outline Lecture 9 Probability Distributions 6-1 Introduction 6- Probability Distributions 6-3 Mean, Variance, and Expectation 6-4 The Binomial Distribution Outline 7- Properties of the Normal Distribution
More informationST440/550: Applied Bayesian Analysis. (5) Multi-parameter models - Summarizing the posterior
(5) Multi-parameter models - Summarizing the posterior Models with more than one parameter Thus far we have studied single-parameter models, but most analyses have several parameters For example, consider
More informationThe Central Limit Theorem. Sec. 8.2: The Random Variable. it s Distribution. it s Distribution
The Central Limit Theorem Sec. 8.1: The Random Variable it s Distribution Sec. 8.2: The Random Variable it s Distribution X p and and How Should You Think of a Random Variable? Imagine a bag with numbers
More information1/3/12 AP STATS. WARM UP: How was your New Year? EQ: HW: Pg 381 #1, 2, 3, 6, 9, 10, 17, 18, 24, 25, 31. Chapter
1/3/12 AP STATS WARM UP: How was your New Year? EQ: Name one way you can tell between discrete variables and continuous variables? HW: Pg 381 #1, 2, 3, 6, 9, 10, 17, 18, 24, 25, 31 1 Jan. 3, 2012 HW: Pg
More informationLecture 16: Estimating Parameters (Confidence Interval Estimates of the Mean)
Statistics 16_est_parameters.pdf Michael Hallstone, Ph.D. hallston@hawaii.edu Lecture 16: Estimating Parameters (Confidence Interval Estimates of the Mean) Some Common Sense Assumptions for Interval Estimates
More informationThe Forex Report CORE CONCEPTS. J A N U A R Y Signal Selection By Scott Owens
The Forex Report CORE CONCEPTS J A N U A R Y 2 0 0 5 Signal Selection By Scott Owens When selecting which signals to use, most traders shop charts until they find one that tells the story they want to
More informationLecture 9. Probability Distributions
Lecture 9 Probability Distributions Outline 6-1 Introduction 6-2 Probability Distributions 6-3 Mean, Variance, and Expectation 6-4 The Binomial Distribution Outline 7-2 Properties of the Normal Distribution
More information8.1 Estimation of the Mean and Proportion
8.1 Estimation of the Mean and Proportion Statistical inference enables us to make judgments about a population on the basis of sample information. The mean, standard deviation, and proportions of a population
More informationEconomics 883: The Basic Diffusive Model, Jumps, Variance Measures. George Tauchen. Economics 883FS Spring 2015
Economics 883: The Basic Diffusive Model, Jumps, Variance Measures George Tauchen Economics 883FS Spring 2015 Main Points 1. The Continuous Time Model, Theory and Simulation 2. Observed Data, Plotting
More informationNEWCASTLE UNIVERSITY. School SEMESTER /2013 ACE2013. Statistics for Marketing and Management. Time allowed: 2 hours
NEWCASTLE UNIVERSITY School SEMESTER 2 2012/2013 Statistics for Marketing and Management Time allowed: 2 hours Candidates should attempt ALL questions. Marks for each question are indicated. However you
More informationGame Theory and Economics Prof. Dr. Debarshi Das Department of Humanities and Social Sciences Indian Institute of Technology, Guwahati.
Game Theory and Economics Prof. Dr. Debarshi Das Department of Humanities and Social Sciences Indian Institute of Technology, Guwahati. Module No. # 06 Illustrations of Extensive Games and Nash Equilibrium
More informationFinal exam solutions
EE365 Stochastic Control / MS&E251 Stochastic Decision Models Profs. S. Lall, S. Boyd June 5 6 or June 6 7, 2013 Final exam solutions This is a 24 hour take-home final. Please turn it in to one of the
More informationSection 0: Introduction and Review of Basic Concepts
Section 0: Introduction and Review of Basic Concepts Carlos M. Carvalho The University of Texas McCombs School of Business mccombs.utexas.edu/faculty/carlos.carvalho/teaching 1 Getting Started Syllabus
More informationQuantitative Introduction ro Risk and Uncertainty in Business Module 5: Hypothesis Testing Examples
Quantitative Introduction ro Risk and Uncertainty in Business Module 5: Hypothesis Testing Examples M. Vidyasagar Cecil & Ida Green Chair The University of Texas at Dallas Email: M.Vidyasagar@utdallas.edu
More informationChapter 8 Estimation
Chapter 8 Estimation There are two important forms of statistical inference: estimation (Confidence Intervals) Hypothesis Testing Statistical Inference drawing conclusions about populations based on samples
More informationModeling the extremes of temperature time series. Debbie J. Dupuis Department of Decision Sciences HEC Montréal
Modeling the extremes of temperature time series Debbie J. Dupuis Department of Decision Sciences HEC Montréal Outline Fig. 1: S&P 500. Daily negative returns (losses), Realized Variance (RV) and Jump
More informationAudit Sampling: Steering in the Right Direction
Audit Sampling: Steering in the Right Direction Jason McGlamery Director Audit Sampling Ryan, LLC Dallas, TX Jason.McGlamery@ryan.com Brad Tomlinson Senior Manager (non-attorney professional) Zaino Hall
More informationChapter 9. Idea of Probability. Randomness and Probability. Basic Practice of Statistics - 3rd Edition. Chapter 9 1. Introducing Probability
Chapter 9 Introducing Probability BPS - 3rd Ed. Chapter 9 1 Idea of Probability Probability is the science of chance behavior Chance behavior is unpredictable in the short run but has a regular and predictable
More informationEcon 101A Final Exam We May 9, 2012.
Econ 101A Final Exam We May 9, 2012. You have 3 hours to answer the questions in the final exam. We will collect the exams at 2.30 sharp. Show your work, and good luck! Problem 1. Utility Maximization.
More informationChapter 6 Simple Correlation and
Contents Chapter 1 Introduction to Statistics Meaning of Statistics... 1 Definition of Statistics... 2 Importance and Scope of Statistics... 2 Application of Statistics... 3 Characteristics of Statistics...
More informationData that can be any numerical value are called continuous. These are usually things that are measured, such as height, length, time, speed, etc.
Chapter 8 Measures of Center Data that can be any numerical value are called continuous. These are usually things that are measured, such as height, length, time, speed, etc. Data that can only be integer
More informationWhen we look at a random variable, such as Y, one of the first things we want to know, is what is it s distribution?
Distributions 1. What are distributions? When we look at a random variable, such as Y, one of the first things we want to know, is what is it s distribution? In other words, if we have a large number of
More informationConover Test of Variances (Simulation)
Chapter 561 Conover Test of Variances (Simulation) Introduction This procedure analyzes the power and significance level of the Conover homogeneity test. This test is used to test whether two or more population
More informationMidterm Exam III Review
Midterm Exam III Review Dr. Joseph Brennan Math 148, BU Dr. Joseph Brennan (Math 148, BU) Midterm Exam III Review 1 / 25 Permutations and Combinations ORDER In order to count the number of possible ways
More informationQuantitative Methods for Economics, Finance and Management (A86050 F86050)
Quantitative Methods for Economics, Finance and Management (A86050 F86050) Matteo Manera matteo.manera@unimib.it Marzio Galeotti marzio.galeotti@unimi.it 1 This material is taken and adapted from Guy Judge
More informationBUSINESS MATHEMATICS & QUANTITATIVE METHODS
BUSINESS MATHEMATICS & QUANTITATIVE METHODS FORMATION 1 EXAMINATION - AUGUST 2009 NOTES: You are required to answer 5 questions. (If you provide answers to all questions, you must draw a clearly distinguishable
More informationBiostatistics and Design of Experiments Prof. Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras
Biostatistics and Design of Experiments Prof. Mukesh Doble Department of Biotechnology Indian Institute of Technology, Madras Lecture - 05 Normal Distribution So far we have looked at discrete distributions
More information