Linear Models for Classification

Size: px
Start display at page:

Download "Linear Models for Classification"

Transcription

1 3/8/ Chaer 4 Liear Models for Classifiaio Classifiaio he goal i lassifiaio is o ae a iu veor ad o assig i o oe of K disree lasses C here K he iu sae is divided io K deisio regios hose boudaries are alled deisio boudaries or deisio surfaes ah regio rereses oe lass ad eah iu is lassified io oe of regios lasses Liear Classifiaio Liear lassifiaio meas ha he deisio surfaes are liear fuios of he iu veor ad hee are defied b D - dimesioal herlaes ihi he D- dimesioal iu sae Daa ses hose lasses a be searaed eal b liear deisio surfaes are said o be liearl searable Liear Regressio versus Liear Classifiaio Liear regressio M j jφ j Liear lassifiaio M Regressio j j φ j j here j is j he jh eleme of Classifiaio f here f is a fuio aivaio fuio ha mas io differe lasses C

2 3/8/ Aivaio Fuios he simles aivi fuio is jus iself ie f he mos ommol used aivi fuio is he sigmoid S-shae fuio f e hih mas squashes he real value io a fiie iervals lasses Classifiaio ih sigmoid aivaio fuio is ofe alled logisi regressio Se hreshold fuio Disrimia Fuios A disrimia is a fuio ha aes a iu veor ad assigs i o oe of K lasses deoed C Biar disrimia fuio lassifies iu io o lasses Muli-lass disrimia fuio lassifies iu io K lasses K> hree aroahes o lassifiaio Use disrimia fuios direl ihou robabiliies: Cover he iu veor io oe or more real values so ha a simle oeraio lie hreshholdig a be alied o ge he lass he real values should be hose o maimize he useable iformaio abou he lass label ha is i he real value Disrimiaive aroah: lass C Comue he odiioal robabili of eah lass he mae a deisio ha miimizes some loss fuio Geeraive models -omare he robabili of he iu uder searae lass-seifi g fi a mulivariae Gaussia o he iu veors of eah lass ad see hih Gaussia maes a es daa veor mos robable Is his he bes be? Biar Disrimia he simles rereseaio of a liear disrimia fuio is obaied b aig a liear ombiaio of he iu veor so ha here is alled a eigh veor ad is a bias Iu veor is assiged o lass C if > ad o lass C oherise

3 3/8/ Biar Disrimia o d orresods o a D -dimesioal herlae ihi he D-dimesioal iu sae deermies he orieaio of he deisio surfae Disrimia fuios for > lasses Oe ossibili is o use o-a disrimia fuios ah fuio disrimiaes oe lass from he res Aoher ossibili is o use -/ o-a disrimia fuios ah fuio disrimiaes beee o ariular lasses Boh hese mehods have roblems Problems ih muli-lass disrimia fuios A simle soluio More ha oe good aser o-a referees eed o be rasiive! Use disrimia fuios i j ad i he ma his is guaraeed o give osise ad ove deisio regios if is liear A > α α > α α A j imlies for osiive α A ad B ha j B > A j B B 3

4 3/8/ Mulile Class Disrimia Mulile Class Disrimia A sigle K-lass disrimia osiss of K liear fuios of he form for K assigig o lass C if > j for all j * arg ma he deisio boudar beee lass C ad lass C j is herefore give b j ad hee orresods o a D -dimesioal herlae defied b j j he deisio regios of suh a disrimia are alas sigl oeed ad ove Disrimia Parameer Learig Lear he eighs give iu a se of iu ad ouu Learig mehods Leas-squares mehod Fisher disrimia learig Leas-squares mehod ML mehod simae suh ha he model rediios as lose as ossible o a se of arge values ah lass C is desribed b is o liear model so ha ] K 4

5 3/8/ 5 Leas-squares mehod I veor forma e have Y Y K K K D K K Leas-squares mehod o d Give samles ad heir orresodig lass labels here is a K veor ha follos -of-k odig ie he elemes are all zeros ee for he lass ha belogs o Leas-squares soluio is o fid ha miimizes he sum-of-squares errors ie ] ] ] ] Y Y Leas-squares mehod o d D X ae he derivaives of r o ad seig i o zero e a solve as follos here X X X Leas-squares mehod o d LSQ mehod is suseible o ouliers If he righ aser is ad he model sas 5 i loses so i hages he boudar o avoid beig oo orre

6 3/8/ Aoher eamle here leas squares regressio gives oor deisio surfaes Fisher Liear Disrimia Aoher a o fid a ha a bes liearl searae he lasses ie a ha miimizes he mislassifiaio errors his a be ahieved b rojeig he iu veor ie oo a e subsae here he lasses are bes searaed his is also alled dimesioali reduio sie he dimesio of is iall muh smaller ha ha of Fisher Liear Disrimia o d Fisher Liear Disrimia for Biar Classifiaio he lass searaio i he e feaure sae a be quaiaivel haraerized b he small ihi-lass variae ad large beeelass variae he Fisher rierio is defied o be he raio of he beee-lass variae o he ihilass variae Fisher disrimia aalsis is o fid ha he Fisher rierio is maimized 6

7 3/8/ Fisher Liear Disrimia for Biar Classifiaio o d he Fisher rierio a be defied as S B J S here S B is he beee-lass ovariae mari ad is give b m ad m are samle meas for o lasses ad S is he oal ihi-lass ovariae mari give b Fisher Liear Disrimia for Biar Classifiaio o d Differeiaig Log J ih rese o e fid ha J is maimized he S m m here oe is deermied u o a sale faor Bu ha is o? Fisher Crierio v Leas-square Crierio he leas-squares aroah is based o he goal of maig he model rediios as lose as ossible o a se of arge values he Fisher rierio is derived b requirig maimum lass searaio i he ouu sae More robus ha he LSQ mehod For he o-lass roblem he Fisher rierio a be obaied as a seial ase of leas squares Fisher s disrimia for mulile lasses Cosider he geeralizaio of he Fisher disrimia o K > lasses he eigh veors { } a be osidered o be he olums of a eigh mari so ha he ihi ad beee lass variaes are here S ad m are he variae ad mea of h lass ad m is he oal mea 7

8 3/8/ Fisher s disrimia for mulile lasses o d Oe rierio ha measures he raio of beee-lass variae ad ihi lass variae is Maimizig J leads o hose olums are eigeveors of S S orresodig o he D larges eigevalues Ḅ Geeraive models vs Disrimiaive Model Geeraive models I models he joi robabili disribuio of he lass C ad iu daa ie C Give PC lassifiaio is he erformed b esimaig PC from he joi robabili disribuio Disrimiaive models I direl models he oserior lass disribuio ie PC ad lassifiaio is he doe usig PC Geeraive Models PCPC PC -geeraive model osiss of lass rior P C ad he lielihood PC PC PC Geeraive Models o d Give PC usig Baes rule PC a be omued as C C C C C o use PC for lassifiaio e eed firs esimae PC hih meas e esimae he rior P C ad he lielihood PC C C C C C 8

9 3/8/ 9 ML simae of PC Give iid raiig daa C here Assume o lass ie or ad Pπ P P ] ] π π ML simae of PC o d aig he log of he equaio above ieldig aig he derivaive of LP r o π ad seig i o zero e a solve π as here deoes he oal umber of daa ois for C ad he oal umbers ois for C ] l l ] l l P L π π π ML simae of oiuous PC o d For he lielihood fuio P is arameers deed o he e of disribuio Assume is oiuous ad P follos Gaussia disribuio ad o lasses share he same ovariae mari Σ } e{ / / D π Σ Σ ML simae of PC o d Subsiuig he lielihood fuio ba o he L P disribuio ad aig derivaive ih r ad Σ ieldig heir ML esimaes as C C S S S S 9 Σ

10 3/8/ ML simae of disree PC o d Assume is disree ad i oais D ideede values for eah lass ie for lass ad Hee Subsiuig P ba o L P ad aig derivaive r o i e a obai i D i i i D ] i i Biar Disrimiaive Models Logisi Regressio e model P direl from he daa P is iall modeled as a logisi regressio fuio Give a daa se here ] ad e } { } { his is he so-alled logisi regressio lassifiaio Biar Disrimiaive Models o d aig log of he above L ields ae derivaives of r o ields a solved ieraivel as here a is he learig rae a be radoml iiialized ad i should overge o he global oimal Give P a be obaied for lassifiaio he umber of arameers for disrimiaive models is iall muh smaller ha for he geeraive model ] l l L α ] Ses for Biar Logisi Regressio Give he raiig daa here ad {} Iiialize he veor radoml Comue usig for eah Comue Ieraivel udae usig ih differe learig raes α eg uil he hage of is small Plug io eq o omue for quer daa Classif io lass if P is larger ha 5 oherise o lass e ] α e

11 3/8/ Mulilass Disrimiaive Models Poserior disribuio for lass K> e C e here PC is modeled b a mulilass sigmoid fuio For he joi oserior robabili here is he h lass value for h samle ih folloig -of-k odig K K ] Mulilass Disrimiaive Models ae he log of he joi rob disribuio L L K L aig he derivaive of L r o ields L K L Mulilass Disrimiaive Models a be solved ieraivel as η Give he label of es samle is obaied b * argma

An alternative estimator for estimating the finite population mean in presence of measurement errors Rajesh Singh, Sachin Malik

An alternative estimator for estimating the finite population mean in presence of measurement errors Rajesh Singh, Sachin Malik A aleraive esimaor for esimaig he fiie populaio mea i presece of measureme errors Rajesh Sigh, Sachi Mali Deparme of Saisics, Baaras Hidu Uiversi araasi-005, Idia Absrac This aricle preses he problem of

More information

SA-1. Robotics Capstone. Intro to Probabilistic Techniques Probabilities Bayes rule Bayes filters

SA-1. Robotics Capstone. Intro to Probabilistic Techniques Probabilities Bayes rule Bayes filters SA- CSE-48 Roboics Capsoe Iro o robabilisic Techiqes robabiliies Baes rle Baes filers robabilisic Roboics e idea: Eplici represeaio of cerai sig he calcls of probabili heor ercepio sae esimaio Acio Acio

More information

Parametric Density Estimation: Maximum Likelihood Estimation

Parametric Density Estimation: Maximum Likelihood Estimation Parametric Desity stimatio: Maimum Likelihood stimatio C6 Today Itroductio to desity estimatio Maimum Likelihood stimatio Itroducto Bayesia Decisio Theory i previous lectures tells us how to desig a optimal

More information

Outline. Introduction. Retrospective Test for Loss Reserving Methods - Evidence from Auto Insurers

Outline. Introduction. Retrospective Test for Loss Reserving Methods - Evidence from Auto Insurers Rerospecive Tes or Loss Reservig Mehods - Evidece rom Auo Isurers eg Shi - Norher Illiois Uiversiy joi work wih Gle Meyers - Isurace Services Oice CAS Aual Meeig November 8 00 Oulie Iroducio Loss reservig

More information

1.Purposes of this research

1.Purposes of this research Isabiliy of he Hedoic Model ad Is Effec o he Qualiy Adjuse of Price Idex -- The case of deskop PCs Naohisa Hirakaa Bak of Japa 1.Purposes of his research How is isable over ie he hedoic odel for deskop

More information

A new method of forecasting south-west monsoon rainfall

A new method of forecasting south-west monsoon rainfall Curre Bioica 6): 8-86, ISSN 97-4 A ew mehod of forecasig souh-wes mosoo raifall K Raga Rao *, Navee Kumar Boiroju ad M Krisha Redd Sri Veaeshwara Veeriar Uiversi, Dair Techolog Programme, Kamaredd-5, AP,

More information

Estimating subregional and regional growth for developing Asia

Estimating subregional and regional growth for developing Asia Esimaing subregional and regional growh for develoing Asia In esimaing subregional (e.g., Eas Asia) and regional (i.e., develoing Asia) gross domesic roduc (GDP) growh, i is necessary o use weighs o roerly

More information

4452 Mathematical Modeling Lecture 17: Modeling of Data: Linear Regression

4452 Mathematical Modeling Lecture 17: Modeling of Data: Linear Regression Mah Modeling Lecure 17: Modeling of Daa: Linear Regression Page 1 5 Mahemaical Modeling Lecure 17: Modeling of Daa: Linear Regression Inroducion In modeling of daa, we are given a se of daa poins, and

More information

A Vector Autoregression Framework for the Modeling of Commodity Spreads

A Vector Autoregression Framework for the Modeling of Commodity Spreads A Vecor Auoregression Framework for he Modeling of Commodiy Sreads Ted Kury The Energy Auhoriy ICDSA 007 June, 007 Rule # of Pricing Models Pricing models can offer valuable insigh ino he behavior of simle

More information

This specification describes the models that are used to forecast

This specification describes the models that are used to forecast PCE and CPI Inflaion Differenials: Convering Inflaion Forecass Model Specificaion By Craig S. Hakkio This specificaion describes he models ha are used o forecas he inflaion differenial. The 14 forecass

More information

Topic 14: Maximum Likelihood Estimation

Topic 14: Maximum Likelihood Estimation Toic 4: November, 009 As before, we begi with a samle X = (X,, X of radom variables chose accordig to oe of a family of robabilities P θ I additio, f(x θ, x = (x,, x will be used to deote the desity fuctio

More information

Clustering Categorical Data Using a Swarm-based Method

Clustering Categorical Data Using a Swarm-based Method Cluserig Caegorial Daa Usig a Swarm-based Mehod Hesam Iakia, Aih Abraham Mahie Ielgee Researh Labs, MIR Labs, www.mirlabs.org hesam.iakia@gmail.om, aih.abraham@ieee.org Absra The K-Modes algorihm is oe

More information

Mortality in the Nordic countries Sweden. IAA Life 2007, Stockholm Ellinor Forslund

Mortality in the Nordic countries Sweden. IAA Life 2007, Stockholm Ellinor Forslund Moraliy in he Nordic counries Sweden IAA Life 2007, Sockholm Ellinor Forslund Ouline Background Mehodology Daa Resuls Conclusions Background Mehodology Daa Resuls Conlusions The need of a new common moraliy

More information

Finance Solutions to Problem Set #6: Demand Estimation and Forecasting

Finance Solutions to Problem Set #6: Demand Estimation and Forecasting Finance 30210 Soluions o Problem Se #6: Demand Esimaion and Forecasing 1) Consider he following regression for Ice Cream sales (in housands) as a funcion of price in dollars per pin. My daa is aken from

More information

Analytical Method for Solution Two-Dimensional Partial Differential Equations with Boundary Integral Conditions

Analytical Method for Solution Two-Dimensional Partial Differential Equations with Boundary Integral Conditions Ieraioal Joural of Egieerig Sciece Iveio ISSN Olie: 39 6734 ISSN Pri: 39 676 Volume 6 Issue 8 Augus 7 PP. 39-44 Aalical Mehod for Soluio Two-Dimesioal Parial Differeial Equaios wih Boudar Iegral Codiios

More information

4.5 Generalized likelihood ratio test

4.5 Generalized likelihood ratio test 4.5 Geeralized likelihood ratio test A assumptio that is used i the Athlete Biological Passport is that haemoglobi varies equally i all athletes. We wish to test this assumptio o a sample of k athletes.

More information

Exam 1. Econ520. Spring 2017

Exam 1. Econ520. Spring 2017 Exam 1. Econ520. Spring 2017 Professor Luz Hendricks UNC Insrucions: Answer all quesions. Clearly number your answers. Wrie legibly. Do no wrie your answers on he quesion shees. Explain your answers do

More information

A dual approach to some multiple exercise option problems

A dual approach to some multiple exercise option problems A dual approach o some muliple exercise opion problems 27h March 2009, Oxford-Princeon workshop Nikolay Aleksandrov D.Phil Mahemaical Finance nikolay.aleksandrov@mahs.ox.ac.uk Mahemaical Insiue Oxford

More information

Data Mining Anomaly Detection. Lecture Notes for Chapter 10. Introduction to Data Mining

Data Mining Anomaly Detection. Lecture Notes for Chapter 10. Introduction to Data Mining Daa Mining Anomaly Deecion Lecure Noes for Chaper 10 Inroducion o Daa Mining by Tan, Seinbach, Kumar Tan,Seinbach, Kumar Inroducion o Daa Mining 4/18/2004 1 Anomaly/Oulier Deecion Wha are anomalies/ouliers?

More information

Data Mining Anomaly Detection. Lecture Notes for Chapter 10. Introduction to Data Mining

Data Mining Anomaly Detection. Lecture Notes for Chapter 10. Introduction to Data Mining Daa Mining Anomaly Deecion Lecure Noes for Chaper 10 Inroducion o Daa Mining by Tan, Seinbach, Kumar Tan,Seinbach, Kumar Inroducion o Daa Mining 4/18/2004 1 Anomaly/Oulier Deecion Wha are anomalies/ouliers?

More information

Bond Prices and Interest Rates

Bond Prices and Interest Rates Winer erm 1999 Bond rice Handou age 1 of 4 Bond rices and Ineres Raes A bond is an IOU. ha is, a bond is a promise o pay, in he fuure, fixed amouns ha are saed on he bond. he ineres rae ha a bond acually

More information

Ravindra N. Chittimoori, Lawrence B. Holder and Diane J. Cook

Ravindra N. Chittimoori, Lawrence B. Holder and Diane J. Cook From: Proeedigs of he Twelfh Ieraioal FLAIRS Coferee. Coyrigh 999, AAAI (www.aaai.org). All righs reserved. Alyig he Subdue Subsruure Disovery Sysem o he Chemial Toxiiy Domai Ravidra N. Chiimoori, Lawree

More information

Density estimation III

Density estimation III CS 750 Mace Learg Lecure 7 Desy esmao III Mlos Hauskrec mlos@.edu 539 Seo Square Eoeal famly Eoeal famly: all robably mass / desy fucos a ca be wre e eoeal ormal form f e a vecor of aural or caocal arameers

More information

Slot Assignment for TDMA MAC in Industrial Wireless Sensor Network

Slot Assignment for TDMA MAC in Industrial Wireless Sensor Network Slo Assigme for TDMA MAC i Idusrial Wireless Sesor Nework Chig-Lug Chag Dep. of CSIE Naioal Yuli Uiversiy of Sciece ad Techology Taiwa, R.O.C. chag@yuech.edu.w Kua-Yi Ho Dep. of CSIE Naioal Yuli Uiversiy

More information

1.2 A CATALOG OF ESSENTIAL FUNCTIONS

1.2 A CATALOG OF ESSENTIAL FUNCTIONS SETION. A ATALOG OF ESSENTIAL FUNTIONS. A ATALOG OF ESSENTIAL FUNTIONS V Pla he Video V EXAMPLE A Table liss he average carbon dioide level in he amosphere, measured in pars per million a Mauna Loa Observaor

More information

The Dynamics of the Supply Chain. The Dynamics of the Supply Chain. What are the Causes. Lecture 4. The bullwhip effect. Order Size.

The Dynamics of the Supply Chain. The Dynamics of the Supply Chain. What are the Causes. Lecture 4. The bullwhip effect. Order Size. ecure 4 The Dynamics of he Suly Chain The bullwhi effec Order Size Disribuor Orders Reailer Orders Cusomer Demand Producion Plan Time Source: Tom Mc Guffry, Elecronic Commerce and Value Chain Managemen,

More information

Hopscotch and Explicit difference method for solving Black-Scholes PDE

Hopscotch and Explicit difference method for solving Black-Scholes PDE Mälardale iversity Fiacial Egieerig Program Aalytical Fiace Semiar Report Hopscotch ad Explicit differece method for solvig Blac-Scholes PDE Istructor: Ja Röma Team members: A Gog HaiLog Zhao Hog Cui 0

More information

1 Purpose of the paper

1 Purpose of the paper Moneary Economics 2 F.C. Bagliano - Sepember 2017 Noes on: F.X. Diebold and C. Li, Forecasing he erm srucure of governmen bond yields, Journal of Economerics, 2006 1 Purpose of he paper The paper presens

More information

The Relationship Between Monetary and Macroprudential Policies

The Relationship Between Monetary and Macroprudential Policies KDI Joural of Ecoomic Policy 01739(1): 19 40 hp://dx.doi.org/10.3895/kdijep.017.39.1.19 The Relaioship Bewee Moeary ad Macroprudeial Policies By JONG KU KANG This paper aalyzes he ieracio bewee moeary

More information

Effects of drift and noise on the optimal sliding window. window size for data stream regression models. Tschumitschew, Katharina; Klawonn, Frank

Effects of drift and noise on the optimal sliding window. window size for data stream regression models. Tschumitschew, Katharina; Klawonn, Frank Effecs of drif ad oise o he opimal slidig widow size for daa sream regressio models Iem Type Aricle Auhors Tschumischew, Kaharia; Klawo, Frak Ciaio Effecs of drif ad oise o he opimal slidig widow size

More information

World Urbanization Prospects The 2018 Revision

World Urbanization Prospects The 2018 Revision E c o o m i c & S o c i a l A f f a i r s World Urbaizaio Prospecs The 2018 Revisio Mehodology Uied Naios New York, 2018 This page is ieioally lef blak ESA/P/WP/252 Deparme of Ecoomic ad Social Affairs

More information

Forecasting consists basically of analysis of the following elements.

Forecasting consists basically of analysis of the following elements. www.gemyui.com CHAPTER-III FORECASTING Casig daa forward is called forecasig. I is a projecio based upo pas daa or i is a esimae of a eve which will happe i fuure. Need of forecasig: Whe here is a ime

More information

The Likelihood Ratio Test

The Likelihood Ratio Test LM 05 Likelihood Ratio Test 1 The Likelihood Ratio Test The likelihood ratio test is a geeral purpose test desiged evaluate ested statistical models i a way that is strictly aalogous to the F-test for

More information

Appendix B: DETAILS ABOUT THE SIMULATION MODEL. contained in lookup tables that are all calculated on an auxiliary spreadsheet.

Appendix B: DETAILS ABOUT THE SIMULATION MODEL. contained in lookup tables that are all calculated on an auxiliary spreadsheet. Appendix B: DETAILS ABOUT THE SIMULATION MODEL The simulaion model is carried ou on one spreadshee and has five modules, four of which are conained in lookup ables ha are all calculaed on an auxiliary

More information

AY Term 2 Mock Examination

AY Term 2 Mock Examination AY 206-7 Term 2 Mock Examiatio Date / Start Time Course Group Istructor 24 March 207 / 2 PM to 3:00 PM QF302 Ivestmet ad Fiacial Data Aalysis G Christopher Tig INSTRUCTIONS TO STUDENTS. This mock examiatio

More information

. The firm makes different types of furniture. Let x ( x1,..., x n. If the firm produces nothing it rents out the entire space and so has a profit of

. The firm makes different types of furniture. Let x ( x1,..., x n. If the firm produces nothing it rents out the entire space and so has a profit of Joh Riley F Maimizatio with a sigle costrait F3 The Ecoomic approach - - shadow prices Suppose that a firm has a log term retal of uits of factory space The firm ca ret additioal space at a retal rate

More information

CAUCHY'S FORMULA AND EIGENVAULES (PRINCIPAL STRESSES) IN 3-D

CAUCHY'S FORMULA AND EIGENVAULES (PRINCIPAL STRESSES) IN 3-D GG303 Lecture 19 11/5/0 1 CAUCHY'S FRMULA AN EIGENVAULES (PRINCIPAL STRESSES) IN 3- I II Mai Topics A Cauchy s formula Pricipal stresses (eigevectors ad eigevalues) Cauchy's formula A Relates tractio vector

More information

PRODUCTION, MODELING, AND EDUCATION

PRODUCTION, MODELING, AND EDUCATION PRODUCTION, MODELING, AND EDUCATION A compariso of arificial eural eworks wih oher saisical approaches for he predicio of rue meabolizable eerg of mea ad boe meal A. H. Perai,* H. Nassiri Moghaddam,* S.

More information

2/20/2013. of Manchester. The University COMP Building a yes / no classifier

2/20/2013. of Manchester. The University COMP Building a yes / no classifier COMP4 Lecture 6 Building a yes / no classifier Buildinga feature-basedclassifier Whatis a classifier? What is an information feature? Building a classifier from one feature Probability densities and the

More information

Introduction. Enterprises and background. chapter

Introduction. Enterprises and background. chapter NACE: High-Growh Inroducion Enerprises and background 18 chaper High-Growh Enerprises 8 8.1 Definiion A variey of approaches can be considered as providing he basis for defining high-growh enerprises.

More information

An empirical comparison of different risk measures in portfolio optimization

An empirical comparison of different risk measures in portfolio optimization A emirical comariso of differe risk measures i orfolio oimizaio BEH Aril 200 Peer-reviewed & Oe access oural ISS: 804-205 www.ieb.cz BEH - Busiess ad Ecoomic Horizos Volume Issue Aril 200. 39-45 A emirical

More information

Exam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011

Exam 2. Instructor: Cynthia Rudin TA: Dimitrios Bisias. October 25, 2011 15.075 Exam 2 Istructor: Cythia Rudi TA: Dimitrios Bisias October 25, 2011 Gradig is based o demostratio of coceptual uderstadig, so you eed to show all of your work. Problem 1 You are i charge of a study

More information

Chapter 4 The Time Value of Money and Discounted Cash Flow Analysis

Chapter 4 The Time Value of Money and Discounted Cash Flow Analysis Chaper 4 The Time Value of Money and Disouned Cash Flow nalysis 4.5 Muliple Cash Flows Suppose ha an invesmen plan has muliple ash inflows as follows. Cash inflows are $,000 a year from now and $2,000

More information

Estimating Volatilities and Correlations. Following Options, Futures, and Other Derivatives, 5th edition by John C. Hull. Chapter 17. m 2 2.

Estimating Volatilities and Correlations. Following Options, Futures, and Other Derivatives, 5th edition by John C. Hull. Chapter 17. m 2 2. Estiatig Volatilities ad Correlatios Followig Optios, Futures, ad Other Derivatives, 5th editio by Joh C. Hull Chapter 17 Stadard Approach to Estiatig Volatility Defie as the volatility per day betwee

More information

MA Advanced Macro, 2016 (Karl Whelan) 1

MA Advanced Macro, 2016 (Karl Whelan) 1 MA Advanced Macro, 2016 (Karl Whelan) 1 The Calvo Model of Price Rigidiy The form of price rigidiy faced by he Calvo firm is as follows. Each period, only a random fracion (1 ) of firms are able o rese

More information

The Mathematics Of Stock Option Valuation - Part Four Deriving The Black-Scholes Model Via Partial Differential Equations

The Mathematics Of Stock Option Valuation - Part Four Deriving The Black-Scholes Model Via Partial Differential Equations The Mahemaics Of Sock Opion Valuaion - Par Four Deriving The Black-Scholes Model Via Parial Differenial Equaions Gary Schurman, MBE, CFA Ocober 1 In Par One we explained why valuing a call opion as a sand-alone

More information

Maximum Empirical Likelihood Estimation (MELE)

Maximum Empirical Likelihood Estimation (MELE) Maximum Empirical Likelihood Estimatio (MELE Natha Smooha Abstract Estimatio of Stadard Liear Model - Maximum Empirical Likelihood Estimator: Combiatio of the idea of imum likelihood method of momets,

More information

ECON 5350 Class Notes Maximum Likelihood Estimation

ECON 5350 Class Notes Maximum Likelihood Estimation ECON 5350 Class Notes Maximum Likelihood Estimatio 1 Maximum Likelihood Estimatio Example #1. Cosider the radom sample {X 1 = 0.5, X 2 = 2.0, X 3 = 10.0, X 4 = 1.5, X 5 = 7.0} geerated from a expoetial

More information

Computer Lab 6. Minitab Project Report. Time Series Plot of x. Year

Computer Lab 6. Minitab Project Report. Time Series Plot of x. Year Compuer Lab Problem. Lengh of Growing Season in England Miniab Projec Repor Time Series Plo of x x 77 8 8 889 Year 98 97 The ime series plo indicaes a consan rend up o abou 9, hen he lengh of growing season

More information

Ma 093 and MA 117A - Exponential Models. Topic 1 Compound Interest

Ma 093 and MA 117A - Exponential Models. Topic 1 Compound Interest Ma 093 and MA 117A - Eponenial Models Topic 1 Compound Ineres 15) Compound Ineres A person invess $7000 a 10% ineres compounded annuall. a) Find an equaion for he value of he invesmen afer ears. = a* b

More information

Power Curves for t-test. Shoe Wear. α =.05, X 1,..., X n N(µ,1) > t.test(rnorm(20,mean=2,sd=2)) One-Sample t-test

Power Curves for t-test. Shoe Wear. α =.05, X 1,..., X n N(µ,1) > t.test(rnorm(20,mean=2,sd=2)) One-Sample t-test One-Samle -Tes Poer Crves for -es α =.05, X 1,..., X n N(µ,1) n=20.es(rnorm(20,mean=2,sd=2)) One Samle -es daa: rnorm(20, mean = 2, sd = 2) = 2.384, df = 19, -vale = 0.02771 alernaive hyohesis: re mean

More information

Optimal Consumption and Investment with Habit Formation and Hyperbolic discounting. Mihail Zervos Department of Mathematics London School of Economics

Optimal Consumption and Investment with Habit Formation and Hyperbolic discounting. Mihail Zervos Department of Mathematics London School of Economics Oimal Consumion and Invesmen wih Habi Formaion and Hyerbolic discouning Mihail Zervos Dearmen of Mahemaics London School of Economics Join work wih Alonso Pérez-Kakabadse and Dimiris Melas 1 The Sandard

More information

International Review of Business Research Papers Vol. 4 No.3 June 2008 Pp Understanding Cross-Sectional Stock Returns: What Really Matters?

International Review of Business Research Papers Vol. 4 No.3 June 2008 Pp Understanding Cross-Sectional Stock Returns: What Really Matters? Inernaional Review of Business Research Papers Vol. 4 No.3 June 2008 Pp.256-268 Undersanding Cross-Secional Sock Reurns: Wha Really Maers? Yong Wang We run a horse race among eigh proposed facors and eigh

More information

STAT 135 Solutions to Homework 3: 30 points

STAT 135 Solutions to Homework 3: 30 points STAT 35 Solutios to Homework 3: 30 poits Sprig 205 The objective of this Problem Set is to study the Stei Pheomeo 955. Suppose that θ θ, θ 2,..., θ cosists of ukow parameters, with 3. We wish to estimate

More information

Stock Price Information Content, Idiosyncratic Volatility and Expected Return

Stock Price Information Content, Idiosyncratic Volatility and Expected Return Joural of Mahemaical Fiace 015 5 401-411 Published Olie November 015 i SciRes. hp://www.scirp.org/joural/jmf hp://dx.doi.org/10.436/jmf.015.54034 Sock Price Iformaio Coe Idiosycraic Volailiy ad Expeced

More information

a. If Y is 1,000, M is 100, and the growth rate of nominal money is 1 percent, what must i and P be?

a. If Y is 1,000, M is 100, and the growth rate of nominal money is 1 percent, what must i and P be? Problem Se 4 ECN 101 Inermediae Macroeconomics SOLUTIONS Numerical Quesions 1. Assume ha he demand for real money balance (M/P) is M/P = 0.6-100i, where is naional income and i is he nominal ineres rae.

More information

18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013

18.S096 Problem Set 5 Fall 2013 Volatility Modeling Due Date: 10/29/2013 18.S096 Problem Set 5 Fall 2013 Volatility Modelig Due Date: 10/29/2013 1. Sample Estimators of Diffusio Process Volatility ad Drift Let {X t } be the price of a fiacial security that follows a geometric

More information

Macroeconomics II A dynamic approach to short run economic fluctuations. The DAD/DAS model.

Macroeconomics II A dynamic approach to short run economic fluctuations. The DAD/DAS model. Macroeconomics II A dynamic approach o shor run economic flucuaions. The DAD/DAS model. Par 2. The demand side of he model he dynamic aggregae demand (DAD) Inflaion and dynamics in he shor run So far,

More information

7 pages 1. Hull and White Generalized model. Ismail Laachir. March 1, Model Presentation 1

7 pages 1. Hull and White Generalized model. Ismail Laachir. March 1, Model Presentation 1 7 pages 1 Hull and Whie Generalized model Ismail Laachir March 1, 212 Conens 1 Model Presenaion 1 2 Calibraion of he model 3 2.1 Fiing he iniial yield curve................... 3 2.2 Fiing he caple implied

More information

Organize your work as follows (see book): Chapter 3 Engineering Solutions. 3.4 and 3.5 Problem Presentation

Organize your work as follows (see book): Chapter 3 Engineering Solutions. 3.4 and 3.5 Problem Presentation Chaper Engineering Soluions.4 and.5 Problem Presenaion Organize your work as follows (see book): Problem Saemen Theory and Assumpions Soluion Verificaion Tools: Pencil and Paper See Fig.. in Book or use

More information

Market Models. Practitioner Course: Interest Rate Models. John Dodson. March 29, 2009

Market Models. Practitioner Course: Interest Rate Models. John Dodson. March 29, 2009 s Praciioner Course: Ineres Rae Models March 29, 2009 In order o value European-syle opions, we need o evaluae risk-neural expecaions of he form V (, T ) = E [D(, T ) H(T )] where T is he exercise dae,

More information

x satisfying all regularity conditions. Then

x satisfying all regularity conditions. Then AMS570.01 Practice Midterm Exam Sprig, 018 Name: ID: Sigature: Istructio: This is a close book exam. You are allowed oe-page 8x11 formula sheet (-sided). No cellphoe or calculator or computer is allowed.

More information

The Relation between Implied and Realized Volatility of S&P 500 Index

The Relation between Implied and Realized Volatility of S&P 500 Index he Relaio bewee Implied ad ailiy of S&P 5 Idex Jighog Shu* School of Ieraioal rade ad Ecoomics, Uiversiy of Ieraioal Busiess & Ecoomics, Huixidogjie, Hepigjiebeikou, Beijig, P.R. Chia, el: (86) 6483 783,

More information

Bingham, Ella; Kaban, Ata; Fortelius, Mikael The aspect Bernoulli model: multiple causes of presences and absences

Bingham, Ella; Kaban, Ata; Fortelius, Mikael The aspect Bernoulli model: multiple causes of presences and absences Powered by TCPDF (www.cpdf.org) This is a elecroic repri of he origial aricle. This repri may differ from he origial i pagiaio ad ypographic deail. Bigham, Ella; Kaba, Aa; Forelius, Miael The aspec Beroulli

More information

Stock price modelling: Theory and Practice

Stock price modelling: Theory and Practice Sock price modellig: Theory ad Pracice Abdelmoula Dmouj Supervisor: drs. A.M. Dobber Vrije Uiversiei Faculy of scieces Amserdam, The Neherlads Sock price modellig: Theory ad pracice Preface This disseraio

More information

(1 + Nominal Yield) = (1 + Real Yield) (1 + Expected Inflation Rate) (1 + Inflation Risk Premium)

(1 + Nominal Yield) = (1 + Real Yield) (1 + Expected Inflation Rate) (1 + Inflation Risk Premium) 5. Inflaion-linked bonds Inflaion is an economic erm ha describes he general rise in prices of goods and services. As prices rise, a uni of money can buy less goods and services. Hence, inflaion is an

More information

Producing historical for STS-statistics Theory with an application turnover in the Netherlands ( )8

Producing historical for STS-statistics Theory with an application turnover in the Netherlands ( )8 8 e8 Producing hisorical for STS-saisics Theory wih an alicaion urnover in he Neherlands (1995 28)8 i ime series sics in NACE Rev.2 in indusrial Ger Buien, Jarl Kamen en Sidney Vergouw Discussion aer (91)

More information

I nflation in the United States has been

I nflation in the United States has been Michael Dueker is a research officer a he Federal Reserve Bank of S. Louis. Nick H. Meggos and homas A. Pollmann rovided research assisance. Measuring Moneary Policy Ineria in arge Fed Funds Rae Changes

More information

Many Techniques Developed. Uncertainty. Aspects of Uncertainty. Decision Theory = Probability + Utility Theory

Many Techniques Developed. Uncertainty. Aspects of Uncertainty. Decision Theory = Probability + Utility Theory Ucertait CSE 47 Ma Techiques Developed Fu Logic Certait Factors No-mootoic logic robabilit Ol oe has stood the test of time! UW CSE AI Facult Aspects of Ucertait Suppose ou have a flight at oo Whe should

More information

ECORFAN Journal OPTIMIZATION June 2014 Vol.5 No

ECORFAN Journal OPTIMIZATION June 2014 Vol.5 No Compariso of Europea ad Asia valuaio of opios wih uderlyig average ad sochasic ieres rae by oe ORTIZ- Ambrosio * & aríez-aría 2057 Escuela Superior de Ecoomía-I. P. N. Pla de Agua Priea 66, Pluarco Elías

More information

Combining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010

Combining imperfect data, and an introduction to data assimilation Ross Bannister, NCEO, September 2010 Combiig imperfect data, ad a itroductio to data assimilatio Ross Baister, NCEO, September 00 rbaister@readigacuk The probability desity fuctio (PDF prob that x lies betwee x ad x + dx p (x restrictio o

More information

Analyzing Investors Market Sentiment Based on the Option-implied Distribution of Stock Returns

Analyzing Investors Market Sentiment Based on the Option-implied Distribution of Stock Returns Analyzing Invesors Marke enimen Based on he Oion-imlied Disribuion of ok Reurns Ming hann sai Corresonding auhor, Assoiae Professor Dearmen of Finane, Naional Universiy of Kaohsiung, Kaohsiung, aiwan.

More information

Fial sep (Biomial Theorem)-by abhiji Kumar Jha LEVEL I 5 Show ha he middle erm i he expasio of ( + x) is! ieger x, where is a posiive Fid he erms idepede of x, x 0, i he expasio of (i) x x 6 (ii) x x I

More information

Point Estimation by MLE Lesson 5

Point Estimation by MLE Lesson 5 Poit Estimatio b MLE Lesso 5 Review Defied Likelihood Maximum Likelihood Estimatio Step : Costruct Likelihood Step : Maximize fuctio Take Log of likelihood fuctio Take derivative of fuctio Set derivative

More information

Chapter Four 1/15/2018. Learning Objectives. The Meaning of Interest Rates Future Value, Present Value, and Interest Rates Chapter 4, Part 1.

Chapter Four 1/15/2018. Learning Objectives. The Meaning of Interest Rates Future Value, Present Value, and Interest Rates Chapter 4, Part 1. Chapter Four The Meaig of Iterest Rates Future Value, Preset Value, ad Iterest Rates Chapter 4, Part 1 Preview Develop uderstadig of exactly what the phrase iterest rates meas. I this chapter, we see that

More information

1 Random Variables and Key Statistics

1 Random Variables and Key Statistics Review of Statistics 1 Radom Variables ad Key Statistics Radom Variable: A radom variable is a variable that takes o differet umerical values from a sample space determied by chace (probability distributio,

More information

Midterm II. Monday, August 3. 2 hours

Midterm II. Monday, August 3. 2 hours Sa Facisco State Uivesity ichael Ba ECON 85 Summe 5 idtem II oday, August 3 hous Name: Istuctios. This is closed book, closed otes exam.. No calculatos o ay kid ae allowed. 3. Show all the calculatios.

More information

Market and Information Economics

Market and Information Economics Marke and Informaion Economics Preliminary Examinaion Deparmen of Agriculural Economics Texas A&M Universiy May 2015 Insrucions: This examinaion consiss of six quesions. You mus answer he firs quesion

More information

Rational Appeasement, Daniel Treisman, International Organization. Proofs of Propositions 4 and 5

Rational Appeasement, Daniel Treisman, International Organization. Proofs of Propositions 4 and 5 Raional Appeaseen, Daniel Treisan, Inernaional Organizaion. Proofs of Proposiions 4 and 5 Proposiion 4: In he gae wih endogenous sakes, a deerrene equilibriu an exis only if he ener s fixed os of fighing,

More information

MA Lesson 11 Section 1.3. Solving Applied Problems with Linear Equations of one Variable

MA Lesson 11 Section 1.3. Solving Applied Problems with Linear Equations of one Variable MA 15200 Lesso 11 Sectio 1. I Solvig Applied Problems with Liear Equatios of oe Variable 1. After readig the problem, let a variable represet the ukow (or oe of the ukows). Represet ay other ukow usig

More information

DATA QUALITY ASSESSMENT FOR SYSTEM IDENTIFCATION: A PROPOSED NEW FRAMEWORK

DATA QUALITY ASSESSMENT FOR SYSTEM IDENTIFCATION: A PROPOSED NEW FRAMEWORK DAA QUALIY ASSESSMEN FOR SYSEM IDENIFCAION: A PROPOSED NEW FRAMEWORK Yuri A.W. Shard and Biao Huang * Dearmen of Chemical and Maerials Engineering Universiy of Albera Edmonon, AB, Canada, 6G 2V4 Absrac

More information

Output: The Demand for Goods and Services

Output: The Demand for Goods and Services IN CHAPTER 15 how o incorporae dynamics ino he AD-AS model we previously sudied how o use he dynamic AD-AS model o illusrae long-run economic growh how o use he dynamic AD-AS model o race ou he effecs

More information

Financial Econometrics Jeffrey R. Russell Midterm Winter 2011

Financial Econometrics Jeffrey R. Russell Midterm Winter 2011 Name Financial Economerics Jeffrey R. Russell Miderm Winer 2011 You have 2 hours o complee he exam. Use can use a calculaor. Try o fi all your work in he space provided. If you find you need more space

More information

Density estimation II.

Density estimation II. Lecture 5 esty estmato II. Mlos Hausrecht mlos@cs.tt.eu 539 Seott Square Outle Outle: esty estmato: Bomal strbuto Multomal strbuto ormal strbuto oetal famly ata: esty estmato {.. } a vector of attrbute

More information

Chapter 15. Bayesian Statistics and Decision Analysis. COMPLETE BUSINESS STATISTICS by AMIR D. ACZEL & JAYAVEL SOUNDERPANDIAN

Chapter 15. Bayesian Statistics and Decision Analysis. COMPLETE BUSINESS STATISTICS by AMIR D. ACZEL & JAYAVEL SOUNDERPANDIAN COMPLETE BUSINESS STATISTICS by AMIR D. ACZEL & JAYAVEL SOUNDERPANDIAN 6 th editio. 15-1 Chater 15 Bayesia Statistics Decisio Aalysis 15-2 15 Bayesia Statistics Decisio Aalysis 15-3 15 LEARNING OBJECTIVES

More information

Distilling GRU with Data Augmentation for Unconstrained Handwritten Text Recognition

Distilling GRU with Data Augmentation for Unconstrained Handwritten Text Recognition Disilling GRU wih Daa Augmenaion for Unconsrained Handwrien Tex Recogniion Reporer: Zecheng Xie Souh China Universiy of Technology Augus 6,2018 Ouline Problem Definiion Daa Augmenaion Experimens Conclusion

More information

A New Constructive Proof of Graham's Theorem and More New Classes of Functionally Complete Functions

A New Constructive Proof of Graham's Theorem and More New Classes of Functionally Complete Functions A New Costructive Proof of Graham's Theorem ad More New Classes of Fuctioally Complete Fuctios Azhou Yag, Ph.D. Zhu-qi Lu, Ph.D. Abstract A -valued two-variable truth fuctio is called fuctioally complete,

More information

Watch out for the impact of Scottish independence opinion polls on UK s borrowing costs

Watch out for the impact of Scottish independence opinion polls on UK s borrowing costs Wach ou for he impac of Scoish independence opinion polls on UK s borrowing coss Cosas Milas (Universiy of Liverpool; email: cosas.milas@liverpool.ac.uk) and Tim Worrall (Universiy of Edinburgh; email:

More information

Miller and Modigliani s (1961) stock price valuation formula based on constant discount rates implies ( )

Miller and Modigliani s (1961) stock price valuation formula based on constant discount rates implies ( ) VARIANCE BOUNDS Mille and Modigliani s 96) sock pice valuaion fomula based on consan discoun aes implies E[ d ] ) ) If we knew he fuue dividends fo ceain we would have pice - he pefec- foesigh d 2) ) Examining

More information

A random variable is a variable whose value is a numerical outcome of a random phenomenon.

A random variable is a variable whose value is a numerical outcome of a random phenomenon. The Practice of Statistics, d ed ates, Moore, ad Stares Itroductio We are ofte more iterested i the umber of times a give outcome ca occur tha i the possible outcomes themselves For example, if we toss

More information

Pricing Unemployment Insurance in Iran

Pricing Unemployment Insurance in Iran Iranian Journal of Risk and Insurance, Vol. 1, No. 1, Sring 2015 Pricing Unemloymen Insurance in Iran Reza Ofoghi 1 Received: 02. Feb. 2015 Ramyar Ebne Abbas 2 Acceed: 21. Ar. 2015 Absrac Emloyees are

More information

Economic Growth Continued: From Solow to Ramsey

Economic Growth Continued: From Solow to Ramsey Economic Growh Coninued: From Solow o Ramsey J. Bradford DeLong May 2008 Choosing a Naional Savings Rae Wha can we say abou economic policy and long-run growh? To keep maers simple, le us assume ha he

More information

Unemployment and Phillips curve

Unemployment and Phillips curve Unemploymen and Phillips curve 2 of The Naural Rae of Unemploymen and he Phillips Curve Figure 1 Inflaion versus Unemploymen in he Unied Saes, 1900 o 1960 During he period 1900 o 1960 in he Unied Saes,

More information

Point Estimation by MLE Lesson 5

Point Estimation by MLE Lesson 5 Poit Estimatio b MLE Lesso 5 Review Defied Likelihood Maximum Likelihood Estimatio Step : Costruct Likelihood Step : Maximize fuctio Take Log of likelihood fuctio Take derivative of fuctio Set derivative

More information

Supplement to Chapter 3

Supplement to Chapter 3 Supplemen o Chaper 3 I. Measuring Real GD and Inflaion If here were only one good in he world, anchovies, hen daa and prices would deermine real oupu and inflaion perfecly: GD Q ; GD Q. + + + Then, he

More information

Today: Finish Chapter 9 (Sections 9.6 to 9.8 and 9.9 Lesson 3)

Today: Finish Chapter 9 (Sections 9.6 to 9.8 and 9.9 Lesson 3) Today: Fiish Chapter 9 (Sectios 9.6 to 9.8 ad 9.9 Lesso 3) ANNOUNCEMENTS: Quiz #7 begis after class today, eds Moday at 3pm. Quiz #8 will begi ext Friday ad ed at 10am Moday (day of fial). There will be

More information

Pricing FX Target Redemption Forward under. Regime Switching Model

Pricing FX Target Redemption Forward under. Regime Switching Model In. J. Conemp. Mah. Sciences, Vol. 8, 2013, no. 20, 987-991 HIKARI Ld, www.m-hikari.com hp://dx.doi.org/10.12988/ijcms.2013.311123 Pricing FX Targe Redempion Forward under Regime Swiching Model Ho-Seok

More information

ANSWER ALL QUESTIONS. CHAPTERS 6-9; (Blanchard)

ANSWER ALL QUESTIONS. CHAPTERS 6-9; (Blanchard) ANSWER ALL QUESTIONS CHAPTERS 6-9; 18-20 (Blanchard) Quesion 1 Discuss in deail he following: a) The sacrifice raio b) Okun s law c) The neuraliy of money d) Bargaining power e) NAIRU f) Wage indexaion

More information

On the Chord Length to Arc Length Ratio for Open Curves Undergoing a Length-Rescaled Curvature Flow

On the Chord Length to Arc Length Ratio for Open Curves Undergoing a Length-Rescaled Curvature Flow On he Chord engh o Arc engh Raio for Oen Curves Undergoing a engh-rescaed Curvaure Fow Erik Forseh Juy 3, 2007 The engh-rescaed Curvaure Fow We begin by defining a few roeries of he new fow. e φ be he

More information