Combining Experimental and Non-Experimental Design in Causal Inference
|
|
- Karin Gordon
- 5 years ago
- Views:
Transcription
1 Combining Experimental and Non-Experimental Design in Causal Inference Kari Lock Morgan Department of Statistics Penn State University Rao Prize Conference May 12 th, 2017
2 A Tribute to Don Design trumps analysis Motivated by a real study Experimental design & rerandomization Observational study & propensity scores Rubin causal model & potential outcomes Educational testing (AP scores) (Missing data) (Noncompliance)
3 Design trumps Analysis For Objective Causal Inference, Design trumps Analysis Rubin 2008 X = covariates, W = treatment, Y = outcome(s) Design W X Analysis Y W, X Balance covariates As much as possible should be done without observed outcomes!
4 Knowledge in Action Goal: estimate causal effect of Knowledge in Action (KIA) (a form of project-based learning) in AP classes on AP scores and other outcomes Part 1 ( Efficacy Study ): randomize schools to KIA or control; compare outcomes after 1 year Part 2 ( Maturation Study ): continue to follow schools another year (experimental & observational)
5 Districts (blocks) *In this talk I ll just focus on one district District 1 District 5 Schools (clusters) RANDOMIZATION Teachers Students OUTCOMES
6 Covariates Covariates available at randomization: School covariates (e.g. Title 1 status, type, etc.) Teacher covariates (e.g. years of experience) Previous student (class) covariates: Race/ethnicity Poverty status Parental education PSAT scores x 1 8 th grade standardized test scores Total number of students Number of students who took the AP exam If covariates are available, we should use them when we randomize! x 2 2 covariates used for randomization
7 Rerandomization Collect covariate data Specify criteria for acceptable balance (Re)randomize Randomize units units to to treatment groups Check balance xx 1,TT xx 1,CC < 0.05 and xx 2,TT xx 2,CC < 0.05 unacceptable acceptable Conduct experiment Analyze results
8 Covariate Balance: Empirical Percent reduction in variance: PPPPPPPP = vvvvvv xx jj,tt xx jj,cc vvvvvv xx jj,tt xx jj,cc rrrrrrrrrrrr. vvvvvv xx jj,tt xx jj,cc
9 Covariate Balance: Theoretical Suppose xx jj,tt xx jj,cc ~ Normal for jj 1 kk xx 1 xx 2 xx kk Rerandomize if xx jj,tt xx jj,cc aa jj for jj 1 kk Then the PRIV for xx jj is pp xx1 = pp xx2 = pp zzjj = 1 2 γγ 3 2, aa jj 2 2vvvvvv(xx jj ) γγ 1 2, aa jj 2 2vvvvvv(xx jj ) 1 nn + 1 TT nncc 1 nn + 1 TT nncc, where γγ(bb, cc) 0 cc yy bb 1 ee yy dddd.
10 Outcome PRIV If rerandomization is equal percent variance reducing (EPVR), then PRIV for the outcome difference in means is PPPPPPPP YY = RR 2 PPPPPPPP XX Here, RR and PPPPPPPP XX 98%, so PPPPPPPP YY = 74% Precision increases by a factor of = 3.85 Equivalent to almost quadrupling n!!! (Effective sample size goes from 76 to 293!) NOTE: This is TRUE variance! Need randomization-based inference to reflect this
11 Correlational Structure
12 Affine Invariance Affine invariance: rerandomization stays the same for any affine transformation a + bx If rerandomization criterion is affinely invariant and x is ellipsoidally symmetric 1. Ε XX TT XX cc rerand. = Ε XX TT XX cc = 00 => Rerandomization leads to unbiased estimates for any linear function of x 2. cov XX TT XX cc rerand. cov XX TT XX cc Preserves the correlations of XX TT XX cc Balance improvement equal for each xx jj (equal percent variance reducing) (Morgan and Rubin, Annals of Statistics, 2012)
13 Mahalanobis Mahalanobis: XX TT XX cc cov xx 1 XX TT XX cc
14 Knowledge in Action Part 1 ( Efficacy Study ): randomize schools to KIA or control; compare outcomes after 1 year Part 2 ( Maturation Study ): continue to follow schools another year (experimental & observational)
15 Covariate data for schools not in RCT MATCHING Matched Sample: 2 years of KIA no KIA Covariate data for schools in RCT RANDOMIZE WAVE 1: WAVE 2: KIA KIA: 2 nd year KIA: 1 st year 2 years of KIA no KIA? 1 year of KIA no KIA 2 years of KIA 1 year of KIA
16 2 years of KIA no KIA? 2 years of KIA no KIA Non-experimental direct approach Matched Sample: WAVE 1: KIA KIA: 2 nd year WHICH IS BETTER??? WAVE 2: KIA: 1 st year 1 year of KIA no KIA 2 years of KIA 1 year of KIA Experimental indirect approach
17 Potential Outcomes & Estimands YY jj (WW jj, tt)= potential outcome for school j under treatment WW jj in year t Causal effect: compare potential outcomes under different treatments ττ 1,tt YY 1, tt YY 0, tt = nn jj=1 YY jj 1, tt nn nn jj=1 YY jj 0, tt nn ττ 2 1,tt YY 2, tt YY 1, tt = nn jj=1 YY jj 2, tt nn nn jj=1 YY jj 1, tt nn ττ 2,tt YY 2, tt YY 0, tt = nn jj=1 YY jj 2, tt nn nn jj=1 YY jj 1, tt nn
18 Estimators ττ 1,2017 nn jj=1 WWjj YY jj (1,2017) nn jj=1 jj=1 WW jj nn (1 WWjj ) YY jj (0,2017) nn jj=1 (1 WW jj ) ττ 2 1,2018 nn jj=1 II WWjj =2 YY jj (2,2018) nn jj=1 II WWjj =2 nn jj=1 II WWjj =1 YY jj (1,2018) nn jj=1 II WWjj =1 ττ 2,2018 nn jj=1 II WWjj =2 YY jj (2,2018) nn jj=1 II WWjj =2 nn jj=1 II WWjj =1 YY jj (0,2018) nn jj=1 II WWjj =1
19 2 years of KIA no KIA? 2 years of KIA no KIA Non-experimental direct approach Matched Sample: WAVE 1: KIA KIA: 2 nd year WHICH IS BETTER??? WAVE 2: KIA: 1 st year 1 year of KIA no KIA 2 years of KIA 1 year of KIA Experimental indirect approach
20 Propensity Score Matching 1 if in Wave 1 of experiment WW jj = 0 if not in experiment Propensity score: ee jj = PP WW jj = 1 xx jj ) Match each Wave 1 teacher with a control with a similar propensity score Criteria for success: Quality of observed covariate data can only balance observed data Good matches available adequate overlap between groups large enough pool of potential controls
21 Propensity Score Matching If we have good matches, we can balance observed covariates Key point: unless we have data on all relevant covariates (which we won t), there will still be bias (baseline differences) Usually hard to quantify this bias BUT we have a very rare feature!!
22 1 year of KIA no KIA 2 years of KIA no KIA Matched Sample: WAVE 1: WAVE 2: KIA KIA: 2 nd year KIA: 1 st year We can validate the nonexperimental approach by comparing 1 year impact estimates! 1 year of KIA no KIA
23 2 years of KIA no KIA? 1 year of KIA no KIA 2 years of KIA no KIA Non-experimental direct approach Matched Sample: WAVE 1: KIA KIA: 2 nd year WHICH IS BETTER??? WAVE 2: KIA: 1 st year 1 year of KIA no KIA 2 years of KIA 1 year of KIA Experimental indirect approach
24 Experimental Indirect Approach ττ 2 1, ττ 1,2017 = YY 2,2018 YY 1, YY 1,2017 YY 0,2017 Critical assumption: potential outcomes may depend on year, but treatment effects do not That is, YY 1,2017 YY 1,2018, but ττ 1,2017 = ττ 1,2018 ττ 1 This implies ττ 1 + ττ 2 1 = ττ 2
25 Define ττ 2 ττ 1 + ττ 2 1 Unbiased Theorem: Assuming treatment effects do not vary by year, Ε ττ 2 = ττ 2. Proof: Ε ττ 2 = E ττ 1 + ττ 2 1 = ττ 1 + ττ 2 1 = ττ 2.
26 Variance vvvvvv( ττ 2 ) = vvvvvv( ττ 1 + ττ 2 1 ) = vvvvvv ττ 1 +vvvvvv ττ cov( ττ 1, ττ 2 1 ) Both estimates are comparisons of the same teachers; likely to be highly positively correlated More than double the variance of each individual estimate
27 Constant Treatment Effect? Suppose constant treatment effect, so YY jj 1, tt = YY jj 0, tt + ττ 1 and YY jj 2, tt = YY jj 1, tt + ττ 2 1 jj. Then: o o ττ 1 = ττ 1 + YY WWWWWWWWW (0, 2017) YY WWWWWWWWW (0, 2017) ττ 2 1 = ττ YY WWWWWWWWW (0, 2018) YY WWWWWWWWW (0, 2018) Under additivity, and if we again assume differences in time cancel with comparisons within the same year, then ττ 1 and ττ 2 1 are perfectly correlated! vvvvvv( ττ 2 ) = vvvvvv ττ 1 +vvvvvv ττ vvvvvv ττ 1 vvvvvv ττ 2 1 If vvvvvv ττ 1 vvvvvv ττ 2 1, then vvvvvv( ττ 2 ) 4vvvvvv ττ 1
28 2 years of KIA no KIA? 1 year of KIA no KIA 2 years of KIA no KIA Non-experimental direct approach Matched Sample: WHICH IS BETTER??? WAVE 1: WAVE 2: KIA KIA: 2 nd year KIA: 1 st year BIAS- VARIANCE TRADEOFF! Complementary! 1 year of KIA no KIA 2 years of KIA 1 year of KIA Experimental indirect approach
29 Other Interesting Tidbits Student-level versus school level analysis Combined analyses? Student/parental consent => missing data Joiners Non-compliance Teachers switching schools/courses Anticipation bias and more!
30 Conclusion Rerandomization can improve experimental design Propensity score matching can improve observational studies Bias-variance tradeoff for 2 year impact Lots of fun statistics in rich applied problems!
31 Funded by George Lucas Educational Foundation Joint work with Anna Saavedra, Amie Rappaport, Ying Liu, and Juan Saavedra
32 Weighting Option 1: Weight schools equally ττ 1 = nn jj=1 WW jj YY jj 1 nn jj=1 nn (1 WW jj ) YY jj 0 WW nn jj (1 WW jj ) jj=1 jj=1 Option 2: Weight students equally nn ττ 1 = jj=1 WW jj YY jj 1 nn jj nn jj=1(1 WW jj ) YY jj 0 nn jj WW jj nn nn jj (1 WW jj )nn jj jj=1 nn jj=1 Differing number of students (3-127) ττ may vary with class size = nn jj=1 nn jj WWjj YYii ii=1 (1) nn nn nn jj jj=1 (1 WWjj ) YYii ii=1 (0) WW jj nn nn jj (1 WW jj )nn jj jj=1 jj=1
33 Multilevel Model 2 Student-level: YY ii WW jj ii ~NN μμ jj WW jj + ββ 1 xx 1, σσ YY 2 School-level: μμ jj WW jj ~NN αα kk + ττww jj + ββ 2 xx 2, σσ μμ District-level: αα kk ~NN(αα + ββ 3 xx 3, σσ 2 αα ) Smaller schools shrink more; in between the two weighting extremes
Midterm Exam 1, section 2. Thursday, September hour, 15 minutes
San Francisco State University Michael Bar ECON 312 Fall 2018 Midterm Exam 1, section 2 Thursday, September 27 1 hour, 15 minutes Name: Instructions 1. This is closed book, closed notes exam. 2. You can
More informationBayesian Methods: Naïve Bayes
Bayesian Methods: Naïve Bayes Nicholas Ruozzi University of Texas at Dallas based on the slides of Vibhav Gogate Last Time Parameter learning Learning the parameter of a simple coin flipping model Prior
More informationSpecial Topics: Data Science
Special Topics: Data Science L Linear Methods for Prediction Dr. Vidhyasaharan Sethu School of Electrical Engineering & Telecommunications University of New South Wales Sydney, Australia V. Sethu 1 Topics
More informationECO 745: Theory of International Economics. Jack Rossbach Fall Lecture 6
ECO 745: Theory of International Economics Jack Rossbach Fall 2015 - Lecture 6 Review We ve covered several models of trade, but the empirics have been mixed Difficulties identifying goods with a technological
More informationLecture 5. Optimisation. Regularisation
Lecture 5. Optimisation. Regularisation COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne Iterative optimisation Loss functions Coordinate
More informationImperfectly Shared Randomness in Communication
Imperfectly Shared Randomness in Communication Madhu Sudan Harvard Joint work with Clément Canonne (Columbia), Venkatesan Guruswami (CMU) and Raghu Meka (UCLA). 11/16/2016 UofT: ISR in Communication 1
More informationFunctions of Random Variables & Expectation, Mean and Variance
Functions of Random Variables & Expectation, Mean and Variance Kuan-Yu Chen ( 陳冠宇 ) @ TR-409, NTUST Functions of Random Variables 1 Given a random variables XX, one may generate other random variables
More informationJasmin Smajic 1, Christian Hafner 2, Jürg Leuthold 2, March 16, 2015 Introduction to Finite Element Method (FEM) Part 1 (2-D FEM)
Jasmin Smajic 1, Christian Hafner 2, Jürg Leuthold 2, March 16, 2015 Introduction to Finite Element Method (FEM) Part 1 (2-D FEM) 1 HSR - University of Applied Sciences of Eastern Switzerland Institute
More informationThe Simple Linear Regression Model ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD
The Simple Linear Regression Model ECONOMETRICS (ECON 360) BEN VAN KAMMEN, PHD Outline Definition. Deriving the Estimates. Properties of the Estimates. Units of Measurement and Functional Form. Expected
More informationPhysical Design of CMOS Integrated Circuits
Physical Design of CMOS Integrated Circuits Dae Hyun Kim EECS Washington State University References John P. Uyemura, Introduction to VLSI Circuits and Systems, 2002. Chapter 5 Goal Understand how to physically
More informationOperational Risk Management: Preventive vs. Corrective Control
Operational Risk Management: Preventive vs. Corrective Control Yuqian Xu (UIUC) July 2018 Joint Work with Lingjiong Zhu and Michael Pinedo 1 Research Questions How to manage operational risk? How does
More informationConservation of Energy. Chapter 7 of Essential University Physics, Richard Wolfson, 3 rd Edition
Conservation of Energy Chapter 7 of Essential University Physics, Richard Wolfson, 3 rd Edition 1 Different Types of Force, regarding the Work they do. gravity friction 2 Conservative Forces BB WW cccccccc
More informationCommunication Amid Uncertainty
Communication Amid Uncertainty Madhu Sudan Harvard University Based on joint works with Brendan Juba, Oded Goldreich, Adam Kalai, Sanjeev Khanna, Elad Haramaty, Jacob Leshno, Clement Canonne, Venkatesan
More informationCS249: ADVANCED DATA MINING
CS249: ADVANCED DATA MINING Linear Regression, Logistic Regression, and GLMs Instructor: Yizhou Sun yzsun@cs.ucla.edu April 24, 2017 About WWW2017 Conference 2 Turing Award Winner Sir Tim Berners-Lee 3
More informationNCSS Statistical Software
Chapter 256 Introduction This procedure computes summary statistics and common non-parametric, single-sample runs tests for a series of n numeric, binary, or categorical data values. For numeric data,
More informationTie Breaking Procedure
Ohio Youth Basketball Tie Breaking Procedure The higher seeded team when two teams have the same record after completion of pool play will be determined by the winner of their head to head competition.
More informationCommunication Amid Uncertainty
Communication Amid Uncertainty Madhu Sudan Harvard University Based on joint works with Brendan Juba, Oded Goldreich, Adam Kalai, Sanjeev Khanna, Elad Haramaty, Jacob Leshno, Clement Canonne, Venkatesan
More informationCS145: INTRODUCTION TO DATA MINING
CS145: INTRODUCTION TO DATA MINING 3: Vector Data: Logistic Regression Instructor: Yizhou Sun yzsun@cs.ucla.edu October 9, 2017 Methods to Learn Vector Data Set Data Sequence Data Text Data Classification
More informationISyE 6414 Regression Analysis
ISyE 6414 Regression Analysis Lecture 2: More Simple linear Regression: R-squared (coefficient of variation/determination) Correlation analysis: Pearson s correlation Spearman s rank correlation Variable
More informationPre-Kindergarten 2017 Summer Packet. Robert F Woodall Elementary
Pre-Kindergarten 2017 Summer Packet Robert F Woodall Elementary In the fall, on your child s testing day, please bring this packet back for a special reward that will be awarded to your child for completion
More informationUse of Auxiliary Variables and Asymptotically Optimum Estimators in Double Sampling
International Journal of Statistics and Probability; Vol. 5, No. 3; May 2016 ISSN 1927-7032 E-ISSN 1927-7040 Published by Canadian Center of Science and Education Use of Auxiliary Variables and Asymptotically
More informationMixture Models & EM. Nicholas Ruozzi University of Texas at Dallas. based on the slides of Vibhav Gogate
Mixture Models & EM Nicholas Ruozzi University of Texas at Dallas based on the slides of Vibhav Gogate Previously We looked at -means and hierarchical clustering as mechanisms for unsupervised learning
More informationNew Class of Almost Unbiased Modified Ratio Cum Product Estimators with Knownparameters of Auxiliary Variables
Journal of Mathematics and System Science 7 (017) 48-60 doi: 10.1765/159-591/017.09.00 D DAVID PUBLISHING New Class of Almost Unbiased Modified Ratio Cum Product Estimators with Knownparameters of Auxiliary
More informationAnalysis of Gini s Mean Difference for Randomized Block Design
American Journal of Mathematics and Statistics 2015, 5(3): 111-122 DOI: 10.5923/j.ajms.20150503.02 Analysis of Gini s Mean Difference for Randomized Block Design Elsayed A. H. Elamir Department of Statistics
More informationLogistic Regression. Hongning Wang
Logistic Regression Hongning Wang CS@UVa Today s lecture Logistic regression model A discriminative classification model Two different perspectives to derive the model Parameter estimation CS@UVa CS 6501:
More informationCourse 495: Advanced Statistical Machine Learning/Pattern Recognition
Course 495: Advanced Statistical Machine Learning/Pattern Recognition Lectures: Stefanos Zafeiriou Goal (Lectures): To present modern statistical machine learning/pattern recognition algorithms. The course
More informationCoaches, Parents, Players and Fans
P.O. Box 865 * Lancaster, OH 43130 * 740-808-0380 * www.ohioyouthbasketball.com Coaches, Parents, Players and Fans Sunday s Championship Tournament in Boys Grades 5th thru 10/11th will be conducted in
More informationTSP at isolated intersections: Some advances under simulation environment
TSP at isolated intersections: Some advances under simulation environment Zhengyao Yu Vikash V. Gayah Eleni Christofa TESC 2018 December 5, 2018 Overview Motivation Problem introduction Assumptions Formation
More informationA Class of Regression Estimator with Cum-Dual Ratio Estimator as Intercept
International Journal of Probability and Statistics 015, 4(): 4-50 DOI: 10.593/j.ijps.015040.0 A Class of Regression Estimator with Cum-Dual Ratio Estimator as Intercept F. B. Adebola 1, N. A. Adegoke
More informationCT4510: Computer Graphics. Transformation BOCHANG MOON
CT4510: Computer Graphics Transformation BOCHANG MOON 2D Translation Transformations such as rotation and scale can be represented using a matrix M ee. gg., MM = SSSS xx = mm 11 xx + mm 12 yy yy = mm 21
More informationDecision Trees. Nicholas Ruozzi University of Texas at Dallas. Based on the slides of Vibhav Gogate and David Sontag
Decision Trees Nicholas Ruozzi University of Texas at Dallas Based on the slides of Vibhav Gogate and David Sontag Announcements Course TA: Hao Xiong Office hours: Friday 2pm-4pm in ECSS2.104A1 First homework
More informationMinimum Mean-Square Error (MMSE) and Linear MMSE (LMMSE) Estimation
Minimum Mean-Square Error (MMSE) and Linear MMSE (LMMSE) Estimation Outline: MMSE estimation, Linear MMSE (LMMSE) estimation, Geometric formulation of LMMSE estimation and orthogonality principle. Reading:
More informationknn & Naïve Bayes Hongning Wang
knn & Naïve Bayes Hongning Wang CS@UVa Today s lecture Instance-based classifiers k nearest neighbors Non-parametric learning algorithm Model-based classifiers Naïve Bayes classifier A generative model
More informationAttacking and defending neural networks. HU Xiaolin ( 胡晓林 ) Department of Computer Science and Technology Tsinghua University, Beijing, China
Attacking and defending neural networks HU Xiaolin ( 胡晓林 ) Department of Computer Science and Technology Tsinghua University, Beijing, China Outline Background Attacking methods Defending methods 2 AI
More informationSupport Vector Machines: Optimization of Decision Making. Christopher Katinas March 10, 2016
Support Vector Machines: Optimization of Decision Making Christopher Katinas March 10, 2016 Overview Background of Support Vector Machines Segregation Functions/Problem Statement Methodology Training/Testing
More informationNew Albany / Fred Klink Memorial Classic 3rd Grade Championship Bracket **Daylight Saving Time - Turn Clocks Up One Hour**
rd Grade Championship Bracket st Pool B nd Pool A 9:00 am New Albany Annex :0 am New Albany Annex st Pool C nd Pool B :0 pm New Albany nd Pool C 0:05 am New Albany Annex :5 pm New Albany Annex st Pool
More informationJamming phenomena of self-driven particles
Jamming phenomena of self-driven particles Pedestrian Outflow and Obstacle Walking with Slow Rhythm Daichi Yanagisawa, RCAST, UTokyo Pedestrian Outflow and Obstacle Phys. Rev. E, 76(6), 061117, 2007 Phys.
More informationISyE 6414: Regression Analysis
ISyE 6414: Regression Analysis Lectures: MWF 8:00-10:30, MRDC #2404 Early five-week session; May 14- June 15 (8:00-9:10; 10-min break; 9:20-10:30) Instructor: Dr. Yajun Mei ( YA_JUNE MAY ) Email: ymei@isye.gatech.edu;
More informationGrade K-1 WRITING Traffic Safety Cross-Curriculum Activity Workbook
Grade K-1 WRITING Tra fic Safety Cross-Curriculum Activity Workbook Note to Teachers The AAA Traffic Safety Education Materials present essential safety concepts to students in Kindergarten through fifth
More informationSan Francisco State University ECON 560 Summer Midterm Exam 2. Monday, July hour 15 minutes
San Francisco State University Michael Bar ECON 560 Summer 2018 Midterm Exam 2 Monday, July 30 1 hour 15 minutes Name: Instructions 1. This is closed book, closed notes exam. 2. No calculators or electronic
More informationSNARKs with Preprocessing. Eran Tromer
SNARKs with Preprocessing Eran Tromer BIU Winter School on Verifiable Computation and Special Encryption 4-7 Jan 206 G: Someone generates and publishes a common reference string P: Prover picks NP statement
More information115th Vienna International Rowing Regatta & International Masters Meeting. June 15 to June 17, 2018
115th Vienna International Rowing Regatta & International Masters Meeting Conducted by the Vienna Rowing Association An event forming part of the Austrian Club Championships 2018 (ÖVM 2018) June 15 to
More informationLesson 18: There Is Only One Line Passing Through a Given Point with a Given Slope
There Is Only One Line Passing Through a Given Point with a Given Slope Classwork Opening Exercise Examine each of the graphs and their equations. Identify the coordinates of the point where the line intersects
More informationDo New Bike Share Stations Increase Member Use?: A Quasi-Experimental Study
Do New Bike Share Stations Increase Member Use?: A Quasi-Experimental Study Jueyu Wang & Greg Lindsey Humphrey School of Public Affairs University of Minnesota Acknowledgement: NSF Sustainable Research
More informationGuidelines for Applying Multilevel Modeling to the NSCAW Data
Guidelines for Applying Multilevel Modeling to the NSCAW Data by Sharon Christ, Paul Biemer and Christopher Wiesen Odum Institute for Research in Social Science May 2007 Summary. This document is intended
More informationIntroduction to Genetics
Name: Introduction to Genetics Keystone Assessment Anchor: BIO.B.2.1.1: Describe and/or predict observed patterns of inheritance (i.e. dominant, recessive, co-dominance, incomplete dominance, sex-linked,
More information2016 AzMERIT and Historical Trend Data
2016 AzMERIT and Historical Trend Data Scottsdale Unified School District Dr. Anna McCauley, Ed.D. Assistant Superintendent of Accountability and Instruction logit(π i ) = log π i 1 π i Scottsdale Unified
More informationAddition and Subtraction of Rational Expressions
RT.3 Addition and Subtraction of Rational Expressions Many real-world applications involve adding or subtracting algebraic fractions. Similarly as in the case of common fractions, to add or subtract algebraic
More informationMachine Learning Application in Aviation Safety
Machine Learning Application in Aviation Safety Surface Safety Metric MOR Classification Presented to: By: Date: ART Firdu Bati, PhD, FAA September, 2018 Agenda Surface Safety Metric (SSM) development
More informationNEUE DONAU / VIENNA. June 24 to 26,
114th VIENNA INTERNATIONAL ROWING REGATTA & MASTERS TRIAL NEUE DONAU / VIENNA June 24 to 26, 2017 www.ruderverband.wien Wiener Ruderverband 2 114th Vienna International Rowing Regatta Conducted by the
More informationName May 3, 2007 Math Probability and Statistics
Name May 3, 2007 Math 341 - Probability and Statistics Long Exam IV Instructions: Please include all relevant work to get full credit. Encircle your final answers. 1. An article in Professional Geographer
More informationThe MACC Handicap System
MACC Racing Technical Memo The MACC Handicap System Mike Sayers Overview of the MACC Handicap... 1 Racer Handicap Variability... 2 Racer Handicap Averages... 2 Expected Variations in Handicap... 2 MACC
More informationNATIONAL FEDERATION RULES B. National Federation Rules Apply with the following TOP GUN EXCEPTIONS
TOP GUN COACH PITCH RULES 8 & Girls Division Revised January 11, 2018 AGE CUT OFF A. Age 8 & under. Cut off date is January 1st. Player may not turn 9 before January 1 st. Please have Birth Certificates
More informationStat 139 Homework 3 Solutions, Spring 2015
Stat 39 Homework 3 Solutions, Spring 05 Problem. Let i Nµ, σ ) for i,..., n, and j Nµ, σ ) for j,..., n. Also, assume that all observations are independent from each other. In Unit 4, we learned that the
More informationFull Name: Period: Heredity EOC Review
Full Name: Period: 1 4 5 6 7 Heredity EOC Review Directions: For each genotype below, indicate whether it is a heterozygous (write: He) OR homozygous (write: Ho). 1. Tt BB DD ff tt dd dd Ff TT Bb bb FF
More informationINSTALLING THE PROWLER 13 RUDDER
INSTALLING THE PROWLER 13 RUDDER Parts Included: Steering Parts: Foot Rail Parts: Rudder Parts: Retraction Parts: 4 Rubber 2 Rail Assemblies Rudder Body 1 Rudder Retraction Grommets (includes steering
More informationEE582 Physical Design Automation of VLSI Circuits and Systems
EE Prof. Dae Hyun Kim School of Electrical Engineering and Computer Science Washington State University Routing Grid Routing Grid Routing Grid Routing Grid Routing Grid Routing Lee s algorithm (Maze routing)
More informationWhat is Restrained and Unrestrained Pipes and what is the Strength Criteria
What is Restrained and Unrestrained Pipes and what is the Strength Criteria Alex Matveev, September 11, 2018 About author: Alex Matveev is one of the authors of pipe stress analysis codes GOST 32388-2013
More informationThree different funding sources funded different facets of the research.
Three different funding sources funded different facets of the research. In November 2014, the research team received monies from the N.C. Marine Fisheries Commission s Conservation Fund, with matching
More informationLecture 10. Support Vector Machines (cont.)
Lecture 10. Support Vector Machines (cont.) COMP90051 Statistical Machine Learning Semester 2, 2017 Lecturer: Andrey Kan Copyright: University of Melbourne This lecture Soft margin SVM Intuition and problem
More informationgraphic standards manual Mountain States Health Alliance
manual Mountain States mountain states health alliance Bringing Loving Care to Health Care Table of Contents 4 5 6 7 9 -- Why do we need? Brandmark Specifications Brandmark Color Palette Corporate Typography
More informationExistence of Nash Equilibria
Existence of Nash Equilibria Before we can prove the existence, we need to remind you of the fixed point theorem: Kakutani s Fixed Point Theorem: Consider X R n a compact convex set and a function f: X
More informationName: Grade: LESSON ONE: Home Row
LESSON ONE: Home Row asdfjkl; asdfjkl; asdfjkl; aa ss dd ff jj kk ll ;; aa ss dd ff jj kk ll ;; aa ss dd ff jj kk ll ;; aa ss dd ff jj kk ll ;; aa ss dd ff jj kk ll ;; aa ss dd ff jj kk ll ;; aa ss dd
More informationBhagwant N. Persaud* Richard A. Retting Craig Lyon* Anne T. McCartt. May *Consultant to the Insurance Institute for Highway Safety
Review of The Impact of Red Light Cameras (Photo-Red Enforcement) on Crashes in Virginia by Nicholas J. Garber, John S. Miller, R. Elizabeth Abel, Saeed Eslambolchi, and Santhosh K. Korukonda Bhagwant
More informationMy ABC Insect Discovery Book
Act i vi t ypack I ns ectabcs I nt hi spac k: ABCASLSi gnfl as hcar ds I ns ec tabcac t i v i t y SongL y r i c s AndMor e! Ac i t i v i ess uppor ts i gnsandc onc ept st aughti n Rac hel&t het r eesc
More informationChapter 10 Aggregate Demand I: Building the IS LM Model
Chapter 10 Aggregate Demand I: Building the IS LM Model Zhengyu Cai Ph.D. Institute of Development Southwestern University of Finance and Economics All rights reserved http://www.escience.cn/people/zhengyucai/index.html
More informationWhat does it take to produce an Olympic champion? A nation naturally
Survival of the Fittest? An Econometric Analysis in to the Effects of Military Spending on Olympic Success from 1996-01. Mark Frahill The Olympics are the world s greatest sporting celebrations, seen as
More informationEffects of sea lion predation on Willamette River winter steelhead viability
Effects of sea lion predation on Willamette River winter steelhead viability Matt Falcy Bryan Wright Matt Falcy Willamette Falls Willamette Falls Goal: Quantify threat of extirpation posed by sea lions
More informationThe Effect of Public Sporting Expenditures on Medal Share at the Summer Olympic Games: A Study of the Differential Impact by Sport and Gender
Dickinson College Dickinson Scholar Student Honors Theses By Year Student Honors Theses 5-21-2017 The Effect of Public Sporting Expenditures on Medal Share at the Summer Olympic Games: A Study of the Differential
More informationReduction of Speed Limit at Approaches to Railway Level Crossings in WA. Main Roads WA. Presenter - Brian Kidd
Australasian College of Road Safety Conference A Safe System: Making it Happen! Melbourne 1-2 September 2011 Reduction of Speed Limit at Approaches to Railway Level Crossings in WA Radalj T 1, Kidd B 1
More informationb) (2 pts.) Does the study show that drinking 4 or more cups of coffee a day caused the higher death rate?
Question 1 (10 pts) A study published in the August 15, 2017 issue of Mayo Clinic Proceedings tracked 44,000 people aged 20 to 87 for an average of about 16 years and found that those who drank 4 or more
More informationScoil Rince Ní Bhrogáin
Scoil Rince Ní Bhrogáin Presents the Omagh Championships On Saturday 10 th and Sunday 11 th February 2018 In St Joseph s Hall, Omagh Adjudicators: Ms.Yvonne Cannon Ms Michelle Lee Ms. Gabrielle Lynam Ms.
More informationConfigurable Test-Goal Set Partitioning for Directed Multi- Goal Test Generation
Configurable Test-Goal Set Partitioning for Directed Multi- Goal Test Generation Malte Lochau (TU Darmstadt) Joint work with: Sven Apel, Johannes Bürdek, Dirk Beyer, Andreas Holzer, Andreas Stahlbauer
More informationAbstract In this paper, the author deals with the properties of circumscribed ellipses of convex quadrilaterals, using tools of parallel projective tr
Study on the Properties of Circumscribed Ellipses of Convex Quadrilaterals Author: Yixi Shen Mentors: Zhongyuan Dai; Yijun Yao No. High School of East China Normal University Shanghai, China December,
More informationAn Application of Signal Detection Theory for Understanding Driver Behavior at Highway-Rail Grade Crossings
An Application of Signal Detection Theory for Understanding Driver Behavior at Highway-Rail Grade Crossings Michelle Yeh and Jordan Multer United States Department of Transportation Volpe National Transportation
More informationHow To Win The Ashes A Statistician s Guide
How To Win The Ashes A Statistician s Guide Kevin Wang Sydney Universtiy Mathematics Society Last Modified: August 21, 2015 Motivation How come SUMS doesn t do statistics talk very often? Motivation How
More informationAssignment. To New Heights! Variance in Subjective and Random Samples. Use the table to answer Questions 2 through 7.
Assignment Assignment for Lesson.1 Name Date To New Heights! Variance in Subjective and Random Samples 1. Suppose that you have collected data for the weights of all of the crates in a warehouse. a. Give
More informationNavigate to the golf data folder and make it your working directory. Load the data by typing
Golf Analysis 1.1 Introduction In a round, golfers have a number of choices to make. For a particular shot, is it better to use the longest club available to try to reach the green, or would it be better
More informationGenetics and Inheritance
+ Genetics and Inheritance + Intro to Genetics Every living thing plant or animal, microbe or human being has a set of characteristics inherited from its parent or parents. Your DNA holds the genetic code
More informationQuality Assurance Charting for QC Data
Quality Assurance Charting for QC Data September 2018 Iowa s Environmental & Public Health Laboratory Copyright the State Hygienic Laboratory at the University of Iowa 2017. All rights reserved. Images
More informationa) List and define all assumptions for multiple OLS regression. These are all listed in section 6.5
Prof. C. M. Dalton ECN 209A Spring 2015 Practice Problems (After HW1, HW2, before HW3) CORRECTED VERSION Question 1. Draw and describe a relationship with heteroskedastic errors. Support your claim with
More informationSupplementary Online Content
Supplementary Online Content McEvoy JP, Byerly M, Hamer RM, et al. Effectiveness of Paliperidone Palmitate vs Haloperidol Decanoate for Maintenance Treatment of Schizophrenia: a Randomized Clinical Trial.
More informationTo Illuminate or Not to Illuminate: Roadway Lighting as It Affects Traffic Safety at Intersections
To Illuminate or Not to Illuminate: Roadway Lighting as It Affects Traffic Safety at Intersections Mark Rea Lighting Research Center Rensselaer Polytechnic Institute Eric Donnell Dept. of Civil and Environmental
More informationThe Effects of Altitude on Soccer Match Outcomes
The Effects of Altitude on Soccer Match Outcomes Tyler Williams Massachusetts Institute of Technology Cambridge, MA, United States, 02139 Email: tkwillia@mit.edu Abstract Soccer teams regularly compete
More informationIn aseptic processing, performance
B I O P R O C E S S TECHNICAL Quantifying Sterilizing Membrane Retention Performance Mark M. Blanchard In aseptic processing, performance of sterilizing filtration is of critical importance. A filter device
More informationImpact of a Pilot Walking School Bus Intervention on Children s Pedestrian Safety Behaviors
Impact of a Pilot Walking School Bus Intervention on Children s Pedestrian Safety Behaviors Jason A. Mendoza, MD, MPH Assistant Professor of Pediatrics USDA/ARS Children s Nutrition Research Center, Academic
More informationINTRODUCTION Microfilm copy of the Draper Collection of manuscripts. Originals located at the State Historical Society of Wisconsin.
C Draper, Lyman Copeland, Collection, 1735-1815 2964 136 rolls of microfilm RESTRICTED MICROFILM This collection is available at The State Historical Society of Missouri. If you would like more information,
More informationClass 23: Chapter 14 & Nested ANOVA NOTES: NOTES: NOTES:
Slide 1 Chapter 13: ANOVA for 2-way classifications (2 of 2) Fixed and Random factors, Model I, Model II, and Model III (mixed model) ANOVA Chapter 14: Unreplicated Factorial & Nested Designs Slide 2 HW
More informationTie Breaking Procedure
Ohio Youth Basketball Tie Breaking Procedure The higher seeded team when two teams have the same record after completion of pool play will be determined by the winner of their head to head competition.
More information8. International Matchplay-Trophy 2017 Golfclub Sinsheim
8. International Matchplay-Trophy 2017 Golfclub Sinsheim Entrance fee: EUR 180,The entrance fee has to be paid by remittance with the ceremony of entry. Participants from abroad have to transfer the entrance
More informationPredicting Results of March Madness Using the Probability Self-Consistent Method
International Journal of Sports Science 2015, 5(4): 139-144 DOI: 10.5923/j.sports.20150504.04 Predicting Results of March Madness Using the Probability Self-Consistent Method Gang Shen, Su Hua, Xiao Zhang,
More informationADB Sri Lanka Resident Mission
ADB Sri Lanka Resident Mission 1 Motivation Objective Theory of change Background Methodology Results Implications Way forward 2 ADB has funded road rehabilitation throughout the Asia Pacific region and
More informationRisk-Based Inspection Pressure Relief Devices
Risk-Based Inspection Pressure Relief Devices Moisés Sebastião Jones ARTICLE INFO ABSTRACT Keywords: Pressure Relief Devices RBI API Weibull parameters Probability of failure RBI software Risk-based inspection
More informationA definition of depth for functional observations
A definition of depth for functional observations Sara López-Pintado and Juan Romo Departamento de Estadística y Econometría Universidad Carlos III de Madrid Madrid, Spain A definition of depth for functional
More informationAn Analysis of the Travel Conditions on the U. S. 52 Bypass. Bypass in Lafayette, Indiana.
An Analysis of the Travel Conditions on the U. S. 52 Bypass in Lafayette, Indiana T. B. T readway Research Assistant J. C. O ppenlander Research Engineer Joint Highway Research Project Purdue University
More informationDESIGN AND ANALYSIS OF ALGORITHMS (DAA 2017)
DESIGN AND ANALYSIS OF ALGORITHMS (DAA 2017) Veli Mäkinen 12/05/2017 1 COURSE STRUCTURE 7 weeks: video lecture -> demo lecture -> study group -> exercise Video lecture: Overview, main concepts, algorithm
More informationFive Great Activities Using Spinners. 1. In the circle, which cell will you most likely spin the most times? Try it.
Five Great Activities Using Spinners 1. In the circle, which cell will you most likely spin the most times? Try it. 1 2 3 4 2. Marcy plays on her school basketball team. During a recent game, she was fouled
More informationMath 243 Section 4.1 The Normal Distribution
Math 243 Section 4.1 The Normal Distribution Here are some roughly symmetric, unimodal histograms The Normal Model The famous bell curve Example 1. The mean annual rainfall in Portland is unimodal and
More informationPaper 2.2. Operation of Ultrasonic Flow Meters at Conditions Different Than Their Calibration
Paper 2.2 Operation of Ultrasonic Flow Meters at Conditions Different Than Their Calibration Mr William Freund, Daniel Measurement and Control Mr Klaus Zanker, Daniel Measurement and Control Mr Dale Goodson,
More informationHolly Burns. Publisher Mary D. Smith, M.S. Ed. Author
Editor Jenni Corcoran, M.Ed. Illustrator Renée Christine Yates Editorial Project Manager Mara Ellen Guckian Cover rtist Denise auer Managing Editor Ina Massler Levin, M.. Creative Director Karen J. Goldfluss,
More information