Phantom effects in school composition research: consequences of failure to control biases due to measurement error in traditional multilevel models

Abstract

The main objective of this study was to quantify the impact of failing to account for measurement error on school compositional effects. Multilevel structural equation models were incorporated to control for measurement error and/or sampling error. Study 1, a large sample of English primary students in Years 1 and 4, revealed a significantly negative compositional effect associated with school-average achievement that became more negative after controlling for measurement error. Study 2, a large study of Cypriot primary students in Year 4, showed a small, positive but statistically significant compositional effect that became non-significant after controlling for measurement error. Our findings have important methodological, substantive, and theoretical implications for on-going debates on the school compositional effects on students’ outcomes, because nearly all previous research has been based on traditional approaches to multilevel models, which are positively biased, due to the failure to control for measurement error. © 2015 Taylor & Francis.