A Partial Simulation Study of Phantom Effects in Multilevel Analysis of School Effects: The Case of School Socioeconomic Composition:

TLDR: This paper used hierarchical linear modeling (HLM) to estimate the effects of socioeconomic status (SES) on academic achievement at different levels of an educational system and found that if a prior acad...

Abstract: Hierarchical linear modeling (HLM) is often used to estimate the effects of socioeconomic status (SES) on academic achievement at different levels of an educational system. However, if a prior acad...

Figures

Table 4.2 Absolute Changes in the Effects of Student and School Socioeconomic Status (SES) after the Addition of the Prior Measure of Science Achievement in Various Correlations with the Current Measure of Science Achievement

Figure 5.1 Change in effects of student SES on current science achievement, with addition of prior science achievement in various correlations with current science achievement.

Table 4.3 Relative Changes in the Effects of Student and School Socioeconomic Status (SES) after the Addition of the Prior Measure of Science Achievement in Various Correlations with the Current Measure of Science Achievement

Table 3.1 The 810 Regression coefficient estimates

Table 4.1 Description of independent variables

Figure 5.2 Change in effects of school SES on current science achievement, with addition of prior science achievement in various correlations with current science achievement.

Full text

%94A0=>4?D:109?@.6D%94A0=>4?D:109?@.6D
%9:B70/20%9:B70/20
$30>0>,9/4>>0=?,?4:9>/@.,?4:9#.409.0> :77020:1/@.,?4:9

!"$#%$ #$%) !$ $#!"$#%$ #$%) !$ $#
%$&)## # $#$# %$&)## # $#$# 
# #     ! #$ # #     ! #$ 
,:*3:@
%94A0=>4?D:109?@.6D
3,:E3:@@6D0/@
424?,7 -50.?/09?4G0=3??;>/:4:=20?/
"423?.74.6?::;09,100/-,.61:=849,90B?,-?:70?@>69:B3:B?34>/:.@809?-090G?>D:@"423?.74.6?::;09,100/-,.61:=849,90B?,-?:70?@>69:B3:B?34>/:.@809?-090G?>D:@
"0.:8809/0/4?,?4:9"0.:8809/0/4?,?4:9
*3:@,:!"$#%$ #$%) !$ $#%$&)## 
# $#$# # #     ! #$ 
$30>0>,9/
4>>0=?,?4:9>/@.,?4:9#.409.0>

3??;>@69:B70/20@6D0/@0/>.+0?/>
$34>:.?:=,74>>0=?,?4:94>-=:@23??:D:@1:=1=00,9/:;09,..0>>-D?30:77020:1/@.,?4:9,?%9:B70/20?
3,>-009,..0;?0/1:=49.7@>4:949$30>0>,9/4>>0=?,?4:9>/@.,?4:9#.409.0>-D,9,@?3:=4E0/,/8494>?=,?:=:1
%9:B70/20:=8:=0491:=8,?4:9;70,>0.:9?,.?%9:B70/207>A@6D0/@

#$%$"$#$%$"$
=0;=0>09??3,?8D?30>4>:=/4>>0=?,?4:9,9/,->?=,.?,=08D:=4249,7B:=6!=:;0=,??=4-@?4:9
3,>-00924A09?:,77:@?>4/0>:@=.0>@9/0=>?,9/?3,?,8>:707D=0>;:9>4-701:=:-?,49492
,9D900/0/.:;D=423?;0=84>>4:9>3,A0:-?,490/900/0/B=4??09;0=84>>4:9>?,?0809?>
1=:8?30:B90=>:10,.3?34=/;,=?D.:;D=423?0/8,??0=?:-049.7@/0/498DB:=6,77:B492
070.?=:94./4>?=4-@?4:941>@.3@>04>9:?;0=84??0/-D?301,4=@>0/:.?=490B34.3B477-0
>@-84??0/?:%9:B70/20,>//4?4:9,7470
30=0-D2=,9??:$30%94A0=>4?D:109?@.6D,9/4?>,209?>?304==0A:.,-709:90C.7@>4A0,9/
=:D,7?D1=0074.09>0?:,=.34A0,9/8,60,..0>>4-708DB:=649B3:70:=49;,=?49,771:=8>:1
80/4,9:B:=30=0,1?0=69:B9,2=00?3,??30/:.@809?809?4:90/,-:A08,D-08,/0
,A,47,-704880/4,?07D1:=B:=7/B4/0,..0>>@970>>,908-,=2:,;;740>
=0?,49,77:?30=:B90=>34;=423?>?:?30.:;D=423?:18DB:=6,7>:=0?,49?30=423??:@>049
1@?@=0B:=6>>@.3,>,=?4.70>:=-::6>,77:=;,=?:18DB:=6@9/0=>?,9/?3,?,81=00?:
=024>?0=?30.:;D=423??:8DB:=6
"&'!!" &!$"&'!!" &!$
$30/:.@809?809?4:90/,-:A03,>-009=0A40B0/,9/,..0;?0/-D?30>?@/09?F>,/A4>:=:9
-03,71:1?30,/A4>:=D.:884??00,9/-D?304=0.?:=:1=,/@,?0#?@/40>#:9-03,71:1
?30;=:2=,8B0A0=41D?3,??34>4>?30G9,7,;;=:A0/A0=>4:9:1?30>?@/09?F>?30>4>49.7@/492,77
.3,920>=0<@4=0/-D?30,/A4>:=D.:884??00$30@9/0=>4290/,2=00?:,-4/0-D?30>?,?0809?>
,-:A0
,:*3:@#?@/09?
=(49,,5:=!=:10>>:=
=,=2,=0?,@>.34=0.?:=:1=,/@,?0#?@/40>

A PARTIAL SIMULATION STUDY OF PHANTOM EFFECTS IN MULTILEVEL
ANALYSIS OF SCHOOL EFFECTS: THE CASE OF SCHOOL SOCIOECONOMIC
COMPOSITION
________________________________________
DISSERTATION
________________________________________
A dissertation submitted in partial fulfillment of the
requirements for the degree of Doctor of Philosophy in the
College of Education
at the University of Kentucky
By
Hao Zhou
Lexington, Kentucky
Director: Dr. Xin Ma, Professor of Quantitative and Psychometric Methods
Lexington, Kentucky
2019
Copyright © Hao Zhou 2019

ABSTRACT OF DISSERTATION
A PARTIAL SIMULATION STUDY OF PHANTOM EFFECTS IN MULTILEVEL
ANALYSIS OF SCHOOL EFFECTS: THE CASE OF SCHOOL SOCIOECONOMIC
COMPOSITION
Socioeconomic status (SES) affects students’ academic achievement at different
levels of an educational system. However, misspecified Hierarchical Linear Model (HLM)
may bias school SES estimation. In this study, a partial simulation study was conducted
to examine how misspecified HLM model bias school and student SES estimation.
The result of this study can be summarized by four important points. First, based
on partial simulation procedure, phantom effects of school SES and student SES are real.
Second, characteristics of phantom effects are generalized. The stronger the correlation
between prior science achievement measure and present science achievement measure,
the greater the decrease in both student SES effects and school SES effects. Third, the
procedure of partial simulation provides a new angle to conduct theoretical studies (full
simulation), which is entirely based on ideal assumption. Finally, the procedure of partial
simulation offers researchers a way to create prior student academic achievement
measures when they are not available for data analysis.
KEYWORDS: Partial Simulation Study, School SES Effect, Student SES Effect
Hao Zhou
(Name of Student)
04/26/2019
Date

A PARTIAL SIMULATION STUDY OF PHANTOM EFFECTS IN MULTILEVEL
ANALYSIS OF SCHOOL EFFECTS: THE CASE OF SCHOOL SOCIOECONOMIC
COMPOSITION
By
Hao Zhou
Dr. Xin Ma
Director of Dissertation
Dr. Margaret Bausch
Director of Graduate Studies
04/26/2019
Date