AUTHOR=Rose Norman , Nagy Gabriel , Nagengast Benjamin , Frey Andreas , Becker Michael 

TITLE=Modeling Multiple Item Context Effects With Generalized Linear Mixed Models

JOURNAL=Frontiers in Psychology

VOLUME=10

YEAR=2019

URL=https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2019.00248

DOI=10.3389/fpsyg.2019.00248

ISSN=1664-1078

ABSTRACT=<p>Item context effects refer to the impact of features of a test on an examinee's item responses. These effects cannot be explained by the abilities measured by the test. Investigations typically focus on only a single type of item context effects, such as item position effects, or mode effects, thereby ignoring the fact that different item context effects might operate simultaneously. In this study, two different types of context effects were modeled simultaneously drawing on data from an item calibration study of a multidimensional computerized test (<italic>N</italic> = 1,632) assessing student competencies in mathematics, science, and reading. We present a generalized linear mixed model (GLMM) parameterization of the multidimensional Rasch model including <italic>item position effects</italic> (distinguishing between <italic>within-block position effects</italic> and <italic>block position effects</italic>), <italic>domain order effects</italic>, and the interactions between them. Results show that both types of context effects played a role, and that the moderating effect of domain orders was very strong. The findings have direct consequences for planning and applying mixed domain assessment designs.</p>