A Comparison of Logistic Regression Models for Dif Detection in Polytomous Items: The Effect of Small Sample Sizes and Non-Normality of Ability Distributions

Journal Title: International Journal of Assessment Tools in Education - Year 2015, Vol 2, Issue 1

Abstract

This study investigated the effectiveness of logistic regression models to detect uniform and non-uniform DIF in polytomous items across small sample sizes and non-normality of ability distributions. A simulation study was used to compare three logistic regression models, which were the cumulative logits model, the continuation ratio model, and the adjacent categories model. The results revealed that logistic regression was a powerful method to detect DIF in polytomous items, but not useful to distinguish the type of DIF. Continuation ratio model worked best to detect uniform DIF, but the cumulative logits model gave more acceptable type I error results. As sample size increased, type I errors increased at cumulative logits model results. Skewness of ability distributions reduced power of logistic regression to detect non-uniform DIF. Small sample sizes reduced power of logistic regression.

Authors and Affiliations

Yasemin KAYA, Walter L. LEITE, M. David MILLER

Keywords

Related Articles

The Effect of School Efficiency on Student Achievement

This study was conducted to determine the effect of school efficiency of secondary schools on student achievement based on the views of teachers. A scale was prepared in line with the aims of the study, and this scale wa...

The Use of Academic Portfolio in the Learning and Assessment of Physics Students from a Singapore Private College

The purpose of this perspective paper is to examine the use of portfolios in the teaching and learning of physics in a Singapore private college. The paper starts with a short introduction of the types of students and th...

The Influence of Item Formats when Locating a Student on a Learning Progression in Science

Learning progressions are used to describe how students’ understanding of a topic progresses over time. This study evaluates the effectiveness of different item formats for placing students into levels along a learning p...

Investigation of 9th Grade High School Students’ Attitudes towards Science Course

In this study, ninth grade students’ attitudes towards science were investigated in terms of self-regulation strategies, motivational beliefs and gender variables. The sample of this study includes 322 male and 296 femal...

Look Sir, I Drew You

The purpose of this study is to try to find out how the fifth, sixth, seventh and eighth graders perceive science teachers through the pictures they have drawn. A qualitative research method was used in the research. A t...

Download PDF file
  • EP ID EP174037
  • DOI -
  • Views 148
  • Downloads 0

How To Cite

Yasemin KAYA, Walter L. LEITE, M. David MILLER (2015). A Comparison of Logistic Regression Models for Dif Detection in Polytomous Items: The Effect of Small Sample Sizes and Non-Normality of Ability Distributions. International Journal of Assessment Tools in Education, 2(1), 22-39. https://europub.co.uk./articles/-A-174037