A Comparison of Logistic Regression Models for Dif Detection in Polytomous Items: The Effect of Small Sample Sizes and Non-Normality of Ability Distributions

Journal Title: International Journal of Assessment Tools in Education - Year 2015, Vol 2, Issue 1

Abstract

This study investigated the effectiveness of logistic regression models to detect uniform and non-uniform DIF in polytomous items across small sample sizes and non-normality of ability distributions. A simulation study was used to compare three logistic regression models, which were the cumulative logits model, the continuation ratio model, and the adjacent categories model. The results revealed that logistic regression was a powerful method to detect DIF in polytomous items, but not useful to distinguish the type of DIF. Continuation ratio model worked best to detect uniform DIF, but the cumulative logits model gave more acceptable type I error results. As sample size increased, type I errors increased at cumulative logits model results. Skewness of ability distributions reduced power of logistic regression to detect non-uniform DIF. Small sample sizes reduced power of logistic regression.

Authors and Affiliations

Yasemin KAYA, Walter L. LEITE, M. David MILLER

Keywords

Related Articles

Investigation of 9th Grade High School Students’ Attitudes towards Science Course

In this study, ninth grade students’ attitudes towards science were investigated in terms of self-regulation strategies, motivational beliefs and gender variables. The sample of this study includes 322 male and 296 femal...

Comparing Physics Textbooks in Terms of Assessment and Evaluation Tools

Assessment and evaluation instruments provide teachers the opportunity of shaping education in the beginning, contributing to education during the process and evaluating education at the end of the process. Textbooks, on...

Use of Full Hierarchy Consistency Index to Assess Response Consistency

Measurement models need to properly delineate the real aspect of examinees’ response processes for measurement accuracy purposes. To avoid invalid inferences, fit of examinees’ response data to the model is studied throu...

Development of Pamukkale Piano Learning Style Scale

In musical instrument training, piano has been taught as a compulsory instrument in all departments of Music Education. It is thought that as a major instrument, piano plays a crucial role in music education. Without que...

The development of a self-efficacy scale for mathematical modeling competencies

Mathematical modeling has come into prominence during the last few decades in many countries’ mathematics teaching curricula. It combines real life situations with mathematical context. Although evaluating students’ math...

Download PDF file
  • EP ID EP174037
  • DOI -
  • Views 130
  • Downloads 0

How To Cite

Yasemin KAYA, Walter L. LEITE, M. David MILLER (2015). A Comparison of Logistic Regression Models for Dif Detection in Polytomous Items: The Effect of Small Sample Sizes and Non-Normality of Ability Distributions. International Journal of Assessment Tools in Education, 2(1), 22-39. https://europub.co.uk./articles/-A-174037