Investigating Different Theory-Based Differential Item Functioning Methods Under Different Scoring Situations
Journal Title: International Journal of Assessment Tools in Education - Year 2017, Vol 4, Issue 2
Abstract
This study intended to investigate the operations of various theory-based Differential Item Functioning (DIF) methods under different scoring situations. In this context, data obtained from conducting a Verbal Reasoning Skills Test (scored both in dichotomous and weighted scores) on 1593 individuals was examined via Mantel-Haenszel/Mantel, Standardization and Likelihood Ratio Test techniques and items that point to DIF and numbers of items with DIF for each technique and scoring situation were identified. Results show that Classical Test Theory (CTT) based DIF methods generally provided results that were consistent in themselves and that these results were not significantly different from each other. Agreement between techniques based on Item Response Theory (IRT) and Classical Test Theory (CTT) was found to be low under different scoring situations and results were significantly different from each other.
Authors and Affiliations
Hüseyin Selvi, Devrim Özdemir Alıcı
Keywords
Related Articles
- EP ID EP235240
- DOI 10.21449/ijate.334584
- Views 152
- Downloads 0
Developing a Proof-of-Concept Selection Test for Entry into Primary Teacher Education Programs
The purpose of the study is to measure students' performance through different measurement tools and compare the findings through G Theory in order to identify the errors associated with the raters and items to improve t...
Investigation of 9th Grade High School Students’ Attitudes towards Science Course
In this study, ninth grade students’ attitudes towards science were investigated in terms of self-regulation strategies, motivational beliefs and gender variables. The sample of this study includes 322 male and 296 femal...
The Dif Identification in Constructed Response Items Using Partial Credit Model
The study was to identify the load, the type and the significance of differential item functioning (DIF) in constructed response item using the partial credit model (PCM). The data in the study were the students’ instrum...
Scaling of Ideal Teachers Characteristics with Pairwise Comparison Judgments According to Pre-service Teachers Opinions
In this study, scaling the characteristics that should be found in an ideal teacher according to the pre-service teachers by using the pairwise comparison method was aimed. Thirteen characteristics that an ideal teacher...
The Use of Academic Portfolio in the Learning and Assessment of Physics Students from a Singapore Private College
The purpose of this perspective paper is to examine the use of portfolios in the teaching and learning of physics in a Singapore private college. The paper starts with a short introduction of the types of students and th...