The Dif Identification in Constructed Response Items Using Partial Credit Model
Journal Title: International Journal of Assessment Tools in Education - Year 2018, Vol 5, Issue 1
Abstract
The study was to identify the load, the type and the significance of differential item functioning (DIF) in constructed response item using the partial credit model (PCM). The data in the study were the students’ instruments and the students’ responses toward the PISA-like test items that had been completed by 386 ninth grade students and 460 tenth grade students who had been about 15 years old in the Province of Yogyakarta Special Region in Indonesia. The analysis toward the item characteristics through the student categorization based on their class was conducted toward the PCM using CONQUEST software. Furthermore, by applying these items characteristics, the researcher draw the category response function (CRF) graphic in order to identify whether the type of DIF content had been in uniform or non-uniform. The significance of DIF was identified by comparing the discrepancy between the difficulty level parameter and the error in the CONQUEST output results. The results of the analysis showed that from 18 items that had been analyzed there were 4 items which had not been identified load DIF, there were 5 items that had been identified containing DIF but not statistically significant and there were 9 items that had been identified containing DIF significantly. The causes of items containing DIF were discussed.
Authors and Affiliations
Heri Retnawati
Investigating the Impact of Missing Data Handling Methods on the Detection of Differential Item Functioning
In this study, it is aimed to investigate the impact of different missing data handling methods on the detection of Differential Item Functioning methods (Mantel Haenszel and Standardization methods based on Classical Te...
Exploring Teachers’ Assessment Practices and Skills
The need for increased use of test results to improve educational outcomes is urgent; yet, there is little understanding in the research literature of practitioners’ knowledge and skills in interpreting and using educati...
Quality Control in Survey Design: Evaluating a Survey of Educators’ Attitudes Concerning Differentiated Compensation
This study utilized the Rasch model to assess the quality of a survey instrument designed to measure attitudes of administrators and teachers concerning a differentiated teacher compensation program piloted in Kentucky....
Investigating Different Theory-Based Differential Item Functioning Methods Under Different Scoring Situations
This study intended to investigate the operations of various theory-based Differential Item Functioning (DIF) methods under different scoring situations. In this context, data obtained from conducting a Verbal Reasoning...
The Development Study of Thoughts Scale Towards Measurement and Assessment Course on High Education
Considering that measurement and assessment, the most critical component of the education process, should be properly carried out by educators, it is necessary to make sure that education faculties deliver the measuremen...