The Influence of Item Formats when Locating a Student on a Learning Progression in Science
Journal Title: International Journal of Assessment Tools in Education - Year 2016, Vol 3, Issue 2
Abstract
Learning progressions are used to describe how students’ understanding of a topic progresses over time. This study evaluates the effectiveness of different item formats for placing students into levels along a learning progression for carbon cycling. The item formats investigated were Constructed Response (CR) items and two types of two-tier items: (1) Ordered Multiple-Choice (OMC) followed by CR items and (2) Multiple True or False (MTF) followed by CR items. Our results suggest that estimates of students’ learning progression level based on OMC and MTF responses are moderately predictive of their level based on CR responses. With few exceptions, CR items were effective for differentiating students among learning progression levels. Based on the results, we discuss how to design and best use items in each format to more accurately measure students’ level along learning progressions in science.
Authors and Affiliations
Jing Chen, Amelia Wenk Gotwals, Charles W. Anderson, Mark D. Reckase
Keywords
Related Articles
- EP ID EP174032
- DOI 10.21449/ijate.245196
- Views 134
- Downloads 0
The Use of Academic Portfolio in the Learning and Assessment of Physics Students from a Singapore Private College
The purpose of this perspective paper is to examine the use of portfolios in the teaching and learning of physics in a Singapore private college. The paper starts with a short introduction of the types of students and th...
The Development of a General Disaster Preparedness Belief Scale Using the Health Belief Model as a Theoretical Framework
The Health Belief Model (HBM) is one of the oldest and most recognized conceptual framework of health behavior and can be applied to disaster preparedness efforts which focus predominantly on human behavior. The study ai...
Multi-Trait Multi-Method Matrices for the Validation of Creativity and Critical Thinking Assessments for Secondary School Students in England and Greece
The aim of this paper is the validation of measurement tools which assess critical thinking and creativity as general constructs instead of subject specific skills. Specifically, this research examined whether there is c...
The Influence of Item Formats when Locating a Student on a Learning Progression in Science
Learning progressions are used to describe how students’ understanding of a topic progresses over time. This study evaluates the effectiveness of different item formats for placing students into levels along a learning p...
Higher Education End-of-Course Evaluations: Assessing the Psychometric Properties Utilizing Exploratory Factor Analysis and Rasch Modeling Approaches
This paper offers a critical assessment of the psychometric properties of a standard higher education end-of-course evaluation. Using both exploratory factor analysis (EFA) and Rasch modeling, the authors investigate th...