The Influence of Item Formats when Locating a Student on a Learning Progression in Science

Journal Title: International Journal of Assessment Tools in Education - Year 2016, Vol 3, Issue 2

Abstract

Learning progressions are used to describe how students’ understanding of a topic progresses over time. This study evaluates the effectiveness of different item formats for placing students into levels along a learning progression for carbon cycling. The item formats investigated were Constructed Response (CR) items and two types of two-tier items: (1) Ordered Multiple-Choice (OMC) followed by CR items and (2) Multiple True or False (MTF) followed by CR items. Our results suggest that estimates of students’ learning progression level based on OMC and MTF responses are moderately predictive of their level based on CR responses. With few exceptions, CR items were effective for differentiating students among learning progression levels. Based on the results, we discuss how to design and best use items in each format to more accurately measure students’ level along learning progressions in science.

Authors and Affiliations

Jing Chen, Amelia Wenk Gotwals, Charles W. Anderson, Mark D. Reckase

Keywords

Related Articles

Prospective Teachers’ Tendencies to Utilize From the Facilities of Contemporary Educational Technology

In terms of effectiveness and efficiency, it is important to determine the views of prospective teachers related to taking advantage of the facilities of contemporary educational technology. This study which aims to iden...

Investigating the Impact of Missing Data Handling Methods on the Detection of Differential Item Functioning

In this study, it is aimed to investigate the impact of different missing data handling methods on the detection of Differential Item Functioning methods (Mantel Haenszel and Standardization methods based on Classical Te...

Comparing Physics Textbooks in Terms of Assessment and Evaluation Tools

Assessment and evaluation instruments provide teachers the opportunity of shaping education in the beginning, contributing to education during the process and evaluating education at the end of the process. Textbooks, on...

Development of “Willingness to Become School Administrator and Adjustment Scale”

The purpose of this study is to develop a likert-style reliable and valid scale in order to measure teachers’ level of willingness and adjustment to become school administrator. Before developing the scale, the literatur...

Developing a Proof-of-Concept Selection Test for Entry into Primary Teacher Education Programs

The purpose of the study is to measure students' performance through different measurement tools and compare the findings through G Theory in order to identify the errors associated with the raters and items to improve t...

Download PDF file
  • EP ID EP174032
  • DOI 10.21449/ijate.245196
  • Views 144
  • Downloads 0

How To Cite

Jing Chen, Amelia Wenk Gotwals, Charles W. Anderson, Mark D. Reckase (2016). The Influence of Item Formats when Locating a Student on a Learning Progression in Science. International Journal of Assessment Tools in Education, 3(2), 101-122. https://europub.co.uk./articles/-A-174032