A Bayesian latent mixture model approach to assessing performance in stock-flow reasoning
Journal Title: Judgment and Decision Making - Year 2017, Vol 12, Issue 5
Abstract
People often perform poorly on stock-flow reasoning tasks, with many (but not all) participants appearing to erroneously match the accumulation of the stock to the inflow – a response pattern attributed to the use of a “correlation heuristic”. Efforts to improve understanding of stock-flow systems have been limited by the lack of a principled approach to identifying and measuring individual differences in reasoning strategies. We present a principled inferential method known as Hierarchical Bayesian Latent Mixture Models (HBLMMs) to analyze stock-flow reasoning. HBLMMs use Bayesian inference to classify different patterns of responding as coming from multiple latent populations. We demonstrate the usefulness of this approach using a dataset from a stock-flow drawing task which compared performance in a problem presented in a climate change context, a problem in a financial context, and a problem in which the financial context was used as an analogy to assist understanding in the climate problem. The hierarchical Bayesian model showed that the proportion of responses consistent with the “correlation heuristic” was lower in the financial context and financial analogy context than in the pure climate context. We discuss the benefits of HBLMMs and implications for the role of contexts and analogy in improving stock-flow reasoning.
Authors and Affiliations
Arthur Kary, Guy E. Hawkins, Brett K. Hayes and Ben R. Newell
Variations on anchoring: Sequential anchoring revisited
The anchoring effect, the assimilation of judgment toward a previously considered value, has been shown using various experimental paradigms. We used several variations of the sequential anchoring paradigm, in which a nu...
The wisdom of crowds: Predicting a weather and climate-related event
Environmental uncertainty is at the core of much of human activity, ranging from daily decisions by individuals to long-term policy planning by governments. Yet, there is little quantitative evidence on the ability of no...
The non-effects of repeated exposure to the Cognitive Reflection Test
We estimate the effects of repeated exposure to the Cognitive Reflection Test (CRT) by examining 14,053 MTurk subjects who took the test up to 25 times. In contrast with inferences drawn from self-reported prior exposure...
Validation of Adult Decision-Making Competence in Chinese college students
The present study was conducted to validate the Chinese version of the Adult Decision-Making Competence scale. 364 college students were recruited from four universities in China. The results indicate the Chinese Adult D...
A fine-grained analysis of the jumping-to-conclusions bias in schizophrenia: Data-gathering, response confidence, and information integration
Impaired decision behavior has been repeatedly observed in schizophrenia patients. We investigated several cognitive mechanisms that might contribute to the jumping-to-conclusions bias (JTC) seen in schizophrenia patient...