Development of a multiple-choice test to assess critical thinking in climate change

Research output: Contribution to journalResearch articleContributedpeer-review

Contributors

  • Magdalena Micoloi - , Chair of Didactics of Physics (First author)
  • Lana Ivanjek - , Johannes Kepler University Linz (Author)
  • Mieke De Cock - , KU Leuven (Author)
  • Thomas Schubatzky - , University of Innsbruck (Author)
  • Sarah Wildbichler - , University of Innsbruck (Author)
  • Rainer Wackermann - , Ruhr University Bochum (Author)
  • Gesche Pospiech - , Chair of Didactics of Physics (Last author)

Abstract

Recognizing the complex environmental challenges that humanity faces, there is a growing need to develop critical thinking skills specifically oriented toward understanding and addressing climate change. To facilitate the assessment of these skills, a critical thinking in climate change (CTCC) test was developed. In the first step, 16 semistructured interviews were conducted with high school and university students. Drawing on insights from these interviews alongside previous research, a first version of the CTCC test comprising 41 items was administered to a sample of N=289 high school and university students from Austria, Belgium, and Germany. The test development process and subsequent evaluation were performed using Rasch modeling to determine test functioning. Through an iterative process that included three rounds of testing involving a total number of N=809 students and analyses, the test items were revised. The final version of the CTCC test consists of 24 items. Results from Rasch analysis suggest that the test has high item reliability (0.96) and person reliability (0.80), making it a useful tool for assessing critical thinking skills among high school graduates and first-semester university students.

Details

Original languageEnglish
Number of pages17
JournalPhysical Review Physics Education Research
Volume21
Issue number2
Publication statusPublished - 15 Dec 2025
Peer-reviewedYes

Keywords