The International Climate Psychology Collaboration: Climate change-related data collected from 63 countries

Kimberly C Doell, Boryana Todorova, Madalina Vlasceanu, Joseph B Bak Coleman, Ekaterina Pronizius, Philipp Schumann, Flávio Azevedo, Yash Patel, Michael Berkebile-Weinberg, Cameron Brick, Florian Lange, Samantha J Grayson, Yifei Pei, Alek Chakroff, Karlijn L. van den Broek, Claus Lamm, Denisa Vlasceanu, Sara M. Constantino, Steve Rathje, Danielle Goldwert, Ke Fang, Salvatore Maria Aglioti, Mark Alfano, Andy J Alvarado-Yepez, Angélica Andersen, Frederik Anseel, Matthew A J Apps, Chillar Asadli, Fonda Jane Awuor, Piero Basaglia, Jocelyn J. Bélanger, Sebastian Berger, Paul Bertin, Michał Białek, Olga Białobrzeska, Michelle Blaya-Burgo, Daniëlle N. M. Bleize, Simen Bø, Lea Boecker, Paulo S. Boggio, Sylvie Borau, Björn Bos, Ayoub Bouguettaya, Markus Bräuer, Tymofii Brik, Roman Briker, Tobias Brosch, Ondrej Buchel, Daniel Buonauro, Radhika Butalia, Héctor Carvacho, Sarah A. E. Chamberlain, Hang‐Yee Chan, Dawn Yi Lin Chow, Dongil Chung, Luca Cian, Noa Cohen-Eick, Luis Sebastian Contreras-Huerta, Davide Contu, Vladimir Cristea, Jo Cutler, Silvana D’Ottone, Jonas De keersmaecker, Sarah Delcourt, Sylvain Delouvée, Kathi Diel, Benjamin D Douglas, Moritz A. Drupp, Shreya Dubey, Jānis Ekmanis, Panagiotis Mitkidis, Mahmoud Medhat Elsherif, Iris M. Engelhard, Yannik A. Escher, Tom Étienne, Laura Farage, Ana Rita Farias, Stefan Feuerriegel, Andrej Findor, Lucía Freira, Malte Friese, Neil Gains, Albina Gallyamova, Sandra J. Geiger, Oliver Genschow, Biljana Gjoneska, Theofilos Gkinopoulos, Beth Goldberg, Amit Goldenberg, Sarah Gradidge, Simone Grassini, Kurt Gray, Sonja Grelle, Siobhán M. Griffin, Lusine Grigoryan, Ani Grigoryan, Dmitry Grigoryev, June Gruber, Johnrev GuilaranScientific 2024 · DOI

TL;DR

This paper introduces a massive, cross-cultural dataset of over 59,000 participants from 63 countries, collected through an online survey designed to understand the psychology of climate change. The study tested 11 different interventions aimed at promoting climate action, providing a rich resource for researchers to explore the complex interplay of psychological, demographic, and national factors influencing climate-related beliefs and behaviors globally.

What Problem Does This Paper Address?

Climate change is a pressing global issue, yet understanding the psychological drivers of individual and collective action to mitigate it remains a significant challenge. Much of the existing research is limited to Western, educated, industrialized, rich, and democratic (WEIRD) populations, hindering the generalizability of findings. Furthermore, correlational studies often struggle to establish causal relationships between psychological factors and climate action. This paper addresses these limitations by providing a large-scale, internationally diverse dataset that tests the efficacy of various interventions designed to promote climate change mitigation across a broad spectrum of outcomes and demographics.

Methods

The study employed a quasi-experimental, between-subjects design. Participants were randomly assigned to one of 11 different interventions or a control condition. These interventions were developed through a collaborative process and tested for their ability to influence four key outcomes: climate change belief, support for climate policies, willingness to share climate information on social media, and performance on a pro-environmental behavioral task (the Work for Environmental Protection Task - WEPT). In addition to the intervention effects, participants provided demographic information and reported on other relevant variables like political orientation, environmental identity, and trust in climate science. The data collection was conducted online via Qualtrics, with rigorous attention checks and data cleaning procedures implemented to ensure data quality.

Datasets

The primary dataset introduced in this paper consists of data from 59,508 eligible participants collected between July 2022 and July 2023 across 63 countries. This dataset includes:

  • Raw and cleaned survey data: Containing responses to interventions, outcome variables, demographic information, and additional independent variables.
  • All survey materials: Including consent forms, intervention descriptions, and questionnaires.
  • Relevant analysis scripts: To facilitate replication and further analysis.
  • Data visualizations: To aid in understanding the data distributions and findings.

Additionally, the paper describes data from an "intervention tournament" where collaborators submitted and ranked potential interventions, providing insights into the perceived practical and theoretical support for different approaches.

Key Insights and Ideas

  • Global Reach of Climate Psychology: The study highlights the feasibility and importance of conducting large-scale, international research on climate psychology, moving beyond WEIRD samples to capture a more nuanced global perspective.
  • Intervention Efficacy Across Cultures: By testing 11 distinct interventions across 63 countries, the dataset allows for the examination of how different psychological framing and nudges impact climate beliefs and behaviors in diverse cultural contexts.
  • Multi-faceted Measurement of Climate Action: The inclusion of climate beliefs, policy support, social media sharing, and a behavioral task (WEPT) provides a comprehensive view of climate action, acknowledging that it is not a monolithic construct.
  • The Power of Collaboration: The paper showcases the success of a large, international collaboration in generating a substantial and valuable dataset, demonstrating a model for future large-scale social science research.

Key Results

While the paper primarily focuses on describing the dataset and its collection, it does present some preliminary findings:

  • A total of 83,927 individuals participated, with 59,508 meeting the inclusion criteria (passing attention checks and the WEPT demonstration).
  • The dataset includes a wide range of demographic variables, with varying degrees of matching to national population statistics across countries (detailed in Table 2).
  • The WEPT task resulted in the planting of 333,333 trees through a collaboration with The Eden Reforestation Project, estimating a significant sequestration of carbon dioxide.
  • Reliability measures (Cronbach's Alpha, McDonald's Omega) for the key outcome variables (climate beliefs, policy support, political orientation) indicate good to excellent internal consistency across countries.

Limitations and Future Work

The authors acknowledge several limitations:

  • Sampling Heterogeneity: While efforts were made to match samples to national demographics, sampling procedures varied across countries, leading to heterogeneity. However, they also cite research suggesting convenience samples can be adequate for estimating treatment effects.
  • Translation and Adaptation Challenges: Despite rigorous translation and adaptation protocols, some interventions required country-specific adaptations, and the paper notes that some teams had issues with full translation and adaptation, with participants from those teams being removed.
  • Attrition Rates: While the cleaned dataset aims to maximize utility, there is a small portion of participants who did not finish the entire survey or respond to all items.

Future work can leverage this rich dataset for a multitude of secondary analyses, exploring the effectiveness of interventions across socio-political variables, cultural dimensions (like individualism-collectivism), and other demographic factors. The authors also provide extensive resources, including code and data, to facilitate such future research.

Summary updated

Abstract

Climate change is currently one of humanity's greatest threats. To help scholars understand the psychology of climate change, we conducted an online quasi-experimental survey on 59,508 participants from 63 countries (collected between July 2022 and July 2023). In a between-subjects design, we tested 11 interventions designed to promote climate change mitigation across four outcomes: climate change belief, support for climate policies, willingness to share information on social media, and performance on an effortful pro-environmental behavioural task. Participants also reported their demographic information (e.g., age, gender) and several other independent variables (e.g., political orientation, perceptions about the scientific consensus). In the no-intervention control group, we also measured important additional variables, such as environmentalist identity and trust in climate science. We report the collaboration procedure, study design, raw and cleaned data, all survey materials, relevant analysis scripts, and data visualisations. This dataset can be used to further the understanding of psychological, demographic, and national-level factors related to individual-level climate action and how these differ across countries.
BibTeX
@inproceedings{doell2024international,
  author = {Kimberly C Doell and Boryana Todorova and Madalina Vlasceanu and Joseph B Bak Coleman and Ekaterina Pronizius and Philipp Schumann and Flávio Azevedo and Yash Patel and Michael Berkebile-Weinberg and Cameron Brick and Florian Lange and Samantha J Grayson and Yifei Pei and Alek Chakroff and Karlijn L. van den Broek and Claus Lamm and Denisa Vlasceanu and Sara M. Constantino and Steve Rathje and Danielle Goldwert and Ke Fang and Salvatore Maria Aglioti and Mark Alfano and Andy J Alvarado-Yepez and Angélica Andersen and Frederik Anseel and Matthew A J Apps and Chillar Asadli and Fonda Jane Awuor and Piero Basaglia and Jocelyn J. Bélanger and Sebastian Berger and Paul Bertin and Michał Białek and Olga Białobrzeska and Michelle Blaya-Burgo and Daniëlle N. M. Bleize and Simen Bø and Lea Boecker and Paulo S. Boggio and Sylvie Borau and Sylvie Borau and Björn Bos and Ayoub Bouguettaya and Markus Bräuer and Tymofii Brik and Roman Briker and Tobias Brosch and Ondrej Buchel and Daniel Buonauro and Radhika Butalia and Héctor Carvacho and Sarah A. E. Chamberlain and Hang‐Yee Chan and Dawn Yi Lin Chow and Dongil Chung and Luca Cian and Noa Cohen-Eick and Luis Sebastian Contreras-Huerta and Davide Contu and Vladimir Cristea and Jo Cutler and Silvana D’Ottone and Jonas De keersmaecker and Sarah Delcourt and Sylvain Delouvée and Kathi Diel and Benjamin D Douglas and Moritz A. Drupp and Shreya Dubey and Jānis Ekmanis and Panagiotis Mitkidis and Mahmoud Medhat Elsherif and Iris M. Engelhard and Yannik A. Escher and Tom Étienne and Laura Farage and Ana Rita Farias and Stefan Feuerriegel and Andrej Findor and Lucía Freira and Malte Friese and Neil Gains and Albina Gallyamova and Sandra J. Geiger and Oliver Genschow and Biljana Gjoneska and Theofilos Gkinopoulos and Beth Goldberg and Amit Goldenberg and Sarah Gradidge and Simone Grassini and Kurt Gray and Sonja Grelle and Siobhán M. Griffin and Lusine Grigoryan and Ani Grigoryan and Dmitry Grigoryev and June Gruber and Johnrev Guilaran},
  title = {{The International Climate Psychology Collaboration: Climate change-related data collected from 63 countries}},
  booktitle = {Scientific},
  year = {2024},
  doi = {10.1038/s41597-024-03865-1},
}
Figure