General Information
Project description
Previous research by the Program of Applied Research on Climate Action and the Environment (PARCA) team has found that Canadians generally display poor understanding of the relative impacts of different pro-climate actions and have gaps in their understanding of climate change. Following up on these findings, a randomized controlled survey-experiment was conducted in December 2023 to test the impact of several behaviourally-informed interventions on climate literacy outcomes. Results suggested that 3 interventions—the Consensus, Concrete, and Combined conditions (described below)—were most effective in increasing people’s awareness about climate change and the impacts of pro-climate actions.
To understand the efficacy of climate literacy interventions in the real world, this study is testing the effects of these 3 different kinds of messages on climate literacy outcomes (specifically awareness of climate change and adaptation and mitigation behaviors) among users of a partner organization’s social media channels. The partner, the Canadian Association of Science Centres (CASC), shared the intervention posts (in the form of visually engaging graphics including the information for each condition) and accompanying quiz questions on their ScienceUpFirst (SUF) social media channels. The conditions are as follows and were presented in the following order, with 2 weeks between them to reduce carryover effects (note random assignment was not possible and the same users may have participated in multiple conditions):
1. Passive control/baseline: no graphics/intervention materials presented, only the 4 quiz questions evaluating climate literacy;
2. Consensus condition: Highlights the social and scientific consensus about climate change and climate action;
3. Concrete condition: Describes specific pro-climate actions and their relative impacts;
4. Combined condition: Combines information from the consensus and concrete conditions and some more general information about climate change.
Analysis Plan
Pre-analysis plan: Is there a pre-analysis plan associated with this registration?
Hypothesis
1. Respondents who view the intervention conditions are expected to perform better on the climate literacy quiz questions compared to the baseline condition (with no content).
2. Respondents who view the combined condition are expected to perform better on the questions about climate change mitigation and adaptation strategies compared to the rest of conditions.
3. Respondents who view the concrete and combined conditions are expected to perform better than the baseline and consensus conditions on the mitigation actions questions.
How hypothesis will be tested
All 3 of our hypotheses will be tested using Chi square tests with a Type I error rate of .05.
Dependent variables
Primary:
Proportion of accurate responses to 4 multiple-choice questions evaluating different aspects of climate literacy, namely:
-Climate change mitigation strategies
-Climate change adaptation strategies
-Individual actions that can be taken to mitigate climate change
-Cause of climate change
Secondary:
We will also explore a variety of social media metrics (e.g., views, engagements, comments).
Analyses
See above.
Sample Size. How many observations will be collected or what will determine sample size?
We have no control over the final sample size as it will depend on how many users happen to view the intervention posts and complete the quiz questions for each condition, and we will only be able to collect quiz responses for 24 hours after each one is posted. Based on engagement metrics CASC collected for the experiment timeframe (Jan-Feb) from previous years, we are anticipating a total sample size of roughly 1500 participants.
Data Exclusion
N/A (the primary dependent variables will only be available as aggregate data)
Treatment of Missing Data
N/A
Who is behind the project?
Project status:
Pre-registration
Methods
What is the project about?
Date published:
12 May 2025