Strategy, evaluation, and impact for citizen science

Introduction to the module

Text, explaining how we are going to introduce the topic of citizen science strategies and policies, with two examples of different policy documents that were developed and enacted in two different contexts 

Explaining to the learner why this section is relevant to understanding citizen science strategy and policy-making

Example of successful CS strategy implementation in RPO

Telling the story of the NOAA Citizen Science Strategy, which outlines a path for the agency to engage the public in support of key mission areas and aligns with the US Crowdsourcing and Citizen Science Act 

Demonstration of an institutional policy that connects citizen science to key mission areas and national policy

Example of development of national CS strategy

Telling the story of the German citizen science strategy, which contains 94 concrete recommendations for action to further develop citizen science in Germany and anchor it permanently in science, society and politics

Demonstration of a national policy that seeks to anchor citizen science permanently in scientific institutions and society 

Strategic planning in RPOs with particular attention to citizen science (2 min)

Going over the three planning imperatives - leadership, communication, assessment - with special emphasis on linking assessment and planning

Helping learners to develop their thinking about strategic processes in RPOs with special attention to assessment and planning

Introduction to the training module

Providing a link between the previous training module and the need for comprehensive evaluation and assessment related to CS

Explaining to the learners why this section is relevant - to link policy-making and strategy to assessment criteria

Challenges in evaluating CS

Explaining why CS assessments need to be broader than usual assessments in science including diverse objectives and project types, issues around data quality and reliability, and subjective impacts

Demonstrating the need for more comprehensive assessment models

Assessing citizen science to evaluate its quality, impact, and effectiveness

Elaborating scientific, societal, and learner impacts, including data quality, research contribution, environmental and societal benefits, awareness and education, engagement, and empowerment

Giving learners an understanding of the many different quality criteria that are relevant for CS assessment

The Citizen Science Impact Assessment Framework (CSIAF)

Explaining the six guiding principles of CSIAF: 1) Acknowledging a variety of purposes of citizen science impact assessment, 2) Non-linear conceptualisation of impact journeys to overcome impact silos, 3) Comprehensive impact assessment methods and information sources, 4) Moving beyond absolute impact, 5) Fostering comparison of impact assessment results across citizen science projects, and 6) Cumulative enhancement of the framework over time

Equipping learners with a set of foundational principles to support thorough and effective evaluation in the realm of CS

MICS: Measuring the impact of CS

Describing the five impact domains included in the MICS framework, including examples of the indicators proposed

Project selection

In smaller groups, learners choose to work either own CS project or the hypothetical CS project called “Pollinator Paradise”. If they opt for the latter option, they will familiarize themselves with the project as outlined in the handout.

Providing learners with a tailored learning experience. This allows them to apply assessment criteria directly to their own projects or gain valuable experience by working with a hypothetical case, ensuring the relevance of the activity to their specific needs.

Brainstorming on assessment criteria

Learners will collaboratively brainstorm and design assessment criteria for the chosen citizen science project. The groups should consider the scientific impact, societal impact, and learner impact. If necessary, refer to the MICS domains and indicator clusters provided in the handout for guidance.

Encouraging learners to consider diverse perspectives and enhancing the quality of assessment criteria. They gain a holistic understanding of the multifaceted nature of CS evaluation, preparing them to evaluate real-world projects effectively.

Flip chart creation

Each group creates a flip chart sheet outlining the assessment criteria. The learners are encouraged to be creative in their thinking about the criteria and how they are presented visually.

Fostering creativity and visual communication skills. Encouraging learners to think critically about how to present assessment criteria effectively, a valuable skill in the communication of complex ideas in the academic and professional world.

Presentation and feedback

The groups present their flip chart with their assessment criteria. Presentations should explain the criteria and the reasoning behind them. Feedback is provided from other groups and the facilitator.

Promoting public speaking and presentation skills as well as critical feedback from peers and the facilitator to ensure that learners receive diverse perspectives, helping them refine and improve their assessment criteria.