Systematic evaluation approaches and alignment with society

Skills and resources needed for CS assessment

Introducing more challenges for CS evaluation.

Explaining to learners that researchers and their RPOs need to invest and allocate resources for CS assessments, in particular if they are going to be continuous.

Open Framework for Evaluating Citizen Science Activities (OFECSA)

Describing the elements of the Open Framework for Evaluating Citizen Science Activities, including the scientific, volunteer, and the socio-ecological dimensions.

Demonstrating how a simple evaluation model applies to citizen science as a basic introduction to methodological approaches to evaluation.

Tools for evaluation

Describing basic tools of evaluation such as surveys, interviews, embedded assessment, participatory observation, and self-reflection processes.

Providing an overview of simple assessment tools + their pros and cons.

The logic model of evaluation applied to citizen science

Introducing the logic model as an overall framework for systematic assessments.

Guiding learners to think methodologically about evaluation and assessment criteria.

Fostering democratic, accountable, and responsive R&I.

Portraying RRI as a framework and approach that seeks to ensure that research and innovation activities are conducted in a way that aligns with societal values and needs, and that they contribute to positive societal outcomes.

Explaining the RRI philosophy to the learners.

Analysis of how Citizen Observatories (COs) have adopted RRI principles.

COs are collaborative initiatives that engage members of the public, including volunteers and local communities, in monitoring and collecting data related to various aspects of the environment, society, or public services.

Demonstrating that COs have adopted some RRI principles such as Open Access and Public Participation in Scientific Research, but not others such as ethics and governance.

Overlaps and divergences between CS and RRI.

Explaining overlaps between CS and RRI, but also their divergences, arguing that citizen science could learn lessons from RRI approaches and processes

Enabling learners to consider CS from an RRI perspective and learn from RRI approaches.

Integrating RRI into higher education institutions and citizen science.

Describing how HEIs can help transform the research and innovation system by developing new normative frameworks, plans to foster dialogue and participatory approaches, policies of openness and inclusivity.

Enabling learners to design a strategy for how to incorporate RRI into HEIs (and citizen science).

Evaluation dimensions   for RRI.

Presenting the seven RRI dimensions (Public engagement, Gender equality, Research ethics, Open science, Sustainability (social, economic, and ecological), Science education and outreach, and Governance) and how they may be evaluated in terms of process (formative evaluation) and outcome (summative evaluation)

Providing learners with conceptual tools for evaluations of RRI and CS.

Brainstorming

In small groups, the learners consider the key RRI dimensions outlined in the handout. Each group should brainstorm and compile a list of specific indicators within these dimensions that hold relevance for citizen science projects (such as Pollinator Paradise from the previous interactive session).

Learners gain the opportunity to collaborate and brainstorm in small groups, allowing for the integration of diverse perspectives and insights into the development of RRI indicators.

Sharing and discussion

Each group will present one or two indicators they have generated for a general discussion on their RRI significance and potential impact on citizen science projects.

The sharing of generated indicators allows learners to exchange ideas and insights. It promotes a collaborative learning environment where individuals can learn from one another's perspectives and experiences.

Consolidation and conclusion

In groups, discuss common themes and trends that emerged from the shared indicators. Select a few indicators that seemed particularly important or universally applicable to citizen science.

Selecting a few indicators as particularly important or universally applicable provides learners with actionable takeaways. It empowers them to implement these indicators effectively in their CS projects, aligning them with responsible and inclusive research and innovation practices.