Skip to content
An official website of the OECD. Find out more
Created by the Public Governance Directorate

This website was created by the OECD Observatory of Public Sector Innovation (OPSI), part of the OECD Public Governance Directorate (GOV).

How to validate authenticity

Validation that this is an official OECD website can be found on the Innovative Government page of the corporate OECD website.

Monitoring and participatory evaluation of the National Strategy to Combat Poverty 2021-2030 (ENCP)

Living lab session 3

As part of the National Strategy to Combat Poverty (ENCP), PlanAPP is piloting a participatory monitoring and evaluation (M&E) model. This model involves designing mechanisms for participation in collaboration with social sector organisations. Following this, individuals living in poverty will participate in the M&E process of the ENCP from its inception. The goal is to enhance the development of well-informed and contextually relevant public policies, foster a culture of participation, and advance evaluation practices in Portugal.

Innovation Summary

Innovation Overview

There is increasing recognition that addressing the complexity of contemporary challenges with public policies necessitates adopting new models of democratic governance. This includes participatory mechanisms that facilitate interaction among diverse perspectives and types of knowledge, enriching the decision-making process and enhancing the legitimacy of adopted solutions.

While there are mechanisms for citizen consultation in the initial stages of the public policy cycle, there is a lack of systematic involvement of citizens in later stages in Portugal. Additionally, policy evaluation remains inadequately institutionalised. In this context, this innovation aims to establish a new approach in public administration that promotes active citizen participation in the design, monitoring, and evaluation of public policies.

Specifically inspired by a French experiment conducted by France Stratégie from 2019 to 2022, PlanAPP is testing the implementation of an approach that ensures the participation of people experiencing poverty in the monitoring and evaluation (M&E) of the ENCP. The process involves several phases:

  • Living Lab: Engagement of social sector organisations with direct experience of poverty, collaborating to co-create a methodological roadmap for ensuring the participation of this demographic in the M&E of the ENCP. Four sessions were held in 2023, each attended by between 10 and 15 organisations. This group will continue meeting periodically to discuss and learn from the participatory M&E implementation.
  • Implementation of Methodological Roadmap: Rollout of participatory M&E involving ENCP recipients, in collaboration with the social sector organisations from the Living Lab. Participatory sessions are planned for 2024 and 2025.
  • Systematisation: Drawing from the accumulated experience of the participatory M&E approach, a methodological guide will be developed and disseminated. This guide aims to facilitate the development of participatory M&E processes that other public institutions can adopt and apply across different policy areas.
  • The objectives of this innovation are:

  • To integrate the M&E process with the recipients of ENCP measures, enabling ongoing assessment of effects during implementation.
  • To focus M&E efforts on the most significant issues identified, thereby enhancing the relevance and utility of evaluations.
  • To foster participatory and inclusive citizenship.
  • To enhance public administration capabilities in designing and conducting participatory processes within M&E frameworks of public policies.
  • To strengthen the 'evaluation culture' within public institutions.
  • This initiative seeks to fundamentally enhance the democratic governance of public policies in Portugal, promoting transparency, effectiveness, and responsiveness to the needs of the population.

    Innovation Description

    What Makes Your Project Innovative?

    ENCP's participatory M&E is innovative for the following reasons:

    • The involvement of the population living in poverty in ENCP's M&E allows people affected by public policy to contribute to the identification of concrete issues that are potentially differentiating and therefore deserve to be evaluated. This participation goes beyond merely consulting people on the results and impacts of certain measures, involving them right from the design of monitoring and evaluation, which is traditionally a phase exclusively the domain of specialists.
    • Conducting participatory processes is an uncommon practice in Portuguese public administration. Implementing and systematising a participatory approach in a public policy with the relevance and media coverage of the ENCP could help to standardise and demystify this type of process, as well as helping to develop the skills and conditions that will allow it to be replicated.

    Innovation Development

    Collaborations & Partnerships

    The following are identified as partners:

    • ENCP Coordination: validation and support in designing the innovation; mobilisation of social sector organisations;
    • Strategy and Planning Office: technical support for the operationalisation of the ENCP;
    • Institute of Social Sciences of the University of Lisbon: conceptualisation, guidance and systematisation of the Living Lab;
    • Social sector organisations: knowledge and experience in anti-poverty initiatives; co-organisation of population involvement sessions.

    Users, Stakeholders & Beneficiaries

    The beneficiaries of the innovation include:

    • Citizens: opportunity for the population with a lower level of civic participation to influence policies that have an impact on their lives;
    • Public sector: development of skills in participatory M&E;
    • ENCP Coordination: fulfilment of ENCP Strategic Objective 6.1 (ensuring participation mechanisms);
    • Social sector organisations: involvement in the process of implementing a public policy that is central to their sphere of work.

    Innovation Reflections

    Results, Outcomes & Impacts

    The 4 sessions held in 2023 made it possible to:

    • Co-construct methodological guidelines to guide the implementation of participatory M&E;
    • Deepen the knowledge of social sector organisations about the ENCP;
    • Promote a broader understanding of the potential and limitations of the participatory approach and the importance of M&E, and strengthen organisations' commitment to involvement.

    For the years 2024-2025 it is planned to:

    • Holding at least 8 participatory sessions with the ENCP target population, with a view to their M&E;
    • Systematising the experience into a guide for implementing participatory M&E processes, which should serve as a basis for consolidating participatory approaches within the public administration.

    Challenges and Failures

    Challenges include:

    • Managing expectations: ensuring that everyone involved has a clear and accurate understanding of the purpose, importance and scope of their participation;
    • Active and continuous participation: overcoming any possible lack of interest, disillusionment or discomfort with participation, in order to guarantee ongoing commitment and involvement;
    • Superficial and symbolic participation (tokenism): avoid moments of participation being reduced to validating decisions previously made or to an appearance of participation that is not then reflected in decision-making;

    The monitoring of the ICS and the involvement of social sector organisations in the living lab has helped to identify strategies to avoid and mitigate these risks.

    Conditions for Success

    Consideration should be given to

    • Prior training: ensuring that participants receive an introduction to the topics covered, enabling them to actively participate in the discussions;
    • Inclusive communication: avoiding the use of language that could intimidate, alienate or silence participants;
    • Recognition: consider material or immaterial rewards for the time dedicated to the sessions;
    • Highlighting usefulness: ensuring feedback and making the contributions received visible to the overall ENCP M&E process;
    • Human, logistical and financial resources: including the existence of facilitators who are experts in participatory processes;
    • Networking: ensuring the involvement of social organisations in organising the sessions and mobilising participants.

    Replication

    PlanAPP's involvement, as co-promoter of this innovation, ensures the systematisation of the procedures and good practices identified during the implementation of the ENCP's participatory M&E. In addition, as a competence centre tasked with promoting M&E within the public administration, PlanAPP is in a privileged position to communicate and disseminate these good practices. The involvement of social sector organisations throughout the process should contribute to greater knowledge about the general importance of M&E and, in particular, participatory M&E. At the same time, it will empower these organisations to replicate approaches of this nature in initiatives associated with the fulfilment of their missions.

    Lessons Learned

    So far, the following lessons have been learnt:

    • There is interest from social sector organisations in actively participating in the process. Their involvement helps to dispel doubts about the scope of the ENCP and ensure greater commitment to supporting it.
    • It is essential to repeatedly communicate (at the time of the invitation and during the process) the scope and products resulting from participation.
    • All parties involved in managing the process (PlanAPP, ENCP Coordination and ICS) should have the same understanding of the scope and output of each phase of the process, explaining the points on which there is no consensus or certainty. After each meeting, it is recommended to circulate and validate a written summary of the agreements reached.

    Anything Else?

    This project was born as part of PlanAPP's technical support activities, in conjunction with the Ministry of Labour, Solidarity and Social Security's Strategy and Planning Office and in close collaboration with ENCP's coordination, as provided for in Council of Ministers Resolution no. 184/2021, which mainly focus on the design and operationalisation of the Strategy's monitoring system. Considering the potential for innovation, training and learning that this technical support brings to PlanAPP and the Public Administration, other activities to be developed were included in the ENCP Action Plan, including the Living Lab and the sessions to implement the participatory approach to M&E.

    Status:

    Innovation provided by:

    Media:

    Files:

    • Roadmap for participatory M&E Methodological roadmap resulting from the living lab, with indications on how to ensure the participation of people living in poverty in ENCP's M&E.
    • Living Lab Report Document that systematises the living lab experience (co-creation process with social sector organisations).

    Date Published:

    1 July 2024

    Join our community:

    It only takes a few minutes to complete the form and share your project.