Background

IMPORTANT: Applicants are requested to apply online http://jobs.undp.org by 15th July 2019. Full ToR with Annexe's and can be seen and downloaded at http://procurement-notices.undp.org/view_notice.cfm?notice_id=57053.

As a critical component of any democratic system, civil society has been and will continue to be an important actor of reform processes taking place in the Western Balkans (WB). In this context, the EU accession agenda in the region promotes the role of civil society in further democratisation, including consultation in decision making, contribution to processes associated with policy and regulatory changes, as well as performing a watchdog function and promoting public accountability. Albania, Bosnia and Herzegovina, Kosovo, the Republic of North Macedonia, Montenegro, and Serbia (hereinafter: EU IPA beneficiaries) face comparable challenges when it comes to the cooperation between governments and civil society organisations (CSO), including limitations in the overall environment for CSO operations, lack of structured CSO participation in public affairs and inadequate CSO capacities. While considerable public funding is allocated to CSOs, available procedures are often not transparent, monitoring of awarded funds is not performed and effects are not measured.

The overall objective/impact of the ReLOaD is to strengthen participatory democracies and the EU integration process in the Western Balkans by empowering civil society to actively take part in decision making and by stimulating an enabling legal and financial environment for civil society. The specific objective/outcome of the programme is to strengthen partnerships between local governments and civil society in the Western Balkans by introducing transparent and project-based funding of CSOs from local government budgets towards greater civic engagement in decision-making and improvement of local service delivery. The programme outputs/results focus on promotion and institutionalization of transparent and project-based funding of CSOs by local governments, capacity building of local governments and CSOs and their effective interaction, improved service delivery by CSOs to the most vulnerable and excluded groups and facilitating cross-country thematic networking of CSOs and local government representatives. Detailed outline of the Programme Result Framework is available in Annex 1.

Evaluation purpose, objectives and scope

a) Purpose

The purpose of the Project Evaluation is to provide an impartial review of the ReLOaD programme in terms of its relevance, effectiveness, efficiency, impact, sustainability, overall performance, management and achievements. The information, findings, lessons learned and recommendations generated by the evaluation will be used by the Project Board/Board of Partners, UNDP, EU and by the implementing partners to strengthen the remaining Project implementation and inform future programming.

b) Objective

The evaluation objective is to examine the overall performance of the ReLOaD, its results, inputs and activities, and how the outputs delivered added value to local governments and CSOs. In a substantive analysis of the effectiveness of the project approach and feedback from beneficiaries, the evaluation should assess cause and effect relations within the programme, identifying the extent to which the observed changes can be attributed to the ReLOaD. In addition, this evaluation aims to provide forward-looking recommendations to the EU and UNDP in the field of local government-civil society relations and promotion of CSO role in service delivery.

c) Scope

The evaluation will assess the extent to which the planned specific objective/outcome and results/outputs have been achieved since the beginning of the programme and likelihood for their full achievement by the end of the programme in July 2020 (based on the Programme Document/Description of the Action and its results framework). The evaluation will look into the overall programme performance and results, covering six IPA beneficiaries where the programme is implemented (Albania, Bosnia and Herzegovina, Kosovo, the Republic of North Macedonia, Montenegro and Serbia).

Specifically, the evaluation will review, evaluate and make recommendation regarding the implementation of the ReLOaD programme in 53 partner local governments in six IPA beneficiaries. It will look into critical programme’s aspects, such as partnership between CSOs and local authorities and institutionalization of the methodology for transparent and project-based funding of CSOs from local government budget. To the extent possible, it will also consider the relevance and influence of 200 implemented CSO projects on the individuals and groups within the programme’s localities (online survey of the programme beneficiaries).

Finally, the evaluation will look into the programme processes, innovations, strategic partnerships and linkages in the regional context, that proved critical in producing the intended results/outputs and the factors that facilitated and/or hindered the progress in achieving the results/outputs, both in terms of the external environment and risks, as well as internal, including: weaknesses in programme design, management, human resource skills, and resources.

Duties and Responsibilities

Based on the UNDP Evaluation Guidelines, UNEG Norms and Stand for Evaluations (2016) and in consultations with UNDP Country Office, the evaluation will be participatory, involving relevant stakeholders.

The International Evaluation Consultant (the Consultant) will propose an evaluation methodology and agree on a detailed plan for the assignment as a part of the evaluation Inception Report. The proposed methodology may employ any relevant and appropriate quantitative, qualitative or combined methods to conduct the Project Evaluation, exploring specific, gender sensitive data collecting and analytical methods and tools applicable in the concrete case. The Consultant is expected to creatively combine the standard and other evaluation tools and technics to ensure maximum reliability of data and validity of the evaluation findings.

Standard UNDP evaluation methodology would suggest the following data collecting methods:   

• Desk review: The Consultant will conduct a detailed review of the programmatic materials and deliverables including the Programme Document/Description of the Action, theory of change and results framework, monitoring and programme quality assurance reports, annual workplans, consolidated progress reports etc. An indicative list of documents for desk review is provided in Annex 3.
• Key informant interviews: The Consultant will interview representatives of main institutional partners, EU and UNDP, other relevant stakeholders (e.g. Advisory Group) and donors and in all six IPA beneficiaries. For the interviews, the Consultant is expected to design evaluation questions around relevance, effectiveness, efficiency and sustainability criteria, according to different stakeholders to be interviewed. An indicative list of main stakeholders that may be considered for meetings is provided in Annex 2.
• Meetings / focus group discussions with local governments and CSOs: 2 - 3 site visits per IPA beneficiary will be arranged to meet with men and women, beneficiaries and stakeholders and review results of the programme;
• Other methodologies, as appropriate, such as case studies, statistical analysis, social network analysis, etc.[1]

As an integral part of the evaluation report and specifically under the impact criteria, the Consultant will review the programme effects and impact on its target groups. In this context and using the online survey, the consultancy is expected to gain insights from both the partner local governments and CSOs regarding the importance of grassroot CSO projects and the work of the CSOs in general in their communities.

Stakeholders involvement: During the evaluation process, the Consultant is expected to meet senior representatives of the UNDP, EU and the programme team, key partners and stakeholders in all six IPA beneficiaries. Initial briefing and evaluation debriefing to obtain the critical feedback on the evaluation report, are envisaged. To assess programme performance, approach and modalities, the Consultant will meet with key programme partners and stakeholders, members of national Boards of Partners (respective ministries of local governments, offices for cooperation with civil society, associations of cities and municipalities in all six IPA beneficiaries). In addition, the views of representatives of partner local governments and CSOs awarded under the ReLOaD grant scheme will be considered to obtain critical insight and information on the programme activities and results. As relevant, the Consultant will also meet with representatives of other UNDP-implemented initiatives as well as EU-funded projects (such as ROMACTED, TACSO, etc.) active in the field of civil society development. During these meetings, it would be important to record and accumulate inputs necessary not only for the programme evaluation, but also to highlight recommendations and advise on potential programme follow-up phase.

The expected duration of the assignment is up to 47 work days, with ca 27 days in the IPA beneficiaries (5 days in Albania, 6 days in Bosnia and Herzegovina and 4 days in the remaining IPA beneficiaries) in the period May/July 2019.

Evaluation tasks / deliverables

Following the initial briefing and a detailed desk review, the Consultant will be responsible for delivering the following products and tasks:

• Inception Report (10-15 pages) will be presented before the evaluation starts, showing how each evaluation question will be answered by proposing methods, sources of data and data collection procedures. The Inception Report should elaborate an evaluation matrix (provided in Annex 4) for the ReLOaD programme and propose a schedule of tasks, activities and evaluation deliverables. The Evaluation Inception Report should follow the structure proposed in the UNDP Evaluation Guidelines, p. 22-23.
• Evaluation and data collection mission: Upon the approval of the Inception Report and the evaluation work plan by the UNDP, the Consultant is expected to carry out the programme evaluation, including review of effects of CSO projects in target local communities in six IPA beneficiaries. To collect data and insights on the programme, the Consultant will undertake one field mission per IPA beneficiary and have meetings and interviews with relevant stakeholders, including government, CSO, EU and UNDP representatives. UNDP will provide support in organization of meetings and logistical arrangements as necessary.
• Draft Evaluation Report: Based on the findings generated through desk review and data collection missions, the Consultant will prepare and submit the Draft Evaluation Report to the UNDP team and key stakeholders for review. Structure of the Report is outlined in Annex 5.
• Evaluation review process (and eventual dispute settlement): Comments, questions, suggestions and requests for clarification on the evaluation draft will be submitted to the Consultant and addressed in the agreed timeframe. The Consultant should reply to the comments through the evaluation audit trail document[2]. If there is disagreement in findings, these should be documented through the evaluation audit trail, while effort should be made to come to an agreement.
• Evaluation debriefings: will be held with UNDP Bosnia and Herzegovina (contracted party that administers the programme), EU representatives and other key stakeholders to present main findings and recommendations either face-to-face or in a form of a Skype briefing. In addition, short briefings on immediate findings with UNDP sr. management will be considered after completion of field work in each IPA beneficiary.
• Evaluation Report (maximum 50 pages of the main body) should be logically structured, contain data and evidence-based findings, conclusions, lessons and recommendations, and be presented in a way that makes the information accessible and comprehensible. Finally, based on the evaluation findings and in a distinct report section, the Consultant will provide forward-looking actionable recommendations, outlining key strategic priorities to be addressed in the potential next phase of the programme.[3]

Evaluation team composition and required competencies

The evaluation will be conducted by an International Evaluation Consultant. The Consultant is expected to provide an independent and substantiated review of the programme achievements; capture underperformance; review coherence and inter-connectivity among initiatives within the programme; assess partnership strategy; capture feedback from beneficiaries of assistance provided by the programme, in light of development results; last but not least – recommend improvements that may be undertaken to ensure quality outcome, and provide strategic forward-looking recommendations, outlining pathways for the period beyond this programme phase.

[1] UNDP Evaluation Guidelines, Annex 2. Summary of common data-collection methods/sources used in UNDP evaluations

[2] Template available at http://web.undp.org/evaluation/guideline/documents/PDF/UNDP_Evaluation_Guidelines.pdf, p. 25

[3] Evaluation Report Template available at http://web.undp.org/evaluation/guideline/documents/PDF/UNDP_Evaluation_Guidelines.pdf, p.49

Competencies

Core values:

• Demonstrates integrity and fairness by modelling UN values and ethical standards;
• Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability.

Core competencies

• Demonstrates professional competence to meet responsibilities and post requirements and is conscientious and efficient in meeting commitments, observing deadlines and achieving results;
• Results-Orientation: Plans and produces quality results to meet established goals, generates innovative, practical solutions to challenging situations;
• Communication: Excellent communication skills, including the ability to convey complex concepts and recommendations, both orally and in writing, in a clear and persuasive style tailored to match different audiences;
• Team work: Ability to interact, establish and maintain effective working relations with a culturally diverse team;
• Client orientation: Ability to establish and maintain productive partnerships with national partners and stakeholders and pro-activeness in identifying of beneficiaries and partners’ needs and matching them to appropriate solutions.

Required Skills and Experience

Academic Qualifications/Education:

• Advanced university degree in social sciences, economics, public administration, regional development/planning, or other sciences sustainable development;

Experience:

• At least 5 years of extensive project/programme evaluation expertise and experience, with evaluations in the area of local governance and local development;
• Sound knowledge of results-based management systems, and gender-sensitive monitoring and evaluation methodologies;
• Expertise in the area of local governance/public administration and/or civil society development;
• General understanding and knowledge of the political/administrative and development context of the Western Balkan region;
• Previous working experience in the Western Balkan region is an asset;
• Proven analytical skills and ability to conceptualize and write concisely and clearly.

Languages Requirements:

• Fluency in English language.

Other:

• Excellent computer skills (MS Office applications) and ability to use information technologies as a tool and resource.

Qualification Requirements

 Only candidates obtaining a minimum of 70 points would be considered for Technical Evaluation.

Technical Evaluation

Only candidates obtaining a minimum of 70 points would be considered for the Financial Evaluation.

EVALUATION

Individual consultants will be evaluated based on the following methodology:

Cumulative analysis

When using this weighted scoring method, the award of the contract should be made to the individual consultant whose offer has been evaluated and determined as:
a) responsive/compliant/acceptable, and
b) Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation.

• * Technical Criteria weight-70%
• * Financial Criteria weight- 30%

Applicants are required to submit an application including:

• Proposal (outlining the specific design and methods for the evaluation):

  • Explaining why they are the most suitable for the work;

  • Providing a brief methodology on how they will approach and conduct the work;

  • the methodology should present the Consultant’s approach, proposed detailed methods, scope and evaluation criteria and questions;
  • the methodology should apply a mixed-method approach collecting both quantitative and qualitative data to validate and triangulate data;
  • the methodology should include the filled in evaluation matrix (Annex 3);
  • the methodology should explain the data collection tool/s to be used.

     

• Completed and signed the Offeror’s template Confirming Interest and Availability (please follow the link: https://popp.undp.org/_layouts/15/WopiFrame.aspx?sourcedoc=/UNDP_POPP_DOCUMENT_LIBRARY/Public/PSU_%20Individual%20Contract_Offerors%20Letter%20to%20UNDP%20Confirming%20Interest%20and%20Availability.docx&action=default);
• Latest personal CV, including past experience from similar projects, and email, telephone and any other contact details for references;
• Financial proposal - which will separately specify professional fee, indicating number of anticipated working days, travel costs (air-ticket or use of private vehicle), living allowance, and all other applicable costs.

Please scan all above mentioned documents and upload as one attachment only online through this website.

Note:

• For an assignment requiring travel, consultants of 65 years or more require full medical examination and statement of fitness to work to engage in the consultancy.
• Due to large number of potential applicants, only competitively selected candidates will be contacted for remaining steps of the service procurement process.