Background
Since the cessation of armed conflict in 2002, the country has made significant progress in the recovery and peace building processes including the holding of elections, restoration of governance structures, and reconciliation through the work of the Truth and Reconciliation Commission. The capacity of the national security architecture in Sierra Leone continues to develop. The Office of National Security has strengthened its role as the agency responsible for the coordination of all national agencies and government departments on security-related matters.
However, security situation in the country was still fragile. The high unemployment among the youth among others has posed a significant challenge to the fragile peace. Majority of basic infrastructure destroyed by the prolonged conflict has yet to be rehabilitated. Boarder security also remains fragile.
In entering into the new Country Programme period from 2008, UNDP is conducting an outcome evaluation of peace and development area between 2004-2007, in order to assess the status of the peace related outcomes, UNDP’s contribution and relevance and draw lessons learned for the next programme cycle.
Duties and Responsibilities
Outcome to be evaluated
The outcomes to be evaluated are defined by the Country Programme Document of UNDP Sierra Leone, which is stated as follows:
1. Increased livelihood opportunities for war affected populations especially women and youth
2. Improved capacity for conflict resolution and addressing human rights issues at community level
Objectives and scope of the outcome evaluation
This evaluation is being undertaken to determine the collective outcome of four years of peace and development work in Sierra Leone, from 2004-2007. The evaluation report will present findings and conclusion, lessons learned and recommendations for the future.
The main objectives of the outcome evaluation:
- Assess progress towards the outcome
- Assess the factors affecting the outcome
- Assess key UNDP contributions to outcomes
- Assess the partnership strategy
Each of the key issues shall be evaluated using the main evaluation criteria as appropriate: effectiveness, efficiency, relevance, impact, and sustainability. Specifically, the following issues should be addressed:
Outcome analysis
- What is the current situation and possible trend in the near future with regard to the outcome?
- In the past, has sufficient progress been achieved vis-à-vis the outcome as measured by the outcome indicator?
- What are the main factors (positive and negative) that affect the achievement of the outcome?
- Are the outcome indicators chosen sufficient to measure the outcomes?
- To what extent are synergies in programming such as partnerships among various UNDP programmes related to outcomes?
Output-outcome link
- Whether UNDP’s outputs or other interventions can be credibly linked to the achievement of the outcome (including the key outputs, projects, and soft assistance)
- What are the key contributions that UNDP has made/is making to the outcome?
- What has been the role of UNDP soft-assistance activities in helping achieve the outcome?
- With the current planned interventions in partnership with other actors and stakeholders, will UNDP be able to achieve the outcome within the set timeframe and inputs – or whether additional resources are required and new or changed interventions are needed?
- Whether UNDP’s partnership strategy has been appropriate and effective.
- Assess UNDP’s ability to develop national capacity in a sustainable manner (through exposure to best practices in other countries, holistic and participatory approach). Has UNDP been able to respond to changing circumstances and requirements in capacity development?
- What is the prospect of the sustainability of UNDP interventions related to the outcome?
The scope of the evaluation is all projects undertaken and completed by the UNDP’s Peace and development unit from 2004 to 2007, while including analysis of underlying factors beyond UNDP control that have influenced the outcome. The evaluation will be country-wide.
Evaluation methodology and team composition
As an outcome evaluation’s focus is on outcomes rather than outputs, particularly on development change and the role of partners, it is envisioned that the evaluation will take both a quantitative and qualitative approach. It will therefore encompass a number of methods, including desk reviews, stakeholder interviews, and a synthesis of existing project evaluations and documents.
One external evaluator (international consultant) will be recruited. Two full time, nationally-based national consultantswill assist the evaluator. In addition, the evaluator will have the support of the Peace and development unit in Sierra Leone. Prior to the evaluator’s arrival, Peace and development unit will provide an overview of the projects and have undertaken preliminary data collection and analysis, which will include gathering contextual information, project monitoring and evaluation data.
Upon arrival, the evaluator is expected to apply the following approaches for data collection and analysis:
- Desk review of relevant documents such as the country plan, project documents and monitoring reports
- Discussions with senior management and programme staff
- Interviews with and participation of partners and stakeholders
- Field visits to selected project sites if necessary
- Consultation and debriefing meetings
Tentative time schedule (Working day):
- Day 1 - Initial briefing of evaluator, evaluation design and work plan
- Day 2 - 3 - Desk review
- Day 4 - 7 - Stakeholder meetings, interviews
- Day 8 - 9 - Field visits
- Day 10 - Presentation of draft report for comments
- Day 11 - 13 - Follow up meeting and interviews
- Day 14 - Final presentation
- Day 15 - Briefing for senior management and submission of the final report
Expected outputs and use
The evaluator is expected to deliver an analytical report which should include the following:
Executive summary (1-2 pages)
- Introduction (0.5-1 page)
- Description of the evaluation methodology (1pages)
- Situational analysis with regard to the outcome, outputs, and partnership strategy (4-5 pages)
- Ratings on performance and progress towards outcomes (2-3 pages)
- Analysis of opportunities to provide guidance for future programming (3-4 pages)
- Key findings, including best practices and lessons learned (4-5 pages)
- Conclusions and recommendations (4-5 pages)
- Appendices: Charts, terms of reference, field visits, people interviewed, documents reviewed
The report will provide managers with options for strategy and policy as well as recommendations. This will form a basis for learning while also helping to ensure accountability and reflection on future UNDP programming in Sierra Leone. Furthermore, the report will be published in the country review and made available on the internet.
Competencies
- Possess strong analytical and writing skills, with the ability to conceptualize, articulate, write and debate about peace and development issues
- Prior experience in facilitating planning, and monitoring and evaluation / outcome evaluations is particularly relevant.
- Fluency in written and spoken English, incl. proven ability to write reports and develop/execute presentations;
Required Skills and Experience
International Consultant
- An advanced degree in public policy, development studies, economics, sociology, or a related social science.
- Possess strong analytical and writing skills, with the ability to conceptualize, articulate, write and debate about peace and development issues
- Prior experience in UNDP’s outcome evaluations would be a strong asset
- Competent and knowledgeable in development and peace and development issues in Sierra Leone
- Advanced level of proficiency in both written and spoken English.
National Consultant:
- Masters degree in public policy, development studies, economics, sociology or a related social sciences
- Minum 5 years of working experiences on research projects focusing on peace and development.