Background

As spelt out and planned in the programme document, it is a requirement to conduct an end of programme evaluation for the intervention.  The purpose of the evaluation is to therefore assess the Joint Program design, operations, administration, and outcomes in order to identify lessons and good practices that can improve future Joint Programming on Peace building and enhancing protection systems with a gender focus.

The main objectives of the evaluation are to:

  • Take stock of current programme achievements, challenges and opportunities;
  • Verify the continued relevance (alignment with national needs) and pertinence of the programme as well as the related sustainability of benefits thereof;
  • Assess the programme design, objectives, strategies and implementation arrangements in light of changes in the program context and the risks therein;
  • Identify key lessons and make recommendations on how to improve joint programming on Gender Equality and women’s empowerment in Uganda. The evaluation will be a tool for deepening knowledge and understanding of the assumptions, risks, options and limits of development programming and cooperation around GEWE in Uganda.
  • The clients of the evaluation and main audience of the report are:
  • Relevant staff in target ministries, local government and targeted government institutions;
  • Target beneficiary communities/groups;
  • Relevant staff in participating UN-agencies;
  • UN Agencies;
  • Technical units and head of Units in the participating UN-agencies;
  • UN-agency Headquarters;
  • Development partners.

Aligned with United Nations Evaluation Group (UNEG) Norms and Standards, this evaluation has an explicit focus on utility. The Government of Uganda, Donors and the UN will be the primary users of this evaluation. A synthesized knowledge product drawing upon lessons learned about the process and management of the joint program will provide recommendations for effective design, planning, management, monitoring and evaluation for future joint programming/programmes on GEWE in Uganda. Lessons learned and information relating to the outcomes of the Joint Program and its impact will provide input into the priority areas of focus for future programming in these areas. This knowledge product will be shared with key stakeholders, donors and partners. In line with Norms and Standards a management response will be prepared for this evaluation as practical means to enhance the use of evaluation findings and follow-up to the evaluation recommendations. The management response will identify who is responsible, what are the action points and the deadlines. The evaluation results will be shared broadly with all stakeholders involved in the programme to inform future initiatives. It will specifically be posted on the online UN Women ‘Global Accountability and Tracking of Evaluation Use - GATE System’ and other relevant online sites.

Land mark international resolutions such as UNCSR 1325 and 1820 recognize the differential impacts of conflict on men and women and call for the prevention and protection of women and girls from violence and their participation in peace building and post conflict reconstruction.  Women, however continue to be marginalized from participation and their needs remain unmet.  Any inequalities they faced before conflict are increased by the consequences of conflict and the challenges of reconstruction and reintegration.  Women and girls in Acholi are no exception and they continue to be subjected to forms of gender based discrimination and violence.

In the development of the Government of Uganda’s Peace, Recovery and Development Plan (PRDP) for war affected districts of Northern Uganda, women who had mobilized through the Women’s Coalition for Peace to contribute women’s views to the peace agreements and participated as observers at the Juba Peace Talks were not consulted. The PRDP went on to formulate priorities that largely failed to consider the post conflict needs of women, including issues of protection from gender based violence, ending impunity for sexual violence offenders and for women to have greater participation and decision making in peace building and recovery discussions.

Local Council Courts, together with traditional community mechanisms for land conflict resolution, such as Kwer Kwaro Acholi, play a fundamental role in adjudicating and mediating land disputes, especially those involving returnees. The capacity of these institutions to handle complex land cases in a gender sensitive manner is however the target of few support initiatives under the PRDP or other development programmes. The absence of effective law enforcement mechanisms as well as the inadequate capacity of traditional leaders and of Ker Kwaro Acholi and Local Council Courts to handle land disputes in a manner that upholds the rights to women and youth, to reconcile families and communities, and to protect the traditional rights of women to use the customary land, created an environment in which women and girls are robbed of the dividends of peace in Acholi.

Duties and Responsibilities

The Joint programme in line with the Secretary General’s 7 –point Action Plan for Women’s Participation in Peace building, and falls under the priority area four set forth in the Terms of Reference of the PBF, i.e. establishment or re-establishment of essential administrative services and related human and technical capacities.

This Programme proposal fits under the UNPBF Priority Plan for Uganda,  UNPRAP Outcome 1, Programme Outcome 2; ‘Transitional justice processes, mechanisms and capacities for mediation, peace building and reconciliation facilitated” and Programme Outcome 4; “recovery, reintegration, protection services, systems and structures established and accessible to vulnerable groups/affected population groups”.

This Programme Proposal aims to compliment PBF funded UNJP 1 and UNJP 2 with a focus on gender equality dimension.

Specifically, it aims to strengthen of gender components under:

  • UN JP 1: Output 1.1.2 “Transitional justice processes, mechanisms and capacities for mediation, peace building, conflict resolution and reconciliation facilitated”;
  • UN JP 2, Output 6. “Children formerly associated with armed forces and groups and other children affected by conflict are supported through reception, interim care and/or reunification with families/communities of origin’.

It responds to unmet needs of women and girls by enhancing the gender perspective in some of the outputs and ongoing activities under the PBF funded UNJP 1 and UNJP 2. Under UNJP 1 which supported transitional justice processes, mediation, and conflict resolution, and the mobilization of LC2 courts and the strengthening of the Ker Kwaro, the principle of non-discrimination especially related to gender-equality will be emphasized.  The UN JP 2, supported one activity for the children and their mothers returning from the LRA, while the activities in this programme support the women and girls formerly abducted by LRA and who have returned but, are still languishing in the communities on their own facing resistance, non-acceptance and discrimination.

The objective of the programme is to fully reintegrate these marginalized women and girls through community acceptance and empowerment through income-generation, so that they can positively contribute to community cohesion and become integral members of their communities.  Hence this proposal compliments the JP 2 reunification and reintegration of children by emphasizing the gender-dimension in the reintegration support.

The programme activities explicitly address the discrimination and marginalization of women and girls who were either formerly abducted by the LRA or were former combatants, so that they are empowered through social reintegration and access to land.

This programme proposal has two main components:

  • Social reintegration of girls and young mothers formerly associated with LRA;
  • Empowerment of women and former combatants to have access to land.

Both components build upon and compliment the on-going efforts but also aim to address the existing gaps especially related to gender discrimination.  Both the components have ex-LRA women and girls as the beneficiaries, the first one addressing their social and economic reintegration back into their communities of origin with full acceptance and support of the communities, and the second one addressing their access to land through the transitional justice system as well as the formal Local Council 2 Courts.  Strong linkages exist between the two components.  The overall cultural, normative, and administrative environment is made more protective by raising the awareness of Clan leaders about their own Acholi Principles on Gender, training of members of Land Committees, supporting women and girls to access land (2nd component), mobilizing communities, holding communities dialogues, holding cleansing ceremonies, communities develop actions plans to support these women and girls, and the District Local Governments include specific measures for their support in their district and budget plans. (1st component).  For these women and girls to become socially acceptable and economically productive members of their communities, social and reintegration support is provided through the 1st component in the form of vocational and income-generation skills training along with start-up kits, improved seed, tools, and oxen and oxen ploughs for commercial agricultural activities, while the 2nd component provides for legal support to access their land. Thus both components of the proposal are inter-related and inter-dependent.

The evaluation will cover the programme period from January 2013 – September 2015 in the seven districts of the Acholi Sub-region (Gulu, Pader, Agago, Kitgum, Amuru, Nwoya, Lamwo). The evaluation will be conducted over a 2 months period and will include consultations with the Participating UN Agencies (UN Women and UNICEF); their implementing partners; and the target beneficiaries across the seven districts.

Evaluation questions:

The specific review questions and relevant evaluation instruments will be determined during the inception stage and in close consultation with the Evaluation Reference Group. The following questions shall guide the inquiry under the different aspects of the analytical framework.

Relevance

The extent to which the objectives of the Joint Program are consistent with the evolving needs and priorities of the beneficiaries, partners, and stakeholders:

  • How has the programme addressed the relevant needs in the country? Have new, more relevant needs emerged that the programme should address in future;
  • How have the stakeholders taken ownership of the programme concept;
  • How do the partners, target groups and beneficiaries consider that the programme achieved its goal in contributing towards enabling women access services and opportunities;
  • To what extent has the programme contributed to the national priorities stipulated in key documentation (National Gender Policy, National Development Plan);
  • How have the programme objectives addressed identified rights and needs of women and girls in national and regional contexts? How much has  the programme contributed to shaping women’s rights priorities;
  • What rights does the program advance under CEDAW, the Millennium Development Goals and other international commitments? How has the program contributed towards the achievement of MDG3 in Uganda.

Efficiency:

A measure of how economically resources / inputs (funds, expertise, time, etc.) were converted to results.

  • What measures have been taken during planning and implementation to ensure that resources are efficiently used;
  • Have programme funds and activities been delivered in a timely manner? If not, what were the bottlenecks encountered? How were they addressed;
  • Could the activities and outputs have been delivered with fewer resources without reducing their quality and quantity;
  • Were resources (financial, time, people) sufficiently allocated to integrate human rights and gender equality in the design, implementation, monitoring and review of the JP;
  • Have UN Women’s (as coordinating agency) organizational structure, managerial and coordination mechanisms effectively supported the delivery of the programme;
  • What were the constraints (e.g. political, practical, and bureaucratic) to addressing human rights and gender equality efficiently during implementation? What level of effort was made to overcome these challenges.

Effectiveness

The extent to which the Joint Program’s objectives were achieved, or are expected / likely to be achieved. The basis for this inquiry will be the JP results framework:

  • What has been the progress made towards achievement of the expected outcomes and expected results? What are the results achieved;
  • What are the reasons for the achievement or non-achievement;
  • To what extent have beneficiaries been satisfied with the results;
  • Does the program have effective monitoring mechanisms in place to measure progress towards results? Were these monitoring mechanisms able to identify challenges and were the necessary follow up actions taken to address these challenges;
  • To what extent have the capacities of duty-bearers and rights-holders been strengthened.

Sustainability:

The likelihood of a continuation of benefits from a development intervention after the intervention is completed or the probability of continued long-term benefits:

  • What is the likelihood that the benefits from the program will be maintained for a reasonably long period of time if the program were to cease;

  • Is the program supported by national/local institutions? Do these institutions, including Government and Civil Society, demonstrate ownership, leadership commitment and technical capacity to continue to work with the program or replicate it;
  • Do partners have the financial capacity to maintain the benefits from the program? What might be needed to support partners to maintain these benefits;
  • To what degree are partners changing their policies or practices to improve human rights and gender equality fulfillment (e.g. new services, greater responsiveness, resource re-allocation, improved quality etc.);
  • Based on the findings of the evaluation and demand from the beneficiaries and national institutions, which components of the program should be carried over into a future phase, and are there any recommendations for their improvement.

Validity of the design:

How well the program was conceived and what effect this had on its potential to achieve the postulated results:

  • Was a gender analysis conducted during the UNDAF or the development of the programme? If undertaken, did the gender analysis offer good quality information on underlying causes of inequality to inform the programme design;
  • Were the planned programme outputs and results relevant and realistic for the situation on the ground? Did they need to be adapted to specific (local, sectoral etc.) needs or conditions;
  • Is the intervention logic coherent and realistic? What needs to be adjusted? (refer to the programme Results Matrix);
  • What are the main strategic components of the programme? How do they contribute and logically link to the planned outcomes? How well do they link to each other;
  • Who are the partners of the programme? How strategic are partners in terms of mandate, influence, capacities and commitment;
  • How appropriate and useful are the indicators described in the programme document in assessing the programme's progress? Are the targeted indicator values realistic and can they be tracked? If necessary, how should they be modified to be more useful? Are the means of verification for the indicators appropriate;
  • To what extent are approaches such as attention to gender, human rights based approach to programming and results based management understood and pursued in a coherent fashion.

Management and Coordination:

  • How well were the responsibilities delineated and implemented in a complementary fashion;
  • How well have the coordination functions been fulfilled;
  • Have the management and implementation capacities (coordination, participating UN agencies, IPs) been adequate;
  • How effectively has the programme management monitored programme performance and results;
  • Have appropriate means of verification for tracking progress, performance and achievement of indicator values been defined;
  • Has the relevant UN Joint Program information and data systematically being collected and collated;
  • Has information been regularly analysed to feed into management decisions;
  • How (if at all) has the programme made strategic use of coordination and collaboration with other Joint Programmes (UNJPGE, UNJPGBV & UNJPFGM) to increase its effectiveness and impact.

Existing information

The following documents will be shared with the evaluation team:

  • Programme documents, MoUs, SAAs;
  • UNDAF 2010-2014;
  • Results Matrix;
  • Various documents of the JP PBF;
  • Programme work plans;
  • Progress reports;
  • Publications and promotional materials;
  • Reports on specific activities;
  • Documents related to programme achievements.

Evaluation approach, process and method

The evaluation methodology will be developed by the Evaluation Team and presented for approval to the Evaluation Reference Group. The methodology should use a combination of quantitative and qualitative research methods that are appropriate to address the main evaluation questions. These methods should be applied with respect to human rights and gender equality principles and facilitate the engagement of key stakeholders. Measures will be taken to ensure data quality, validity and credibility of both primary and secondary data gathered and used in the evaluation.

The evaluation will be carried following UN Evaluation Group (UNEG) Norms and Standards (see http://www.unwomen.org/about-us/accountability/evaluation/), as well as the Ethical Guidelines for evaluations in the UN system, see Annex to this ToR. In line with Norms and Standards a management response will be prepared for this evaluation as practical means to enhance the use of evaluation findings and follow-up to the evaluation recommendations. The management response will identify who is responsible, what are the action points and the deadlines.

The evaluation should draw on and serve to complement the previously conducted and ongoing Joint Program evaluations in Uganda (i.e. JPPBF, JP GBV, UNJPGE).

Evaluation Process

The consultant is expected to:

Present and discuss an Inception Report

To the Reference Group at an inception meeting. This report should include, but not limited to:

  • Interpretation of the Terms of Reference.

Detailed Work Plan Schedule – Detailed Data Collection Methodology Data Collection Tools.

Conduct a desk review

Which will focus on an in-depth context analysis of the Joint Programme, and also answer some questions of relevance. The documents include all those listed in the next section of this ToR.

Conduct Key Informant Interviews

Key informants are individuals who are knowledgeable or experienced in a specific areas or aspects of the Joint Programme. For the purposes of this evaluation the key informants will include, key staff of participating UN agencies and Government Ministries, key civil society partners, implementing partners, and representatives of the beneficiary groups. Depending on the nature of information required, available time and resources, the evaluating team will conduct semi-structured individual or group interviews. This methodology will be useful for triangulating information and interviewing a broad range of stakeholders.

Conduct Focus Groups / Consultation Workshops

Focus group discussions can gather in-depth qualitative information from a group of participants with a similar background/role in the Joint Program – for example, civil society partners, community leaders, program participants / beneficiaries, etc. The discussion will be facilitated and guided by a list of topics/questions developed by the evaluating team. The team will also identify focus groups based on the areas of evaluative inquiry.

Conduct Field and site visits

A selection criteria will be developed in consultation with the evaluation team, the Joint Program management unit as well as national leadership

Submit a draft evaluation report and make a presentation

Of the findings to stakeholders for validation. The consultant will integrate stakeholder comments as appropriate and submit an final evaluation report.

Submit an observations report

That documents the review process so that the process can be improved in the succeeding Joint Programme reviews

Stakeholder participation

Key stakeholders to be considered include UN Women and UNICEF programme staff, Key staff at the Resident Coordinator’s Office, GPI implementing partners, Participating government institutions (local Governments, LC IIs), community structures, and the traditional institutions in Acholi. Following UN Women Evaluation Policy the evaluation will aim at engaging particularly different groups throughout the process. A select team of key stakeholders will act as a reference group and will be involved at various stages during the evaluation process. This includes, inter alia, providing comments on the TOR, on the inception report and draft report, and supporting the utilization and dissemination of the evaluation findings. The GPI partners will be included in data collection and analysis, reporting, dissemination and follow-up.

Expected products

The evaluator will be expected to deliver:

  • An Inception report that includes a detailed evaluation design outlining key questions, data collection and analysis methods, data collection tools/protocols, list of key informant/agencies;
  • Review of evaluation questions, performance criteria, issues to be studied;
  • Description of the theory of change/intervention logic;
  • Work plans for all members of the evaluation team with clear timelines and responsibilities;
  • Evaluation matrix (with at least evaluation questions, indicators, methods of data collection, data sources, evaluation criteria). This framework should be developed in a participatory manner- (the evaluator and the evaluation committee will work closely) before commencement of the actual review;
  • Data collection instruments/tools that will inform a systematic and structured approach to information gathering and analysis;
  • A draft report for review by participating UN Agencies and main partners;
  • A second draft report incorporating comments made on the first draft;
  • Power point presentation for dissemination purpose;
  • To further promote learning and the exchange of experiences, a dissemination strategy will be developed for sharing lessons learnt and good practices from this review with UN partners, GoU stakeholders, relevant staff in participating UN-agencies, UN Women and other relevant stakeholders including beneficiary communities;
  • Observations report that documents the review process so that the process can be improved in the succeeding Joint Programme reviews.

Final Report to include the following components:

  • Executive Summary (maximum five pages);
  • Programme description;
  • Evaluation purpose;
  • Evaluation methodology;
  • Findings, Analysis, and Conclusions (no more than 20 pages). This section's content should be organized around the TOR questions, and include the finding and conclusions for each of the subject areas to be evaluated;
  • Lessons learnt;
  • Recommendations;
  • Add annexes to the final report:
  • Terms of Reference;
  • List of documents reviewed;
  • Data collection tools used;
  • List of UN agencies, implementing partners, staff and other stakeholders consulted.

All documents are to be written in English.

Impact

Positive and negative, primary and secondary long-term effects produced by the Joint Program, directly or indirectly, intended or unintended. (The evaluation will not be able to fully assess the Joint Program’s impact, as some activities are still ongoing; however it will address the following questions with the results and evidence that is available to date).

What are the intended and unintended, positive and negative, long term effects of the program, particularly on different groups of women and on their socioeconomic conditions.

To what extent can the changes that have occurred as a result of the program be identified and measured.

What is the evidence that the program enabled the rights-holders to claim their rights more successfully and the duty-holders to perform their duties more efficiently.

Competencies

  • Independence;
  • Cultural Sensitivity/Valuing diversity;
  • Impartiality;
  • Conflict of Interest;
  • Honesty and Integrity;
  • Competence;
  • Accountability;
  • Obligations to Participants;
  • Confidentiality;
  • Avoidance of Harm;
  • Accuracy, Completeness and Reliability;
  • Transparency.

Required Skills and Experience

International consultant:                   

Education:

  • Advanced degree in social sciences/ development studies or other relevant field and with formal research skills.

Experience:

  • At least 7 years strong professional experience in gender equality, human rights and women’s empowerment programming of UN agencies, development partners and government;
  • Extensive experience and knowledge in conducting evaluations, including leading complex evaluations e.g. of UN Joint Programs, Delivering as One etc as team leader;
  • Knowledge and experience in evaluating gender equality and women’s rights interventions, including in Peace building contexts;
  • Demonstrable application and understanding of UN Mandates on Human Rights and Gender Equality;
  • Demonstrable knowledge and understanding of Results Based Management methodologies;
  • Extensive research experience, including applying quantitative and qualitative methods;
  • Knowledge of regional/ country/local context;
  • Proven experience and excellent networking and partnership.

Language:

  • Proficiency in English, including excellent English writing skills.

National consultant                   

Education:

  • Advanced degree in social sciences development studies or other relevant field and with formal research skills.

Experience:

  • At least 3 years experience in conducting evaluations, and applying quantitative and qualitative methods, including data analysis skills;
  • Knowledge and experience in evaluating gender equality and women’s rights interventions, including in Peace building contexts;
  • Demonstrable knowledge and understanding of Results Based Management methodologies;
  • Demonstrable application and understanding of UN Mandates on Human Rights and Gender Equality;
  • Research experience, including applying quantitative and qualitative methods;
  • Experience working in Northern Uganda, and particularly the Acholi Sub-region.

Language:

  • Proficiency in English, including excellent English writing skills;
  • Knowledge of the local language in the Acholi sub-region will be an added advantage.

Applying for the consultancy

Applicants are required to submit an expression of interest to undertake the assignment/consultancy and include the following:

  • Cover letter stating why you want to do this work, your capacity and experience and available start date;
  • It should also indicate whether you apply for the International or National consultancy;
  • A brief technical proposal highlighting how you will conduct the assignment;
  • Detailed CV (UN Women P11 format). The form can be down loaded from the UN Women website http://unwomen.org;
  • Shortlisted candidates should be ready to avail on request three (3) of their most recent evaluation reports where they have played a lead role, with contacts (Name, Email and Phone) of supervisors.

Interested and qualified persons should visit the vacancies on the UN Women Site located at http://jobs.undp.org  for detailed vacancy announcement and submit application before 10th October 2015.