National Evaluation Consultant (team member) to conduct a gender-responsive mid-term evaluation of the project: “Enhancing accountability for gender equality and women’s empowerment in national development and peacebuilding in Ukraine”



Advertised on behalf of :

Location : Kyiv, UKRAINE
Application Deadline :22-May-19 (Midnight New York, USA)
Type of Contract :Individual Contract
Post Level :National Consultant
Languages Required :
English  
Duration of Initial Contract :23 days (within period of 13 May 2019 to 31 July 2019)

Background

UN Women, grounded in the vision of equality enshrined in the Charter of the United Nations, works for the elimination of discrimination against all women and girls; the empowerment of women; and the achievement of equality between women and men as partners and beneficiaries of development, human rights, humanitarian action and peace and security.

The overarching goal of UN Women Ukraine is to empower women and girls and ensure full enjoyment of their human rights towards a peaceful and gender equal society in Ukraine. The implementation of the UN Women Ukraine Country Strategy (2018-2022) is guided by key international gender equality and women’s human rights norms and standards. UN Women’s work in Ukraine focuses on supporting the government, parliament and civil society in advancing gender equality and implementation of the national and international commitments.  Through its normative support functions, UN Women assists Ukraine in implementation of the Sustainable Development Goals, recommendations of the Universal Periodic Review, implementation of the Convention on Elimination of All Forms of Discrimination against Women (CEDAW) and the other human rights treaty body recommendations on women’s human rights, Beijing Platform for Actions and the outcome documents of its reviews, and the UN Security Council Resolutions on Women, Peace and Security, among other normative frameworks.

Ukraine ratified the key international instruments on human rights, gender equality and women’s rights, including the Convention on Elimination of Discrimination against Women (CEDAW) in 1980, joined the Beijing Declaration (BPFA) and ratified the International Convention on the Elimination of All Forms of Racial Discrimination (ICERD) in 1994. Country adopted and localized the SDGs, accomplished the baseline report and is in the process of developing the mechanism for SDGs implementation through sectoral policies and programmes. Gender equality is enshrined in the Constitution and Ukraine and adopted a solid policy and legal framework. The Government developed the National Strategy on Human Rights and the Action Plan (2016-2020). The 2018 saw several policy advancements on gender equality. The Cabinet of Ministers for the first time included gender equality priorities in the Government Plan: institutionalization of the gender analysis of legislation; the revision of NAP1325 based on the mid-term review. The Government also adopted the National Action Plan on the CEDAW Concluding Observations (1) and the State Programme on Equal Rights and Opportunities for Women and Men by 2021 (2), which builds on the BPfA, SDGs and CEDAW, and integrates the measures to address multiple forms of discrimination.

Despite of these significant efforts, gender equality and human rights are yet to become an integral part of the reforms, recovery or peacebuilding processes. Gender equality and human rights priorities need to be further mainstreamed in the sectoral policies and plans. The structural barriers to a full realization of human rights and gender equality can be further addressed in the ongoing governance (public administration reform, justice sector reform), and women, peace and security (security sector reform, defense reforms).

Since 2017, UN Women is implementing a project “Enhancing accountability for gender equality and women’s empowerment in national development and peacebuilding” is supporting the consolidated efforts of the government, parliament, women’s groups and civil society organisations (CSOs) to meet state commitments on gender equality and women’s rights, including CEDAW, UN Security Council Resolution 1325 on Women, Peace and Security (UNSCR 1325) and SDGs through reforms and peace and security processes.

The project is working to provide the government with the institutional, capacity development and technical support to carry out its ambitious reforms to mainstream gender and women’s human rights, and to ensure that the conflict’s profound impact on gender relations and roles informs policy-making. The project specifically targets public administration, justice, security sector and defence sector reforms.

The human rights-based approach is well integrated throughout  the project and makes every effort to engage with and strengthen the voice of women in policy making and reforms and guided by the international human rights treaties and is based on a theory of change which articulates the causal linkages and actions required by the government, parliament, civil society, UN Women and other international development partners to achieve transformative change in the lives of women in Ukraine.

The overall project goal is to achieve transformative results for gender equality and women’s empowerment in Ukraine by integrating gender equality and women’s human rights commitments into the national reforms and the peace and security processes, and by putting mechanisms in place for adequate financing, implementation, monitoring and evaluation.

The theory of change stipulates that If 1) governance and national reforms integrate gender equality and WPS commitments; (2) the capacity of the national institutional mechanism on gender equality is strengthened for government-wide mainstreaming of gender in policies and reforms; (3) key government institutions have capacity to implement commitments through sectoral reforms, plans and budgets; (4) oversight and coordination mechanisms for implementation of the gender equality and WPS commitments are set and operational; (5) favourable social attitudes and gender awareness are promoted among duty bearers and rights holders; and (6) women’s groups, having capacity and opportunity, demand for their rights and priorities in reforms then the transformative results for gender equality and women’s empowerment will be achieved because the implementation of the international and national gender equality and WPS commitments will be well coordinated, financed and monitored.

The project is in the middle phase of its implementation and as established in the Project Document, a mandatory external mid-term evaluation is to be conducted by UN Women Ukraine Country Office.

This mid-term evaluation will serve as a primarily formative (forward-looking) evaluation to support the CO and national stakeholders’ strategic learning and decision-making for the ongoing project implementation and enhanced accountability for development effectiveness.To implement this task, UN Women seeks to hire National  Consultant for conducting the gender-responsive mid-term evaluation of the project, who will work in the team with international  consultant to be hired by UN Women. Please refer to Annex 1 of the TOR for further details on Evaluation Management Structure, Evaluation Approach, Methodology Criteria and Questions, Scope of the Evaluation, Evaluation Process, duties and responsibilities of the Evaluation Team

(1) Cabinet of Ministers of Ukraine, Decree # 634-? dated 5 September 2018 “On approval of “National Action Plan on Implementation of the Concluding Observations to the 8th Periodic Report of Ukraine on Convention of Elimination of All Forms Discrimination Against Women until 2021”. Available at https://www.kmu.gov.ua/ua/npas/pro-go-planu-dij-z-vikonannya-rekomo-zhinok-do-vosmoyi-periodichnoyi-dopovidi-ukrayini-pro-vikonannya-konvenciyi-pro-likvidaciyu-vsih-form-diskriminaciyi-shchodo-zhinok-na-period-do-2021-roku

(2) Ukraine, Cabinet of Ministers of Ukraine, Decree #273 dated 11 April 2018 “On approval of the State Social Programme on Equal Rights and Opportunities of Women and Men until 2021. Available at https://kmu.gov.ua/ua/npas/pro-zatverdzhennya-derzhavnoyi-socialnoyi-programi-zabezpechennya-rivnih-prav-ta-mozhlivostej-zhinok-i-cholovikiv-na-period-do-2021-roku


Duties and Responsibilities

Under the overall guidance of the UN Women Representative, the UN Women Regional Evaluation Specialist for Europe and Central Asia and direct supervision of the Programme Specialist, the consultant will implement a set of tasks, including, but not limited to: 

1.       Assist the Team Leader to conduct a desk review of the documents related to the implementation of the “Enhancing accountability for gender equality and women’s empowerment in national development and peacebuilding in Ukraine” project and support the team leader by collecting relevant national policy and programme documents and support analysis of the same;

2.       Participate in any needed skype calls/teleconferences with UN Women and the key partners as part of the preparatory work for the assignment.

3.       Elaborate and provide inputs to the inception report which will include evaluation objectives and scope, description of evaluation methodology/methodological approach that includes data collection tools, data analysis methods, key informants/agencies, evaluation questions, performance criteria, issues to be studied, work plan and reporting requirements and preliminary findings from the initial desk review. It should also include a clear evaluation matrix linking all these aspects that will guide further data collection.

4.       Support the Team Leader to undertake data collection   through a series of individual interviews and focus group discussions with key stakeholders from the Government, Parliament, civil society at national, oblast and community levels will be conducted. This will include:

  • 7 days preparation and support to a Team Leader during 7 days-long mission during the conduct stage of the evaluation (5 days in Kyiv to interview the key stakeholders; 2 days-long field trips to collect data from the stakeholders at the oblast (to be determined with the Government)

5.       Provide inputs to the  final draft of gender-responsive evaluation report which will include findings, lessons learned, conclusions and recommendations in line with the objectives (above).

Assignment Deliverables:

1.       Preparation for a mission and Inputs to the Inception report – 5 days by 20 May 2019 (15%).

2.       Draft evaluation report by 15 June 2019 – 12 days by 30 June 2019 (60 %)

3.       Final evaluation report & evaluation brief – 6 days by 31 July 2019 (25%).

TOTAL – 23 days

Inputs:

  • The Consultant is expected to work remotely using her/his own computer but may access the UN Women office for printing of relevant documents or should he/she be required to work on-site at any point during the assignment.
  • UN Women will provide the consultant with the resource materials, organize meetings, including in the field.

Performance evaluation:

Contractor’s performance will be evaluated against such criteria as: timeliness, responsibility, initiative, communication, accuracy, and quality of the products delivered. The evaluation will be carried out and cleared by the hiring manager which will also be the basis for payment on a delivery by delivery basis to the consultant.

Financial arrangements:

Payment will be disbursed by three instalments upon receipt of the deliverables (as detailed above): first instalment after deliverables 1) and 2) and, second instalment upon completion the deliverable 3) and their certification by the UN Women Programme Specialist that the work submitted is of the required standards and as per the requirements set out in the TOR.


Competencies

Core Values

  • Respect for Diversity
  • Integrity
  • Professionalism

Core Competencies

  • Awareness and Sensitivity Regarding Gender Issues
  • Accountability
  • Creative Problem Solving
  • Effective Communication
  • Inclusive Collaboration
  • Stakeholder Engagement
  • Leading by Example

Please visit this link for more information on UN Women’s Core Values and Competencies: http://www.unwomen.org/-/media/headquarters/attachments/sections/about%20us/employment/un-women-employment-values-and-competencies-definitions-en.pdf


Required Skills and Experience

  • A Master’s Degree or equivalent in social sciences, gender studies, political science, development studies or another related field; Or, Bachelor’s degree in these disciplines with minimum five years’ experience
  • Minimum three years of professional experience in the field of gender equality and women’s empowerment, governance, human rights issues in Ukraine with substantive involvement in several evaluation processes;
  • Previous knowledge of the UN system will be an asset.
  • Minimum 3 years’ experience in monitoring and evaluation of the projects and programmes
  • Fluency in English and Ukrainian; ability to translate and interpret the materials

Evaluation of Applicants:

Applications will be evaluated based on the cumulative analysis taking into consideration the combination of their qualifications and financial proposal. A two-stage procedure is utilized in evaluating the proposals, with evaluation of the technical proposal being completed prior to any price proposal being compared. The award of the contract should be made to the individuals whose offer has been evaluated and determined as:

  • Responsive/compliant/acceptable
  • Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation.

Technical criteria - total max 70 points:

  • The technical qualification of the individual is evaluated based on desk review and following technical qualification evaluation criteria:

Technical Evaluation Criteria

Criterion A – Relevant education – max. 10

Criterion B – Language skills – max. 10

Criterion C – Relevant Experience with total for all stated criteria – max. 50

  • At least 3 years of relevant experience in case of master’s level education and minimum 5 years’ experience in case of bachelor’s degree evaluating development projects, programmes, policies and strategies. (25 points)
  • Sound experience and knowledge of women’s human rights and gender equality (10)
  • Experience working with the governance and/or Women, Peace and Security reforms, gender equality and women’s human rights will be considered a strong asset (5 points)
  • Knowledge of Ukraine context is a must- knowledge of ongoing national reforms process would be a strong asset (5 points)
  • Previous professional experience with development agencies and the United Nations would be considered an asset (5 points)

                Total Obtainable Score for technical criteria – max. 70

Financial/Price Proposal evaluation:

  • Only the financial proposal of candidates who have attained a minimum of 49 points in the technical evaluation will be further considered and evaluated.
  • The total number of points allocated for the financial/price component is 30.
  • The maximum number of points will be allotted to the lowest price proposal that is opened/ evaluated and compared among those technical qualified candidates who have attained a minimum of 49 points in the technical evaluation. All other price proposals will receive points in inverse proportion to the lowest price.

Evaluation of submitted financial offers will be done based on the following formula: S = Fmin / F * 30

(S - score received on financial evaluation; Fmin - the lowest financial offer out of all the submitted offers qualified over the technical evaluation round; F - financial offer under the consideration).

Application and submission package:

The candidate’s application should include:

  • A brief Letter of Interest containing the statement on candidate’s experience in the field of recruitment. Completed and signed UN Women Personal History (P-11) form, that can be downloaded from: http://www.unwomen.org/en/about-us/employment.
  • Proposal. The financial proposal shall specify a total lump sum amount with a breakdown of a daily professional rate per number of anticipated working days to include daily subsistence allowance, international travel related costs, and other costs (telephone, etc.).
  • Interested candidates are requested to apply no later than  9.00 am EEST on 25 April 2019 by submitting 2 attachments: 1) technical (P-11 and a Letter of Interest) as well as 2) financial proposals to the following e-mail address: hr.ukraine@unwomen.org with a subjectInternational Consultant for mid-term evaluation of “Enhancing accountability for gender equality and women’s empowerment in national development and peacebuilding in Ukraine” project.
  • Applications without financial proposal will be treated as incomplete and will not be considered for further assessment.

UN Women applies fair and transparent selection process that would take into account the competencies/skills of the applicants as well as their financial proposals.

Sample of Financial Proposal

The format shown on the following tables is suggested for use as a guide in preparing the Financial Proposal

Cost Breakdown per Deliverables*(Lump Sum, All Inclusive)

Deliverables - # of days and Percentage of Total Price (Weight for payment) -   Price, UAH

1   

2   

3   

 Total max. # of working days (100%)     UAH ……

*Basis for payment tranches

 

Annex 1

Terms of Reference of the gender-responsive evaluation of the “Enhancing accountability for gender equality and women’s empowerment in national development and peacebuilding in Ukraine” project.

  1. Evaluation Approach, Purpose, Objectives and Use
  2. Evaluation Approach, Purpose, Objectives and Use

After two years of the project implementation, as established in the Project Document, a mandatory external mid-term evaluation is to be conducted by UN Women Ukraine Country Office.

This mid-term evaluation is being commissioned by the Ukraine Country Office (CO) as a primarily formative (forward-looking) evaluation to support the CO and national stakeholders’ strategic learning and decision-making for the remaining period of the project. The evaluation is expected to support enhanced accountability for development effectiveness and learning from experience to inform the future operations of the project;

  • A Theory of Change (ToC) approach will be followed for the evaluation and the reconstructed ToC should elaborate on the objectives and assumptions that stakeholders use to explain the change process as represented in the change framework of the project.
  • The indicative list of the type of questions for a mid-term evaluation are elaborated in the section 3 below
  • The evaluation should provide formative recommendations for strengthening the project delivery based on the four OECD-DAC evaluation criteria, i.e. relevance, effectiveness, efficiency and sustainability

This mid-term evaluation is taking place towards the middle of the implementation of the intervention which will be June 2019 and its main purpose is assessing the programmatic progress of the intervention to make any necessary adjustments and lessons learned so far.

The overall objective of the mid-term evaluation is to assess the progress made towards the achievement of the set outcomes and objectives, analyze the results achieved and challenges encountered, adjust implementation modalities as needed and incorporate changes throughout all program components for the remaining implementation period.

The specific evaluation objectives are:

  • To analyze the relevance of the project implementation strategy and approaches to the development of gender-responsive policies, accountability frameworks and gender-responsive national reforms;
  • To review the relevance of the logical framework and respective Monitoring and Evaluation Plan of the project;
  • To assess effectiveness and organizational efficiency in progressing towards the achievement of the project’s results;
  • To assess the potential sustainability of the results and the feasibility of ongoing, nationally-led efforts in the thematic areas tackled by the project from the viewpoint of national ownership, accountability, national capacity development, partnership and coordination between UN Women and other development partners;
  • To document lessons learned, best practices, success stories and challenges to inform future work of UN Women in the frameworks of gender-responsive governance and Women, Peace and Security;
  • To assess how the intervention and its results relate and contribute to the Sustainable Development Goals in Ukraine.

The information generated by the evaluation will be used by UN Women and different stakeholders to:

  • Contribute to building of the evidence base on effective strategies for strengthening the support to the government and other stakeholders in gender transformative reforms
  • Facilitate the strategic reflection, learning and further planning for programming in the areas of strengthen the capacity of the Government of Ukraine and national stakeholders and structures on reforms with the aim to increase sustainability of the results beyond the programme

Main evaluation users include UN Women Country Office in Ukraine as well as Government of Sweden (project donor). Furthermore, national stakeholders - NGO partners, Parliamentary counterparts, targeted state agencies, and local governments will be also closely involved in the evaluation process to increase ownership of findings, draw lessons learned and make and greater use of this mid-term evaluation results.

The findings of the evaluation are expected to contribute to effective programming and efficient and sustainable project delivery. The information generated by the evaluation will moreover be used to engage policy makers and other stakeholders at local, national and regional levels in evidence-based dialogues and to advocate for gender-responsive strategies, national reforms with a particular focus on gender equality, human rights, and Women, Peace and Security at local, national and regional levels.

3. Evaluation Criteria and Key Evaluation Questions

As indicated above, the evaluation will address the OECD-DAC evaluation criteria of relevance, effectiveness, efficiency and sustainability. More specifically, the evaluation will address the following key questions under each of the criterion:

Relevance:

  • To what extent is the intervention aligned with international, regional and national agreements and conventions on gender equality and women’s empowerment?
  • How does the project design match with the complexity of national structures, systems and decision-making processes?
  • How does UN Women assure that the project reflects and aligns to Ukraine’s national plans on gender equality as well as the country’s internationally undertaken obligations and/or best practices?
  • To what extent the project is aligned with Ukraine’s UN Partnership Framework (UNPF) 2018- 2022 and nationalized SDGs?
  • To what extend the project is contributing to the implementation UN Women Strategic Note?
  • To what extent does the project’s design and implementation process include a collaborative process, shared vision for results-based delivery?  
  • Is the implementation based on quality analysis, including gender and human rights-based analysis, risk assessments, socio-cultural and political analysis?
  • To what extent was the design of the intervention relevant to the needs and priorities of the beneficiaries?
  • To what extent the project has been flexible to adapt to the changes in the national reforms processes

Effectiveness

  • What has been the progress made towards achievement of the expected outputs and outcomes?
  • How effective have the selected programme strategies and approaches been in progressing towards achieving programme results?
  • Has the project achieved any unforeseen results so far, either positive or negative? For whom? What are the good practices and the obstacles or shortcomings encountered? How were they overcome?
  • To what extent have capacities of relevant duty-bearers and rights-holders been strengthened at this stage of implementation?
  • Does the project have effective monitoring mechanisms in place to measure progress towards results?
  • How adaptably and rapidly did UN Women react to changing country context and address the challenges?
  • What -if any- types of innovative good practices have been introduced in the programme for the achievement of GEWE results?
  • Has the project led to complementary and synergistic effects on broader UN efforts to achieve GEWE in Ukraine?

Efficiency:

  • Have resources (financial, human, technical support, etc.) been allocated to progress towards the achievement of the project outputs and outcomes? 
  • Does progress towards the achievement of outputs correspond to the mid-term phase of the project implementation?
  • How the project implementation affected efficiency of delivery so far? What factors have influenced this?
  • Is the coordination between the counterparts and UN Women leading to better programme results?
  • Has there been effective leadership and management of the project including the structuring of management and administration roles to maximize results?
  • To what extent are the programme’s monitoring mechanisms in place effective for measuring and informing management of project performance and progress towards targets?

Potential sustainability:

  • To what extend has the UN Women been able to establish relevant partnerships with key stakeholders? To what extent are relevant national stakeholders and actors included in the UN Women programming and implementation and policy advocacy processes?
  • To what extent has so far the intervention succeeded in building sustainable individual and institutional capacities of rights-holders and duty-bearers?
  • Do key national partners including women’s movements and women’s organizations etc. have voice and influence within the project implementation?
  • To what extent key national partners were involved in the project’s conceptualization and design process?
  • To what extent the project modality led to improved communication, coordination and information exchange within the line Ministries, other relevant stakeholders in Ukraine?

It is expected that the evaluation team will develop an evaluation matrix, which will relate to the questions below (and refine them as needed), the areas they refer to, the criteria for evaluating them, the indicators and the means for verification as a tool for the evaluation. Final evaluation matrix with revised and refined evaluation questions will be validated and approved in the evaluation inception report.                                            

4. Scope of the evaluation

The mid-term evaluation of the project is to be conducted externally by an International Consultant supported by National Consultant selected through a competitive process. It is planned to be conducted in the period of April – July 2019. The evaluation will cover project implementation period from June 2017 until June 2019 (24 months).

The evaluation will be conducted in Ukraine, where the project has been implemented; in the capital Kyiv with one possible travel to Kharkiv Oblast to collect data as defined by the agreed evaluation work-plan.

The evaluation will examine all the relevant documents of UN Women, including logical framework of the project, its Monitoring and Evaluation Plan, annual work plan, annual reports to the donor, knowledge products produced in the frameworks of the project, etc.

5. Evaluation Process and Methodology

The evaluation methodology will deploy mixed methods, including quantitative and qualitative data collection methods and analytical approaches to account for complexity of gender relations and to ensure participatory and inclusiveness processes that are culturally appropriate. A theory of change approach will be followed. The reconstructed theory of change should elaborate on the objectives and articulation of the assumptions that stakeholders use to explain the change process represented by the change framework that this project considered and has contributed to promote gender equality and women’s empowerment. Assumptions should explain both the connections between early, intermediate and long-term project outcomes and the expectations about how and why the project has brought them about. Interviews and focus group discussions with all key stakeholders involved in the project implementation, including but not limited to UN Women project team, local NGO partners beneficiaries, legislative body, central and local government partners, etc.  shall also take place.

In addition, UN Women is among the UN-SWAP reporting UN entities and the contractor has to take into consideration that the evaluation is managed by UN Women are annually assessed against the UN-SWAP Evaluation Performance Indicator and its related scorecard. The evaluation will be conducted in accordance with UN Women evaluation guidelines and UNEG Norms and Standards for evaluation and the UNEG Code of Conduct for Evaluations in the UN System.[1]

The evaluation process is divided in five phases: 1) Preparation, mainly devoted to structuring the evaluation approach, preparing the TOR, compiling programme documentation, and hiring the evaluation company; 2) Inception, which will involve reconstruction of theory of change, evaluability assessment, online inception meetings with the UN Women project  team, inception report and finalization of evaluation methodology; 3) Data collection and analysis, including desk research and preparation of field missions, visits to the national stakeholders in Kyiv, and potential visit to one of the security sector higher education institution located in Kharkiv; 4) Data analysis and synthesis stage, focusing on data analyzed, interpretation of findings and drafting of an Evaluation Report; and 5) Dissemination and follow-up, which will entail the development of a Management Response by UN Women.

The evaluation team will be responsible for phases 2, 3 and 4 with the support of UN Women while UN Women is entirely responsible for phases 1 and 5.

Phases for which evaluation team will be responsible of submitting quality deliverables entail the following:

  • Inception phase: at the beginning of the consultancy, the contractor will be provided with key sources of information for an initial desk review. The online inception meetings will be conducted with the UN Women project team.  At the end of this phase an inception report that will include the refined evaluation methodology will be delivered. The inception report will be validated and approved by UN Women.
  •  Data collection phase: based on the inception phase, the contractor will carry out an in-depth desk review, and field mission/s will be conducted to complete data collection and triangulation of information. Interviews and focus group discussions with key stakeholders, as relevant, will take place.
  •  Data analysis and synthesis phase: The collected information will be analyzed and mid-term evaluation report will be delivered. A validation meeting will be organized where the contractor will validate the final report with UN Women.

6. Stakeholders Participation and Evaluation Management

The mid-term evaluation will be a consultative, inclusive and participatory process and will ensure the participation of project beneficiaries. The evaluation will be Human Rights based and Gender responsible and an Evaluation Reference Group (ERG) will be constituted. 

UN Women will appoint an officer who will serve as the Evaluation Task Manager and who will be responsible for the day-to-day management of the evaluation and ensures that the evaluation is conducted in accordance with the UN Women Evaluation Policies, United Nations Evaluation Group Ethical Guidelines and Code of Conduct for Evaluation in the United Nations system and other key relevant guidance documents. The evaluation process will be supported by the UN Women Europe and Central Asia Regional Evaluation Specialist.

Moreover, an Evaluation Management Group (EMG) comprising of evaluation Task Manager and delegated staff member/s by UN Women Representative will be established to oversee the evaluation process, make key decisions and quality assure the different deliverables. The EMG will quality assure and approves all deliverables. EMG will be responsible for the coordination in the field including logistical support during field missions.

The establishment of an Evaluation Reference Group (ERG) will facilitate the participation of key stakeholders in the evaluation process and will help to ensure that the evaluation approach is robust and relevant to staff and stakeholders. Furthermore, it will make certain that factual errors or errors of omission or interpretation are identified in evaluation products. The reference group will provide input and relevant information at key stages of the evaluation: terms of reference, inception report, draft and final reports and dissemination of the results. The establishment of an ERG will enable the participation of relevant stakeholders in the design and in the validation of the evaluation, raising awareness of the different information needs, quality assurance throughout the process and in sharing the evaluation results. The Evaluation Reference Group will be engaged throughout the process and will be composed of relevant National Government and local stakeholders, representatives from Civil Society Organizations. The ERG group will review the draft evaluation report and provide substantive feedback to ensure quality and completeness of the report.

Within six weeks upon completion of the evaluation, UN Women Representative will approve a management response that addresses the evaluation recommendations to ensure learning and inform implementation of the remaining period of the project.

7. Expected Deliverables, Duties and Responsibilities

The evaluation team, comprising of International and National consultants are expected to deliver the following products:

1)            Inception Report where the evaluation team will present a refined scope, a detailed outline of the evaluation design and methodology, evaluation questions, and criteria for the approach for in-depth desk review and field work to be conducted in the data collection phase. The report will include an evaluation matrix and detailed work plan.  A first draft report will be shared with the Evaluation Management Group and, based upon the comments received the evaluation team will revise the draft.  The revised draft will be shared with the Evaluation Reference Group for feedback. The evaluation team will maintain an audit trail of the comments received and provide a response on how the comments were addressed in the final inception report. – by 10 May 2019 

2)            Conducted field visits to Kyiv, Ukraine and one potential visit to the security sector higher education institution; conduct key informant interviews and focus group discussions, and analyzed data - by 28 May 2019

3)            Power Point Presentation of preliminary findings (conducted in Kyiv). A PowerPoint presentation detailing the emerging findings of the evaluation will be shared with the Evaluation Management Group for feedback. The revised presentation will be delivered to the reference group for comment and validation. The evaluation team will incorporate the feedback received into the draft report- by 30 May 2018

4)            Draft Evaluation report which will be shared with the evaluation management group for initial feedback. The second draft report will incorporate Evaluation Management Group feedback and will be shared with the Evaluation Reference Group for identification of factual errors, errors of omission and/or misinterpretation of information. The third draft report will incorporate this feedback and then be shared with the reference group for final validation. The evaluation team will maintain an audit trail of the comments received and provide a response on how the comments were addressed in the revised drafts – by 15 June 2019

5)  Final Mid-term Evaluation report taking into consideration comments and feedback collected from UN Women. The report shall include the following chapters: Executive Summary, Introduction and Background, Evaluation approach and methodology (including limitations), Findings, Conclusions, Lessons learnt, Recommendations and relevant Annexes, including Evaluation Brief (3-4 pages) - by 10 July 2019

6) Evaluation communication products:  Final PowerPoint/Prezi presentation of the final key evaluation findings and recommendations, and a 2-pager on the final key findings, lessons learned and recommendations in a format preferably adjustable for individual project sites both in English and Ukrainian.

The evaluation will be conducted from the period of 1 May– 31 July 2019 for 30 working days. All deliverables will be presented in English and Ukrainian.

8. Evaluation team composition and requirements

An evaluation team consisting of an international team leader and a national team member will conduct the evaluation. Both have experience of each of the following: conducting evaluations, gender equality, governance, Women, Peace and Security and reforms. The team leader is responsible for coordination during all phases of the evaluation process, ensuring the quality of outputs and application of methodology as well as timely delivery of all evaluation products in close collaboration with the evaluation task manager and the evaluation management group. The team member will provide support to the team leader in all the aspects of conducting the evaluation, including translation and interpretation where necessary and logistical support.

In further detail, the duties and responsibilities of the Team Leader are as follows:

  • Leading the inception phase and developing an inception report outlining design, approach and methodology of the evaluation and an indicative workplan of the evaluation team within the framework of this ToR.
  • Design and lead in carrying out collection, research and analysis of relevant documentation and other data, and reporting.
  • Overseeing and assuring quality of data collection and leading the analysis of the evaluation evidence.
  • Preparing for meetings with the evaluation management group, evaluation reference group and other stakeholders to review findings, conclusions and recommendations.
  • Leading the preparation of the evaluation communication products.

In further detail, the duties and responsibilities of the National Team Member are as follows:

  • Supporting inception phase gathering documents, following up with UN Women CO in the country and synthesizing relevant information;
  • Assisting in the preparation of the missions with UN Women CO as relevant;
  • Participating in country data collection mission;
  • Conduct interviews and collect additional data as needed;
  • Attending and supporting the preparation of all meetings and presentations;
  • Supporting the analysis of the evidence at country level.
  • Supporting the preparation of evaluation deliverables

TOR Annexes

  1. UNEG Code of Conduct for Evaluations [2]
  2. UNEG Ethical Guidelines[3]
  3. UNEG Norms for Evaluation in the UN System[4]
  4. UNEG Standards for Evaluation in the UN System[5]
  5. UNEG Guidance Integrating Human Rights and Gender in the UN System[6]
  6. UN Women Evaluation Handbook[7]
  7. UNDP Evaluation Handbook[8]
  8. UNFPA Evaluation Handbook[9]
  9. UN SWAP Evaluation Performance Indicator and related Scorecard[10]
  10. Evaluation Consultants Agreement Form
  11. M&E template for Evaluation Report[11]
  12. Evaluation Matrix -
Relevant evaluation criteriaKey QuestionsSpecific Sub-QuestionsData SourcesData Collection Methods/ToolsIndicators/Success StandardMethods for Data Analysis
       
       

 

[2]  http://www.unevaluation.org/document/detail/100

[3] http://www.unevaluation.org/document/detail/102

[4] http://www.uneval.org/document/detail/21

[5] http://www.uneval.org/document/detail/22

[6] http://www.uneval.org/document/detail/1616

[7] http://genderevaluation.unwomen.org/en/evaluation-handbook

[8] http://web.undp.org/evaluation/handbook/documents/english/pme-handbook.pdf

[9] https://www.unfpa.org/sites/default/files/admin-resource/eval_policy_e5_dp_fpa_2013%20%281%29.pdf

[10] http://www.uneval.org/document/detail/1452

[11] http://procurement-notices.undp.org/view_file.cfm?doc_id=142960


UNDP is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, indigenous groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.

UNDP does not tolerate sexual exploitation and abuse, any kind of harassment, including sexual harassment, and discrimination. All selected candidates will, therefore, undergo rigorous reference and background checks.


If you are experiencing difficulties with online job applications, please contact erecruit.helpdesk@undp.org.

© 2016 United Nations Development Programme