Background

The Independent Evaluation Office (IEO) is a functionally independent unit within UNDP that supports the oversight and accountability functions of the UNDP Executive Board and the management of UNDP. The work of the office includes conducting thematic, programmatic and other independent evaluations as well as developing evaluation standards, procedures criteria and methodological guidance for UNDP decentralised evaluations as well as the quality assessment of all UNDP decentralised evaluations which it reports on to UNDP and the Executive Board. This is outlined in the UNDP Evaluation policy.

In response to quality concerns of UNDP decentralised evaluations and in turn credibility and usability issues of these evaluations, IEO and UNDP have embarked on a programme to strengthen decentralised evaluation across the organization. This has included: -

  • 2016-19: Revised quality assessment process and implementation of the QA tool for all evaluations
  • 2016-17: Regional workshops to review evaluation implementation, process and existing guidance and capacity needs.
  • 2018-19: Participatory revision of the UNDP evaluation guidelines.
  • 2019: Launch of the revised UNDP evaluation guidelines in English/ French/ Spanish
  • 2019: Series of webinars to supporting the launch of the UNDP evaluation guidelines
  • 2019: Regional workshops rolling out the revised UNDP evaluation guidelines
  • 2019: Development of certified online evaluation training for UNDP staff (Launched June 2020)
  • 2020: Analysis of previous IEO support to Decentralised Evaluations (papers provided on assignment)
  • 2020: UNDP guidance for Evaluation during COVID-19

Duties and Responsibilities

IEO is reviewing its support to Decentralised evaluations across UNDP and as part of the review is further updating its evaluation guidance to address identified needs and gaps in the evaluation guidance.  This assignment will support the addition, expansion and updating of the 2019 evaluation guidelines for evaluation across UNDP, with updates across all 6 sections of the evaluation guidance as well as an overall review for clarity and relevance. The consultant will work in close consultation with the UNDP IEO Capacity Development section throughout the assignment.

1. Revised and updated UNDP evaluation guidelines: Based on implementation experience and feedback from UNDP staff, adjust, amend, and clarify sections of the evaluation guidance as needed, including:

     Section One: Evaluation Function

     Section Two: Decentralised Evaluation in UNDP

  • Develop and expanded more detail objective and methodological detail for various types of evaluations undertaken regularly by UNDP programme units (CPD, outcome, thematic, portfolio and others)
  • Details on funding agency expectations and requirements where known (GEF, PBF, EU, others as agreed) and links to guidance
  • Link throughout to good examples from UNDPs evaluation database for different types of evaluation.
  • Review for clarity and relevance and elaborate in areas as agreed

     Section Three: Evaluation Planning

  • Develop sample standard operating procedures (SoPs)  and process maps for the development and implementation of evaluation plans, based on the evaluation guidelines and roles and responsibilities (section 5 of the guidelines).
  • Add further detail on the use of evaluation and evaluation plans as management decision making tools.
  • Add detail of what should be included in UNDP programme unit’s evaluation plans.
  • Review for clarity and relevance and elaborate in areas as agreed.

     Section Four: Evaluation Implementation

  • Elaborate sample SOPs and process maps for evaluation implementation process based on existing timelines and roles and responsibilities (section 5 of the guidelines).
  • Integrate further guidance for inclusion of gender and disabilities within evaluations.
  • Review for clarity and relevance and elaborate in areas as agreed.
  • Develop a project quality rating system for use by evaluators when undertaking evaluations of UNDP projects.
  • Review for clarity and relevance and elaborate in areas as agreed.

     Section Five: Roles and Responsibilities

  • Link standard roles and responsibilities to SOPs and processes maps.
  • Develop standard scope of work for key evaluation roles, including M&E focal points and evaluation managers.

     Section Six: Evaluation Assessment

  • Review for clarity and relevance and elaborate in areas as agreed.
  • Elaborate on how to use final evaluation quality assessment comments to strengthen future evaluations.

2. Evaluation guidelines Section 7: FAQ section. A new FAQ section for the evaluation guidance should be developed drawing on questions asked during webinars held during 2019 and 2020 as well as the guidance themselves.

3. An induction/ onboarding package for UNDP M&E staff: Using the revised UNDP evaluation guidance an induction/ on boarding package for new UNDP M&E staff should be developed to help them in their role, including i) evaluation guidance ii) links to videos/ webinars and presentations of previous training, ii) report templates, iii) SOPs, iv) job descriptions and v) process checklists.

4. Evaluator induction package: Short package for contracted evaluators that includes i) inception report outline format, ii) draft report outline format iii) audit trail for report comments and guide on expectation (one-page guide to be developed) and iv) Link to Section 6: Quality Assessment process.

To view the full terms of reference for this consultancy, please click here.

Competencies

Functional Competencies

  • Excellent knowledge of current evaluation practice and theory;
  • Strong understanding of various methodologies in evaluation;
  • Ability to develop clear, concise, well-structured guidance documents;
  • Ability to get things done while exercising good judgement;
  • Excellent writing skills; and
  • Ability to work both independently and in collaboration with others.

Required Skills and Experience

Education

  • Master’s degree in a relevant subject area, such as but not limited to international development, economics, evaluation, or other social, physical or natural science.

Experience

  • At least 7 years’ experience in evaluating development programmes;
  • Proven experience in the development of evaluation guidance and training;
  • Understanding of UNDP or other development agencies’ work and evaluation approaches; and
  • Experience with UNDP and its decentralised evaluation implementation process an advantage.

Languages

  • Fluency in written and spoken English required; ability to work in French and/or Spanish an advantage.

Application Instructions

Applicants are invited to upload as one combined document the following documents to the UNDP Jobs site:

  • CV in the format known as  P11, indicating all past experience from similar projects, as well as the contact details (email and telephone number) of at least three (3) professional references;
  • A completed Confirmation of Interest and Submission of Financial Proposal Form that indicates your daily rate for this consultancy; and;
  • A brief cover letter (250-400 words) that highlights previous experience in evaluation including in the UNDP/UN and with experience with capacity development for evaluation.