Background

The Independent Evaluation Office (IEO) is a functionally independent unit within UNDP that supports the oversight and accountability functions of the UNDP Executive Board and the management of UNDP. The work of the office includes conducting thematic, programmatic and other independent evaluations as well as developing evaluation standards, procedures criteria and methodological guidance for UNDP decentralised evaluations as well as the quality assessment of all UNDP decentralised evaluations which it reports on to UNDP and the Executive Board. This is outlined in the UNDP Evaluation policy.

In response to quality concerns of UNDP decentralised evaluations and in turn credibility and usability issues of these evaluations, IEO and UNDP have embarked on a programme to strengthen decentralised evaluation across the organization. This has included: 

  • 2016-19: Revised quality assessment process and implementation of the QA tool for all evaluations
  • 2016-19: Detailed reporting to the UNDP Executive Board and UNDP on decentralised evaluations through the Annual report on Evaluation
  • 2016-17: Regional workshops to review evaluation implementation, process and existing guidance and capacity needs.
  • 2018-19: Participatory revision of the UNDP evaluation guidelines.
  • 2019: Launch of the revised UNDP evaluation guidelines in English/ French/ Spanish
  • 2019: Series of webinars to supporting the launch of the UNDP evaluation guidelines
  • 2019: Regional workshops rolling out the revised UNDP evaluation guidelines
  • 2019: Development of certified online evaluation training for UNDP staff (to be launched in 2020)

 

Duties and Responsibilities

 

As IEO and UNDP develop a strategy for future support to decentralised evaluation the IEO would like to take stock of the work undertaken to both better strengthen and target its support to decentralised evaluation in the future. Three pieces of analysis are expected from the assignment and will be staged between March and May 2020, including i) analysis of the results of the QA process; ii) Surveys and interviews with evaluation staff; and, iii) a review of previous support for decentralised evaluation.

Each analysis stage and production of papers will be undertaken in close cooperation with IEO staff which have been supporting UNDP evaluation capacity development in recent years.  

Quality assessment analysis:

  • Analysis of 4 years of data from quality assessments of UNDP decentralised evaluations to identify quality trends (strengths and weaknesses) across methodological, thematic/ sectorial, regional and crosscutting criteria.
  • UNDPs QA tool annually reviews all of UNDPs evaluations for quality across 4 areas
    1. TOR quality
    2. Evaluation structure, methodology and data sources and use
    3. Evaluation inclusion of cross-cutting issues and,
    4. Evaluation findings, conclusions and recommendations
  • Quality assessment data is available by country, region, budget size, evaluation type, SDG area, strategic plan focal area as well as other criteria.
  • Analysis should show the situation and also identify areas for further future decentralised evaluation support, guidance or capacity development.

Survey and interviews of evaluation planners, managers, implementors and technical support staff.

  • Interview a selected group of regional and country level management, programme officers and M&E focal points to identify areas where there is un-met need for support, guidance or capacity development decentralised evaluation across UNDP.
  • Prepare and conduct an online survey of regional and country level programme staff and M&E focal points (100+) to explore support, guidance or capacity development needs for decentralised evaluation.

Review existing evaluation guidance and support:

  • In light of the findings from parts i and ii, review existing UNDP Evaluation Guidelines and support mechanisms and identify any sections of the Guidelines that should be clarified, adjusted or otherwise improved, as well as elements that should be added to further facilitate decentralised planning, implementation, and production of quality evaluation reports that are credible and usable.
  • In addition, identify other lines of support that could be provided by the IEO to further strengthen decentralised evaluation.

For more detailed information, please click here to view the full terms of reference for the position. 

Competencies

Functional competencies

  • Proven ability to undertake quantitative data analysis and present findings clearly.
  • Strong understanding of questionnaire design and ability to develop questionnaires and other review instruments that will address issues identified in the design, independently;
  • Strong interviewing skills and is able to conduct interviews independently;
  • Strong understanding of various methodologies in evaluation, both qualitative and quantitative, such as surveys, record reviews, focus groups and case studies and is able to contribute to the development of the most efficient and effective methodology for the design, with minimal guidance;
  • Experience implementing and/ or managing evaluations and knowledge of UNDP and its Decentralised evaluation implementation process and guidance.
  • Excellent oral and written communication skills.

Required Skills and Experience

Education

  • Master’s degree in a relevant subject area, such as but not limited to international development, economics, evaluation, or other social, physical or natural science.

Experience

  • At least 7 years’ experience in evaluating development programmes;
  • Experience in capacity development for evaluation;
  • Understanding of UNDP or other development agencies’ work and evaluation approaches;
  • Experience with quality assessment of evaluations an advantage.

Languages

  • Fluency in written and spoken English required; ability to conduct interviews in French and/or Spanish an advantage.

Application Instructions

Applicants are invited to upload as one combined document the following documents to the UNDP Jobs site:

  • CV in the format known as  P11, indicating all past experience from similar projects, as well as the contact details (email and telephone number) of at least three (3) professional references;
  • A completed Confirmation of Interest and Submission of Financial Proposal Form that indicates your daily rate for this consultancy; and;
  • A brief cover letter (250-400 words) that highlights previous experience in evaluation including in the UNDP/UN and with experience with capacity development for evaluation.