Background

The United Nations supports the people and the Government of Pakistan to achieve their national development goals. The UN provides humanitarian assistance in case of natural disasters and crises, and is a long term partner in sustainable development. Led by the UN Resident Coordinator and Humanitarian Coordinator, the 19 resident UN Agencies, Funds, Programmes and departments are operational in all eight administrative areas of Pakistan. Straddling humanitarian assistance and sustainable development, the UN is working at both the national and sub-national level.

Pakistan was one of the eight Delivering as One UN (DaO) pilots, making it part of the first generation of countries implementing the UN Reforms agenda for development. Having completed the first cycle of One UN Programme (2009-2012), Pakistan is currently implementing the second cycle of the One UN Programme II (OPII) 2013-17, which was formulated after two years of consultation and analysis.

The OPII covers the whole development domain of the UN in Pakistan in the form of joint programming, covering the six strategic priority areas (SPAs), given below:

  • SPA 1: Vulnerable and marginalized populations have equitable access and use of quality services;
  • SPA 2: Inclusive economic growth through the development of sustainable livelihoods;
  • SPA 3: Increased national resilience to disasters, crises and external shocks;
  • SPA 4: Strengthened governance and social cohesion;
  • SPA 5: Gender Equality and Social Justice;
  • SPA 6: Food and nutrition security for the most vulnerable groups.

The OP II was designed to address some of the challenges of the first generatipon one programme. An Operational Plan was developed which is results orientated and includes a strengthened M&E framework. The Operational Plan clearly delineates the mechanisms and processes for the implementation of OPII. Joint annual planning, reporting and provincial steering committee meetings are important processes supported by the different mechanisms of SPA Co-Conveners/Working Groups, Programme Management Team (PMT)/ Programme Monitoring and Evaluation Working Group (PME), and SPA Monitoring, Review and Reporting Committes (MRRCs), all working under the guidance of the UNCT.  The Evaluability Assessment will help identify the gaps in OPII M&E processes for effective planning, monitoring and evaluation to support correct accounting for results both during and after implementation of the programme.

Duties and Responsibilities

The overall objective of undertaking the Evaluability Assessment is to enable the Government of Pakistan and the UNCT to evaluate OPII in a coherent, effective and efficient manner while upholding the principles of national ownership, leadership and mutual accountability. Guided by the Delivering as One (DaO) and UN Programming Principles, the Evaluability Assessment (EA) of OPII aims to determine and identify all the gaps in information necessary to be filled for effective planning, monitoring, reporting and evaluation of the programme, i.e. at the level of joint outcomes and joint outputs, at federal and provincial levels as relevant.

Scope:

The Evaluability Assessment is expected to cover the following aspects and issues with regard to OPII:

  • The robustness of the planned results (RRF), indicators, baselines and targets and corresponding activities (in annual work plans) of OPII in establishing the horizontal and vertical logic in accordance with UNDG RBM principles and guidelines;
  • The quality and availability of credible and timely data and information on OPII indicators, baselines, targets and time frame;
  • The adequacy of the institutional mechanisms in place, as per the principles of DaO, to facilitate and support OPII planning, implementation, monitoring, reporting and evaluation at national and provincial levels;
  • Accountabilities of stakeholders at various level in relation to planning, implementation and oversight;
  • Ensure coherence with resilience principles.

In view of the above, the scope and coverage of Evaluability Assessment will be limited only to OPII in terms of its design, information (related to its results matrix) and the institutional context and processes supporting its implementation.

Process

The OPII Evaluability Assessment shall be conducted involving all stakeholders, including government agencies, the UN, civil society and beneficiaries, as and when relevant.

The following processes and products constitute the deliverables (also see Annex I for a Sample of Guide Questions related to the processes):

  • Hold an inception discussion with key stakeholders to have a clear understanding of the scope, objectives and methodology of the Evaluability Assessment;
  • Conduct a desk review of literature, processes and systems regarding OPII;
  • Structured interviews with stakeholders;
  • A short opinion survey (Survey Monkey) engaging stakeholders;
  • Focus group discussions; and
  • Consultative meetings and workshops with the concerned parties and stakeholders.

The consultant can also devise and propose other relevant assessments methods deemed necessary in view of the conduciveness of the context which shall be discussed, agreed and included in the final Inception Report of the assessment.

Deliverables

The Evaluability Assessment of OPII shall result into the following concrete results which are actionable to remedy any flaws in OPII institutional mechanisms, planning process, financial and results matrices. The following deliverables are expected from the Evaluability Assessment:

  • An Inception Report (including workplan/design/methodology) for the Assessment detailing out the execution plan for the assessment;
  • A comprehensive Evaluability Assessment Report of OPII including recommendations;
  • A draft action plan underlining the specific measures that the UNCT needs to take to address the shortfalls in OPII with regard to its evaluability, delivery and accounting for results.

Indicative Work Flow and Time Frame

The Evaluability Assessment shall be carried out during October 2014-January 2015 for a duration of approximately 90 working days including the inception period, data collection and analyses, meetings, report writing and field visits, if required. In discussion with the RCO, the consultant hired shall detail out the timeframe by deliverables and specific activities/actions required to achieve them in the Inception Report adhering to the broad schedule of activities as follows:

Phase – 1 Preparatory phase:

Time Frame 10 days

  • Inception/ scoping mission for the Evaluability Assessment;
  • Agreement on methodology and detailed work plan;
  • Participate at the initial stakeholder meeting to launch the Evaluability Assessment exercise.

Phase – 2 Review of documents/ Information gathering:

Time Frame 35 days

  • Review of documents, reports, supporting materials;
  • Meetings/ workshops/ consultations with relevant stakeholders;
  • Finalize interview questionnaires with key stakeholders;
  • Field visits.

Phase – 3 Data Analysis:

Time Frame 25 days

  • Undertake validation and analysis of the qualitative and quantitative data acquired from desk review and field visits;
  • Advise and ensure storage of the validated/verified data in UN MIS One View/OPII Portal for M/E purpose;
  • Any other suggested activity.

Phase – 4 Preparation/ finalization of the Evaluability Assessment Report with Recommendations:

Time Frame – 20 days

  • Preparation of the draft report;
  • Presentation of draft findings/ report to PME/ PMT;
  • Finalization of the Report based on feedback from PMT, PME and other relevant stakeholders;
  • Submission of final report to PME.

Management Arrangements:

The organization and management arrangements for the conduct of OPII Evaluability Assessment will be as follows:

  • Evaluability Management Team (EMT): Resident Coordinator’s Office (RCO) and   PME Chair  – The RCO will manage and take the operational responsibility for the implementation of the Evaluability Assessment with recruitment of the consultant, facilitation of his/her work, finalization and publication of the Evaluability Assessment Report.  The EMT will also help ensure necessary cooperation from all counterparts and key stakeholders to meet with the consultant and provide correct and appropriate information and the required data in a timely fashion;
  • Technical Oversight by Reference Group (RG): The RG will be formed with representation from the PME group and key stakeholders, government counterparts and civil society. The RG will act as the technical oversight body for the Evaluability Assessment - reviewing and approving the Inception Report, work schedule, draft Evaluability Assessment Report which will then be submitted to the PMT and UNCT respectively for their review, comments and approval;
  • Stakeholder Consultations: At the federal level, the Economic Affairs Division and other concerned government partners and agencies will be engaged through the existing channels of communication and mechanism. At the provincial level, the PSC co-chairs and UN PPT mechanisms will be consulted and engaged through field visits and provincial work. As stakeholders, the relevant CSO(s) may also be engaged in the consultations both at the national and provincial levels.

Competencies

Functional Competencies:

  • Substantial knowledge on Planning, monitoring and evaluation;
  • Substantial experience in developing RBM planning documents and strategies;
  • Substantial experience in generating dialogue and consultation process in areas of policy analysis, 
  • Planning and monitoring;
  • A collaborative work style;
  • Excellent communication skills.

Required Skills and Experience

Education:

  • Masters or Ph.D level in economics/development studies from an internationally reputed university.

Experience:

  • Minimum of 10 years relevant work experience in the areas of multi-sector programme planning, management, monitoring and evaluation;
  • Prior experience working of conducting Evaluability Assessment with UN on UNDAF and DaO context will be an added advantage.

Languages:

  • Excellent English writing skills are essential.