Background

The UN Mission for the Ebola Emergency Response (UNMEER) was endorsed by the General Assembly on the 19th September 2014. At this early stage of the international response, cash payments to workers were mentioned in the UN Overview of Needs and Requirements document as an essential service, with a restricted Guinea-specific funding envelope of $2.5 million. An inter-agency ‘non-cluster’ on cash payments and social protection was quickly established, which undertook costings, mapping of actors, policy reviews, technical capacity gap analysis, and needs assessments.

At the same time, reports of striking health workers due to non-payment or discrepancy of incentives, became more frequent. The international community raised concerns whilst also recognising the need to maintain sovereignty of the affected countries in paying their own workers under their own domestically-negotiated policy frameworks. This was especially pertinent in Liberia where negotiations on pay-scales between workers’ unions and the Government pre-dated the ebola crisis.

A triple burden soon emerged of (1) more health sector workers needing (2) higher incentives in a system that needed (3) strengthening in order to increase financial throughput and accountability at a time of emergency. The ripple effect (resulting in in an inflationary effect in the public sector) was also being felt in other sectors, notably security.

UNMEER was developing a division of labour for UN partners within the emergency response. Anthony Banbury, UNMEER SRSG, wrote to the UN heads of agencies requesting formal commitments in order to clarify the division of labour. UNDP responded to the request and committed to lead the work on ERW payments. At the operational conference for scaling up the UN system approach to the ebola response in Accra (15-18th October), UNDP pledged to all partners that it would guarantee that all ERWs would be paid fully and on time from 1 December onwards.

UNMEER planning was conducted on the basis of a projected upper limit caseload of 5,000-10,000 ebola cases per week by December 1st. This produced a projected need for 150,000 ebola response workers across the countries. The staffing structure of these workers would comprise 7-8 defined worker cadres, working across three countries, with an incomplete picture of the coverage and functioning of public payroll mechanisms and private payment modalities.

Responding to this broader mandate, within UNDP, the payments team expanded to include the core government functions team, which brought expertise on emergency payments and public sector support in the aftermath of a crisis.

In line with the approved project document for the payments programme for ebola response, an end of the project evaluation will be conducted to measure impact against its objectives and output areas approved in the project document, namely:

• Facilitation and promotion of information management system;
• Strengthening existing payment mechanisms (mobile money, banking systems, MFIs, payment delivery) for ebola response workers and subsequently for ebola survivors and families of ebola victims;
• Establishment an operational contingency plan to ensure payments can be made in case of partial failures.

In addition, the evaluation will assess the unintended impact and results of the programme, including sustainability of impact and effectiveness of a communication strategy.

Duties and Responsibilities

Purpose of evaluation

The purpose of the evaluation is to:

• To assess results of the PPERW, intended and unintended;
• To identify the factors that affected UNDP contribution and performance including strength and weakness; threat and opportunities; identify lessons learnt from decisions, strategies and approaches undertaken during project implementation;
• Based on the above, to provide strategic recommendations to fine tuning the institutional strategy for payments during crisis.

Scope of work

Scope and objectives of evaluation:

Overall, the evaluation will assess PPERW for relevance, effectiveness, efficiency, sustainability and impact.  The evaluation will determine key drivers or factors enabling successful implementation.

• Analyze risk factors and how they were addressed by the project;
• Level of national ownership and measure to enhance national capacities for sustainability of results;
• Analyze the inclusiveness, gender mainstreaming and women empowerment as well as other issues related to human-rights based approach and addressing the needs of vulnerable groups within the project.

Activity Estimated time and Key outputs:

Preparation by consultant (2 days)

• Review of project document and progress reports (M&E Indicators Reports; MPTF Monthly Reports; others);
• Other relevant literature review;
• Briefing from PPERW Management Team;
• Agreement on activities & timeframes;
• Preparation of meetings/programme;
• Development of assessment methodology (involving analysis of programmes and activities in areas of time, target groups, person reached, and outcomes measured [if at all, how and with what results]).

Key Deliverables:          

• Familiarization with PPERW;
• Evaluation work plan and timeframe;
• Evaluation instruments (examples: matrix with key evaluation questions and means of verification, questionnaires, interview protocols, meeting programmes, focus group methodologies, etc.).

Meetings and discussions with stakeholders in countries (to be finalized and coordinated by each country PPERWs, with participation from MPTF M&E Officers) (work 5 days in each country = 15 days)

• Interview PPERW;
• Interview UNDP CO management;
• Interview with stakeholders such as banks, Mobile Network Operators, Ministry of Health and Ministry of Finance and Economics, NERC, International NGO, ERWs, province ebola coordination offices and organizations/employers representing ERWs;
• Interview ERWs/field visit (at least one): sampling of at least 20 ERW interviews.

Key Deliverables:

• Documented records of interviews and observations with stakeholders;
• Draft evaluation findings.

Presentation of findings to PPERW Management (1 day)

              Incorporate feedback into findings

Key Deliverable:

              Presentation of findings.

Writing Report (9 days)

Draft Report & Final Report which should:

• Contain an executive summary (mandatory);
• Be analytical in nature (both quantitative and qualitative);
• Be structured around issues and related findings/lessons learnt;
• Include conclusions;
• Include recommendations.

NB: A report template will be provided to the consultants. Consideration should be given to producing a final report for public information & donors.                          

Key Deliverables:

Draft report delivered to PPERW for consideration and for comments.

Total time allocated to the assignment is 28 working days

Evaluation outputs

The key product expected is a comprehensive analytical report, in line with the UNDP Guidelines for Outcome Evaluations.  Data used in the report must be reliable, valid and credible to ensure the best quality of report. Applying the case study technique is advisable as an addition to the in-depth interviews to be conducted during meetings with stakeholders.

Additional outputs include a PowerPoint presentation on key findings and a draft report to be circulated in stakeholder meetings.

Deliverables will include:

• Evaluation inception report;
• Draft evaluation report;
• Final evaluation report.

The standard evaluation report should include the following chapters:

Evaluation methodology

• Context and background (including the context of the country – like lack of strong banking system, dynamics of ebola, etc.), information about project;
• Evaluation findings: against evaluation criteria (relevance, effectiveness, sustainability, etc.), risk factors assessment, ownership, key drivers/factors, gender/human rights and other cross-cutting considerations (maybe divided into several chapter or sub-chapters).

Lessons learnt

• The overall responsibility for managing the evaluation will be with the PPERW managers – regional manager & in-country managers for Guinea, Liberia and Sierra Leone;
• PPERW will facilitate contact and meetings with key partners in the country; provide funding for the evaluation; and provide comments on the final report;
• MTPF M&E officers in all three countries will be invited to partake in the evaluation process, including planning, meetings and comments on the final report.

Duration of assignment and duty station

The assignment is home based with three mission travel to Guinea, Liberia and Sierra Leon; The duration of the assignment is 28 days inclusive of 5 days in each country (15 days), with 3 days offsite preparation and 10 days offsite Final Report.

Operating principles

The consultants should operate on principles that are in line with the spirit of the UN system.  Participation of a range of stakeholders at all levels is an important part of this assessment. The consultants should consider the audience of the evaluation and ways to maximize learning through this process. The consultant is also required to observe the UN norms and standards for programme/project evaluations, produced by UNEG – United Nations Evaluation Group.

Competencies

• Promoting ethics and integrity, creating organizational precedents;
• Building support and political acumen;
• Building staff competence,  creating an environment of creativity and innovation;
• Building and promoting effective teams;
• Creating and promoting enabling environment for open communication;
• Sharing knowledge across the organization and building a culture of knowledge sharing and learning.

Required Skills and Experience

Education:

• Advanced university degree in international development, accounting, economics or related field.

Experience:

• Minimum of 5 years of experience in Evaluation, including experience in designing methodologies as well as tools and strategies for data collection, conducting in-depth interviewing, data coding and production of analytical reports;
• Knowledge of UN and UNDP evaluation standards and requirements, including preferably evaluation assignments performed for UN organizations;
• Knowledge of cash transfer programing including financial inclusion.

Language:

• Fluency in English and French language required.

Contracts payments will be based on all - inclusive daily fee in US dollars:

Recommended Presentation of Offer:

The application is a two-step process. Failing to comply with the submission process may result in disqualifying the applications:

Step 1: Interested individual consultants must include the following documents when submitting the applications in UNDP job shop (Please note that only 1 (one) file can be uploaded therefore please include all docs in one file):

• Personal History Form (P11), indicating all past experience from similar projects, as well as the contact details (email and telephone number) of the Candidate and at least three (3) professional references (the template can be downloaded from this link: http://europeandcis.undp.org/files/hrforms/P11_modified_for_SCs_and_ICs.doc );
• Brief description of why the individual considers him/herself as the most suitable for the assignment, and a methodology, if applicable, on how they will approach and complete the assignment.

Step 2: Submission of Financial Proposal

Applicants are instructed to submit their financial proposals separately indicating an all-inclusive daily fee in US Dollars for this consultancy to bpps.procurement@undp.org, using the financial proposal template available here: http://procurement-notices.undp.org/view_file.cfm?doc_id=43528. The proposals should be sent via e-mail with the following subject heading: “Financial Proposal - Consultant, End of Project Evaluation UNMEER “by the deadline for this vacancy.

Proposals to be received after the deadline may be rejected. In order to assist the requesting unit in the comparison of financial proposals, the financial proposal should be all-inclusive and include a breakdown. The term ‘all-inclusive” implies that all costs (professional fees, travel related expenses, communications, utilities, consumables, insurance, etc.) that could possibly be incurred by the contractor are already factored into the financial proposal.

Criteria for Selection of the Best Offer:

Combined scoring method – where the qualifications and methodology will be weighted a maximum of 70 points and combined with the price offer which will be weighted a max of 30 points out of 100 points

Method: Cumulative analysis method will be used to evaluate proposals.

When using this weighted scoring method, the award of the contract will be made to the individual consultant whose offer has been evaluated and determined as:

• Responsive/compliant/acceptable; and
• Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation.

Technical Criteria weight: 70%

Financial Criteria weight: 30%

Only candidates obtaining a minimum of 49 points on technical part will be considered for the financial evaluation.

Technical Proposal

Criteria to pass technical evaluation requires a minimum of 49 points out of 70 points:

• Minimum of 5 years of experience in evaluation, including experience in designing methodologies as well as tools and strategies for data collection, conducting in-depth interviewing, data coding and production of analytical reports (30 points);
• Knowledge of UN and UNDP evaluation standards and requirements, including preferably evaluation assignments performed for UN organizations (20 points);
• Knowledge of cash transfer programing including financial inclusion (20 points).

Criteria for financial evaluation (30 points); The following formula will be used to evaluate financial proposal:

p = y (µ/z), where

p = points for the financial proposal being evaluated

y = maximum number of points for the financial proposal

µ = price of the lowest priced proposal

z = price of the proposal being evaluated

Financial Proposal (30% weight of combined score)

Please submit an all-inclusive lump sum daily fee.

Financial proposals must be all inclusive and must be expressed on the basis of a daily fee. The term ‘all inclusive” implies that all costs (professional fees, communications, utilities, consumables, insurance, etc.) that could possibly be incurred by the Contractor are already factored into the daily fee.

The travel cost of the official missions to Guinea, Liberia and Sierra Leone originating from the consultant’s home base should not be factored in the financial proposals of the applicants.

In this case and in the case of unforeseeable travel, payment of travel costs including tickets, lodging and terminal expenses will be agreed upon between UNDP and the Individual Consultant within the UNDP Travel Policy rates prior to travel and will be reimbursed. In general, UNDP will not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources.

Working arrangements:

UNDP will provide office space, internet access and printing facilities as well as in-country travel support while on mission; the cost of these facilities should not be included in the financial proposals

Contract payments wlll be based on all-inclusive daily fee in US dollars:

Payments will be made to the Individual Consultant based on the number of days worked, and certification of payments by the Team Leader (Supervisor).

More information:

UNDP reserves the right to have an interview.