1) GENERAL BACKGROUND

The second phase (2016-2020) of the joint UNDP-UNODC Pacific Regional Anti-Corruption Project (UN-PRAC) aims to support Pacific Island Countries (PICs) to strengthen their national integrity systems. This is in order to promote ‘clean’ governments and to create an enabling environment for trade, business, investment and sustainable development. In turn, this will enhance the delivery of equitable and high-quality services to all Pacific Islanders.

Over the past years, the debate has shifted from ‘why’ countries should be preventing and fighting corruption to ‘how’. The UN Convention against Corruption (UNCAC) is the only international legally binding framework on how to prevent and fight corruption. It provides a solid basis upon which PICs can develop sustainable anti-corruption reforms. It is for this reason that this Project was designed to build on the platform of UNCAC, as well as the efforts undertaken during the first phase (2012-2016) of UN-PRAC. This includes leveraging the recognition by PICs of the UN as a trusted, impartial partner. One medium by which PICs are addressing the ‘how’ question is through the Mechanism for the Implementation of UNCAC (UNCAC Review Mechanism). This requires States parties to consider what national legislative, institutional and practical frameworks are in place to effectively address corruption. Another related anchor is the Development Agenda 2030 and the Sustainable Development Goals (SDGs), recently adopted by UN Member States. SDG 16 (Promote just, peaceful and inclusive societies) directly calls for stronger action on anti-corruption, transparency and accountability. This Project also strives to more coherently address the link between anti-corruption and development, and to integrate anti-corruption into national and regional development processes.

One of the key implementation principles of UN-PRAC, as noted in the project document, is the integration of gender and human rights throughout the Project. Both UNDP and UNODC are committed to mainstreaming gender equality in their programme work and as such, this Project is also committed to gender equality. In addition, where appropriate, specific activities in support of gender equality in the anti-corruption context are considered. The Project reporting is designed to be gender responsive and raise gender-related issues to the extent possible.

The goal of UN-PRAC is to promote and strengthen measures to prevent and fight corruption more efficiently and effectively in the Pacific region. This aligns with the purpose of UNCAC in paragraph 1(1) and the spirit of SDG 16.

In particular, the project aims to:

1. Provide Niue, Samoa and Tonga with sufficient information and support to enable their accession to UNCAC and all Pacific States parties to actively participate in the UNCAC review process
2. Support Pacific States parties to more effectively implement UNCAC and work towards the achievement of SDG 16
3. Strengthen social accountability mechanisms and the anti-corruption role of non-State actors

2) OBJECTIVES OF THE ASSIGNMENT

In line with the project document, the mid-term Independent Project Evaluation will be undertaken around 24 months after the initiation of the project. The aim of the evaluation is to assess the effectiveness of the design and relevance of the project. Its results will be used to inform the implementation of the second half of the project, assess project’s successes and good practices, as well as lesson learnt and areas of improvement. The main users of the evaluation results will be project managers and donors. 

The following DAC (Development Assistance Committee) criteria will be assessed during the evaluation: relevance, efficiency, effectiveness, impact and sustainability. In addition, design, established partnerships and cooperation as well as aspects of human rights and gender mainstreaming will be assessed. The evaluation will specifically assess how gender aspects have been mainstreamed into the project. Furthermore, lessons learned and best practices will be identified and recommendations based on the findings formulated.

The outcomes of the evaluation will inform as to what extent the project is contributing to the outcomes of the UNDP and UNODC relevant corporate strategic documents, and above towards the operationalization of the SDG agenda.

3) SCOPE OF WORK

Under the guidance and supervision of the Head of the Integrated Results Management Unit (IRMU) of  the UNDP Office in Fiji and the Chief or Deputy Chief of the Independent Evaluation Unit (IEU) of UNODC, the key responsibilities of the evaluation team include (i) development of the evaluation design with detailed methods, tools and techniques, sensitive to key gender as well as human rights issues (ii) ensuring adherence to the United Nations Evaluation Group (UNEG) Norms and Standards, UNODC evaluation norms[1], standards, guidelines and templates and the full evaluation Terms of Reference (ToR), and (iii) ensuring that all deliverables are submitted in a timely and satisfactory manner and in line with the quality criteria checklist.

The mid-term Independent Project Evaluation (MTE) should assess the design of the project. The following are the key evaluation questions:

Given that this is a Mid-Term Independent Project Evaluation, the emphasis will be on identifying lessons learnt, with a view to adjusting the project design and implementation accordingly. The MTE will therefore make recommendations for the way forward, based on progress thus far.

Findings and lessons learned:

• Outline, as logically and objectively as possible, findings and conclusions
• Highlight the major successes and good practices
• Highlight the major shortcomings, and weaknesses in order of importance

Recommendations:

• Present recommendations for a way forward and potential corrective actions; recommendations should be objective, realistic, practical, understandable and forward looking
• Link the recommendations logically to the findings
• Recommend a realistic duration for implementation of remaining project activities

MTE Methodology and Approach

The MTE team should consist of two international consultants (Team leader and Team Member / Expert).

The evaluation will use methodologies and techniques as determined by the specific needs for information, the questions set out in the ToR for the evaluation and the availability of stakeholders. The methodologies and approach need to take into account that this is a regional project, covering 15 countries in a geographically scattered region. In all cases, the evaluation team is expected to analyse all relevant information sources, such as reports, programme documents, thematic programmes, programme files, financial reports and any other documents that may provide further evidence for triangulation, on which his/her conclusions will be based. The evaluation team is also expected to use  relevant quantitative and/or qualitative tools as a means to collect relevant data for the evaluation. While maintaining independence, the evaluation will be carried out based on a participatory approach, which seeks the views and assessments of all parties identified as the key stakeholders of the project/ programme, the Core Learning Partners (CLP).

The evaluation ToR provides basic information as regards to the methodology, which should not be understood as exhaustive. It is rather meant to guide the evaluation team in elaborating an effective, efficient, and appropriate evaluation methodology that should be proposed, explained and justified in the Inception Report.

In addition, the evaluation team will be asked to present a summarized methodology (including an evaluation matrix) in the Inception Report outlining the evaluation criteria, indicators, sources of information and methods of data collection. The evaluation methodology must conform to the United Nations Evaluation Group (UNEG) Norms and Standards as well as the UNODC Evaluation Policy, Norms and Standards.

While the evaluation team shall fine-tune the methodology for the evaluation in an Inception Report, a mixed-methods approach of qualitative and quantitative methods is mandatory due to its appropriateness to ensure an inclusive methodology. Special attention shall be paid to an unbiased and objective approach and the triangulation of sources, methods, data, and theories. Indeed, information stemming from secondary sources will be cross-checked and triangulated through data retrieved from primary research methods. Primary data collection methods need to be gender-sensitive as well as inclusive.

The credibility of the data collection and analysis are key to the evaluation. Rival theories and competing explanations must be tested once plausible patterns emerge from triangulating data.

The limitations to the evaluation need to be identified and discussed by the evaluation team in the Inception Report, e.g. data constraints (such as missing baseline and monitoring data). Potential limitations as well as the chosen mitigating measures should be discussed.

When designing the evaluation data collection tools and instruments, the evaluation team needs to consider the analysis of certain relevant or innovative topics in the form of short case studies, analyses, etc. that would benefit the evaluation results.

• Scope of Work

Bidders shall be free to propose their own team composition and roles. The team should consist of two experts:

• Consultant 1: Team Leader –  Evaluation Specialist, with some previous knowledge of anti-corruption, transparency, accountability
• Consultant 2: Team Member/ Expert – Anti-Corruption / Integrity Specialist

Overall responsibilities lie with the MTE Team Leader, who will provide guidance and leadership on conducting the MTE and on preparing/revising the deliverables. The Team Leader will have expertise in results-based evaluation methodologies.

The Team Leader will be responsible for the quality and timely submission of his/her specific deliverables, as specified below, interacting with the UNODC IEU and UNDP IRMU throughout the evaluation process. All products should be well written, inclusive and have a clear analysis process.

Specific responsibilities of the Team Leader include:

• Leading the documentation review and final framing of MTE questions
• Draft inception report, containing:  initial observations of the desk review, refined evaluation questions, data collection instruments (including surveys/questionnaires and interview guides), sampling strategy, evaluation matrix and limitations to the evaluation; in line with UNODC evaluation norms, standards, guidelines and templates.
• Leading the MTE team in planning and execution of the assignment
• Managing the division of labor and supervising the work of the other consultant (MTE Team Member)
• Incorporating the use of best practice with respect to M&E and results-based evaluation methodologies 
• Leading interviews and consultations, as well as any debriefings to the stakeholders/partners
• Leading the drafting and finalization/quality control of the inception report and the draft and final MTE report, as well as Evaluation Brief (2-pager)

The MTE Team Member/Expert will support the Team Leader and provide the expertise on anti-corruption and integrity in the context of the evaluation. S/he may be asked to lead on specific areas and will be responsible for drafting relevant parts of the inception report and the draft and final MTE report, as well as the Evaluation Brief. Overall responsibilities lie with the MTE Team Leader, who will provide guidance and leadership on conducting the MTE and on preparing/revising the deliverables.

Specific responsibilities of the MTE Team Member include:

• Under the guidance of the Team Lead, undertaking the documentation review and final framing of MTE questions on areas related to anti-corruption
• Supporting the Team Leader during interviews and consultations, as well as any debriefings to the stakeholders/partners, and leading on anti-corruption aspects, as requested by the Team Leader
• Contributing to the drafting and revision of relevant parts of the inception report and the MTE draft and final report, as well as the Evaluation Brief (2-pager), under the guidance of the Team Leader

The evaluators must not have been involved in the design and/or implementation, supervision and coordination of and/or have benefited from the programme/project or theme under evaluation. The evaluation team will report exclusively to the chief or deputy chief of the UNODC IEU and head of the UNDP IRMU, who are the sole clearing entities for all evaluation deliverables and products. The evaluators shall respect the UNEG Ethical Guidelines.

4) DURATION OF ASSIGNMENT, DUTY STATION AND EXPECTED PLACES OF TRAVEL

This assignment will take place between 13 August and 19 December 2018 and is output-based. Travel to Fiji and potentially one other Pacific country is required to hold consultations.  Stakeholder from other countries will be interviewed via skype or phone due to the vast geographical area covered by the project and expensive and challenging travel options in the region. Therefore, other work will be home-based.  Travel will be facilitated by UN-PRAC as per UNDP’s travel rules and regulations.

Timeframe:

• Inception report: by 10 September 2018
• Consultations: by 30 September 2018
• Draft MTE report: by 12 November 2018
• Final MTE report and Evaluation Brief: by 19 December 2018

The MTE is expected to take a total of 67 working days: 40 working days for Consultant 1 (MTE Team Leader) and 27 working days for Consultant 2 (MTE Team Member / Expert), as follows:

5) FINAL PRODUCTS

The final products for this assignment are as follows:

Inception report: The inception report should be prepared by the MTE team before going into the full-fledged MTE exercise. It should include initial observations of the desk review, refined evaluation questions, data collection instruments (including surveys/questionnaires and interview guides), sampling strategy, evaluation matrix and limitations to the evaluation, in line with UNODC evaluation norms, standards, guidelines and templates.

Draft MTE report: Draft evaluation report should be prepared in line with UNODC evaluation norms, standards, guidelines and templates, including an analysis of the performance of the project to adequately address gender equality as well as human rights issues, with concrete findings, conclusions and recommendations.

MTE report: The final report will be produced by the MTR team based on feedback received on the draft report. The final report will be shared with stakeholders and other partners. The final evaluation report and an Evaluation Brief (2-pager) should be prepared in line with UNODC evaluation norms, standards, guidelines and templates.

6) PROVISION OF MONITORING AND PROGRESS CONTROLS

The evaluation team will work under the supervision of the UNODC IEU and UNDP IRMU, who will consult with and seek inputs from other counterparts in line with the evaluation ToR.

UN-PRAC will support the logistical arrangements of consultant travels and stakeholder consultations. Although UN-PRAC is administratively responsible for the MTE, it shall not interfere with analysis and reporting, except where requested and at opportunities for comments/feedback.

UNODC and UNDP will share the final version of the MTE report with the national stakeholder agencies and all partners of the project.

The MTE team will be composed of two independent consultants not involved with the formulation, appraisal, approval and/or implementation of daily management of the project. Both UNODC and UNDP will have the opportunity to weigh in on the selection of the consultants and provide inputs to the required qualifications and competencies. UNDP will oversee the administrative process of recruitment and contracting, with both UNODC and UNDP being given the option of participating in each stage of the selection, including short-listing, reviewing financial proposals, interview panels, etc.

The following are required experience and competencies for MTE Team Lead:

Experience:

• At least 7 years of relevant professional technical experience in the field of evaluation of projects/programmes, strategies, etc.  at the international level, preferably with experience in conducting evaluations for the United Nations;
• Experience in the area of anti-corruption or related field is highly desirable.
• Experience with result-based management and program/project monitoring approaches, including gender and human rights-sensitive evaluations;
• Knowledge of quantitative and qualitative research methods;
• Experience leading review/evaluation teams;
• Sound knowledge in the thematic area of anti-corruption;
• Knowledge and experience of the UN System and in particular of UNODC and/or UNDP would be of advantage;
• Experience in the Pacific region would be an advantage

Functional competencies:

• Strong interpersonal skills, communication and diplomatic skills, ability to lead a team;
• Openness to change and ability to receive and integrate feedback;
• Strong analytical, reporting and writing abilities;
• Excellent speaking and presentation skills;
• Experience in presenting and communicating complex evaluation or research results in a structured manner (in reports, briefs, presentations, etc.);

Language requirements:

• Excellent spoken and written English language skills required

8) REVIEW TIME REQUIRED

10 days after submission of each deliverable.

Payment Schedule:

Payment will be made after satisfactory acceptance and certification of the deliverables and in accordance with UNDP procedures:

• on submission of final MTE inception report – 20% of the total value of the contract
• on submission of draft MTE report – 30% of the total value of the contract
• on acceptance of final MTE report – 50% of the total value of the contract

  Price Proposal and Schedule of Payments

Consultant must send a financial proposal based on Lump Sum Amount. The total amount quoted shall be all-inclusive and include all costs components required to perform the deliverables identified in the TOR, including professional fee, travel costs, living allowance (if any work is to be done outside the IC´s duty station) and any other applicable cost to be incurred by the IC in completing the assignment. The contract price will fixed output-based price regardless of extension of the herein specified duration.

In general, UNDP shall not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources

In the event of unforeseeable travel not anticipated in this TOR, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between the respective business unit and the Individual Consultant, prior to travel and will be reimbursed.

Evaluation Method and Criteria:

Individual consultants will be evaluated based on the cumulative analysis methodology.

The award of the contract shall be made to the individual consultant whose offer has been evaluated and

determined as:

a) responsive/compliant/acceptable, and

b) Having received the highest score out of a pre-determined set of weighted technical and financial

criteria specific to the solicitation: Technical Criteria 70% (as indicated above in Experience and

Qualifications section) and Financial Criteria 30%.

Only candidates obtaining a minimum of 49 points (70% of the total technical points) would be

considered for the Financial Evaluation.

Technical Criteria – Maximum 70 points

Consultant 1: Team Leader –  Evaluation Specialist, with some previous knowledge of anti-corruption, transparency, accountability

• Criteria 1 - Master’s degree in Law, Development Studies, Public Finance, Political Science, Social Sciences, Evaluation, or other relevant field and preferably formal training/education on evaluation methodologies and principles; 10%

• Criteria 2 -At least 7 years of relevant professional technical experience in the field of evaluation of projects/programmes, strategies, etc.  at the international level, preferably with experience in conducting evaluations for the United Nations. Sound knowledge in the thematic area of anti-corruption;  20%
• Criteria 4 - Experience with result-based management and program/project monitoring approaches, including gender and human rights-sensitive evaluations 10%

• Criteria 5 – Knowledge of quantitative and qualitative research methods; 10%
• Criteria 6 - Experience leading review/evaluation teams, strong interpersonal skills, communication; Strong analytical, reporting and writing abilities. Openness to change and ability to receive and integrate feedback; Excellent speaking and presentation skills, Experience in presenting and communicating complex evaluation or research results in a structured manner (in reports, briefs, presentations, etc.); Excellent spoken and written English language skills required – 10%
• Criteria 7 - Knowledge and experience of the UN System and in particular of UNODC and/or UNDP and experience in the Pacific region – 10%

Consultant 2: Team Member/ Expert – Anti-Corruption / Integrity Specialist

• Criteria 1 – Master’s degree in Law, Development Studies, Public Finance, Political Science, Social Sciences, or other relevant field and preferably formal training/education on evaluation methodologies and principles; 10%
• Criteria 2 - At least 5 years of relevant professional technical experience in the field of anti-corruption or related field; 20%

• Criteria 3: Experience in conducting various types of evaluation at the international level, preferably with experience in conducting evaluations for the United Nations would be an asset; 15%

• Criteria 4: Knowledge of quantitative and qualitative methods; Knowledge and experience of the UN System and in particular of UNODC and/or UNDP and experience in the Pacific region- 10%
• Criteria 5:– Strong analytical, reporting and writing abilities; Openness to change and ability to receive and integrate feedback; Excellent speaking and presentation skills, Experience in presenting and communicating complex evaluation or research results in a structured manner (in reports, briefs, presentations, etc.); Excellent spoken and written English language skills required 10%;
• Criteria 6:  Experience working in a team – 5%

DOCUMENTS TO BE INCLUDED WHEN SUBMITTING THE PROPOSALS.

Proposal Submission

All applications must be clearly marked with the title of the consultancy and submitted by 20th July 2018 (Fiji Time) electronically to etenderbox.pacific@undp.org

For any clarification regarding this assignment please write to Lavenia Rokovucago lavenia.rokovucago@undp.org  .

Incomplete applications will not be considered, and only candidates for whom there is further interest will be contacted.