Historique

In accordance with UNDP and GEF monitoring and evaluation policies and procedures, all full and medium-sized UNDP supported GEF financed projects are required to undergo a terminal evaluation upon completion of implementation. These terms of reference set out the expectations for a Terminal Evaluation (TE) of the Developing and Implementing A National Access and Benefit-Sharing Framework in Malaysia (ABS II) (PIMS# 5191).

Project Summary

Project title: Developing and Implementing a National Access and Benefit-Sharing Framework in Malaysia

GEF financing: USD 1,970,000

Co-financing: USD 5,800,000

Implementing partner: Ministry of Natural Resources and Environment (NRE), Malaysia

Project start date: 7 January 2014

Project closing date: 6 January 2018 (original), 6 January 2019 (actual)

Objective and Scope:

The project was designed to strengthen the conservation and sustainable use of biological and genetic resources in Malaysia through developing the national framework for the implementation of Access and Benefit Sharing under CBD. The project will achieve the project objective through the implementation of three inter-connected components. Component 1 addresses the need for a national regulatory and institutional framework on ABS, including a financial mechanism to reinvest funds from ABS agreements back into biodiversity conservation.  The operationalization of this framework will be supported by the strengthening of national institutional and stakeholder capacity in Component 2, including measures for the documentation and  protection of traditional knowledge; and through demonstration of pilot ABS agreements, Prior Informed Consent (PIC) processes and a PIC/community protocol regarding ABS of indigenous and local communities’ traditional knowledge in Component 3, which will provide experience and lessons learned to inform refinement of the framework and implementation processes. The three components will result in the following project outcomes:

Outcome 1: An operational national regulatory and institutional framework on ABS.

Outcome 2: Strengthened national institutional and stakeholder capacity for implementation of the national ABS framework.

Outcome 3: Best practice ABS processes (three) are demonstrated recognizing the principles of PIC and Mutually Agreed Terms (MAT) including the fair and equitable sharing of benefits.

Project document can be referred at http://www.my.undp.org/content/malaysia/en/home/operations/projects/environment_and_energy/developing-and-implementing-a-national-access-and-benefit-sharin.html.

The TE will be conducted according to the guidance, rules and procedures established by UNDP and GEF as reflected in the UNDP Evaluation Guidance for GEF Financed Projects. The objectives of the evaluation are to assess the achievement of project results, and to draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming.  

Evaluation Approach and Method:

An overall approach and method[1] for conducting project terminal evaluations of UNDP supported GEF financed projects has developed over time. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Guidance for Conducting Terminal Evaluations of UNDP-supported, GEF-financed Projects at http://web.undp.org/evaluation/documents/guidance/GEF/UNDP-GEF-TE-Guide.pdf.  A set of potential questions covering each of these criteria can be referred to Annex 4 of the UNDP Guidance for Conducting Terminal Evaluations of UNDP-supported, GEF-financed Projects. The evaluator is expected to amend, complete and submit this matrix as part of an evaluation inception report, and shall include it as an annex to the final report.

The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular, GEF operational focal point, UNDP Country Office, project team, UNDP GEF Regional Technical Adviser based in Bangkok and key stakeholders. The evaluator is expected to conduct a field mission to Putrajaya, Malaysia including the following project sites – States of Perak, Sabah and Sarawak. Interviews will be held with the following organizations and individuals at a minimum: Biodiversity and Forestry Management Division of NRE, Forest Research Institute Malaysia, Sabah Biodiversity Centre, Sarawak Biodiversity Centre, UNDP Malaysia Country Office and local & indigenous communities of Orang Asli Kintak and Kensui, Bidayuh, Lun Bawang, Kelabit and Lundayeh. Detailed list of stakeholders will be given upon confirmation of assignment.

The evaluator will review all relevant sources of information, such as the project document, project reports – including Mid-Year Progress Report, Annual Project Report, Project Implementation Review (PIR), project budget revisions, midterm review, progress reports, GEF focal area tracking tools, project files, national strategic and legal documents, and any other materials that the evaluator considers useful for this evidence-based assessment. The project team will provide a list of documents to the evaluator for review.

Evaluation Criteria & Ratings:

An assessment of project performance will be carried out, based against expectations set out in the Project Logical Framework/Results Framework (see Project Document), which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation will at a minimum cover the criteria of: relevance, effectiveness, efficiency, sustainability and impact. Ratings must be provided on the following performance criteria. The completed table must be included in the evaluation executive summary.   The obligatory rating scales are in page 34 of the UNDP Guidance for Conducting Terminal Evaluations of UNDP-supported, GEF-financed Projects.

Project Finance/Co-finance:

The Evaluation will assess the key financial aspects of the project, including the extent of co-financing planned and realized. Project cost and funding data will be required, including annual expenditures.  Variances between planned and actual expenditures will need to be assessed and explained.  Results from recent financial audits, as available, should be taken into consideration. The evaluator(s) will receive assistance from the Country Office (CO) and Project Team to obtain financial data in order to complete the co-financing table below, which will be included in the terminal evaluation report. 

Mainstreaming:

UNDP supported GEF financed projects are key components in UNDP country programming, as well as regional and global programmes. The evaluation will assess the extent to which the project was successfully mainstreamed with other UNDP priorities, including poverty alleviation, improved governance, the prevention and recovery from natural disasters, and gender.

Impact:

The evaluators will assess the extent to which the project is achieving impacts or progressing towards the achievement of impacts. Key findings that should be brought out in the evaluations include whether the project has demonstrated: a) verifiable improvements in ecological status, b) verifiable reductions in stress on ecological systems, and/or c) demonstrated progress towards these impact achievements.[2]

Conclusions, Recommendations and Lessons: 

The evaluation report must include a chapter providing a set of conclusions, recommendations and lessons.

Implementation Arrangement:

The principal responsibility for managing this evaluation resides with the UNDP CO in Malaysia. The UNDP CO will contract the evaluators and ensure the timely provision of per diems and travel arrangements within the country for the evaluation team. The Project Team will be responsible for liaising with the Evaluators team to set up stakeholder interviews, arrange field visits, coordinate with the Government etc. 

[1] For additional information on methods, see the Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 7, pg. 163

[2] A useful tool for gauging progress to impact is the Review of Outcomes to Impacts (ROtI) method developed by the GEF Evaluation Office:  ROTI Handbook 2009

Devoirs et responsabilités

The National Expert and Evaluator, Indigenous People and Traditional Knowledge will perform the key tasks as follows:

• Report to Lead Expert and Evaluator and work in a team of three independent experts who will conduct the Terminal Evaluation.
• Conduct a document review of project documents i.e. Country Programme Action Plan (CPAP) 2016 – 2020 between UNDP and Government of Malaysia, Project Identification Form (PIF), UNDP Initiation Plan, Project Document, Environmental and Social Safeguard Policy (ESSP), Project Inception Report, Project Implementation Reviews, Finalized GEF focal area Tracking Tools, Project Appraisal Committee meeting minutes, Financial and Administration guidelines used by Project Team, project operational guidelines, manuals and systems, etc.; provided by UNDP Malaysia Country Office and Project Team.
• Prepare the TE inception report detailing evaluation approach and method, evaluation questions and criteria matrix, list of stakeholders, field mission schedule, overall work plan and TE report outline and content.
• Plan and facilitate in a TE inception workshop during the field mission to clarify their understanding of the objectives and methods of the TE.
• Conduct field mission with TE team that consist of interviews with stakeholders who have project responsibilities and site visits to States of Perak/Kedah, Sabah (Long Pasia and Long Mio) and Sarawak (Kampung Kidding in Kuching, Pa’ Lungan and Pa’Ukat in Bario, Long Telingan and Long Kerebangan in Lawas).
• Assess the following four categories of project progress based on the Guidance for Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects for requirements on ratings. No overall rating is required.
• Produce a draft final TE report with TE team members.
• Plan and conduct the TE concluding workshop.
• Finalize and submit the TE report to UNDP.

Deliverables:

• TE Inception Report: TE team clarifies objectives and methods of the Midterm Review no later than 4 weeks before the field mission. To be sent to UNDP Malaysia Country Office and project management. Approximate due date: 15 October 2018
• Field mission: 22 October – 2 November 2018
• PowerPoint Presentation: Initial Findings presented to project management, stakeholders and UNDP Malaysia at the end of the TE field mission. Approximate due date: 2 November 2018
• Draft Final Report: Full report with annexes within 5 weeks of the TE field mission. Approximate due date: 15 December 2018
• TE concluding workshop: 21 – 22 January 2019
• Final Report*: Revised report with annexed audit trail detailing how all received comments have (and have not) been addressed in the final TE report. To be sent to the UNDP Malaysia within 2 weeks of receiving UNDP and stakeholders’ comments and feedback from the TE concluding workshop. Approximate due date: 28 February 2019

*The final TE report must be in English. If applicable, UNDP Malaysia may choose to arrange for a translation of the report into Malay language – the official language more widely shared by national stakeholders.

Timeframe:

The total duration of the assignment will be 60 working days starting 1 October 2018, and shall not exceed 7 months from when the National Expert cum Evaluator is hired.

• 1 – 15 October: Prep the TE Team (handover of project documents), document review and preparing TE Inception Report, and preparation of field mission;
• 16 October – 2 November: Field mission: stakeholder meetings, interviews, field visits;
• 2 November: Mission wrap-up meeting & presentation of initial findings;
• 2 November – 15 December: Preparing draft report;
• 1 – 18 December: Preparing for TE concluding workshop;
• 19 December: Conduct TE concluding workshop;
• 20 December 2018 – 28 February 2019: Incorporating audit trail on draft report/Finalization of TE report;
• 1 March – 30 April 2019: Further feedback and acceptance of TE report by UNDP;
• 30 April 2019: Expected date of full TE completion.

Terms of Payment:

The payments will be performance-based and regularly assessed by UNDP Malaysia Country Office. The breakdown of payment is as follow:

• 10% upon submission and acceptance of detailed work plan;  
• 20% upon submission and acceptance of the inception report;
• 40% upon submission and acceptance of the 1st draft terminal evaluation report;
• 30% upon submission and acceptance of the final terminal evaluation report by UNDP Country Office and UNDP Regional Technical Adviser.

Duty Station:

All travel within Malaysia will be arranged and provided by UNDP Malaysia and Project Team except international travel from home base to Kuala Lumpur, Malaysia. Accommodation and meals will be provided for in-country travel.

Travel:

• International travel will be required to Kuala Lumpur, Malaysia during the field mission;
• The Basic Security in the Field II and Advanced Security in the Field courses must be successfully completed prior to commencement of travel;
• Individual Consultants are responsible for ensuring they have vaccinations/inoculations when travelling to certain countries, as designated by the UN Medical Director.
• Consultants are required to comply with the UN security directives set forth under https://dss.un.org/dssweb/.

Compétences

The National Expert@Evaluator cannot have participated in the project preparation, formulation, and/or implementation (including the writing of the Project Document) and should not have conflict of interest with project related activities.

Functional competencies:

• Extensive knowledge in social and indigenous people (Orang Asli and Orang Asal) issues in the context of biodiversity management in Malaysia;
• Familiar with Convention on Biological Diversity (CBD) and proficiency in Nagoya Protocol
• Sound analytical and organisational skills;
• Excellent communication and writing skills.

Corporate Competencies:

• Demonstrates integrity by modelling the UN’s values and ethical standards;
• Promotes the vision, mission, and strategic goals of UNDP;
• Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability
• Treats all people fairly without favouritism;
• Fulfils all obligations to gender sensitivity and zero tolerance for sexual harassment;
• Demonstrates integrity by modelling the UN’s values and ethical standards.

Qualifications et expériences requises

• Minimum Master’s Degree or equivalent in Anthropology, Orang Asli/Orang Asal Studies, Social Science, Sociology or related fields.

Experience:

• Experience with result-based monitoring and evaluation methodologies for at least 5 years;
• Experience working with project evaluations for at least 5 years;
• Experience working in Malaysia, South-East Asian or Asia-Pacific region;
• Technical knowledge in Orang Asli/Asal and traditional knowledge for at least 5 years.

Language:

• Excellent command of English and Malay.

Documents to be included when submitting the proposals:

Interested individual applicants must submit the following documents/information to demonstrate their qualifications:

1. Completed Letter of Confirmation of Interest and Availability (Annex 1) provided by UNDP;
2. Technical Proposal on how your qualifications and experience can lead towards the successful deliverable of this assignment within the required timeframe, and provide a detailed methodology on how you will approach and conduct the assignment;
3. Financial Proposal should specify a total lump sum amount including a breakdown of working days, travel and relevant costs using the financial proposal template in Annex 2;
4. Personal CV including areas of expertise and past experience in similar projects and at least three (3) references. 

Criteria for Selection of the Best Offer:

The award of the contract will be made to the Individual Consultant who has obtained the highest Combined Score and has accepted UNDP’s General Terms and Conditions.  Only those applications which are responsive and compliant will be evaluated. The offers will be evaluated using the “Combined Scoring method” where:

• Technical proposal including educational background and experience on similar assignments will be weighted a max. of 70%. The evaluation criteria are:
• Financial proposal will weigh as 30% of the total scoring.

UNDP applies a fair and transparent selection process that will take into account the competencies/skills of the applicants as well as their financial proposals. Qualified women and members of social minorities are encouraged to apply.

How to Apply:

• Kindly download the Letter of Confirmation of interest and availability, Financial Proposal Template, P11 form and General Terms & Conditions mentioned below;
• Read and agree to the General Terms & Conditions;
• Click the ‘apply’icon and complete what is required;
• Scan all documents into 1 pdf folder and then upload;
• For clarification question, please email to procurement.my@undp.org. The clarification question deadline is three (3) days before the closing. When emailing for clarification questions, please put "MYC18019" as the subject matter.

Forms and General terms & conditions to be downloaded:

• The Letter of Confirmation of Interest and Financial Proposal Template at: http://www.my.undp.org/content/dam/malaysia/docs/Procurement/MyIC_2018_019%20Template.docx
• The General Terms & Conditions for Individual contract is available at:http://www.my.undp.org/content/dam/malaysia/docs/Procurement/General%20Conditions%20of%20Contract%20for%20IC.pdf?download
• The General Terms & Conditions for Reimbursement Loan Agreement is available at:http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Reimbursable%20Loan%20Agreement%20_%20Terms%20&%20Conditions.pdf?download