Antecedentes

In accordance with 2016 UNDP Evaluation Policy, UNDP Country Office in Malaysia is commissioning a terminal evaluation upon completion of a UNDP-supported Government-financed project implementation under the Country Programme Action Plan (CPAP) 2016 – 2020. This terms of reference (TOR) sets out the expectations for a Terminal Evaluation (TE) of the project titled Implementing the National Sustainable Consumption and Production Blueprint through Government Green Procurement (SCP-GGP).

 

The details of the SCP-GGP project to be evaluated are as follows:  

Project Summary Table

Project Title:

Implementing the National Sustainable Consumption and Production Blueprint through Government Green Procurement (SCP-GGP)

 

ATLAS Project ID:

00094672

 

at endorsement (US$)

at completion (US$)

ATLAS Output ID:

00098761

Government financing (government cost-sharing):

374,920

To be confirmed (TBC) during TE

Country:

Malaysia

UNDP TRAC:

25,080

TBC during TE

Region:

Asia

Other:

250,000 (in-kind contribution)

100,000 (donors/private sector)

TBC during TE

CPAP Outcome:

2.0 Implementation of a national development agenda that enables green growth through climate-resilient measures, sustainable management of energy and natural resources, and improved risk governance.

Total co-financing:

350,000

TBC during TE

11th Malaysia Plan Linkage:

Strategic Thrust 4: Pursuing Green Growth for Sustainability and Resilience

Focus Area B: Adopting the Sustainable Consumption and Production Concept

Strategy B1: Creating Green Markets

Total Project Cost (government + UNDP):

400,000

TBC during TE

Implementing Partner:

Environment and Natural Resource Economics Section, Economic Planning Unit, Prime Minister’s Department Malaysia

Project Document (ProDoc) Signature

(date project began):

6 July 2018

(Operational) Closing Date:

Proposed:

31 December 2020

Actual:

31 December 2020

 

(Operational) Closing Date:

Proposed:

31 December 2020

Actual:

31 December 2020

 

 

 

Deberes y responsabilidades

OBJECTIVE & SCOPE

The project was designed to provide incremental support that will lead to the full adoption and implementation of the National Sustainable Consumption and Production (SCP) Blueprint, particularly through SCP Pathway 1 Government Green Procurement (GGP); to achieve the 11th Malaysia Plan’s target of 20% of selected groups of products and services in government procurement to be green procurement by year 2020. The project has three main outputs namely:

 

  1. Enabling policy and institutions institutionalized for National SCP Blueprint and GGP implementation.
  2. Technical and institutional capacity for SCP and GGP built and enhanced, particularly government procurement practitioners and industry players such as Small and Medium Enterprise (SME).
  3. Best practices of GGP are demonstrated by developing and piloting product criteria, guidelines and standard operating procedures in construction sector, and monitoring & evaluation system.

 

These outputs will in turn contribute to the achievement of the 11th Malaysia Plan Strategic Thrust 4 Pursuing Green Growth for Sustainability and Resilience, and Country Programme Action Plan 2016 – 2020 between Government of Malaysia and UNDP – Outcome 2 Enhancing national resiliency to climate variability and change.

 

The TE will be conducted according to the guidance, rules and procedures established by UNDP as reflected in the UNDP Evaluation Guidelines.  

 

The objectives of the evaluation are to assess the achievement of project results, and to draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming.  

 

EVALUATION APPROACH AND METHOD

An overall approach and method[1] (For additional information on methods, see the Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 7, pg. 163) for conducting project terminal evaluations of UNDP supported projects has developed over time. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Evaluation Guidelines (http://web.undp.org/evaluation/guideline/) and UNDP Guidance for Conducting Terminal Evaluations of  UNDP-supported, GEF-financed Projects. The National Consultant cum Evaluator is expected to prepare, amend, complete and submit a set of questions covering each of these criteria in consultation with UNDP Malaysia Country Office; as part of  an evaluation inception report, and shall include it as an annex to the final report. 

The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular, Economic Planning Unit – the implementing partner, UNDP Country Office, project team, and key stakeholders. Interviews will be held with the following organizations and individuals at a minimum:

  • Environment and Natural Resource Economics Division, Economic Planning Unit at the Prime Minister’s Department
  • Ministry of Finance Malaysia
  • Ministry of Environment and Water (KASA)
  • Ministry of Energy and Natural Resources (KeTSA)
  • Malaysia Green Technology and Climate Change Centre (MGTC)
  • Public Works Department (JKR)
  • Universiti Technology MARA (UiTM)
  • Institute of Strategic and International Studies (ISIS) Malaysia

The evaluator will review all relevant sources of information, such as the project document, project reports – including Mid-Year Progress Report, Annual Progress Report, project budget revisions, project files, national policy and strategic documents, and any other materials that the evaluator considers useful for this evidence-based assessment. A list of documents that the project team will provide to the evaluator for review is included in Annex A of this Terms of Reference.

 

EVALUATION CRITERIA & RATINGS

An assessment of project performance will be carried out, based against expectations set out in the Project Logical Framework/Results Framework in the Project Document (which is available at https://open.undp.org/projects/00094672), which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation will at a minimum cover the criteria of: relevance, effectiveness, efficiency, sustainability and impact. Ratings must be provided on the following performance criteria. The completed table must be included in the evaluation executive summary.   The obligatory rating scales are included in Annex B.

 

Evaluation Ratings:

1. Monitoring and Evaluation

rating

2. IA& EA Execution

rating

M&E design at entry

     

Quality of UNDP Oversight and Quality Assurance (QA)

     

M&E Plan Implementation

     

Quality of Implementing Partner’s Execution

     

Overall quality of M&E

     

Overall quality of Oversight & QA and Execution

     

3. Assessment of Outcomes

rating

4. Sustainability

rating

Relevance

     

Financial resources:

     

Effectiveness

     

Socio-political:

     

Efficiency

     

Institutional framework and governance:

     

Overall Project Outcome Rating

     

Environmental:

     

 

 

Overall likelihood of sustainability:

     

 

 

PROJECT FINANCE/ CO-FINANCE

The Evaluation will assess the key financial aspects of the project, including the extent of co-financing planned and realized. Project cost and funding data will be required, including annual expenditures.  Variances between planned and actual expenditures will need to be assessed and explained.  Results from recent financial audits, as available, should be taken into consideration. The evaluator will receive assistance from the Country Office (CO) and Project Team to obtain financial data in order to complete the co-financing table below, which will be included in the terminal evaluation report. 

Co-financing

(type/source)

UNDP financing (TRAC) (US$)

Government Cost-Sharing

(US$)

Others

(US$)

 

Total

(US$)

Planned

Actual

Planned

Actual

Planned

Actual

Actual

Actual

Grants

 

 

 

 

 

 

 

 

In-kind contribution

 

 

 

 

 

 

 

 

Other

 

 

 

 

 

 

 

 

Total

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

MAINSTREAMING

UNDP supported projects are key components in UNDP country programming, as well as regional and global programmes. The evaluation will assess the extent to which the project was successfully mainstreamed with other UNDP priorities, including poverty alleviation, improved governance, the prevention and recovery from natural disasters, and gender.

 

IMPACT

The evaluator will assess the extent to which the project is achieving impacts or progressing towards the achievement of impacts. Key findings that should be brought out in the evaluations include whether the project has demonstrated: a) verifiable improvements in the implementation of the National Sustainable Consumption and Production Blueprint through government green procurement, and b) demonstrated progress towards these impact achievements.

 

Conclusions, recommendations & lessons

The evaluation report must include a chapter providing a set of conclusions, recommendations and lessons

 

 

IMPLEMENTATION ARRANGEMENTS

The principal responsibility for managing this evaluation resides with the UNDP Country Office (CO) in Malaysia. The UNDP CO will contract the evaluator and ensure the timely coordination of meeting arrangements within the country for the evaluator. The Project Team will be responsible for liaising with the Evaluator to set up stakeholder interviews, arrange meetings, coordinate with the Government etc. 

 

EVALUATION TIMEFRAME

The total duration of the evaluation will be 30 days according to the following plan:

Activity

Timing

Completion Date

Preparation including TE Inception Report with detailed work plan

5 days

18 December 2020

Evaluation Mission

10 days

15 January 2021

Draft Evaluation Report

12 days

31 January 2021

Final Report

3 days

12 February 2021

 

EVALUATION DELIVERABLES

The evaluation team is expected to deliver the following:

Deliverable

Content

Timing

Responsibilities

Inception Report including detailed work plan

Evaluator provides clarifications on timing and method

No later than 2 weeks before the evaluation mission.

Evaluator submits to UNDP CO

Presentation

Initial Findings

End of evaluation mission

To project management and UNDP CO

Draft Final Report

Full report, (per annexed template) with annexes

Within 3 weeks of the evaluation mission

Sent to CO for review

Final Report*

Revised report

Within 1 week of receiving UNDP comments on draft

Sent to CO for uploading to UNDP ERC.

*When submitting the final evaluation report, the evaluator is required also to provide an 'audit trail', detailing how all received comments have (and have not) been addressed in the final evaluation report.

 

PAYMENT SCHEDULE

%

Milestone

20%

Following submission and approval of the detailed work plan and inception report by UNDP CO

50%

Following submission and approval of the 1st draft terminal evaluation report by UNDP CO

30%

Following submission and approval of the final terminal evaluation report by UNDP CO

 

Competencias

Corporate competencies

  • Commitment to UNDP’s mission, vision, values and ethical standards
  • Sensitivity to cultural, gender, religion, race, nationality and age differences
  • Treat all stakeholders fairly and without prejudice
  • Maintains objectivity and impartiality in handling evaluation processes

 

Functional competencies

  • Experience in project development, implementation and evaluation particularly in directly managing results-based monitoring and evaluation methodologies
  • Demonstrated experience in conducting evaluation of multi-year and multi-component programmes and projects
  • Familiarity with the norms and issues in sustainable consumption and production
  • Demonstrated strong coordination and facilitation skills
  • Strong interpersonal skills and the ability to initiate discussions with national/local governmental officials, civil society organizations and communities
  • Demonstrated ability to function in a team environment and to deal with complex multi-stakeholder environment
  • Demonstrated ability to prepare and present comprehensive reports

Habilidades y experiencia requeridas

The National Consultant shall have prior experience in evaluating similar projects.  Experience with UNDP-supported projects is an advantage. The evaluator selected should not have participated in the project preparation and/or implementation and should not have conflict of interest with project related activities. The evaluator must present the following qualifications:

 

Education:

  • Minimum 10 years of relevant professional experience in the field of environment (10 points);

 

Experience:

  • Minimum 5 years of experience with results-based monitoring and evaluation methodologies (25 points);
  • Technical knowledge in the sustainable consumption and production, sustainable and/or green procurement, circular economy, green economy/growth, etc. (25 points);
  • Knowledge of UNDP and Government of Malaysia (10 points).

 

Language:

Language required for this assignment is English and Malay.

 

EVALUATOR ETHICS

Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct (Annex C to be provided by UNDP) upon acceptance of the assignment. UNDP evaluations are conducted in accordance with the principles outlined in the UNEG 'Ethical Guidelines for Evaluations'

 

DOCUMENTS TO BE INCLUDED WHEN SUBMITTING THE PROPOSALS

Interested individual applicants must submit the following documents/information to demonstrate their qualifications:

  1. Document 1 : Letter of Confirmation of Interest and Availability at  http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Letter%20of%20Interest%20_Annex%201.docx?download;
  2. Document 2: Technical Proposal: on how your qualifications, experience and list of track records can lead to successful deliverables of this assignment within the required timeframe, and provide a methodology and approach on how you will approach and conduct the assignments; and 
  3. Document 3: Financial Proposal at https://www.my.undp.org/content/dam/malaysia/docs/Procurement/Financial Proposal Template (Daily Fee) - MYR.doc .All inclusive and takes into account various expenses the candidate expects to incur during the contract, including:
    • The daily professional fee;
    • The cost of travel from the home base to the duty station (UNDP Office, Putrajaya) and vice versa;
    • Communications, utilities and consumables; and
    • Life, health and any other insurance.
  4. Document 4: Personal CV or P11 including areas of expertise and past experiences in similar projects and at least three (3) references at http://www.my.undp.org/content/dam/malaysia/docs/Procurement/P11%20for%20SC%20&%20IC.doc?download
  5. Please submit this information in one file as Document 1, 2, 3 and 4.The system will only accept one attachment , please merge all documents and submit as one file.
  6. Applicants must reply to the mandatory questions asked by the system when submitting the application.
  7. Candidates who fail to submit all the information requested above will be disqualified.


How to Apply:

  • Kindly download the Letter of Confirmation of interest and availability, Financial Proposal Template and General Terms & Conditions mentioned below;
  • Read and agree to the General Terms & Conditions (refer to below link);
  • Click the ‘apply’ icon and complete what is required;
  • Scan all documents into 1 pdf folder and then upload;
  • For clarification question, please email to procurement.my@undp.org. The clarification question deadline is three (3) days before the closing. When emailing for clarification questions, please put "MyIC/2020/063"as the subject matter.

 

General terms & conditions to be downloaded:

Reimbursable Loan Agreement (RLA): A legal instrument between UNDP and a Company/institution, according to which, the latter makes available the services of an individual delivering time-bound and quantifiable outputs that are directly linked to payments

 

ANNEXES 

1.  Annex A: List of Documents to be received by the Evaluators, http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex A List of Documents to be revieced by the Evaluators.pdf

2.  Annex B: Rating Scales, http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20B%20Rating%20Scales.pdf

3.  Annex C: Evaluation Consultant Code of Conduct and Agreement Form      http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex C Evaluation Consultant Code of Conduct and Agreement Form.pdf

4.  Annex D: Evaluation Report Outline,  http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20D%20Evaluation%20Report%20Outline.pdf 

5.  Annex E: Evaluation Report Clearance Form. http://www.my.undp.org/content/dam/malaysia/docs/Procurement/Annex%20E%20Evaluation%20Report%20Clearance%20Form.pdf

 


EVALUATION METHOD AND AWARD OF CONTRACT

  • Only those applications which are responsive and compliant will be shortlisted for technical evaluation;
  • Offers will be evaluated according to the Combined Scoring method – where the technical criteria will be weighted at 70% and the financial offer will be weighted at 30%;
  • The technical criteria including education, experience and written test will be based on a maximum 70 points. Only the top 3 candidates scoring 50 points or higher from the technical proposal review will be considered for financial evaluation;
  • Financial score (max 30 points) shall be computed as a ratio of the proposal being evaluated and the lowest priced proposal of those technically qualified;
  • The financial proposal shall specify an all-inclusive fee and including breakdown per deliverable and all costs components required to perform the deliverables identified in the TOR, including professional fee, in-country travel costs, living allowance and any other applicable cost to be incurred by the National Consultant in completing the assignment.  In order to assist the requesting unit in the comparison of financial proposals, the financial proposal must additionally include a breakdown of this daily fee (including number of anticipated working days and all foreseeable expenses to carry out the assignment);
  • Applicant receiving the Highest Combined Score and has accepted UNDP’s General Terms and Conditions will be awarded the contract.

 

UNDP is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, aboriginal groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.