Historique
BRESL as a regional project is aimed at rapidly accelerating the adoption and implementation of energy standards and labels (ES&L) in Asia, and in so doing bring about energy savings from the use of energy efficient appliances/equipment. The project also facilitates harmonization of test procedures, standards and labels among developing countries in Asia, when appropriate, starting with the six countries, Bangladesh, China, Indonesia, Pakistan, Thailand and Vietnam as BRESL Participating Countries (PCs). The scope of the whole evaluation is at the national and regional level.
The Goal of the project is the reduction of GHG emissions from thermal power generation in selected Asian countries.
The Objective of the project is to Removal of barriers to the successful implementation of energy standards and labeling policies and programs in Asia.
In order to achieve the project Objective, the project consists of five outcomes, which is mutually supportive from each other.
- Outcome 1: Establishment of legal and regulatory basis for removing lowest technologies from the market and promoting high-efficiency technologies;
- Outcome 2: Building of institutional and individual capacity to secure on-the-ground implementation of regulatory frameworks, as well as actual standards and labeling programs;
- Outcome 3: Provision of information and technical assistance to manufacturers of covered products;
- Outcome 4: Regional cooperation and information sharing on-going and helps to maximize impacts;
- Outcome 5: Demonstration of various aspects of the development and implementation of ES&L programs.
The TE will be conducted according to the guidance, rules and procedures established by UNDP and GEF as reflected in the UNDP Evaluation Guidance for GEF Financed Projects.
The objectives of the evaluation are to assess the achievement of project results, and to draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming.
The overall approach and method for conducting project terminal evaluations of UNDP supported GEF financed projects have developed over time. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Guidance for Conducting Terminal Evaluations of UNDP-supported, GEF-financed Projects. A set of questions covering each of these criteria have been drafted and are included with this TOR as seen in Annex A. The evaluator is expected to amend, complete and submit this matrix as part of an evaluation inception report, and shall include it as an annex to the final report.
The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator team is composed of a lead international consultant (IC) and a national consultant (NC) for each of the 6 PCs. This is also referred to as the TE Team. The TE Team is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular the GEF operational focal point, UNDP Country Office, project team, UNDP GEF Regional Technical Adviser based in Bangkok and the key stakeholders. The NCs hired for the PCs are expected to conduct national evaluation in Dhaka, Bangladesh; Beijing, China; Jakarta, Indonesia; Islamabad, Pakistan; Bangkok, Thailand and Hanoi, Vietnam. The NCs will undertake a thorough data gathering and analysis of performance and progress in achieving outputs and outcomes and submit the result of their evaluation to the IC with a copy to RPMU. The IC in coordination with RPMU will determine which PCs will be visited by the IC based on the existence of implementation issues and adequacy of data and information to make a proper TE.
Interviews will be held with the following organizations and individuals and their respective key national partners/stakeholders at a minimum:
- China National Development and Reform Commission (NDRC);
- Bangladesh Standards and Testing Institute (BSTI);
- China National Institute of Standardization (CNIS);
- Indonesia DG of New and Renewable Energy and Energy Conservation (DGNRE-EC);
- Pakistan National Energy Conservation Center (ENERCON)/ Ministry of Water & Power;
- Thailand Greenhouse Gas Management Organization (TGO);
- Ministry of Industry, Vietnam (MOIT).
The TE Team will review all relevant sources of information, such as the project document, project reports – including Annual APR/PIR, project budget revisions, midterm review, progress reports, and GEF focal area tracking tools, project files, national strategic and legal documents, and any other materials that the evaluator considers useful for this evidence-based assessment. A list of documents that the project team will provide to the evaluator for review is included in Annex B of this Terms of Reference.
Devoirs et responsabilités
Implementation Arrangements
The principal responsibility for managing this evaluation resides with the UNDP CO in (Bangladesh/ China/ Indonesia/Pakistan/Thailand/Vietnam). The respective UNDP CO in each Participating Country will contract the evaluators (in close coordination with the Country Team), ensure independence of the evaluation process and manage the timely submission of the expected deliverables and reports and the provision of per diems and travel arrangements within the country for the evaluation team. The Country Team will be responsible for liaising with the TE team to provide the necessary data/information inputs, set up stakeholder interviews, arrange field visits, coordinate with the Government, and other requirements that are necessary for the effective conduct of the evaluation.
In view of the regional scope of the BRESL Project, the UNDP CO in each of the Participating Country will be look after the overall conduct of the evaluation with UNDP CO in China acting as lead CO.
The following is suggested to be the basic procedure in conducting the evaluation:
- An International Consultant (IC) will be engaged to lead and conduct the TE process in close coordination with a National Consultant (NC) appointed by each Country Team (CT) in each of the 6 Participating Countries (PCs) following the M&E principles and procedures for UNDP/GEF-funded projects. The IC will be assisted by an NC-Regional to be hired by UNDP China. The IC, NC-Regional and the 6 NCs will form the TE Team. The TE Team will coordinate very closely with RPMU, CTs and UNDP COs;
- At the national level, the NCs will complete document review, data gathering and analysis and submit report on initial findings, recommendations, lessons learned and best practices as well as summaries of financial evaluation and outcome (energy saving and GHG reduction) analysis and results. At this stage, the NC report is referred to as the initial national level findings report based on the format issued by the IC for the purpose. The report will be submitted to the IC with copies to CT Head, UNDP CO in the PC and RPMU;
- At the same time with Item #2, at the regional level, the IC and the NC-Regional will also conduct the TE of the regional activities, performance and achievement of targets as indicated in the PPM at the regional level in close coordination with the RPMU. The IC and the NC-Regional will complete document review, data gathering and analysis and submit report on initial findings, recommendations, lessons learned and best practices as well as summaries of financial evaluation and outcome (energy saving and GHG reduction) analysis and results. At this stage, the IC/NC-Regional report is referred to as the initial regional level findings report;
- The IC will review the 6 initial national level findings reports prepared and submitted by the NCs prior to the IC Evaluation Mission to the PCs. Particularly, the IC should;
- Check on the veracity of the info/data provided in the NC reports (maybe do a telecon/Skype/Viber call with the NC) on this;
- Identify missing information/data and coordinate the data gathering on these prior to or during the IC’s visit in the country. The Activities Inventory that were prepared for each PC will be useful for this purpose;
- Check the consistency of the reported outputs and achievements based on the PC’s BRESL ProDoc, and also on the documented agreed changes as reported to the RPMU and approved by the PC PSC, as well as consistency with the info reflected in the PIR reports;
- Discuss with NC any issues that have to be addressed (including related to mission activities) and come up with solutions before conducting the mission;
- Evaluate the rationale behind the CO2 emission reductions that are being reported in each NC report. Discuss with the NC the actions to be taken to carry out the evaluation of the GHG emission reductions that are attributable to the national BRESL activities.
The IC/NC-Regional will also refer to the consolidated regional PIR 2014 and the 6 national PIRs 2014 submitted by the CTs to RPMU and other reports, documents and relevant references to support the performance and actual achievement of targets in connection with the BRESL Project Planning Matrix (PPM) at the national and regional levels. The IC will communicate with the NCs about his/her comments on the initial national level findings reports and advise them on how to complete the findings/recommendations and the data needed from the NCs through email communications as inputs to the Overall TE Report. In this connection, the IC/NC-Regional will prepare for and coordinate the completion of the data requirement for the Overall TE Report according to the agreed outline and contents described in the Terms of Reference (TOR) for this TE activity as approved by the UNDP RTA.
The IC, in coordination with RPMU, will determine which PCs will be visited by the IC based on the existence of implementation issues and adequacy/consistency of data and information to make a proper TE. The IC will then visit selected PCs (a) to validate the NC’s initial national findings and recommendations reports, (b) check on completeness of all data required for TE Report, (c) interview key project officials, (d) visit pre-identified key project sites, (e) complete data gaps, (f) verify the proposed GHG emission reductions that are attributable to the BRESL national activities; (g) document evidences of the impacts of the BRESL national activities; and (h) respond to comments during the TE report review by UNDP and its finalization. The duration of the trip for each PC will be at least three (3) days each depending on extent of validation and data completion required to be coordinated by the UNDPCO and CT in the PC.
The IC will consolidate and prepare the overall TE Report based on the validated project accomplishments and progress in achieving the expected outcomes for the 6 PCs at the national level and the TE report of the regional activities using the agreed format in the TOR as approved by the UNDP RTA. Please see Annex E for the TE Report Outline. The draft of the overall TE Report shall be submitted by the IC on behalf of the TE Team to the UNDP RTA, the UNDP China CO (being the Lead CO) and BRESL CT Heads.
The UNDP RTA, the UNDP China CO through the Energy and Environment Group overseeing the BRESL Project and BRESL CT Heads shall provide comments on the draft overall TE Report.
The IC in close coordination with the NCs and CTs will document the responses to the comments, further clarification and final resolutions of issues raised and incorporate them in the TE Report to come up with the final overall TE Report to be submitted by the IC to UNDP China CO as lead CO for the project and then to the UNDP RTA for the final version of the TE Report.
The TE Report will be deemed finally accepted if there are no longer comments on the report by December 31 2014.
Evaluation Timeframe
The total equivalent work-days needed for the evaluation starting from the Notice of Hiring date of the IC and NCs will be 30 days and 20 days, respectively, according to the following plan for the evaluation period starting November to December, 2014:
- Preparation for 3 working days to be completed on December 1, 2014;
- Evaluation mission for 20 working days to be completed on December 16, 2014;
- Draft evaluation report for 5 working days to be completed on December 31, 2014;
- Final report for 2 working days to be completed on Janaury 15, 2014.
Evaluation Deliverables
The evaluation team is expected to deliver the following:
- Inception report providing clarifications on timing and method no later than 1 week before the evaluation mission;
- Presentation on initial findings at the end of evaluaton mission;
- Draft final report within 1 week after the evaluation mission;
- Final report within 1 week of receiving UNDP comments on draft.
The International Consultant shall be responsible for completing and delegating tasks as appropriate for the Terminal Evaluation to the National Counterpart. He/she will ensure the timely submission of the first draft and the final version of the Terminal Evaluation Report with incorporated comments from UNDP and others.
Payment Modalities and Specifications:
- 10% at contract signing;
- 40% following submission and approval of the 1st draft terminal evaluation report;
- 50% following submission and approval (UNDP CO and RPMU) of the final terminal evaluation report.
Compétences
Functional Competencies:
- Demonstrated ability to assess complex situations, succinctly, distils critical issues, and draw forward-looking conclusions and recommendations;
- Ability and experience to lead multi-disciplinary and national teams, and deliver quality reports within the given time;
- Familiar with developing countries context or regional situations relevant to that of the Participating Countries;
- Comprehensive knowledge of international Energy Efficiency (EE)/ Renewable Energy (RE) industry best practices.
Qualifications et expériences requises
Education:
- Post-Graduate in Engineering, Management or Business.
Experience:
- Minimum of ten years accumulated and recognized experience in energy efficiency and climate change projects;
- At least 3 years technical experience in power generation and/or cogeneration engineering or operations;
- Experience with multilateral and bilateral supported EE and climate change projects;
- Technical experience in the application of microturbines in power generation and/or cogeneration and/or Microturbine Cogeneration Technology is advantageous as well as;
- Minimum of five years of project evaluation and/or implementation experience in the result-based management framework, adaptive management and UNDP or GEF Monitoring and Evaluation Policy.
Education:
- Very good reports writing and presentation skills in English.
Application Process
Applicants are requested to apply online (indicate the site, such as http://jobs.undp.org, etc.) by October 10. Individual consultants are invited to submit applications together with their CV for these positions. The application should contain a current and complete C.V. in English with indication of the e-mail and phone contact. The candidates will be requested to submit a price offer indicating the total cost of the assignment (including daily fee, per diem and travel costs) following the prescribed format in Annex F.
UNDP applies a fair and transparent selection process that will take into account the competencies/skills of the applicants as well as their financial proposals. Qualified women and members of social minorities are encouraged to apply.
Please find the full copy of Terms of Reference from the link below: