Background

In accordance with UNDP and GEF M&E policies and procedures, all full and medium-sized UNDP support GEF financed projects are required to undergo a terminal evaluation upon completion of implementation. These terms of reference (TOR) sets out the expectations for a Terminal Evaluation (TE) of the Energy Efficiency Improvements in the Indian Brick Industry (PIMS 3465).

The project was designed with the goal to reduce energy consumption, and restrict GHG emissions by creating appropriate infrastructure for sustained adoption of new and improved technologies for production and use of resource efficient bricks in India.

The objectives of the project are:

  • To demonstrate REB technologies and develop technology models (supply side);
  • To build awareness and develop sustainable markets for REBs among various stakeholders such as builders, architects, individual end-users (demand side);
  • To influence government organizations, financial institutions and policy and decision makers.

Project’s envisaged outcomes are:

  1. Enhancing public sector awareness on resource-efficient products;
  2. Access to finance for brick kiln entrepreneurs;
  3. Improved knowledge on technology, including marketing;
  4. Availability of resource efficient technology models in 5 clusters through Local Resource Centres;
  5. Improved capacity of brick kiln entrepreneurs.

Duties and Responsibilities

Evaluation approach and Method

An overall approach and method for conducting project terminal evaluations of UNDP supported GEF financed projects have developed over time. The evaluation should include a mixed methodology of document review, interviews, and observations from project site visits, at minimum, and the evaluators should make an effort to triangulate information. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Guidance for Conducting Terminal Evaluations of UNDP-supported, GEF-financed Projects. The international consultant will be the team leader and coordinate the evaluation process to ensure quality of the report and its timely submission. The national consultant will provide supportive roles both in terms of professional back up, translation etc. The evaluation team is expected to become well versed as to the project objectives, historical developments, institutional and management mechanisms, activities and status of accomplishments. Information will be gathered through document review, group and individual interviews and site visits.

A set of questions covering each of these criteria have been drafted and are included with this TOR (Annex C) The evaluator is expected to amend, complete and submit this matrix as part of an evaluation inception report, and shall include it as an annex to the final report.

The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular the GEF operational focal point, UNDP Country Office, project team, UNDP GEF Technical Adviser based in the region and key stakeholders. The evaluator is expected to conduct a field mission to various project stakeholder locations viz. Delhi, Bangalore, Chandigarh, Varanasi, etc, including the following project field sites viz. Amritsar-Jalandhar, Chandigarh, Malur, etc. Interviews will be held with the following organizations and individuals at a minimum but not limited to:

  • Relevant personnel at UNDP Country Office in New Delhi, India and Program Officer in-charge of the Project
  • National Project Director (NPD)
  • National Project Coordinator (NPC)
  • Project Management Unit (PMU)
  • Local Resource Centers (LRCs)
  • Relevant project stakeholders like brick industry association, brick kiln entrepreneurs, financial institutions, technology suppliers etc.

The evaluator will review all relevant sources of information, such as the project document, mid-term review (MTR) report, project reports – including Annual APR/PIR, project budget revisions, midterm review, progress reports, GEF focal area tracking tools, project files, national strategic and legal documents, and any other materials that the evaluator considers useful for this evidence-based assessment. A list of documents that the project team will provide to the evaluator for review is included in Annex B of this Terms of Reference.

Evaluation Criteria & Ratings

An assessment of project performance will be carried out, based against expectations set out in the Project Logical Framework/Results Framework (see Annex A), which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation will at a minimum cover the criteria of: relevance, effectiveness, efficiency, sustainability and impact. Ratings must be provided on the following performance criteria. The completed table must be included in the evaluation executive summary. The obligatory rating scales are included in Annex D.

For additional information on methods, see the Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 7, pg. 163

Project Finance / Cofinance

The Evaluation will assess the key financial aspects of the project, including the extent of co-financing planned and realized. Project cost and funding data will be required, including annual expenditures. Variances between planned and actual expenditures will need to be assessed and explained. Results from recent financial audits, as available, should be taken into consideration.

Conclusions, recommendations & lessons

The evaluation report must include a chapter providing a set of conclusions, recommendations and lessons. Conclusions should build on findings and be based in evidence. Recommendations should be prioritized, specific, relevant, and targeted, with suggested implementers of the recommendations. Lessons should have wider applicability to other initiatives across the region, the area of intervention, and for the future.

Implementation arrangements

The principal responsibility for managing this evaluation resides with the UNDP CO in (New Delhi). The UNDP CO will contract the evaluators and ensure the timely provision of per diems and travel arrangements within the country for the evaluation team. The Project Team will be responsible for liaising with the Evaluators team to set up stakeholder interviews, arrange field visits, coordinate with the Government etc.

Throughout the period of evaluation, the evaluation team will liaise closely with the Programme Officer/ Adviser/Project Manager, the concerned agencies of the Government, any members of the international team of experts under the project and the counterpart staff assigned to the project. The team can raise or discuss any issue or topic it deems necessary to fulfill its task, the team, however, is not authorized to make any commitments to any part on behalf of UNDP/GEF or the Government.

Logistics

The evaluation team will conduct a mission visit to New Delhi and selected project sites, to meet with relevant project stakeholders. This visit will also include meetings with the officials of UNDP, the Implementing Partner, stakeholders from other institutions and ministries related to the project.

After the initial briefing by UNDP CO, the review team will meet with the National Project Director (NPD), National Project Coordinator (NPC) and the GEF Operational Focal Point as required.

Team Composition

The evaluation team will be composed of 2 consultants (1 international /1 national evaluators). The international consultant will be designated as the Team Leader and will be responsible for finalizing the report. The consultants shall have prior experience in evaluating similar projects. Experience with GEF financed projects is an advantage. The evaluators selected should not have participated in the project preparation and/or implementation and should not have conflict of interest with project related activities.

The evaluation team shall conduct debriefing for the UNDP Country Office, NPD, NPC, Project Management Unit, and UNDP BRH in India towards the end of the evaluation mission. The international consultant shall lead presentation of the draft review findings creating the recommendations, and shall lead the drafting and finalization of the terminal evaluation.

Evaluator Ethics

Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct (Annex E) upon acceptance of the assignment. UNDP evaluations are conducted in accordance with the principles outlined in the UNEG 'Ethical Guidelines for Evaluations'

Competencies

  • Highly knowledgeable of participatory monitoring, review and evaluation processes, and experience in review and evaluation of technical assistance projects with major donor agencies;
  • Familiar with energy efficiency policies / conditions in India and abroad through management and / or implementation or through consultancies in review and evaluation of donor funded projects;
  • Understanding of CO2 emission reduction calculations (including IPCC, GEF procedure), especially from the energy audit and implementation of its recommendations, that contribute to global benefits;
  • Familiar with GEF rules, regulations and project reviews and evaluations;
  • Demonstrated ability to assess complex situations, succinctly, distil critical issues, and draw forward-looking conclusions and recommendations;
  • Ability and experience to lead multi disciplinary and national teams, and deliver quality reports within the given time;
  • Writing and communication will be in English, and he/she must have excellent communication skills in English. 

Required Skills and Experience

Education:

  • Post Graduation in Science / Engineering.

Experience:

  • Professional background in project evaluation of renewable energy, energy efficiency and climate change mitigation project is essential;
  • Experience in evaluating projects on small scale industries, energy efficiency, specifically in the brick or construction sector is desirable;
  • A minimum of 15 years of relevant experience in monitoring and evaluating donor driven projects (preferably GEF, World Bank, or UN).

Language:

  • Writing and communication will be in English, and he/she must have excellent communication skills in English;
  • Working knowledge of Hindi is desirable.

Payment Schedule:

  • 10% on submission and approval of the TE inception report;
  • 30% on submission and approval of the 1st draft terminal evaluation report;
  • 60% on submission and approval (UNDP-CO and UNDP RTA) of the final terminal evaluation report and GHG Tracking Tool.

Evaluation Criteria:

Cumulative analysis

The award of the contract shall be made to the individual consultant whose offer has been evaluated and determined as:

  • Responsive.

Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation.

Only candidates obtaining a minimum of 49 points (70% of the total technical points) would be considered for the Financial Evaluation.

  • Technical Criteria weight - 70%;
  • Financial Criteria weight - 30%.

Technical:

  • Qualification of the Consultant: 20 Marks;
  • Relevant work Experience: 30 Marks;
  • Proposed Work Plan for undertaking the task: 15 Marks;
  • Time Line for completion of the Task: 5 Marks.

Detailed ToR can be accessed at the following link:

http://www.in.undp.org/content/dam/india/docs/procurement/TOR%20Terminal%20Evaluation%20GEF%20-%20International%20Consultant.docx

Documents to be submitted by Consultants

  • Offeror’s Letter to UNDP Confirming Interest and Availability for the Individual Contractor Assignment
  • Updated and signed P-11 form for ICs
  • Proposed work methodology with timeline - (no standard format)
  • Updated CV with contact details of three references.

Above documents can be found in ‘Forms and Documentation for Individual Contractor’ column in career section. Please find link below:

http://www.in.undp.org/content/india/en/home/operations/careers/

Please note following components have to be covered while giving financial proposal:

  • Per day consultancy fee;
  • Rates for one flight ticket for Home Station-New Delhi-Home station, please note it has to be economy class only.

NOTE: UNDP will reimburse or pay for all local travel, accommodation and food costs during the mission as per actuals.

Notes:

  • Any kind of miscellaneous charges i.e. internet, phone etc. would not be reimbursed;
  • Individuals working with institutions may also apply, contract would be issued in the name of institution for the specific services of individual;
  • Please note proposals without financial proposal will not be considered;
  • CV, Financial proposal and proposed work plan can be clubbed in one file for uploading;
  • The consultants must bring his/her own computing equipment.

Important:

Kindly ensure that all the requested documents are combined in a single PDF document before uploading as the system has provision for uploading only one file. 

Inquiries: