Background

This is the Terms of Reference (ToR) has been produced for the Terminal Evaluation (TE) of GEF project tilted as ‘National Capacity Development for Implementing Rio Conventions through Environmental Governance Project (PIMS# 4884)’ which is to be under taken in April 2019. The project is being implemented by Department of Environment, Ministry of Environment, Forest and Climate Change (MoEFCC). The project started in November 2016 and currently in its last year of implementation. This ToR sets out the expectations from the TE. The TE must be carried according to the guidance outlined in “Guidance For Conducting Terminal Evaluations of UNDP-Supported, Gef-Financed Projects (http://web.undp.org/evaluation/documents/guidance/GEF/UNDP-GEF-TE-Guide.pdf)”.

The project was designed to strengthen Bangladesh’s capacity to implement and manage Rio Convention obligations through mainstreaming. It will emphasize a long-term approach to institutionalizing capacities to meet Rio Convention obligations through a set of learn by doing activities to integrate Rio Convention and other key related MEA obligations into the country’s national development framework. Specifically, this project will strengthen institutional and technical capacities and skills for improved implementation of the Rio Conventions. Additionally, this project will enhance Bangladesh’s human resource development by working with the leading national training institutions. The active participation of stakeholder representatives in the full project life cycle serves to facilitate the strategic adaptation of project activities in keeping with project objectives. The critical role of nonstate stakeholders will contribute to the adaptive collaborative management of project implementation. Besides, the project responds to one of the specific crosscutting capacity development priorities identified in Bangladesh’s NCSA, which is to catalyze more effective engagement in the governance of the global environment through environmentally sound and sustainable development. The project is strategic in that it responds to a targeted set of underlying and critical institutional and technical barriers to environmental governance to meet and sustain global environmental outcomes. Specifically, the project will facilitate the proactive and constructive engagement of relevant decisionmakers and planners across environmental focal areas and socioeconomic sectors.

The value of this project also lies in catalyzing Bangladesh’s drive towards self-sufficiency and environmental sustainability, assuming that the capacities developed will be institutionalized, thereby resulting in an incrementally reduced dependency on external funding. The inherent nature of the project’s crosscutting approach also dictates important partnerships among several key national institutions that play a role in MEA implementation. Key partners include the Bangladesh Public Administration Training Centre (BPATC) and the National Academy for Educational Management (NAEM).

The Ministry of Environment, Forest and Climate Change (MoEFCC) is the executing entity for this project, and the project will be developed in accordance with agreed policies and procedures between the Government of Bangladesh and UNDP. With the support of UNDP, MoEF will establish the necessary planning and management mechanisms and facilitate government decision making to catalyze implementation of project activities and timely delivery of project outputs. The project was designed to be complementary to other related projects under implementation in Bangladesh, including those supported by the Global Environment Facility (GEF). Given these, careful attention will be given to coordinating project activities in such a way that activities are mutually supportive, and opportunities capitalized to realize synergies and cost effectiveness.

The expected outcome of this project is that best practices and innovative approaches for meeting and sustaining Rio Conventions are available and accessible for implementation through national development policies and programmes. This outcome is disaggregated into three project components:

Component 1: Developing institutional capacities for management of global environment

Component 2: Mainstreaming of global environmental conventions into human resource development

Component 3: Raising awareness of the linkages between the Rio Conventions and sustainable development

Finally, the project is consistent with the programmatic objectives of the three GEF thematic focal areas of biodiversity, climate change and land degradation, the achievement and sustainability of which is dependent on the critical development of capacities (individual, organizational and systemic). Through the successful implementation of this project, Bangladesh’s institutional and human resources will be strengthened to help implement MEAs and national policy instruments in a manner that fully reflects Rio Convention principles and obligations.

UNDP now intends to engage an independent international consultant to conduct the Terminal Evaluation of the project/ evaluate the project success towards achieving its purposes

Duties and Responsibilities

The TE will assess progress towards the achievement of the project objectives and outcomes as specified in the Project Document and assess early signs of project success or failure with the goal of identifying the necessary changes to be made in order to set the project on-track to achieve its intended results. The TE will also review the project’s strategy, its risks to sustainability.

The TE will be carried out by an International Consultant having experience of evaluative projects and programs evaluation. The TE will assess the following four aspects of project progress. See the ‘Guidance for Conducting Terminal Evaluation of UNDP-Supported, GEF-Financed Projects’ for extended descriptions.

Project Strategy

Project Design:

• Review the problem addressed by the project and the underlying assumptions.  Review the effect of any incorrect assumptions or changes to the context to achieving the project results as outlined in the Project Document.
• Assess the relevance of the project strategy and assess whether it provides the most effective route towards expected/ intended results.  Were lessons from other relevant projects properly incorporated into the project design?
• Assess how the project addresses country priorities. Review country ownership. Was the project concept in line with the national sector development priorities and plans of the country (or of participating countries in the case of multi-country projects)?
• Review decision-making processes: were perspectives of those who would be affected by project decisions, those who could affect the outcomes, and those who could contribute information or other resources to the process, taken into account during project design processes?
• Assess the extent to which relevant gender issues were raised in the project design. See Annex 9 of Guidance for Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects for further guidelines.
• If there are major areas of concern, recommend areas for improvement.

Results Framework/Logframe:

• Undertake a critical analysis of the project’s logframe indicators and targets, assess how “SMART” the midterm and end-of-project targets are (Specific, Measurable, Attainable, Relevant, Time-bound), and suggest specific amendments/revisions to the targets and indicators as necessary.
• Are the project’s objectives and outcomes or components clear, practical, and feasible within its time frame?
• Examine if progress so far has led to, or could in the future catalyse beneficial development effects (i.e. income generation, gender equality and women’s empowerment, improved governance etc.) that should be included in the project results framework and monitored on an annual basis.
• Ensure broader development and gender aspects of the project are being monitored effectively.  Develop and recommend SMART ‘development’ indicators, including sex-disaggregated indicators and indicators that capture development benefits.

Progress Towards Results

Progress Towards Outcomes Analysis:

• Review the logframe indicators against progress made towards the end-of-project targets using the Progress Towards Results Matrix and following the Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects; colour code progress in a “traffic light system” based on the level of progress achieved; assign a rating on progress for each outcome; make recommendations from the areas marked as “Not on target to be achieved” (red).

Table. Progress Towards Results Matrix (Achievement of outcomes against End-of-project Targets)

Indicator Assessment Key

In addition to the progress towards outcomes analysis:

• Compare and analyse the GEF Tracking Tool at the Baseline with the one completed right before the Midterm Review.
• Identify remaining barriers to achieving the project objective in the remainder of the project.
• By reviewing the aspects of the project that have already been successful, identify ways in which the project can further expand these benefits.

iii.   Project Implementation and Adaptive Management

Management Arrangements:

• Review overall effectiveness of project management as outlined in the Project Document.  Have changes been made and are they effective?  Are responsibilities and reporting lines clear?  Is decision-making transparent and undertaken in a timely manner?  Recommend areas for improvement.
• Review the quality of execution of the Executing Agency/Implementing Partner(s) and recommend areas for improvement.
• Review the quality of support provided by the GEF Partner Agency (UNDP) and recommend areas for improvement.

Work Planning:

• Review any delays in project start-up and implementation, identify the causes and examine if they have been resolved.
• Are work-planning processes results-based?  If not, suggest ways to re-orientate work planning to focus on results?
• Examine the use of the project’s results framework/ logframe as a management tool and review any changes made to it since project start.

Finance and co-finance:

• Consider the financial management of the project, with specific reference to the cost-effectiveness of interventions.
• Review the changes to fund allocations as a result of budget revisions and assess the appropriateness and relevance of such revisions.
• Does the project have the appropriate financial controls, including reporting and planning, that allow management to make informed decisions regarding the budget and allow for timely flow of funds?
• Informed by the co-financing monitoring table to be filled out, provide commentary on co-financing: is co-financing being used strategically to help the objectives of the project. Is the Project Team meeting with all co-financing partners regularly in order to align financing priorities and annual work plans.

Project-level Monitoring and Evaluation Systems:

• Review the monitoring tools currently being used:  Do they provide the necessary information? Do they involve key partners? Are they aligned or mainstreamed with national systems?  Do they use existing information? Are they efficient? Are they cost-effective? Are additional tools required? How could they be made more participatory and inclusive?
• Examine the financial management of the project monitoring and evaluation budget.  Are sufficient resources being allocated to monitoring and evaluation? Are these resources being allocated effectively.

Stakeholder Engagement:

• Project management: Has the project developed and leveraged the necessary and appropriate partnerships with direct and tangential stakeholders?
• Participation and country-driven processes: Do local and national government stakeholders support the objectives of the project? Do they continue to have an active role in project decision-making that supports efficient and effective project implementation?
• Participation and public awareness: To what extent has stakeholder involvement and public awareness contributed to the progress towards achievement of project objectives.

Reporting:

• Assess how adaptive management changes have been reported by the project management and shared with the Project Board.
• Assess how well the Project Team and partners undertake and fulfil GEF reporting requirements (i.e. how have they addressed poorly-rated PIRs, if applicable?)
• Assess how lessons derived from the adaptive management process have been documented, shared with key partners and internalized by partners.

Communications:

• Review internal project communication with stakeholders: Is communication regular and effective? Are there key stakeholders left out of communication? Are there feedback mechanisms when communication is received? Does this communication with stakeholders contribute to their awareness of project outcomes and activities and investment in the sustainability of project results?
• Review external project communication: Are proper means of communication established or being established to express the project progress and intended impact to the public (is there a web presence, for example? Or did the project implement appropriate outreach and public awareness campaigns?)
• For reporting purposes, write one half-page paragraph that summarizes the project’s progress towards results in terms of contribution to sustainable development benefits, as well as global environmental benefits.

iv.   Sustainability

• Validate whether the risks identified in the Project Document, Annual Project Review/PIRs and the ATLAS Risk Management Module are the most important and whether the risk ratings applied are appropriate and up to date. If not, explain why.
• In addition, assess the following risks to sustainability:

Financial risks to sustainability:

• What is the likelihood of financial and economic resources not being available once the GEF assistance ends (consider potential resources can be from multiple sources, such as the public and private sectors, income generating activities, and other funding that will be adequate financial resources for sustaining project’s outcomes)?

Socio-economic risks to sustainability:

• Are there any social or political risks that may jeopardize sustainability of project outcomes? What is the risk that the level of stakeholder ownership (including ownership by governments and other key stakeholders) will be insufficient to allow for the project outcomes/benefits to be sustained? Do the various key stakeholders see that it is in their interest that the project benefits continue to flow? Is there sufficient public / stakeholder awareness in support of the long term objectives of the project? Are lessons learned being documented by the Project Team on a continual basis and shared/ transferred to appropriate parties who could learn from the project and potentially replicate and/or scale it in the future?

Institutional Framework and Governance risks to sustainability:

• Do the legal frameworks, policies, governance structures and processes pose risks that may jeopardize sustenance of project benefits? While assessing this parameter, also consider if the required systems/ mechanisms for accountability, transparency, and technical knowledge transfer are in place.

 Environmental risks to sustainability:

• Are there any environmental risks that may jeopardize sustenance of project outcomes?

Conclusions & Recommendations

The TE team will include a section of the report setting out the TE’s evidence-based conclusions, in light of the findings.

Recommendations should be succinct suggestions for critical intervention that are specific, measurable, achievable, and relevant based on the data analysis conducted in the TE. Recommendations need to be practical and applicable for actual project implementation, as they intended to be used for adaptive programming and course correction. A recommendation table should be put in the report’s executive summary. See the Guidance for Conducting Terminal Evaluation of UNDP-Supported, GEF-Financed Projects for guidance on a recommendation table.

The TE team should make no more than 15 recommendations total.

Ratings

The TE team will include its ratings of the project’s results and brief descriptions of the associated achievements in a TE Ratings & Achievement Summary Table in the Executive Summary of the TE report. See Annex E for ratings scales. No rating on Project Strategy and no overall project rating is required.

TE Ratings and Achievement Summary Table for Rio Project

Approach & Methodology

The TE must provide evidence-based information that is credible, reliable and useful. The TE will review all relevant sources of information including documents prepared during the preparation phase (i.e. PIF, UNDP Initiation Plan, UNDP Environmental & Social Safeguard Policy, the Project Document, project reports including Annual Project Review/PIRs, project budget revisions, lesson learned reports, national strategic and legal documents, and any other materials that the team considers useful for this evidence-based review). The TE will review the baseline GEF focal area Tracking Tool submitted to the GEF at CEO endorsement, and the midterm GEF focal area Tracking Tool that must be completed before the TE field mission begins. 

While the TE needs to employ various types of data as well as data collection tools, the TE is highly encouraged to use as much quantitative data as possible to make the analysis more objective and evidence-based. Qualitative approaches, including the document reviews and interviews, are required for this TE, but it is strongly discouraged to use only qualitative data/ methods

The TE is expected to follow a collaborative and participatory approach ensuring close engagement with the Project Team, government counterparts (the GEF Operational Focal Point), the UNDP Country Office (UNDP CO), UNDP-GEF Regional Technical Advisers, and other key stakeholders.

Engagement of stakeholders is vital to a successful TE. Stakeholder involvement should include interviews with stakeholders who have project responsibilities, including but not limited to concern representatives of For ideas on innovative and participatory Monitoring and Evaluation strategies and techniques, see UNDP Discussion Paper: Innovations in Monitoring & Evaluating Results, 05 Nov 2013.

For more stakeholder engagement in the M&E process, see the UNDP Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 3, pg. 93.

implementing and executing agencies, NPD, PDs of Partner Agencies, representatives of Project Board and PMU, key experts and consultants in the subject area, local level stakeholders including local government, public training institutes, etc. Additionally, the TE is expected to carryout field missions to the project site in Hakaluki Haor, Fenchuganj upazila, Sylhet district of Bangladesh. 

The TE will develop detailed evaluation methodologies and tools in a separate methodology note (in English and, if necessary, in Bengali), including for data collection, data quality control, and data analysis, and share with the UNDP Country Office for clearance.

The final TE report should be prepared maintaining enough quality and it should describe the full TE approach taken and the rationale for the approach making explicit the underlying assumptions, challenges, strengths and weaknesses about the methods and approach of the review.

Arrangements for the TE

The principal responsibility for managing this TE resides with the TE Commissioning agency, i.e., the UNDP Bangladesh Country Office (CO). UNDP CO will contract the consultant – after review of the selected candidate by UNDP CO together with the Project Management Unit- and ensure the timely provision of per diems and travel arrangements to all countries to be visited for the TE Consultant.  The TE consultant will work under over all supervision of the UNDP CO and in collaboration with PMU. UNDP CO and PMU will be responsible for liaising with the TE Consultant to provide all relevant documents, set up stakeholder interviews, and arrange field visits.

DUTIES AND RESPONSIBILITIES

The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained below, as defined and explained in the UNDP Guidance for Conducting Terminal Evaluations of UNDP supported, GEF-financed Projects. The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular the GEF operational focal point, National Implementing Partner of the Project, UNDP Country Office, project team, UNDP GEF Technical Adviser based in the region and key stakeholders. The evaluation is expected to deliver the following:

Inception Report: Evaluator provides clarifications on timing and method no later than 2 weeks before the evaluation mission.

Presentation: Initial Findings has to be presented at the end of evaluation mission.

Draft Report: Full report with annexes (and data where applicable) within 3 weeks of the evaluation mission/ presentation.

Final Report: Revised report within 01 week of receiving UNDP comments on draf

SUPERVISION AND PERFORMANCE EVALUATION

The International Consultant will work closely with UNDP Bangladesh and Under the overall guidance from Assistant Resident Representative, UNDP Bangladesh, the consultant will directly report to and Program Specialist and Project Coordinator of UNDP. The Consultant will work with National Capacity Development for Implementing Rio Conventions through Environmental Governance Project.

TIMEFRAME AND DEADLINE 

Expected duration of the assignment is 22 days over a time period of starting from April to May 2019.

Including 1 Mission in Bangladesh: The Consultant is required to visit Bangladesh including the project Office in Dhaka and other project sites to see field level interventions of Project. So total Mission in Bangladesh will be at least 12 Days. Rest 10 days will be work from home for Inception and TE methodology and finalization of TE.

The tentative TE timeframe is as follows:

Options for site visits should be provided in the Inception Report. The final TE report must be in English.

DOCUMENTS

The Consultant will prepare and submit the above-mentioned documents during the assignment period. The format for the GEF Terminal Evaluation should be agreed on at the beginning of the assignment and cleared by the task force. Further work or revision of the documents may be required if it is considered that the documents do not meet the ToR, errors of fact or the documents are incomplete or not of an acceptable standard.

7. INPUTS

Project office will arrange the office space for the consultant and also assist in arranging meetings, consultations and interviews and ensure access to key officials as mentioned in the proposed methodology.

8. Travel

 All envisaged travel costs must be included in the financial proposal. This includes all travel to join duty station/repatriation travel. In general, UNDP should not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources. In the case of unforeseeable travel, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between the respective business unit and Individual Consultant, prior to travel and will be reimbursed.

Including 1 Mission in Bangladesh: The Consultant is required to visit Bangladesh including the project Office in Dhaka and other project sites to see field level interventions of Project. So total Mission in Bangladesh will be at least 12 Days. Rest 10 days will be work from home for Inception and TE methodology and finalization of TE.

Competencies

Technical competencies: Expertise in Environment or Natural Resources or Biodiversity or Climate Change or Development Studies or in closely related field with special reference to environmental governance. Evaluation experience related to the national level multi-disciplinary projects.

b. Partnerships:

• Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability;

• Maturity and confidence in dealing with senior members of national institutions;

• Excellent written communication skills, with analytical capacity and ability to synthesize relevant collected data and findings for the preparation of quality analysis for the project evaluation.

C. Results:

• Promotes the vision, mission, and strategic goals of UNDP;

• Builds strong relationships with clients, focuses on impact and result for the client and responds positively to feedback;

• Good team player who has ability to maintain good relationships.

Consultant Independence:

The Consultant cannot have engaged in the project preparation, formulation, and/or implementation (including the writing of the Project Document) and should not have a conflict of interest with project’s related activities.

PAYMENT MILESTONE FOR SERVICE

Required Skills and Experience

Qualifications

The evaluator must present the following qualifications:

Education

A Master’s degree in natural resource management/ environmental management/ business/ public administration other related disciplines

Professional Experiences

• Minimum 7 years of relevant professional experience
• Knowledge of UNDP and GEF monitoring and evaluation policies and guidelines – at least 2 GEF funded project evaluation experiences preferably with focus on multi-focal area capacity development project, e.g. on the three thematic areas of the 3Rio convention namely Climate Change, Biodiversity, and Land Degradation
• Previous experience with results-based monitoring and evaluation methodologies;
• Technical knowledge in the targeted focal area(s) – Multi Focal Area Cross-cutting capacity development projects
• Experience in implementation or evaluation of projects/components mainstreaming of the Rio Conventions.
• Proficiency in oral and written English

Additional Competency

• Demonstrated experience of working with UN, development partners, national level and local level governmental and non-governmental agencies, and rural communities in one or more developing country;
• Proven experience with quantitative and qualitative data collection and analysis; evaluation methodologies, tools and sampling;
• Proven ability to produce analytical reports and high quality academic publications in English;
• Experience of managing evaluation teams, and the capability to handle necessary logistics.
• Experiences in using results-based management principles, theory of change /logical framework analysis for programming;
• Ability to bring gender dimensions into the evaluation, including data collection, analysis and report writing;
• Experience of communicating a wide range of partners and stakeholders.
• Experience of working in the South or South East Asia.

Language:

Fluency in reading, writing and speaking in English and excellent Communication skills.

Price Proposal and Schedule of Payments

Consultant must send a financial proposal based on Lump Sum Amount. The total amount quoted shall be all-inclusive and include all costs components required to perform the deliverables identified in the TOR, including professional fee, travel costs, living allowance (if any work is to be done outside the IC´s duty station) and any other applicable cost to be incurred by the IC in completing the assignment. The contract price will be fixed output-based price regardless of extension of the herein specified duration. Payments will be done upon completion of the deliverables/outputs and as per below percentages-

In general, UNDP shall not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources. Lodging, meals and transport cost for field visit related to this assignment will be paid by the project as per UN standard.

In the event of unforeseeable travel not anticipated in this TOR, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between the respective business unit and the Individual Consultant, prior to travel and will be reimbursed.

Travel and DSA:

All envisaged travel costs must be included in the financial proposal. This includes all travel to join duty station/repatriation travel. In general, UNDP should not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources. In the case of unforeseeable travel, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between the respective business unit and Individual Consultant, prior to travel and will be reimbursed.

Including 1 Mission in Bangladesh: The Consultant is required to visit Bangladesh including the project Office in Dhaka and other project sites to see field level interventions of Project. So total Mission in Bangladesh will be at least 12 Days. Rest 10 days will be work from home for Inception and TE methodology and finalization of TE.

Evaluation Method and Criteria:

Individual consultants will be evaluated based on the following methodology.

Cumulative analysis-

The award of the contract will be made to the individual consultant up on Cumulative Analysis/evaluation and determined as:

1. Responsive/compliant/acceptable; and
2. Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation;

Only candidates obtaining a minimum 70% mark in technical evaluation will be considered eligible for financial evaluation.

Technical Criteria for Evaluation (Maximum 70 points)

• Criteria-01; Year of experience of in the field of development project evaluation- Max Point 25
• Criteria-02; Experience of evaluating at least 3 development projects and programs of considerable size related to rural community-based Environment or Natural Resources or Biodiversity or Climate Change adaptation or livelihood related projects in Asia and Pacific Region- Max Point 25
• Criteria-03; Experience of evaluating GEF and UN financed projects and programs of similar nature.- Max Point 20

Financial Evaluation (Total 30 marks)

All technical qualified proposals will be scored out 30 based on the formula provided below.

The maximum points (30) will be assigned to the lowest financial proposal. All other proposals received points according to the following formula:

p = y (µ/

Where:

• p = points for the financial proposal being evaluated;
• y = maximum number of points for the financial proposal;
• µ = price of the lowest priced proposal;
• z = price of the proposal being evaluated.

Documents to be included when submitting the proposals:

Interested individual consultants must submit the following documents/information to demonstrate their qualifications. Proposers who shall not submit below mentioned documents will not be considered for further evaluation.

• Personal CV or P11, indicating all past experience from similar projects, as well as the contact details (email and telephone number) of the Candidate and at least three (3) professional references; P11 can be downloaded from the link below: http://www.bd.undp.org/content/bangladesh/en/home/operations/jobs/
• Technical proposal, including a) a brief description of why the individual considers him/herself as the most suitable for the assignment; b) a brief methodology, on how you will approach and complete the assignment, including a tentative table of contents for the final report; and c) a list of similar assignment with topic/name of the assignment, duration, role of consultant and organization/project
• Financial Proposal: Financial Proposal has to be submitted through a standard interest and availability template which can be downloaded from the link below:

http://www.bd.undp.org/content/dam/bangladesh/docs/Jobs/Interest%20and%20Submission%20of%20Financial%20Proposal-Template%20for%20Confirmation.docx

Please combine all your documents into one (1) single PDF document as the system only allows to upload maximum one document.