Background

Introduction

This is the Scope of Work for the UNDP-GEF Modified Midterm Review (MTR) of the medium-sized four-year project titled Payment for Watershed Services in the Chishui River Basin for the Conservation of Globally Significant Biodiversity (PIMS4822) implemented through the FECO/MEP, which is to be undertaken in late 2016. The project started on the September 25, 2014 and is in its second year of implementation. This scope of this assignment follows the UNDP-GEF Guidance on MTRs, but as a modified MTR, it is narrower in scope than a full MTR. This Scope of Work sets out the expectations for this MTR.  The MTR process must follow the guidance outlined in the document Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects.  (http://web.undp.org/evaluation/documents/guidance/GEF/miderm/Guidance_Midterm%20Review%20_EN_2014.pdf).

Project Background

The project was designed to:

The Chishui River is one of the most important tributaries of the upper Yangtze River, because of its diverse landscapes, richness in biodiversity and abundance in water resources. It is the only major tributary of the Upper Yangtze that remains free-flowing without a mainstream dam.  The Chishui River Basin (CRB) is an important storehouse of biodiversity, lying within the Upper Yangtze Freshwater Ecoregion and the Guizhou Plateau Broadleaf and Mixed Forests Terrestrial Ecoregion. The basin also lies on the eastern margin of the Mountains of Southwest China biodiversity hotspot, and contains part of the China Danxia World Heritage Site. The basin has globally significant fish populations, with 112 species of which 28 are endemic to the Upper Yangtze (27.2% of its endemic fish diversity).

Significant environmental degradation has taken place in the Chishui River Basin, due in large part to unsustainable land use practices with marginalized farming communities increasingly cultivating steep slopes, resulting in deforestation, soil erosion, sediment and nutrient loading of the river, hydrological impacts and loss of biodiversity. The Guizhou Provincial Government and riparian municipalities have already made significant investments towards achieving environmental protection in the CRB to ensure clean water supply to downstream industries. However, this has been inadequate to address the extensive watershed degradation. As a result, both water quality and dry season flows have been impacted, affecting downstream users.

The long term solution proposed by this project is to operationalise and mainstream a market-based system for Payment for Watershed Services (PWS) within China’s existing eco-compensation policies and programmes that will support large scale changes in land use over the long term, coupled with integrated watershed management that takes account of biodiversity and ecological functions as well as development needs. However, two principal barriers currently hamper the realisation of this long term solution: the weak enabling framework and institutional capacity for PWS implementation and upscaling; and insufficient know-how for the establishment and implementation of viable PWS mechanisms for biodiversity conservation.

In the GEF alternative scenario, the accomplishment of river basin management objectives that include sustaining and restoring ecosystem services and biodiversity, rural poverty alleviation, sustainable land use management as well appropriate economic development, will be enabled by the introduction of a PWS system which is harmonized with existing eco-compensation schemes for greater cumulative impact. The potential of PWS to address large scale environmental degradation challenges, its potential for application in other parts of China, as well as the national conservation priority placed on the Chishui River Basin have led the Government of China to present this project for GEF support.  In particular the GEF project will provide significant direct assistance towards realizing the MEP’s plans to introduce PWS as an integral part of national eco-compensation policy and plans, as well as Guizhou Province’s plans to rehabilitate the ecology of the CRB.

The project’s goal is to contribute to the conservation and sustainable use of globally significant biodiversity in China. Its objective is to operationalize a replicable PWS scheme in the Chishui River Basin to stimulate land and natural resource use systems that conserve biodiversity and sustain ecosystem processes. This will be accomplished through two outcomes,

Outcome 1: the first aiming to establish a systemic and institutional framework for PWS development and management at municipal and provincial levels, including the mainstreaming of PWS and biodiversity conservation into relevant policies, plans and regulations.

Outcome 2: aims to demonstrate an operational PWS scheme in a sub-watershed of the Chishui River in Guizhou.

The programme period is 48 months and the total fund is $ 17,908,676 which is including $ 15,500,000 co-financing. 

 

Duties and Responsibilities

Objectives of the MTR

The modified MTR will assess progress towards the achievement of the project objectives and outcomes as specified in the Project Document, and assess early signs of project success or failure with the goal of identifying the necessary changes to be made in order to set the project on-track to achieve its intended results. The MTR will also review the project’s strategy and its risks to sustainability.

 

MTR Approach and Methodology

The MTR should provide evidence-based information that is credible, reliable and useful. The MTR team will review relevant sources of information including documents prepared during the preparation phase (i.e. PIF, UNDP Initiation Plan, UNDP Environmental & Social Safeguard Policy, the Project Document, project reports including Annual Project Review/PIRs, project budget revisions, lesson learned reports, national strategic and legal documents, and any other materials that the team considers useful for this evidence-based review). The MTR team will review the baseline GEF focal area Tracking Tool submitted to the GEF at CEO endorsement, and the midterm GEF focal area Tracking Tool that must be completed before the MTR field mission begins.  

The MTR team is expected to follow a collaborative and participatory approach(For ideas on innovative and participatory Monitoring and Evaluation strategies and techniques, see UNDP Discussion Paper: Innovations in Monitoring & Evaluating Results, 05 Nov 2013.) ensuring close engagement with the Project Team, government counterparts (the GEF Operational Focal Point), the UNDP Country Office(s), UNDP-GEF Regional Technical Advisers, and other key stakeholders.

Engagement of stakeholders is vital to a successful MTR(For more stakeholder engagement in the M&E process, see the UNDP Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 3, pg. 93.). Stakeholder involvement should include interviews with stakeholders who have project responsibilities, including but not limited to executing agencies, senior officials and task team/ component leaders, key experts and consultants in the subject area, Project Board, project stakeholders, academia, local government and CSOs, etc. Additionally, the MTR team is expected to conduct field missions to the project sites in Guizhou Province.

The final MTR report should describe the full MTR approach taken and the rationale for the approach making explicit the underlying assumptions, challenges, strengths and weaknesses about the methods and approach of the review.

 

Detailed scope of the MTR

The MTR team (consists of one international consultant and one national consultant ) will assess the following four categories of project progress. See the Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects for extended descriptions.

i.    Project Strategy

Project design:

  • Review the problem addressed by the project and the underlying assumptions.  Review the effect of any incorrect assumptions or changes to the context to achieving the project results as outlined in the Project Document;
  • Review the relevance of the project strategy and assess whether it provides the most effective route towards expected/intended results;
  • Review how the project addresses country priorities. Review country ownership;
  • Review the extent to which relevant gender issues were raised in the project design. Make suggestions for how relevant gender issues can be better incorporated and monitored in the project. See Annex 9 of Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects for further guidelines.

Results Framework/Logframe:

  • Undertake a critical analysis of the project’s logframe indicators and targets, assess how “SMART” the midterm and end-of-project targets are (Specific, Measurable, Attainable, Relevant, Time-bound), and suggest specific amendments/revisions to the targets and indicators as necessary;
  • Examine if progress so far has led to, or could in the future catalyse beneficial development effects (i.e. income generation, gender equality and women’s empowerment, improved governance etc.) that should be included in the project results framework and monitored on an annual basis;
  • Ensure broader development and gender aspects of the project are being monitored effectively.  Develop and recommend SMART ‘development’ indicators, including sex-disaggregated indicators and indicators that capture development benefits.

ii.    Progress Towards Results

Progress Towards Outcomes Analysis:

  • Review the logframe indicators against progress made towards the end-of-project targets using the Progress Towards Results Matrix and following the Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects; colour code progress in a “traffic light system” based on the level of progress achieved; assign a rating on progress for each outcome; make recommendations from the areas marked as “Not on target to be achieved” (red). 

Project Strategy

Indicator[1]

Baseline Level[2]

Level in 1st PIR (self- reported)

Midterm Target[3]

End-of-project Target

Midterm Level & Assessment[4]

Achievement Rating[5]

Justification for Rating

Objective:

 

Indicator (if applicable):

 

 

 

 

 

 

 

Outcome 1:

Indicator 1:

 

 

 

 

 

 

 

Indicator 2:

 

 

 

 

 

Outcome 2:

Indicator 3:

 

 

 

 

 

 

 

Indicator 4:

 

 

 

 

 

Etc.

 

 

 

 

 

Etc.

 

 

 

 

 

 

 

 

 

Indicator Assessment Key

Green= Achieved

Yellow= On target to be achieved

Red= Not on target to be achieved

 

[1] Populate with data from the Logframe and scorecards

[2] Populate with data from the Project Document

[3] If available

[4] Colour code this column only

[5] Use the 6 point Progress Towards Results Rating Scale: HS, S, MS, MU, U, HU

 

In addition to the progress towards outcomes analysis:

  • Compare and analyse the GEF Tracking Tool at the Baseline with the one completed right before the Midterm Review.
  • Identify remaining barriers to achieving the project objective in the remainder of the project.
  • By reviewing the aspects of the project that have already been successful, identify ways in which the project can further expand these benefits.

 

iii.   Project Implementation and Adaptive Management

Management Arrangements:

  • Review overall effectiveness of project management as outlined in the Project Document.  Have changes been made and are they effective?  Are responsibilities and reporting lines clear?  Is decision-making transparent and undertaken in a timely manner?  Recommend areas for improvement.
  • Review the quality of execution of the Executing Agency/Implementing Partner(s) and recommend areas for improvement.
  • Review the quality of support provided by the Implementing Agency/GEF Partner Agency (UNDP) and recommend areas for improvement.

Work Planning:

  • Review any delays in project start-up and implementation, identify the causes and examine if they have been resolved.
  • Are work-planning processes results-based?  If not, suggest ways to re-orientate work planning to focus on results?

Finance and co-finance:

  • Consider the financial management of the project, with specific reference to the cost-effectiveness of interventions. 
  • Review the changes to fund allocations as a result of budget revisions and assess the appropriateness and relevance of such revisions.
  • Does the project have the appropriate financial controls, including reporting and planning, that allow management to make informed decisions regarding the budget and allow for timely flow of funds?
  • Informed by the co-financing monitoring table to be filled out, provide commentary on co-financing: is co-financing being used strategically to help the objectives of the project? Is the Project Team meeting with all co-financing partners regularly in order to align financing priorities and annual work plans?

Project-level Monitoring and Evaluation Systems:

  • Review the monitoring tools currently being used:  Do they provide the necessary information? Do they involve key partners? Are they aligned or mainstreamed with national systems?  Do they use existing information? Are they efficient? Are they cost-effective? Are additional tools required? How could they be made more participatory and inclusive?
  • Examine the financial management of the project monitoring and evaluation budget.  Are sufficient resources being allocated to monitoring and evaluation? Are these resources being allocated effectively?

Stakeholder Engagement:

  • Project management: Has the project developed and leveraged the necessary and appropriate partnerships with direct and tangential stakeholders?
  • Participation and country-driven processes: Do local and national government stakeholders support the objectives of the project?  Do they continue to have an active role in project decision-making that supports efficient and effective project implementation?
  • Participation and public awareness: To what extent has stakeholder involvement and public awareness contributed to the progress towards achievement of project objectives?

Reporting:

  • Assess how adaptive management changes have been reported by the project management and shared with the Project Board.
  • Assess how well the Project Team and partners undertake and fulfil GEF reporting requirements (i.e. how have they addressed poorly-rated PIRs, if applicable?)
  • Assess how lessons derived from the adaptive management process have been documented, shared with key partners and internalized by partners.

Communications:

  • Review internal project communication with stakeholders: Is communication regular and effective? Are there key stakeholders left out of communication? Are there feedback mechanisms when communication is received? Does this communication with stakeholders contribute to their awareness of project outcomes and activities and investment in the sustainability of project results?
  • Review external project communication: Are proper means of communication established or being established to express the project progress and intended impact to the public (is there a web presence, for example? Or did the project implement appropriate outreach and public awareness campaigns?)

iv.   Sustainability

  • Validate whether the risks identified in the Project Document, Annual Project Review/PIRs and the ATLAS Risk Management Module are the most important and whether the risk ratings applied are appropriate and up to date. If not, explain why.
  • In addition, assess the following risks to sustainability:

Financial risks to sustainability:

  • What is the likelihood of financial and economic resources not being available once the GEF assistance ends (consider potential resources can be from multiple sources, such as the public and private sectors, income generating activities, and other funding that will be adequate financial resources for sustaining project’s outcomes)?

Socio-economic risks to sustainability:

  • Are there any social or political risks that may jeopardize sustainability of project outcomes? What is the risk that the level of stakeholder ownership (including ownership by governments and other key stakeholders) will be insufficient to allow for the project outcomes/benefits to be sustained? Do the various key stakeholders see that it is in their interest that the project benefits continue to flow? Is there sufficient public / stakeholder awareness in support of the long term objectives of the project? Are lessons learned being documented by the Project Team on a continual basis and shared/ transferred to appropriate parties who could learn from the project and potentially replicate and/or scale it in the future?

Institutional Framework and Governance risks to sustainability:

  • Do the legal frameworks, policies, governance structures and processes pose risks that may jeopardize sustenance of project benefits? While assessing this parameter, also consider if the required systems/ mechanisms for accountability, transparency, and technical knowledge transfer are in place.

Environmental risks to sustainability:

  • Are there any environmental risks that may jeopardize sustenance of project outcomes?

Conclusions & Recommendations

The MTR team will include a section of the report setting out the MTR’s evidence-based conclusions, in light of the findings. (Alternatively, MTR conclusions may be integrated into the body of the report.)

Recommendations should be succinct suggestions for critical intervention that are specific, measurable, achievable, and relevant. A recommendation table should be put in the report’s executive summary. See the Guidance For Conducting Midterm Reviews of UNDP-Supported, GEF-Financed Projects for guidance on a recommendation table.

The MTR team should make no more than 15 recommendations total. Recommendations should outline corrective actions for the design, implementation, monitoring and evaluation of the project and should focus on actions to follow up or reinforce initial benefits from the project.

Ratings

The MTR team will include its ratings of the project’s results and brief descriptions of the associated achievements in a MTR Ratings & Achievement Summary Table in the Executive Summary of the MTR report. See Annex E for ratings scales. No rating on Project Strategy and no overall project rating is required.

Table. MTR Ratings & Achievement Summary Table for (Project Title)

Measure

MTR Rating

Achievement Description

Project Strategy

N/A

 

Progress Towards Results

Objective Achievement Rating: (rate 6 pt. scale)

 

Outcome 1 Achievement Rating: (rate 6 pt. scale)

 

Outcome 2 Achievement Rating: (rate 6 pt. scale)

 

Outcome 3 Achievement Rating: (rate 6 pt. scale)

 

Etc.

 

Project Implementation & Adaptive Management

(rate 6 pt. scale)

 

Sustainability

(rate 4 pt. scale)

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

Timeframe

The total duration of the MTR will be approximately (20) days over a time period of approximately three months starting (Early August 2016), and shall not exceed five months from when the team is contracted. The tentative MTR timeframe is as follows:

COMPLETION DATE / TIMEFRAME

ACTIVITY

August 1st, 2016 (2 working days)

Prep the MTR team (handover of Project Documents, desk review for related Project Document)

August 20th ,2016 (9 working days)

MTR mission: stakeholder meetings, interviews, field visits, etc. Presentation of initial findings- last day of the MTR mission

(Sep. 10th ,2016) (8 working days )

Preparing draft report, Circulation of draft report to UNDP for comments

Oct 20th  ( 1 working days )

Incorporating audit trail from feedback on draft report/Finalization of MTR report

Midterm review deliverables

     #

Deliverable

Description

Timing

Responsibilities

1.

Presentation

Initial Findings

End of MTR mission

MTR team presents to project management and the Commissioning Unit

2.

Draft Final Report

Full report (using guidelines on content outlined in Annex B) with annexes

Within 3 weeks of the MTR mission

Sent to the Commissioning Unit, reviewed by RTA, Project Coordinating Unit, GEF OFP

3.

Final Report*

Revised report with audit trail detailing how all received comments have (and have not) been addressed in the final MTR report

Within 1 week of receiving UNDP comments on draft

Sent to the Commissioning Unit

 

MTR Arrangement

The principle responsibility for managing this MTR resides with the Commissioning Unit. The Commissioning Unit for this project’s MTR is UNDP China Office.

The commissioning unit will contract the consultants and ensure the timely provision of per diems and travel arrangements within China for the MTR team. The Project Team will be responsible for liaising with the MTR team to provide all relevant documents, set up stakeholder interviews, and arrange field visits. 

 

Payment Modalities and specifications

10% upon presentation of initial findings after the MTR mission;

30% upon submission of the draft MTR report;

60% upon finalization of the MTR report.

 

Competencies

Two independent consultants (one international and one national) will conduct the MTR. The consultants should not have participated in the project preparation, formulation, and/or implementation (including the writing of the Project Document) and should not have a conflict of interest with project’s related activities.  This advertisement is only targetting the international consultant.

  • Excellent communication skills;
  • Demonstrable analytical skills.

Documents for Application Submission

  • Please provide Offeror’s Letter and proposal (download link:  http://pan.baidu.com/s/1hqJIIaC, please click "XX (64 KB)" on the top right corner of the page to download the documents.) together with your CV while submitting application;
  • In the Offeror’s Letter and proposal, you will be asked to confirm your interest and availability for the assignment, and provide technical and financial proposal;
  • Please merge all your documents as one prior uploading as the application system can only accept one attachment.

Selection criteria: The award of the contract will be made to the Individual Consultant who has obtained the highest Combined Score and has accepted UNDP’s General Terms and Conditions.  Only those applications which are responsive and compliant will be evaluated. The offers will be evaluated using the “Combined Scoring method” where:

  • Technical evaluation - 70%;
  • Financial Evaluation - 30%.

Required Skills and Experience

Education:

  • A secondary degree Master in natural sciences, biodiversity conservation, ecosystem services, or other closely related field.

Experience:

  • Recent experience with result-based management evaluation methodologies;
  • Experience applying SMART indicators and reconstructing or validating baseline scenarios;
  • Competence in adaptive management, as applied to Biodiversity and Ecosystem Services Management;
  • Experience working with the GEF or GEF-evaluations;
  • Experience working in China;
  • Work experience in relevant technical areas for at least 7 years;
  • Demonstrated understanding of issues related to gender and Biodiversity and Ecosystem Services Management; experience in gender sensitive evaluation and analysis;
  • Project evaluation/review experiences within United Nations system will be considered an asset.

Language:

  • Good command of English.