Background

In accordance with UNDP and GEF M&E policies and procedures, all full and medium-sized UNDP support GEF financed projects are required to undergo a terminal evaluation upon completion of implementation. These terms of reference (TOR) sets out the expectations for a Terminal Evaluation (TE) of the Strengthening the effectiveness of the protected area system in Qinghai Province, China to conserve globally important biodiversity (PIMS 4179.)

The essentials of the project to be evaluated are as follows:

Project Summary Table

Project Title:

Strengthening the effectiveness of the protected area system in Qinghai Province, China to conserve globally important biodiversity

GEF Project ID:

80635

 

at endorsement (Million US$)

at completion (Million US$)

UNDP Project ID:

4179

GEF financing:

5,354,545

     

Country:

China

IA/EA own:

     

     

Region:

AP

Government:

18,500,000

     

Focal Area:

BD

Other:

     

     

FA Objectives, (OP/SP):

     

Total co-financing:

18,500,000

     

Executing Agency:

Qinghai Forestry Department

Total Project Cost:

23,854,545

     

Other Partners involved:

     

ProDoc Signature (date project began):

2012.09.14

(Operational) Closing Date:

Proposed:

2017.09.13

Actual:

2017.12.31

Objective and Scope

The project was designed to strengthen the effectiveness of the PA system in Qinghai Province, China to conserve globally important biodiversity. The project objective is to catalyse management effectiveness of Qinghai’s PA system to fulfil its purpose of conserving globally important biodiversity, by removing the barriers mentioned above with three inter-related outcomes.  The focus of the project is to strengthen the PA system in Qinghai to better protect a representative sample of its unique biodiversity and more effectively manage this PA network as a whole. Three outcomes have been listed:

Outcome 1 Mainstreaming PA management into provincial development, plans and policies

Outcome 2: Increasing PA management effectiveness through strengthened institutional and staff capacities

Outcome 3:Demonstration of Effective PA management through community involvement

The TE will be conducted according to the guidance, rules and procedures established by UNDP and GEF as reflected in the UNDP Evaluation Guidance for GEF Financed Projects.

The objectives of the evaluation are to assess the achievement of project results, and to draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming.   

Duties and Responsibilities

Evaluation approach and method

An overall approach and method[1] for conducting project terminal evaluations of UNDP supported GEF financed projects has developed over time. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Guidance for Conducting Terminal Evaluations of  UNDP-supported, GEF-financed Projects.    A  set of questions covering each of these criteria have been drafted and are included with this TOR (fill in Annex C) The evaluator is expected to amend, complete and submit this matrix as part of  an evaluation inception report, and shall include it as an annex to the final report. 

The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular the GEF operational focal point, UNDP Country Office, project team, UNDP GEF Technical Adviser based in the region and key stakeholders. The evaluator is expected to conduct a field mission to (pilots in Qinghai Province of China), including the following project sites (Makehe and Suojia blocks of SNNR).Interviews will be held with the following organizations and individuals at a minimum: (Institute of Geographic Sciences and Natural Resources Research, Institute of Zoology  and Northwest Plateau Institute of Biology of CAS, Chinese Academy of Forestry, Qinghai Provincial Office of Legislative Affairs, SNNR, Natural Resources and Nature Reserve Management Bureau and Makehe Forestry Bureau of QFD, Suojia Township Administration and village co-management committees and wardens ).

The evaluator will review all relevant sources of information, such as the project document, project reports – including Annual APR/PIR, project budget revisions, midterm review, progress reports, GEF focal area tracking tools, project files, national strategic and legal documents, and any other materials that the evaluator considers useful for this evidence-based assessment. A list of documents that the project team will provide to the evaluator for review is included in Annex B of this Terms of Reference.

Evaluation Criteria & Ratings

An assessment of project performance will be carried out, based against expectations set out in the Project Logical Framework/Results Framework (see  Annex A), which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation will at a minimum cover the criteria of: relevance, effectiveness, efficiency, sustainability and impact. Ratings must be provided on the following performance criteria. The completed table must be included in the evaluation executive summary.   The obligatory rating scales are included in  Annex D.

Evaluation Ratings:

1. Monitoring and Evaluation

rating

2. IA& EA Execution

rating

M&E design at entry

     

Quality of UNDP Implementation

     

M&E Plan Implementation

     

Quality of Execution - Executing Agency

     

Overall quality of M&E

     

Overall quality of Implementation / Execution

     

3. Assessment of Outcomes

rating

4. Sustainability

rating

Relevance

     

Financial resources:

     

Effectiveness

     

Socio-political:

     

Efficiency

     

Institutional framework and governance:

     

Overall Project Outcome Rating

     

Environmental :

     

 

 

Overall likelihood of sustainability:

     

 

Project finance / cofinance

The Evaluation will assess the key financial aspects of the project, including the extent of co-financing planned and realized. Project cost and funding data will be required, including annual expenditures.  Variances between planned and actual expenditures will need to be assessed and explained.  Results from recent financial audits, as available, should be taken into consideration. The evaluator(s) will receive assistance from the Country Office (CO) and Project Team to obtain financial data in order to complete the co-financing table below, which will be included in the terminal evaluation report. 

Co-financing

(type/source)

UNDP own financing (mill. US$)

Government

(mill. US$)

Partner Agency

(mill. US$)

Total

(mill. US$)

Planned

Actual

Planned

Actual

Planned

Actual

Actual

Actual

Grants

 

 

 

 

 

 

 

 

Loans/Concessions

 

 

 

 

 

 

 

 

  • In-kind support

 

 

 

 

 

 

 

 

  • Other

 

 

 

 

 

 

 

 

Totals

 

 

 

 

 

 

 

 

 

Mainstreaming

UNDP supported GEF financed projects are key components in UNDP country programming, as well as regional and global programmes. The evaluation will assess the extent to which the project was successfully mainstreamed with other UNDP priorities, including poverty alleviation, improved governance, the prevention and recovery from natural disasters, and gender.

Impact

The evaluators will assess the extent to which the project is achieving impacts or progressing towards the achievement of impacts. Key findings that should be brought out in the evaluations include whether the project has demonstrated: a) verifiable improvements in ecological status, b) verifiable reductions in stress on ecological systems, and/or c) demonstrated progress towards these impact achievements.[2]

Conclusions, recommendations & lessons

The evaluation report must include a chapter providing a set of conclusions, recommendations and lessons

Implementation arrangements

The principal responsibility for managing this evaluation resides with the UNDP CO in China. The UNDP CO will contract the evaluators and ensure the timely provision of per diems and travel arrangements within the country for the evaluation team. The Project Team will be responsible for liaising with the Evaluators team to set up stakeholder interviews, arrange field visits, coordinate with the Government etc.  

 

Evaluation timeframe

The total duration of the evaluation will be 25 days according to the following plan:

Activity

Timing

Completion Date

Preparation

3 days

Before June 30th

Evaluation Mission

16 days

July 15-30

Draft Evaluation Report

5 days

August 1-15

Final Report

1 day

Before August 30

 

Evaluation deliverables

The evaluation team is expected to deliver the following:

Deliverable

Content

Timing

Responsibilities

Inception Report

Evaluator provides clarifications on timing and method

No later than 2 weeks before the evaluation mission.

Evaluator submits to UNDP CO

Presentation

Initial Findings

End of evaluation mission

To project management, UNDP CO

Draft Final Report

Full report, (per annexed template) with annexes

Within 3 weeks of the evaluation mission

Sent to CO, reviewed by RTA, PCU, GEF OFPs

Final Report*

Revised report

Within 1 week of receiving UNDP comments on draft

Sent to CO for uploading to UNDP ERC.

*When submitting the final evaluation report, the evaluator is required also to provide an 'audit trail', detailing how all received comments have (and have not) been addressed in the final evaluation report.

Team Composition

The evaluation team will be composed of (1 international and 1 national evaluator).  The consultants shall have prior experience in evaluating similar projects.  Experience with GEF financed projects is an advantage. The international evaluator will be designated as the team leader and will be responsible for finalizing the report).The evaluators selected should not have participated in the project preparation and/or implementation and should not have conflict of interest with project related activities.

For full mission TOR, please download from: http://pan.baidu.com/s/1eSmUTLw

[1] For additional information on methods, see the Handbook on Planning, Monitoring and Evaluating for Development Results, Chapter 7, pg. 163

[2]A useful tool for gauging progress to impact is the Review of Outcomes to Impacts (ROtI) method developed by the GEF Evaluation Office:  ROTI Handbook 2009

Competencies

  • Strategic technical and intellectual skills in the substantive area with global dynamic perspectives;
  • Leadership, innovation, facilitation, advocacy and coordination skills;
  • Ability to manage technical teams and engage in long term strategic partnership;
  • Entrepreneurial abilities and ability to work in an independent manner;
  • Ability to work effectively in a team, with good relationship management skills ;
  • Strong managerial and coordination skills, including ability to coordinate the development of large, complex projects;
  • Demonstrated ability to operate effectively in a highly complex organizational context;
  • Ability to maintain high standards despite pressing deadlines;
  • Excellent communication (both oral and written) and partnership building skills with multi-dimension partners and people, skill for conflict resolution and negotiation;
  • Excellent writing skills, especially in the preparation of official documents and reports;
  • Good knowledge of China’s environmental and socio-economic context. 

Required Skills and Experience

Education

  • An advanced degree in conservation, natural resources management, environmental science or related fields, preferably in PA conservation and management.

Experience

  • Minimum 10 years of relevant professional experience including Project development, implementation and evaluation;
  • Knowledge of UNDP and GEF, such as GEF policy and practices, GEF project requirements;
  • Previous experience with results-based monitoring and evaluation methodologies;
  • Technical knowledge in the targeted focal area(s) including biodiversity conservation, agriculture, natural resources co-management, integrated planning, etc.;
  • Expertise in economic and social development issues;
  • Good communications and writing skills in English;
  • Professional experiences in working in China and with Chinese counterparts would be an advantage;
  • Working experiences in high altitude areas.

Language

  • Fluency in written and spoken English is required;
  • Good knowledge of Chinese is an asset.

IT Skills:

  • Good IT skills.

Documents for Application Submission

  • Please provide Offeror’s Letter and proposal (download link: http://pan.baidu.com/s/1hqJIIaC, please click "XX (64 KB)" on the top right corner of the page to download the documents.) together with your CV while submitting application; or, https://www.dropbox.com/s/zhov5ekfaty7ncz/Offeror%27s%20letter%20and%20Proposal.doc
  • In the Offeror’s Letter and proposal, you will be asked to confirm your interest and availability for the assignment, and provide technical and financial proposal;
  • Please merge all your documents as one prior uploading as the application system can only accept one attachment.

Selection criteria: The award of the contract will be made to the Individual Consultant who has obtained the highest Combined Score and has accepted UNDP’s General Terms and Conditions.  Only those applications which are responsive and compliant will be evaluated. The offers will be evaluated using the “Combined Scoring method” where:

  • Technical evaluation - 70%;
  • Financial Evaluation - 30%.