Background

In accordance with UNDP and GEF M&E policies and procedures, all full and medium-sized UNDP support GEF financed projects are required to undergo a terminal evaluation upon completion of implementation. These terms of reference (TOR) sets out the expectations for a Terminal Evaluation (TE) of the UNDP-supported GEF-financed project, “NIP update, integration of POPs into national planning and promoting sound healthcare waste management in Kazakhstan” (Kazakhstan) (PIMS # 4612).

The project was designed to reduce the releases of unintentionally produced POPs and other globally harmful pollutants into the environment by promoting sound healthcare waste management in Kazakhstan, and to assist the country in implementing its relevant obligations under the Stockholm Convention

The goals will be achieved through implementation of 4 components:

• Stockholm Convention NIP update and improved institutional coordination on chemical MEAs;
• Overall mercury situation assessed and initial mercury reduction and containment plan formulated;
• Minimization of unintentional POPs and mercury releases in selected hospitals through demonstration of sound Healthcare Waste Management approaches
• Monitoring, learning, adaptive feedback, outreach, and evaluation.

 The TE will be conducted according to the guidance, rules and procedures established by UNDP and GEF as reflected in the UNDP Evaluation Guidance for GEF Financed Projects.  The objectives of the evaluation are to assess the achievement of project results, and to draw lessons that can both improve the sustainability of benefits from this project, and aid in the overall enhancement of UNDP programming

Duties and Responsibilities

EVALUATION APPROACH 

An overall approach and method for conducting project terminal evaluations of UNDP supported GEF financed projects has developed over time. The evaluator is expected to frame the evaluation effort using the criteria of relevance, effectiveness, efficiency, sustainability, and impact, as defined and explained in the UNDP Guidance for Conducting Terminal Evaluations of  UNDP-supported, GEF-financed Projects.    A  set of questions covering each of these criteria have been drafted and are included with this TOR (see Annex C) The evaluator is expected to amend, complete and submit this matrix as part of  an evaluation inception report, and shall include it as an annex to the final report. 

The evaluation must provide evidence-based information that is credible, reliable and useful. The evaluator is expected to follow a participatory and consultative approach ensuring close engagement with government counterparts, in particular the GEF operational focal point, UNDP Country Office, project team, UNDP GEF Technical Adviser based in the region and key stakeholders. The evaluator is expected to conduct a field mission to Astana, Kostanay and East-Kazakhstan regions.

The evaluator will review all relevant sources of information, such as the project document, project reports – including Annual APR/PIR, project budget revisions, midterm review, progress reports, GEF focal area tracking tools, project files, national strategic and legal documents, and any other materials that the evaluator considers useful for this evidence-based assessment. A list of documents that the project team will provide to the evaluator for review is included in Annex B of this Terms of Reference

 EVALUATION CRITERIA

An assessment of project performance will be carried out, based against expectations set out in the Project Logical Framework/Results Framework (see  Annex A), which provides performance and impact indicators for project implementation along with their corresponding means of verification. The evaluation will at a minimum cover the criteria of: relevance, effectiveness, efficiency, sustainability and impact. Ratings must be provided on the following performance criteria. The completed table must be included in the evaluation executive summary.   The obligatory rating scales are included in  Annex D.

 EVALUATION TIMEFRAME

The total duration of the evaluation will be 29 days for the international consultant) and 26 working days (for the national consultant) over a time period of 9 weeks according to the following plan:

 EVALUATION DELIVERABLES

Competencies

Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct (Annex E) upon acceptance of the assignment. UNDP evaluations are conducted in accordance with the principles outlined in the UNEG 'Ethical Guidelines for Evaluations'

Required Skills and Experience

EDUCATION: 

- Master’s degree in the sphere of chemical matters/ hazardous wastes, biology, medical sphere or other closely related fields

EXPERIENCES: 

- Minimum 5  years of professional experience in in chemical matters/ hazardous wastes, biology, medical sphere or other closely related fields

- Experience with results-based monitoring and evaluation methodologies

- Knowledge of results-based evaluation policies and procedures

- Competence in Adaptive Management, as applied to chemicals and/or hazardous waste management projects

- Recognized expertise in the management of chemicals and hazardous waste

- Familiarity with chemicals and hazardous waste management policies and governance structures in Kazakhstan

- Skills in drafting the institutional documents, reviews and background papers related chemicals and waste

- Experience working with international organizations like UNDP and/or GEF or GEF-evaluations

- Proven track record of application of results-based approaches to evaluation of projects focusing on chemicals and hazardous waste (relevant experience in the CIS region is a requirement, and relevant experience within UN system would be an asset)

- Demonstrated understanding of issues related to gender and (fill in GEF Focal Area). Experience in gender sensitive evaluation and analysis

- Excellent communication and demonstrable analytical skills 

LANGUAGE REQUIREMENTS:

- Full proficiency in English both written and verbal including ability to review, draft guidelines and edit required project documentation

- Sound knowledge of Russian language would be an advantage

EVALUATION PROCEDURE:

Initially, individual consultants shall be short-listed on the following minimum qualification criteria: 

- Master’s degree in the sphere of chemical matters/ hazardous wastes, biology, medical sphere or other closely related fields

- Minimum 5  years of professional experience in relevant natural sciences.

The shortlisted candidates will be further evaluated based on the following methodology - cumulative analysis: when using this weighted scoring method, the award of the contract should be made to the individual consultant whose offer has been evaluated and determined as:

- Responsive/compliant/acceptable, and suggesting the lowest price

- “Compliant/acceptable” can be determined as fully corresponding to the ToR.

* Technical Criteria weight: 70%;

* Financial Criteria weight: 30%

APPLICATION PROCEDURE:

The following documents shall be sent by applicant:

- Signed UNDP P11 form and detailed CV (up to 10 pages);

- Duly accomplished Letter of Confirmation of Interest and Availability using the template provided by UNDP;

- Financial Proposal that indicates the all-inclusive fixed total contract price, supported by a breakdown of costs, as per template provided. If an Offeror is employed by an organization/company/institution, and he/she expects his/her employer to charge a management fee in the process of releasing him/her to UNDP under Reimbursable Loan Agreement (RLA), the Offeror must indicate at this point, and ensure that all such costs are duly incorporated in the financial proposal submitted to UNDP;

- Cover letter to UNDP with description of similar consultancy assignments and other relevant information related to proposed methodology of work;

- Two recommendation letters from similar projects within last 3 years.

 *P11, the template for financial proposal and General terms and Conditions for Individual Contracts could be found here: http://www.kz.undp.org/content/kazakhstan/en/home/operations/procurement/ic-contracts.html

LUMP SUM CONTRACT

The financial proposal shall specify a total lump sum amount, and payment terms around specific and measurable (qualitative and quantitative) deliverables (i.e. whether payments fall in installments or upon completion of the entire contract). Payments are based upon output, i.e. upon delivery of the services specified in the TOR.  In order to assist the requesting unit in the comparison of financial proposals, the financial proposal will include a breakdown of this lump sum amount (including travel, per diems, and number of anticipated working days)

TRAVEL

All envisaged travel costs including trip to Astana (3 days), Kostanay region (3 days) and East-Kazakhstan region (5 days) and per diem must be included in financial proposal. In general, UNDP should not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources. In the case of unforeseeable travel, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between the respective business unit and Individual Consultant, prior to travel and will be reimbursed