Background

Phased refusal from inefficient lighting is one of the most affordable and effective ways of fighting climate change. Global demand for electric energy for lighting in 2030 may remain at the same level or even decrease in case of the application of innovative technologies.
Long-term objective of the UNDP / GEF Project (the Project) is the achievement of energy efficiency and the reduction of greenhouse gas emissions through the transformation of lighting products market in the Republic of Kazakhstan, including the implementation of phased decommissioning of incandescent light bulbs, while ensuring the quality of alternative products and cost-effectiveness as well as secure disposal of spent mercury lamps.

The objectives will be achieved based on the following four components:

• Policy design and implementation;
• Development of energy efficient lighting market;
• Teaching and outreach activities;
• Demonstrational projects, including best practices and technologies. To implement and complete all project components, detailed experts support and overall advices are required taking into account elaborated by national experts documents in the project framework.

Duties and Responsibilities

Mid-term evaluation is carried out on the initiative of UNDP country office in Kazakhstan in accordance with UNDP-GEF guidance on monitoring and evaluation for the assessment of overall project progress, to make sure that the project is developing according to the plan and to ensure the attainment of agreed outcomes and to prepare recommendations should any corrections be necessary.

Mid-term evaluation objectives:

• Evaluation of overall activity outcomes in comparison with the objectives and final project outcomes presented in Project document, Project Logical Framework and other related documents;
• Evaluation of project effectiveness and efficiency;
• Analysis of the project implementation and management mechanisms;
• Evaluation of the progress made in the achievement of final outcomes;
• Study of existing strategies and plans on the achievement of common project objective within specified timeframe;
• Assessment of sustainability of activities implemented within the project framework;
• Description and documentation of preliminary lessons in the area of project design, implementation and management;
• Assessment of project relevance from the point of view of national priorities;
• Guidance in relation to future project activities and in case of necessity in relation to implementation and management mechanisms;
• Presentation of lessons learned for future reference.

In particular, evaluation will assess the progress in identifying background information and the difficulties related to project implementation as well as their causes, it will also present recommended corrective action plans. Effective measures on elimination of identified problems holding back project implementation will serve as a condition for determining whether project implementation should continue on:

• Project outcomes will be assessed based on logical framework matrix (see Attachment 3) identifying clear indicators of project dynamics and impact as well as relevant ways of their confirmation. The degree of success will be determined by means of following up the changes in comparison to preconditions. Logical framework was updated during the initial project stage along with a set of indicators that were reviewed for ensuring greater clarity and reliability of the system.
• It is expected that the group which will be making the assessment, will work with key concerned parties of the project, including the Ministry of Industry and New Technologies, Kazakh Institute of Standardization and Certification, technical Higher Institutions, National Chamber of Housing and Construction, local authorities (Akimat of Astana city), private companies, manufacturers, NGOs, members of the Committee on Project management and other key partners.

Scope of work:

The main outcome of mid-term evaluation is the Report on the results of mid-term evaluation which will include:

• Observations made during project evaluation and rating;
• Conclusions;
• Recommendations on achieving sub-outcomes of the project;
• Lessons learned in regard to the best and the worst practices for the achievement of outcomes;
• Progress rating in the achievement of sub-outcomes.

It is expected that the report will have the following structure:

• Executive summary;
• Brief overview of the project;
• Context and purpose of the evaluation;
• Main conclusions, recommendations and lessons learned;
• Introduction;
• Project background;
• Purpose of evaluation;
• Main issues considered during evaluation;
• Evaluation results and their use;
• Evaluation methodology;
• Structure of evaluation;
• The Project and its context in the field of development;
• Beginning and duration of the project;
• Status of project implementation;
• Problems to be solved by the project;
• Top-priority objectives and objectives in the field of development;
• Main parties concerned;
• Deliverables;
• Analysis of the situation in regard to outcomes, sub-outcomes and partnership strategy;
• Observations and conclusions;, Project formulation
• Project relevance;
• Approach to implementation;
• Obligations and commitment of the parties;
• Participation of the parties concerned;
• Approach to dissemination of the results;
• Cost-effectiveness;
• Sustainability;
• Relationship among the project and other sectoral initiatives;
• Management mechanisms.

Project implementation

• Financial management;
• Monitoring and evaluation;
• Management and coordination;
• Risk identification and management (adaptive management).

Outcomes

• Achievement of outcomes, sub-outcomes and objectives;
• Impact of the project;
• Sustainability prospects;
• Conclusions and recommendations.

Observations

• Corrective measures on the concept, duration, implementation, monitoring and project evaluation;
• Activities aimed at strengthening and consolidating project benefits;
• Suggestions for future activities aimed at the achievement of primary objectives;
• Suggestions on increasing responsibility/commitment, potential risks management.

Lessons learned

• Best practices and lessons learned on solving the issues related to efficiency, cost-effectiveness and relevance
• Attachments;
• Terms of reference for evaluation.

Program

• The List of persons interviewed;
• Brief description of site visits;
• The list of reviewed documents;
• Applicable questionnaire (if it was used) and main findings;
• Comments of the parties concerned (only in case of discrepancies with the observations and conclusions made during evaluation).

Total expected volume of the report is about 50 pages. The first version of the report should be submitted to UNDP country office in Kazakhstan within 2 weeks (the timeframe will be agreed on in the beginning of work) after he mission to the country for future dissemination among project key parties concerned for their comments. Any discrepancies among evaluator’s interpretation and project key parties concerned will be explained in the attachment to final report.

Competencies

Corporate skills

• Demonstrate integrity by modeling values and UN ethic standards;
• Promote UNDP vision, mission and strategies;
• Demonstrate culture, gender, religion, nationality  and age tolerance and ability to adopt.

Knowledge management and training

• Share own knowledge and experience;
• Give helpful advises and comments to colleagues;
• Skills to work in team, good organizational and communicative skills.

Leader’s ability and self-control

• Focus on work with a customer;
• Constructive and enthusiastic approach to scope of work rendered;
• Demonstrate ability to stay possessed and keep control in a stressful situation;
• Response friendly to critics and dissent.

Required Skills and Experience

Education:

• University degree in economics, energy management, policies in the area of environmental protection or related disciplines.

Experience:

• At least 10 years of experience in relevant areas;
• Recent experience with the methodologies on management assessment based on outcomes;
• Experience in participatory approaches to monitoring on the basis of stakeholder participation;
• Experience with the use of SMART indicators (specific, measurable, attainable, realistic and timely) and the reproduction or justification of baseline scenarios;
• Knowledge of GEF Monitoring and Evaluation policies;
• Knowledge of UNDP policies and procedures for the assessment based on the outcomes;
• Competence in the field of adaptive management applied to projects on climate change and energy resource management;
• Recognized knowledge and skills in the area of energy resource management for sustainable use;
• Familiarity with the energy sector, policy and regulation in the field of renewable energy sources in Kazakhstan;
• Experience in project evaluation in the UN system would be an advantage;

Language requirements:

• Excellent knowledge of English, communication skills;
• Knowledge of the Russian language is an advantage.

For detailed information please refer to UNDP Kazakhstan web site.