Background

Active Labour Market Programmes 2 has been the flagship project in the reforms of Public Employment Services, as well as in direct provision of skills development and employment opportunities to jobseekers. The project has worked to improve the labour market institutions’ capacities to design relevant policies at central level and deliver integrated services at local level. Through a comprehensive and scaled-up approach, the overall goal has been to build-up on long-standing UNDP achievements in addressing Kosovo’s labour market challenges, as well as to pave the way for long-term and sustainable local mechanisms that are capable to address such challenges on their own.

The project strengthens and ensures the sustainability of the links between labour market actors-employers, jobseekers, policy makers, public employment services and vocational training and educational institutions. By improving the business processes for integrated service delivery in offices where physical infrastructure allows the vulnerable youth across Kosovo, with a focus on women, receive integrated employment services.

Active Labour Market Programmes 2 (ALMP2) is a multi-year project, designed together with the Ministry of Labour and Social Welfare (MLSW) in line with the strategic priorities as outlined in the Sector Strategy 2014 – 2020 of the MLSW. The project is implemented together with the Ministry of Labour and Social Welfare as the main project partner and is financed by the Ministry of Labour and Social Welfare (MLSW), the Ministry of Internal Affairs (MIA) and the United Nations Development Programme (UNDP), building on the generous investment of the MFA of Finland. In the beginning of 2016, the Ministry of Internal Affairs approved the second phase of the joint UNDP/MLSW project component on reintegration of repatriated persons as jobseekers, utilizing the collaboration platforms established by ALMP.

The projects’ main objective is to improve the capacities of the labour market institutions to design relevant gender responsive policies at central level and to deliver integrated services at local level, focusing on the most vulnerable groups among the unemployed.

Start/end dates of the project subject to impact external evaluation are, January 2014 - December 2022.

Further information on the project is available here: https://www.undp.org/kosovo/projects/active-labour-market-programmes-2

Main Project Partner(s) over the implementation years were: The Ministry of Labour and Social Welfare (MLSW)  subject to change in Ministry of Finance Labour and Transfers (MFLT), Kosovo Employment Agency (KEA) , Regional and Municipal Employment Offices, Vocational Training Centers (VTC), Ministry of Internal Affairs (MIA), Municipal Offices for Communities and Returns (MOCR), Municipalities, Private Sector Enterprises, Civil Society Organizations (CSO’s), Ministry of Education, Science and Technology (MEST), Ministry of Trade and Industry (MTI), Kosovo Agency for Statistics (KAS), other labour market institutions, Regional Development Agencies (RDA), Business Associations (BA).

As the project entered its final stage of implementation, the project will hire international Evaluation Consultant to conduct a final project evaluation to assess the overall progress towards the expected results and provide recommendations for future similar interventions.

Assignment will be conducted in line with UN 8 Point Agenda and the UNDP Gender responsive mandate.

 

Objective of the Assignment

The overall objective of this assignment is to conduct a final evaluation of the project in terms of its relevance, impact, effectiveness, efficiency, and sustainability, and elaborate on the lessons learned and recommendations for future interventions of similar nature.

The evaluation will take a specific overview of the projects’ active labour market measures (almm’s) components, by gathering perceptions, aspirations, feedback and data from relevant partners, stakeholders and beneficiaries for objective analysis and conduct of the evaluation. 

Duties and Responsibilities

The evaluation will look to underline the key factors that have either facilitated or impeded project implementation. The International expert will work together with and lead the Local expert, under direct supervision of the Project Manager, in close consultation with the Programme Team. The project team will provide information on administrative and logistical support as needed.

The international evaluation consultant will undertake the following duties and responsibilities:

  • In close cooperation with the Local Evaluation consultant, conduct a comprehensive desk review of project-related documents and UNDP evaluation policies and based on this information, draft and submit an inception report containing the following: a.) the appropriate methodology to be applied during the evaluation; b.) the work plan and any technical instruments to be used during the assignment, while being guided by the set of evaluation questions as presented. Together with the Local Evaluation Expert conduct on-site field visits, meetings, discussions, and interviews with stakeholders of the project (Ministry of Finance, Labour, and Transfers/Department for Social Policies and Family Planning, Ministry of Internal Affairs (MIA), Kosovo Employment Agency (KEA), Municipal Employment Offices and Vocational Training Centres.)The Evaluation Team is also expected to conduct interviews and meetings with UNDP senior management and Programme, and ALMP2 team. The Evaluator is expected to share the list of interviews to be conducted beforehand and receive feedback and clearance from UNDP.
  • Organize a debriefing workshop with UNDP and key stakeholders is held and initial findings and recommendations presented.
  • As per the model agreed from the inception report and on the feedback received by stakeholders and also during the debriefing workshop/session, prepare the final evaluation report containing the methodology applied, a presentation of findings and clear strategic recommendations to the UNDP and its partners for future similar interventions. These recommendations should contain specifically to whom of each of the partners of the project they are addressed. The evaluation consultant will be responsible for all components of the evaluation, and responsible for provision of deliverables listed on time and of acceptable quality of reports, in accordance with the Terms of Reference, ensuring the quality of all products. The reports will be delivered in English language, be qualitative in content and accessible on data (not photo or pdf) due to adding’s and translation in local languages.
  • The final evaluation report must include, but not necessarily be limited to, the elements outlined below:
  1. Title and opening pages
  2. Table of contents
  3. List of acronyms and abbreviations
  4. Executive summary
  5. Introduction and overview
  6. Description of the intervention
  7. Evaluation scope and objectives
  8. Evaluation methodology
  9. Data analysis
  10. Findings and conclusions 
  11. Recommendations  
  12. Lessons learned
  13. Annexes

Finalize the final evaluation report, accounting for the UNDP feedback on the first draft.

Evaluation questions:

Relevant evaluation criteria

Key questions suggested

Project design & contextual relevance:

  • To what extent the Project's objectives are still valid?
  • To what extent the cross-cutting issues (such as environment, gender equality, women empowerment, human rights-based approach, and social standards), principles and quality criteria?
  • Does the Project respond to the needs of the identified target groups and beneficiaries? 
  • Were the unique needs of jobseekers taken into consideration / to what extent was gender equality addressed, were there obstacles in respond to programme?
  • Were all procedures and beneficiaries respected and mainstreamed within the programme implementation?
  • Was the design of the Project appropriate for reaching its results and outcomes?
  • Have any changes been made to the Project’s design during the implementation? If yes, did they lead to significant design improvements? Were coordination, management and financing arrangements clearly defined and did they support institutional strengthening and local ownership?

Effectiveness

  • To what extent have the Programme outputs and outcomes been achieved? Are they on track to be achieved as planned during the Programme? 
  • What factors contributed to progress or delay in the achievement of products and results?
  • What good practices or successful experiences or transferable examples have been identified?
  • What is the quality of interventions and results achieved with main Project stakeholders?
  • Have any changes in the overall context in Kosovo affected Project implementation and overall results?

Project Efficiency:

  • To what extent has support to given to the project beneficiaries by the implementing partners been an efficient implementation modality?
  • To what extent have the target population and participants jobseekers taken an active role in implementing the Programme? What modes of participation have taken place?
  • What factors contributed to progress or delay in the achievement of products and results?
  • What good practices or successful experiences or transferable examples have been identified?
  • What is the quality of interventions and results achieved with main Project stakeholders?
  • To what extent were activities implemented as scheduled and with the planned financial resources?
  • Is there any duplication of efforts, including stakeholders, implementing partners, if no, was the programme so unique in content? if yes, how this was coordinated between coordination bodies/stakeholders or implementing partners, as a tested product or ownership?  What was the effectiveness or difference on each approach/case?
  • What factors contributed to effectiveness or ineffectiveness?

Sustainability

  • Has the Project created conditions to ensure that benefits continue beyond the Project activities?
  • How has the Project institutionalized overall capacity development efforts so far?
  • Has an approach/model been developed that can be further disseminated throughout Kosovo?
  • Is the duration of the current Project sufficient to ensure sustainability of the interventions?
  • Which recommendations can be made to inform future strategies and program?
  • Has the project used introduced contemporary/innovative approaches to solving issues of unemployment?
  • How is the project ensuring sustainability of its results and impacts (i.e., strengthened capacities, continuity of use of knowledge, improved practices, etc.)?
  • Do the legal frameworks, policies and governance structures and processes within which the project operates pose risks that may jeopardize sustainability of project benefits?
  • What is the risk that the level of stakeholders’ ownership will be sufficient to allow for the project benefits to be sustained?

Stakeholders and Partnership Strategy

  • Are the Project's objectives and outcomes consistent and supportive of governmental policies and sectoral policies (where relevant)?
  • To what extent have partnerships been sought and established and synergies created in the delivery of assistance?
  • To what extent do stakeholders support the project’s long-term objectives?
  • Were efficient and mutually satisfactory cooperation arrangements established between Project Team and public institutions?  Private sector?
  • Were partners’ inputs of quality provided in a timely manner?
  • Have partners fully and effectively discharged their responsibilities? Does the Project contribute to the overall UN Country Strategy? Have any new partners emerged that were not initially identified?
  • How has the project implemented the commitments to promote local ownership, alignment, harmonization, management for development results and mutual accountability?

Theory of Change or Results/Outcome Map

  • Was the Theory of Change or project logic feasible and was it realistic?
  • Were assumptions, factors and risks sufficiently taken into consideration

Human rights

  •   To what extent have poor, minority groups, physically challenged, women and other disadvantaged and marginalized groups benefited from the project?

Gender

  • To what extent have gender equality and the empowerment of women been addressed in the design, implementation and monitoring of the project?
  • Is the gender marker data assigned to this project representative of reality?
  • To what extent has the project promoted positive changes in gender equality and the empowerment of women?
  • Were there any unintended effects?
  • Does the Project respond to the needs of the identified target groups and beneficiaries? 

 

Methodology and Evaluation Ethics

 

The Evaluation Team may employ any relevant and appropriate quantitative or qualitative methods it deems appropriate to conduct the project evaluation. Methods should include a desk review of documents; interviews with stakeholders, partners, and beneficiaries; field visits; use of questionnaires or surveys, etc. However, a combination of primary and secondary, as well as qualitative and quantitative data should be used. The Evaluation Team is expected to revise the methodological approach in consultation with key stakeholders as necessary, particularly the intended users and those affected by evaluation results. The Team should present its findings in both quantitative data and qualitative recommendations.

 

The Evaluation Team is expected to hold interviews and meetings with the relevant staff of UNDP, ALMP2, main Project partners and beneficiaries (Ministry of Finance, Labour, and Transfers/Department for Social Policies and Family Planning, Ministry of Internal Affairs, Employment Agency of Kosovo (EARK), Municipal Employment Offices and Vocational Training Centers.) The team will be expected to share the list of interviews to be conducted with UNDP ALMP2 beforehand.

The suggested methodology should be compatible with the UNDP approach to evaluations as described in the Handbook for Planning, Monitoring and Evaluation. 

 

The Evaluation Team is expected to use its findings and expertise to identify the lessons learned, and to propose recommendations for improving the project’s future efforts toward achieving the expected results. Prior to the Evaluation Team’s arrival, it will receive a list of documents to be consulted for its review. The Team will have latitude to design a detailed evaluation scope and methodology and will present a proposed work plan as part of the inception report to UNDP before arrival to Kosovo in order to optimize the time spent during the field mission.

 

The final evaluation will be conducted in accordance with the principles outlined in the UNED ‘Ethical Guidelines for Evaluation' The Evaluation Team must address any critical issues in the design and implementation of the evaluation, including evaluation ethics and procedures to safeguard the rights and confidentiality of information providers.

Expected Results

Tentative due dates:

Inception report containing the methodology to be applied during the final evaluation, as well as the work plan and technical instruments to be used during the course of the assignment is drafted, submitted, and endorsed by UNDP.

05 September 2022

Field visits, meeting’s agenda for conducting the interviews in Kosovo for  gathering data to be used in the final evaluation report.

30 September 2022

A debriefing workshop with UNDP and key stakeholders is held and initial findings and recommendations presented.

05 October 2022

Draft and submit final Evaluation report with the methodology applied, a presentation of findings, a presentation of the lessons learned and clear strategic recommendations to the UNDP and its partners suggesting possible adjustments for the remaining period of project’s implementation is formulated, based on the findings acquired during the field mission to Kosovo and through the relevant project documentation.

10 October 2022

A Final Evaluation report accounting for the UNDP and stakeholders’ feedback on the first draft is produced and validated by UNDP.

30 October 2022

 

 

Remuneration - Lump Sum Amount

The Contract is based on lump sum remuneration and shall be processed subject to completion and validation of deliverables as per the schedule listed below: 

  • 20% upon completion and validation of deliverable 1
  • 50% upon completion and validation of deliverables 2, 3 and 4  
  • 30% upon completion and validation of deliverable 5
     

Required Presentation of Offer: 

The following documents are requested:

  • Personal CV and P11, indicating all past experience from similar projects, as well as the contact details (email and telephone number) of the Offeror and at least three (3) professional references. 
  • Technical proposal, a max. 2-page document briefly outlining the methodology envisaged for the assignment for delivering the expected results within the indicated timeframe.
  • Financial Proposal that indicates lump sum payment based on completion of deliverables.  
  • Copy of Diplomas and copy of Passport.

 
Criteria for selection of the Best Offer

Offers will be evaluated utilizing a combined Scoring method – where the qualifications and technical proposal will be weighted a max. of 70% and combined with the price offer which will be weighted a max of 30.

Competencies

Corporate Competencies:

  • Committed to professionalism, impartiality, accountability and integrity.
  • Displays cultural, gender, religion, race, nationality, ethnicity, and age sensitivity and adaptability.
  • Demonstrates substantial experience in gender equality. Actively promotes gender equality in all activities.
  • Treats all people fairly without favouritism.

Functional Competencies:

  • Ability to work effectively within a team and develop good relationships with counterparts and stakeholders.
  • Ability to synthesise research and draw conclusion on the related subjects.
  • Ability to pay attention to details.
  • Excellent interpersonal skills and ability to communicate effectively, both orally and in writing.
  • Ability to establish effective working relations in a multicultural team environment.
  • Good organisational skills.
  • Commitment to accomplish work.
  • Responds positively to critical feedback.
  • Results and task oriented. 

Required Skills and Experience

Education:

  • Master’s degree in social sciences, economic development, public administration or other related qualification.

Experience:

  • At least 5 years of demonstrated relevant work experience/expertise in evaluation of development interventions at national and/or international level is required. 
  • Demonstrable experience with evaluation processes in field of sustainable development, economic growth, or implementation of active labour market measures.
  • Previous work experience in the Western Balkans, preferably Kosovo in particular, is considered an asset.
  • Extensive knowledge of results-based management evaluation, as well as of participatory M&E methodological and practical considerations in conducting evaluations of development interventions is required.

Language requirements:

  • Fluent in English. Excellent analytical and report writing skills in clear and fluent English.
  • Knowledge of Albanian and/or Serbian languages is an asset. 

 

Application Instructions:

  • Click on the "Apply now" button.
  • Input your information in the appropriate Sections: personal information, language proficiency, education, resume and motivation; You can type in, or paste your short Resume into the last box.
  • Upon completion of the first page, please hit "submit application" tab at the end of the page. On the next page, you will be asked to upload your Resume.
  • System will only allow one attachment. All docs (CV; P11; financial offer; list of similar profiles should be included as one attachment).
  • Please make sure to submit all the requested documents/information; otherwise, your application will be considered incomplete.