Background
HYPERLINK: http://www.undp.org.rs/jobs_new.html. Please follow the instructions provided in the mentioned documents under the section Application Procedure when applying for this consultancy.
Period of assignment/services: 2 months (mid-September 2014 – mid-November 2014)
Proposal should be submitted at the following address:
http://www.undp.org.rs/jobs_new.html under section “Jobs” no later than 27 June 2014.
Any request for clarification must be sent by standard electronic communication to the e-mail: vacancy.rs@undp.org.
The procuring UNDP entity will respond by standard electronic mail and will send response, including an explanation of the query without identifying the source of inquiry, to all consultants.
Applications received without the requested documentation may not be considered.
Purpose
The Terminal Evaluation is initiated by the UNDP CO Serbia as the Implementation Agency for the project “Support to the Sustainable Transport in the City of Belgrade” and it aims to determine whether the project has met its objectives accordingly, to document the lessons learned and best case practices, and to recommend the most appropriate next steps to ensure the sustainability of results.
Objective
This terminal evaluation is intended to assess the relevance, performance and success of the project. It looks at early signs of potential impact and sustainability of results, including the contribution to capacity development and the achievement of global environmental goals. It will also identify/document lessons learned and make recommendations that might improve design and implementation of other UNDP-GEF projects.
The evaluator should seek the perspectives of the different project stakeholders, mainly in the Ministry of Agriculture and Environmental Protection, the City of Belgrade (Secretariat for Transport and Belgrade Land Development Agency) UNDP CO, members of the Project Board, and other project stakeholders, and ensure such perspectives are duly reflected in the evaluation.
More specifically the purpose of the TE is:
- To assess overall performance against the project objective and outcomes as set out in the Project Document and other related documents;
- To assess the effectiveness and efficiency of the project;
- To analyze critically the implementation and management arrangements of the project;
- To assess the progress towards achievement of the outcomes;
- To assess the sustainability of the project’s interventions;
- To list and document initial lessons concerning project design, implementation and management;
- To assess project relevance to national priorities;
- To provide lessons learned for the future.
- More detailed information could be found in Terms of Reference at the link: http://www.undp.org.rs/jobs_new.html.
Duties and Responsibilities
Scope of work
The evaluation will focus on the range of described aspects. In addition to a descriptive assessment, all criteria (relevance, effectiveness and efficiency) should be rated using the following divisions: Highly Satisfactory, Satisfactory, Marginally Satisfactory, or Unsatisfactory. All ratings given should be properly substantiated.
Methodology
The evaluation approach will combine methods such as documentation review (desk study); interviews; and field visits. All relevant project documentation will be made available to the consultant by the project management team, facilitated by UNDP. After studying the documentation the consultant will conduct interviews with all relevant partners including the key partners and beneficiaries. Validation of preliminary findings with stakeholders will happen through circulation of initial reports for comments or other types of feedback mechanisms.
Throughout the period of the evaluation, the consultant will liaise closely with the UNDP CO, UNDP/GEF RTA, the concerned agencies of the Government and the counterpart staff assigned to the project. The consultant can raise or discuss any issue or topic it deems necessary to fulfill the task, the consultant however is not authorized to make any commitments to any party on behalf of UNDP or the Government.
Although the Evaluator should feel free to discuss with the authorities concerned, all matters relevant to its assignment, it is not authorized to make any commitment or statement on behalf of UNDP or GEF or the project management.
The Evaluator should reflect sound accounting procedures and be prudent in using the resources of the evaluation.
The evaluation should assess:
Project concept and design
The evaluators will assess the project concept and design. He/she should review the problem addressed by the project and the project strategy, encompassing an assessment of the appropriateness of the objectives, planned outputs, activities and inputs as compared to cost-effective alternatives. The executing modality and managerial arrangements should also be judged. The evaluator will assess the achievement of indicators and review the work plan, planned duration and budget of the project.
Implementation
The evaluation will assess the implementation of the project in terms of quality and timeliness of inputs and efficiency and effectiveness of activities carried out. Also, the effectiveness of management as well as the quality and timeliness of monitoring and backstopping by all parties to the project should be evaluated. In particular, the evaluation is to assess the Project team’s use of adaptive management in project implementation starting from the inception workshop.
More detailed information could be found in Terms of Reference at the link: http://www.undp.org.rs/jobs_new.html.
Competencies
- Excellent analytical skills;
- Displays ability to synthesize research and reach empirically based conclusions on related subject;
- Strong writing skills;
- Proven capacity to produce reports;
- Displays capacity to provide experienced advice on best practices;
- Possesses knowledge of inter-disciplinary development issues;
- Focuses on result for the client and responds positively to feedback;
- Good application of Results-Based Management;
- Good communication, coordination and facilitation skills;
- Consistently ensures timeliness and quality of work;
- Treats all people fairly without favourism;
- Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability;
- Demonstrates integrity by modeling ethical standards;
- Ability to deliver when working under pressure and within changing circumstances;
- Consistently approaches work with energy and a positive, constructive attitude;
- Excellent interpersonal skills.
Required Skills and Experience
- Masters or equivalent in relevant field of transport, mobility, traffic engineering, civil engineering, urban planning, architecture.
- Minimum 7 years of relevant professional experience, preferably in international/multilateral development context;
- Minimum 5 years of experience in management or implementation of projects related to transport and urban mobility issues;
- Prior proven experience as an evaluator of transport related projects ( please submit a proof for this requirement);
- Experience in evaluating and monitoring technical cooperation and development activities and projects.
- Excellent understanding of Serbia's socio-economic situation;
- Understanding of current policies and legislation on environment, climate change, transport and urban mobility;
- Knowledge of EU environment, climate change and mobility policy will be an asset;
- Recent knowledge of the GEF Monitoring and Evaluation Policy;
- Project evaluation experiences within United Nations system will be considered an asset;
- Knowledge in the use of computers and office software packages and handling of web based monitoring systems.
- Excellent knowledge of written and spoken English.
The evaluators must be independent from both the policy-making process and the delivery and management of assistance. Therefore applications will not be considered from evaluators who have had any direct involvement in the design or implementation of the project. This may apply equally to evaluators who are associated with organizations, universities or entities that are, or have been, involved in the delivery of the project. Any previous association with the project, the Ministry of Agriculture and Environmental Protection, UNDP Serbia or other partners/stakeholders must be disclosed in the application. This applies equally to firms submitting proposals as it does to individual evaluators.
The application should contain:
- Cover letter explaining why you are the most suitable candidate for the advertised position and a brief methodology on how you will approach and conduct the work (based or commenting on the requirements indicated in this TOR).
- Updated P11 form including latest experience in similar projects and updated contact details of referees (blank form can be downloaded from http://europeandcis.undp.org/files/hrforms/P11_modified_for_SCs_and_ICs.doc ); );
- Financial Proposal should be provided in the document Offeror’s Letter to UNDP confirming Interest and availability for the Individual Contractor that could be found at downloaded from the following link: http://www.undp.org.rs/download/ic/Confirmation.docx (only PDF will be accepted). It shall specify a total Lump Sum Amount for the tasks specified in this announcement.
Please note that the financial proposal is all-inclusive and shall take into account various expenses incurred by the consultant/contractor during the contract period (e.g. fee, health insurance, vaccination, office costs and any other relevant expenses related to the performance of services). All envisaged travel costs must be included in the financial proposal. This includes all travel to join duty station/repatriation travel.
Payments will be made to the consultant in two instalments as follows:
30% of the lump sum amount will be done upon completion of deliverable 1 in TOR;
70% of the lump sum amount upon satisfactory completion of the final report and following confirmation from UNDP that the consultant has delivered on the contract obligations in a satisfactory manner.
Individual Consultants are responsible for ensuring they have vaccinations/inoculations when travelling to certain countries, as designated by the UN Medical Director. Consultants are also required to comply with the UN security directives set forth under dss.un.org.
General Conditions of Contracts for the services of Individual Contractors could be found at the following link: http://www.undp.org.rs/download/General Conditions IC.docx.
Evaluation criteria:
Individual consultants will be evaluated based on the following methodologies:
Cumulative analysis
When using this weighted scoring method, the award of the contract should be made to the individual consultant whose offer has been evaluated and determined as:
- Responsive/compliant/acceptable; and
- Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation;
- Technical Criteria weight 70%;
- Financial Criteria weight 30%.
Only candidates obtaining a minimum of 49 point would be considered for the Financial Evaluation.
Qualified women and members of minorities are encouraged to apply.
Incomplete applications will not be considered. Please make sure you have provided all requested materials.
More detailed information on the evaluation criteria could be found in the Procurement Notice at the following link: http://www.undp.org.rs/jobs_new.html.
The criteria of utility, credibility, and relevance/appropriateness will be used for assessing the quality of the evaluation report:
- The report has to be written in clear language (English);
- The Executive Summary should be an extremely short chapter, highlighting the evaluation mandate, approach, key findings, conclusions and recommendations;
- The information in the report has to be complete, well structured and well presented;
- The information in the report has to be reliable i.e. well documented and supported findings;
- The information in the report has to addresses priority or strategic information needs;
- Recommendations have to be concrete and implementable;
- Human rights and gender equality perspective has been taken into account;
- The evaluation has to be conducted in accordance with the principles outlined in the Ethical Guidelines for Evaluation. Code of conduct is enclosed as Annex I and constitutes integral part of this ToR.
Additional Information:
- Individual Contract (IC) will be applicable for individual consultants applying in their own capacity. If the applicant is employed by any legal entity, IC would be issued upon submission of Consent letter from the employer acknowledging the engagement with UNDP. Template of General Conditions on IC could be found on: http://www.undp.org.rs/download/General%20Conditions%20IC.docx. Reimbursable Loan Agreement (RLA) will be applicable for applicants employed by any legal entity. Template of RLA with General Terms and Conditions could be found on: http://www.undp.org.rs/download/RLA%20with%20General%20Terms%20and%20Conditions.doc. In the case of engagement of Civil servants under IC contract modality a no-objection letter and confirmation of unpaid leave provided by the Government entity is required.
Engagement of Government Officials and Employees
- Government Officials or Employees are civil servants of UN Member States. As such, if they will be engaged by UNDP under an IC which they will be signing in their individual capacity (i.e., engagement is not done through RLA signed by their Government employer), the following conditions must be met prior to the award of contract:
A “No-objection” letter in respect of the individual is received from the Government employing him/her, and;
The individual must provide an official documentation from his/her employer formally certifying his or her status as being on “official leave without pay” for the duration of the IC; - The above requirements are also applicable to Government-owned and controlled enterprises and well as other semi/partially or fully owned Government entities, whether or not the Government ownership is of majority or minority status. UNDP recognizes the possibility that there are situations when the Government entity employing the individual that UNDP wishes to engage is one that allows its employees to receive external short-term consultancy assignments (including but not limited to research institutions, state-owned colleges/universities, etc.), whereby a status of “on-leave-without-pay” is not required. Under such circumstance, the individual entering into an IC with UNDP must still provide a “No-objection” letter from the Government employing him/her. The “no objection” letter required under (i) above must also state that the employer formally certifies that their employees are allowed to receive short-term consultancy assignment from another entity without being on “leave-without-pay” status, and include any conditions and restrictions on granting such permission, if any. The said document may be obtained by, and put on record of, UNDP, in lieu of the document (ii) listed above.
Annex I
Ethical Code of Conduct for UNDP Evaluations
(Integral part of ToR)
Evaluations of UNDP-supported activities need to be independent, impartial and rigorous. Each evaluation should clearly contribute to learning and accountability. Hence evaluators must have personal and professional integrity and be guided by propriety in the conduct of their business.
Evaluators
- Must present information that is complete and fair in its assessment of strengths and weaknesses so that decisions or actions taken are well founded;
- Must disclose the full set of evaluation findings along with information on their limitations and have this accessible to all affected by the evaluation with expressed legal rights to receive results;
- Should protect the anonymity and confidentiality of individual informants. They should provide maximum notice, minimize demands on time, and: respect people’s right not to engage. Evaluators must respect people’s right to provide information in confidence, and must ensure that sensitive information cannot be traced to its source;
- Evaluators are not expected to evaluate individuals, and must balance an evaluation of management functions with this general principle;
- Evaluations sometimes uncover evidence of wrongdoing. Such cases must be reported discreetly to the appropriate investigative body. Evaluators should consult with other relevant oversight entities when there is any doubt about if and how issues should be reported;
- Should be sensitive to beliefs, manners and customs and act with integrity and honesty in their relations with all stakeholders. In line with the UN Universal Declaration of Human Rights, evaluators must be sensitive to and address issues of discrimination and gender equality. They should avoid offending the dignity and self-respect of those persons with whom they come in contact in the course of the evaluation. Knowing that evaluation might negatively affect the interests of some stakeholders, evaluators should conduct the evaluation and communicate its purpose and results in a way that clearly respects the stakeholders’ dignity and self-worth;
- Are responsible for their performance and their product(s). They are responsible for the clear, accurate and fair written and/or oral presentation of study limitations, findings and recommendations;
- Should reflect sound accounting procedures and be prudent in using the resources of the evaluation.