Background
- Increased access to comprehensive prevention, care and treatment and impact mitigation of HIV & AIDS and other major diseases
- Effective mechanisms, including social protection in place, that address institutional barriers and socio-cultural dimensions to promote and protect the rights of the poor and most vulnerable including those affected by HIV & AIDS
- Enhanced and accessible systems of justice, legal, public information and education that promote and protect human rights and freedoms
- Increased and equitable access to comprehensive reproductive and child health facilities
- Increased and equitable access to quality formal and non-formal education including for those affected by HIV & AIDS
- Gender sensitive strategies and programmes to combat HIV & AIDS at the workplace based upon ILO Code of Conduct effectively implemented in public, private and informal sector
- Advocacy and Communication Strategies developed and implemented to address stigma & discrimination; and gender relations that render women and girls vulnerable to HIV infection
- Increased capacity and opportunities for women, the most vulnerable children and adolescents as well as PLHAs to participate in governance at all levels, including the Three Ones, and have their views heeded.
- Increased awareness, knowledge, skills and services of HIV & AIDS prevention among most vulnerable communities achieved through district and community-owned HIV & AIDS interventions
Duties and Responsibilities
- Assess the appropriateness, relevance, effectiveness, efficiency, impact and sustainability of the Joint Programme 3;
- Identify lessons learned and draw conclusions which may inform the new UNDAP programme on HIV/AIDS and which can contribute to decision making processes of the UN, GoT and partners.
- Assess the planning and monitoring of the JP3 and its AWP: the process and methodology used, providing evidences and quality of involvement of each of the 2 Governments aiming at measuring the gained capacity;
- Assess the coordination of the sub recipients by ZAC and TACAIDS for all JP3 related activities;
- Assess the funds management/allocation by UNDP for the One Fund and UN Agencies for their parallel resources: system used, its constraints and its advantages.
- How relevant were the JP3 outcomes and outputs in assisting the achievement of Tanzania’s national development goals?
- To what extent were partners involved in the development and implementation of the JP3?
- What evidence is there for evidence based programming (i.e. information generated from situation analysis translated into a response in an appropriate manner).
- To what extent did UN agencies plan together? Did the plans demonstrate coherence and delivering as one?
- To what extent were the management and administrative set up necessary and adequate to deliver the Joint Programme?
- To what extent was the Joint Programme cost effective, in terms of reducing transaction costs internally as well as externally?
- Were the institutional and management arrangements supportive to attainment of the intended objectives? Did the PUNs position the appropriate human resource capacity to reflect the strategic orientation of the programme?
- How efficiently has the JP3 delivered its outputs and outcomes?
- How were the funding modalities used by the UN appropriate, including use of national systems for disbursement?
- To what extent were the key results achieved?
- What were the major factors influencing the (non)achievement of the desired results, including institutional, management and fiscal arrangements?
- What results (outputs and outcomes) has the JP3 achieved since its commencement?
- Has the programme made a difference to the lives of host communities?
- How are impacts different according to gender, age and other vulnerability category (e.g. women, girls, children and key populations such as drug users and sex workers)?
- How sustainable is the progress made and achievements of the JP3?
- What are the major factors which have influenced the relevance, effectiveness, efficiency and sustainability of the JP3?
- What approaches are the JP3 PUNs taking to the building of national capacities? How effective are these approaches?
- What are the key lessons learned from the JP3 and how can they inform future UN, GoT and DP decision making processes?
- What factors favorably or adversely affected the spirit of delivering as one?
- What links exist between national (TACAIDS/ZAC) and field level coordination (including the CMACs and Regional Facilitation Teams)?
- Are there any critical technical gaps in the coordination structures?
- Were cross – cutting considerations mainstreamed in the implementation of activities?
- To what extent did the programme involve the host communities and other stakeholders in programme design and implementation?
- Were the capacity development activities informed by capacity assessment at different levels?
- To what extent was the local context (e.g. gender) taken into consideration when the JP3 was designed?
- To what extent were the principles of Delivering as One in terms of joint programming, planning, implementation and monitoring across PUN agencies adhered to?
- To what extent did the program adhere to the performance indicators outlined in the One Programme document and the Delivering as One vision?
- What factors facilitated or adversely impacted upon Delivering as One?
- What additional measures (if any) could have improved the relevance, effectiveness, efficiency, impact or sustainability of the JP3?
- What lessons can be applied in terms of collaborative programme planning, implementation and monitoring to the implementation of the UNDAP 2011-2015?
- What key measures can the UN in Tanzania, regionally and at HQ, plus the Government of Tanzania and Development Partners (DPs) adopt to improve the implementation and performance of the One Programme under DaO?
- The evaluation is results focused;
- The evaluation will adopt a consultative, iterative and transparent approach with stakeholders;
- Triangulation of information and data across groups of stakeholders and individuals will be the key method to validate evidence, throughout the whole evaluation process;
- The evaluation is cost-effective;
- The evaluation will strictly adhere to the UNEG Norms & Standards.
- Debriefing sessions with the stakeholders (inception, data collection, analysis phases);
- Evaluation matrix relating evaluation issues and questions to evaluation criteria, indicators, sources of information and methods of data collection (inception phase);
- Mapping exercise of the main focus areas of the Joint Programme work (inception phase);
- Desk review of reference documents (inception and data collection phase);
- Individual and group interviews with stakeholders including representatives from Government, JP Steering Committee (and other JP management structures), JP Implementing partners, DPs, UN Agencies, UN Resident Coordinator’s Office, One Fund Administrative Agent (data collection phase);
- Checklists or semi-structured interview protocols for each type of interview (inception phase);
- Establishment of historical causality: a time-line and narrative about the milestone events in the DaO process at country and international level (inception and data collection phase);
- Field observation (data collection phase);
- Thematic studies on specific areas of focus of the Joint Programme, as relevant and appropriate (data collection phase).
- Lessons learning workshop which brings together all the key stakeholders and implementers of the programme (what worked well and why; what didn’t work well and why; what can we learn and what can we do about it in future).
- An inception report: the evaluation team shall prepare an inception report containing a clear work plan, interpretation of the suggested evaluation questions and observations on their evaluability, specific data collection methods, assessment tools such as questionnaires and the specific key informants.
- Presentation of and preliminary findings: At the end of the field work, the evaluation team will present their draft findings and provisional recommendations. The evaluation team will also make a PowerPoint presentation summarizing the main findings recommendations and lessons learned and conclusions
- Draft Report: The evaluation team will prepare a draft report for comments by stakeholders. This should be a focused document containing an executive summary, background, introduction findings, conclusions, recommendations, lessons learned and annexes. It should also clearly state the limitations of the methodology followed.
- Final Report: Based on the comments received from stakeholders, the evaluation team shall submit four hard copies and an electronic version of the final report within 2 weeks of receiving comments.
- Assessing the tenders and managing the consultant recruitment process of the independent evaluation team
- Overseeing the evaluation process throughout its entire duration
- Managing the evaluation budget including drafting financial reports.
- Facilitate visits in consultation with UNAIDS, PUNs, TACAIDS, ZAC and relevant MDAs, Regions and Districts.
- Facilitating the work of the independent evaluation team by ensuring that all relevant contacts and information are available.
- Coordinating any stakeholder workshops in consultation with key stakeholders, and the evaluation team including, among other things: drafting the agenda, identifying materials for consultation and distribution, coordinating with participants; and drafting the stakeholder report.
Competencies
The evaluation team will be comprised of two (2) evaluation professionals (1 international and 1 national consultant) who, as a team, have a solid understanding of the national context, the JP3 focus area and a proven track record of conducting evaluations in a professional manner. To the extent possible the composition of the evaluation team will be gender balanced and utilize regionally based expertise. Full competency in English (written and spoken) is required. Kiswahili will be considered an advantage. The evaluation team is expected to be fully self-sufficient in terms of IT/office equipment, stationary, communication, office space, accommodation, transport and other logistics.
The evaluation team will be responsible for conducting the evaluation. This entails among other responsibilities designing the evaluation according to the specific terms of reference; gathering data from different sources of information; analyzing, organizing and triangulating the information; identifying patterns and causal linkages that explain current performance; drafting evaluation reports at different stages (inception, drafts, final); responding to comments and factual corrections from stakeholders and incorporating them, as appropriate, in subsequent versions; addressing comments by the external Quality Assurance Panel; and making briefs and presentations ensuring the evaluation findings, conclusions and recommendations are communicated in a coherent, clear and understandable manner once the report is completed.
Required Skills and Experience
- Master’s degree in Public Health, international development, monitoring & evaluation or related field.
- A minimum of 10 years of professional experience specifically in the area of evaluation of international development initiatives and development organizations.
- Substantial international track record of conducting different types of evaluations, including process, outcome and impact evaluations in different countries and organizations.
- Experience in M&E of cross-cutting issues including HIV/AIDS, human rights, gender and capacity development.
- Must not have been part of the design, implementation of JP3 or employed by any of the partner organizations during the time of implementation of JP3.
- Knowledge and experience of the UN System and the UN Reform process.
- Understanding of the development context in Tanzania and/or other ‘Delivering as One’ countries would be a clear advantage.
- Excellent communication and interview skills.
- Excellent report writing skills.
- Demonstrated ability to deliver quality results within strict deadlines.
- Master’s degree in Public Health, Epidemiology of HIV/AIDS and programming, monitoring and evaluation or related field.
- A minimum of seven years of professional experience, specifically in the area of monitoring and evaluation of international development initiatives and development organizations.
- A track record of conducting various types of evaluations, including process, outcome and impact evaluations in Tanzania and preferably in the region.
- Experience in M&E of cross-cutting issues including HIV/AIDS, human rights, gender and capacity development.
- Must not have been part of the design, implementation of JP3 or employed by any of the partner organizations during the time of implementation of JP3.
- Knowledge and experience of the UN System and the UN Reform process.
- In-depth understanding of the development context in Tanzania.
- Excellent communication and interview skills.
- Excellent report writing skills.
- Demonstrated ability to deliver quality results within strict deadlines.