Background

Duties and Responsibilities

Objectives (evaluation criteria and key questions)

The evaluation has specific objectives:

1. Assess the relevance of UN Women contribution to the intervention at national level and alignment with international agreements and conventions on gender equality and women’s empowerment.
2. Assess effectiveness and organizational efficiency in progressing towards the achievement of gender equality and women’s empowerment results as defined in the Strategic Note.
3. Enable the UN Women Paraguay CO to improve its strategic positioning to better support the achievement of sustained gender equality and women’s empowerment.
4. Analyse how human rights approach and gender equality principles are integrated in the design and implementation of the Strategic Note.
5. Identify and validate lessons learned, good practices and examples of innovation that supports gender equality and human rights.
6. Provide insights into the extent to which the UN Women CO has realized synergies between its three mandates (normative, coordination and operational).
7. Provide actionable recommendations with respect to the development of the next UN Women Paraguay CO Strategic Note 2019-2024.

The evaluation will apply four OECD/DAC evaluation criteria (http://uneval.org/document/detail/100) (relevance, effectiveness, efficiency, and sustainability) and 11 sub-criteria. Human Rights and Gender Equality is mainstreamed as a sub-criterion. The evaluation will not consider impact (as defined by UNEG) as it is considered too premature to assess this.

The evaluation will seek to answer the following key evaluation questions and sub-questions:

The evaluation is expected to take a gender-responsive approach. Gender-responsive evaluations use a systematic approach to examining factors related to gender that assesses and promotes gender equality issues and provides an analysis of the structures of political and social control that create gender equality. This technique ensures that the data collected is analyzed in the following ways:

1. Determining the claims of rights holders and obligations of duty bearers
2. Assessing the extent to which the intervention was guided by the relevant international (national and regional) normative frameworks for gender equality and women’s rights, UN system-wide mandates and organizational objectives
3. Comparing with existing information on the situation of human rights and gender equality in the community, country, etc.
4. Identifying trends, common responses and differences between groups of stakeholders (disaggregation of data), for example, through the use of graphs or illustrative quotes (that do not allow for identification of the individual)
5. Integrating into the analysis the context, relationships, power dynamics, etc.
6. Analyzing the structures that contribute to inequalities experienced by women, men, girls and boys, especially those experiencing multiple forms of exclusion
7. Assessing the extent to which participation and inclusiveness (with respect to rights holders and duty bearers) was maximized in the interventions planning, design, implementation and decision-making processes
8. Triangulating information to identify similarities and/or discrepancies in data obtained in different ways (i.e., interviews, focus groups, observations, etc.) and from different stakeholders (e.g., duty bearers, rights holders, etc.)
9. Identifying the context behind the numbers and people (using case studies to illustrate broader findings or to go into more depth on an issue)
10. Comparing the results obtained with the original plan (e.g., through the application of the evaluation matrix)
11. Assessing the extent to which sustainability was built into the intervention through the empowerment and capacity building of women and groups of rights holders and duty bearers

The preliminary findings obtained through this process should be validated through a stakeholder workshop with evaluation management and reference groups towards the end of the field mission.

V. Scope of the evaluation

The timing of this Country Portfolio Evaluation is intended to assess the effectiveness and lessons learned as we approach the end of the current Strategic Note.

The period covered by the evaluation will be 2015-mid 2018. The CPE will focus on all activities undertaken by the CO under the Strategic Note, including general support to normative policy and UN coordination. Programme work will be considered based on the thematic areas established by the UN Women Strategic Plan 2014-2017.

The evaluator is expected to establish the boundaries for the evaluation, especially in terms of which stakeholders and relationships will be included or excluded from the evaluation. These will need to be clearly described and justified during the Inception Phase.

UN Women organizational structures and systems outside of the CO (such as regional architecture) are not within the scope of this evaluation, and should be referenced only where there is a clear implication for the design and implement of the CO Strategic Note.

The evaluation is expected to consider the main cultural, religious, social and economic differences between the different regions/ provinces covered by the evaluation when analysing the contributions of UN Women.

The evaluator is expected to undertake a rapid evaluability assessment at the inception stage. This should include the following:

1. An assessment of the relevance, appropriateness and coherence of the implicit or explicit theory of change, strengthening or reconstructing it where necessary;
2. An assessment of the quality of performance indicators in the DRF and OEEF, and the accessibility and adequacy of relevant documents and secondary data;
3. A review of the conduciveness of the context for the evaluation;
4. Ensuring familiarity with accountability and management structures for the evaluation.

The evaluation is expected to face the following logistics constraints:

• Budget and time constraints.
• The Presidential elections and General elections that took place in April 2018 increases important institutional changes with a new government that will take office on 15 August 2018. Some institutions of the Executive Branch could already have movements and new officials could not know about UNW programme.

Where these constraints create limitations in the data that can be collected, these limitations should be understood and generalizing findings should be avoided. In addition, cultural aspects that could impact the collection of data should be analyzed and integrated into data collection methods and tools. The evaluator is expected to include adequate time for testing data collection tools.

VI. Evaluation design (process and methods)

The evaluation will use a theory-based (18) design. The performance of the country portfolio will be assessed according to the theory of change stated in the Strategic Note 2015-2019. To achieve sufficient depth, the evaluation will analyze programming, coordination, and normative activities of the Country Office around the thematic areas stated in the UN Women Strategic Plan 2014-2017.

The evaluation will undertake a portfolio analysis that includes a synthesis of secondary results data for the Development Results Framework (DRF) and the Organizational Effectiveness and Efficiency Framework (OEEF) of the Country Office. This will cover all activities undertaken by the Country Office.

The portfolio analysis will be triangulated through a mixed methods approach that will include:

1. Desk review of additional documentary evidence;
2. Consultation with all main stakeholder groups; and
3. An independent assessment of development effectiveness.

The method should include a wide range of data sources (including documents, field information, institutional information systems, financial records, beneficiaries, staff, funders, experts, government officials and community groups).

The evaluation is particularly encouraged to use participatory methods to ensure that all stakeholders are consulted as part of the evaluation process. At a minimum, this should include participatory tools for consultation with stakeholder groups and the inclusion of women and individuals and groups who are vulnerable and/or discriminated against in the consultation process. The consultant should guarantee the protection of participants and respect for confidentiality.

The evaluation is encouraged to use the following data collection tools:

• Interviews
• Focus Groups
• Secondary document analysis
• Survey
• Observation
• Multimedia (video, photography, drawing)

The evaluator should take measures to ensure data quality, reliability and validity of data collection tools and methods and their responsiveness to gender equality and human rights.

The evaluation is expected to reconstruct the theory of change using a participatory process during the inception stage. This should be analyzed based on feminist and institutional analysis.

The evaluation will apply Contribution Analysis to assess the effectiveness of UN Women’s country portfolio. The evaluation will also include a basic analysis of risk in the country portfolio.

Given the small size of the portfolio, the evaluation is expected to cover interventions in all thematic areas in addition to UN coordination and normative work.

VII. Stakeholder participation

The consultant is expected to discuss during the inception phase how the evaluation will ensure participation of stakeholders at all stages, with a particular emphasis on rights holders and their representatives.

Stakeholders should include:

1. Target groups, their households and community members;
2. Programme and project partners;
3. National government institutions;
4. Internal UN Women stakeholders;
5. Civil society representatives;
6. Political leaders and representatives
7. Private sector and trade unions representatives;
8. Donors and development partners;
9. UN Country Team.

The consultant is encouraged to extend this analysis through mapping relationships and power dynamics as part of the evaluation. It is important to pay particular attention to participation of rights holders—in particular women and vulnerable and marginalized groups—to ensure the application of a gender-responsive approach. It is also important to specify ethical safeguards that will be employed.

The evaluator is expected to validate findings through engagement with stakeholders at stakeholder workshops, debriefings or other forms of engagement.

VIII. Time frame

The evaluation is expected to be conducted according to the following time frame, with the Inception Phase commencing in July.

The estimated number of person-days required for the evaluation is 40

Task                                                                                                                                Time frame                                                       Responsible party

Inception phase (desk review to prepare for evaluation)                        15 days (post contract signing)                 Evaluator

Inception Workshop and preparation of Aide Memoire                          2 days                                                                  Evaluator, task manager an                                                                                  and UNWOMEN staff

Data collection stage (field mission)                                                                  5 days                                                                  Evaluator

Reporting stage (analysis and presentation of draft Final Report)       12 days (post final data collection)         Evaluator

Evaluation Reference Group feedback to draft Final Report                  5 days                                                                  UNWOMEN evaluation                                                                                                                                                                                                                                     reference group     

Findings validation and participatory recommendations workshop    1 day                                                                    Evaluator, task manager

                                                                                                                                                                                                                        and UNW staff                                                                                                                                                                                                                      

Presentation of Final Report                                                                                5 days                                                                  Evaluator

TOTAL (Evaluator)                                                                      40 days

The evaluator is expected to design and facilitate the following events:

1. Participatory inception workshop (including refining the evaluation framework, stakeholder map, and theory of change);
2. In-country entry and exit briefs for UN Women staff and key stakeholders;
3. Findings validation and participatory recommendations workshop.

IX. Expected deliverables

This section describes the type of products (reports, briefs or other) that are expected from the evaluation, who will use them and how they will be used.

A model Final Evaluation Report will be provided to the evaluator based on the following outline. The evaluation task manager and the Regional Evaluation Specialist will quality assure the evaluation report. The draft and final evaluation report will be shared with the evaluation reference group for quality review. The final report will be approved by the Evaluation Management Group.

1) Title and opening pages

2) Executive summary

3) Background and purpose of the evaluation

4) Programme/object of evaluation description and context

5) Evaluation objectives and scope

6) Evaluation methodology and limitations

7) Findings: relevance, effectiveness (normative, coordination, operational), efficiency, sustainability, and gender and human rights

8) Conclusions

9) Recommendations

10) Lessons learned

ANNEXES:

• Terms of Reference

• Documents consulted

• Lists of institutions interviewed or consulted and sites visited (without direct reference to individuals)

• Analytical results and methodology related documentation, such as evaluation matrix

• List of findings and recommendations

X. Management of the evaluation

This evaluation will have the following management structures:

1. UN Women Evaluation Task Manager for coordination and day-to-day management;
2. Evaluation Management Group for decision-making: Country Representative, Evaluation Task Manager, Regional Evaluation Specialist
3. Evaluation Reference Group for substantive technical support: UN Women programme staff, National government partners, Development partners/donors, UNCT representatives, Civil Society Advisory Group.

The main roles and responsibility for the management of the evaluation are:

Evaluator: 

To avoid conflict of interest and undue pressure, the evaluator need to be independent, implying that he/she must not have been directly responsible for the design, or overall management of the subject of the evaluation, nor expect to be in the near future.

1. Evaluator must have no vested interest and must have the full freedom to conduct the evaluative work impartially. He/she must be able to express his/her opinion in a free manner.
2. The evaluator prepares all evaluation reports, which should reflect an agreed- upon approach and design for the evaluation from the perspective of the evaluator, the evaluation manager and RES.

Evaluation manager: (supported by the Regional Evaluation Specialist) (19)

1. Conducts a preliminary assessment of the quality of reports and comments for action by the evaluator
2. Provides substantive comments on the conceptual and methodological approach and other aspects of the evaluation design
3. Manages logistics for the field mission
4. Initiates timely payment of the evaluator
5. Coordinates feedback on the draft and final report from the evaluation management and reference groups
6. Maintains an audit trail of comments on the evaluation products so that there is transparency in how the evaluator is responding to the comments

Evaluation management and reference groups

1. Provide substantive comments and other operational assistance throughout the preparation of reports.
2. Where appropriate, participates in meetings and workshops with other key partners and stakeholders before finalization of reports.

(18) A theory based-design assesses the performance of the Strategic Note based upon its stated assumptions about how change happens. These assumptions can be challenged, validated or expanded upon by the evaluation.

(19) The regional evaluation specialist participates in the country visit including data collection in an active advisory and quality assurance role, ensuring that learning stays within the organization.

Competencies

Competencies:

UN Core values and competencies

Core Values:

* Respect for Diversity

* Integrity

* Professionalism

Core Competencies:

* Awareness and Sensitivity Regarding Gender Issues

* Accountability

* Creative Problem Solving

* Effective Communication

* Inclusive Collaboration

* Stakeholder Engagement

* Leading by Example

Required Skills and Experience

Evaluator skills and experiences

UN Women are seeking to appoint a qualified national/regional consultant to undertake the evaluation.

The evaluator is expected to be able to demonstrate evidence of the following capabilities:

1. Academic degree in Social Sciences, Economist y/o Exact Sciences
2. At least five (5) years of experience in conducting evaluations, desirable experience in conducting gender-responsive evaluation.
3. Extensive knowledge of, and experience in applying, qualitative and quantitative evaluation methods.
4. Proven experience in gender analysis and human-rights based approaches.
5. Data analysis skills
6. Excellent ability to communicate with stakeholders
7. Technical competence in the thematic areas to be evaluated
8. Process management skills, including facilitation and communication skills
9. Knowledge of the role of UN Women and its programming, coordination and normative roles at the regional and country level
10. Proficiency in Spanish
11. Desirable working experience and proven knowledge of the context in Paraguay.
12. Application process

All applications must include only one attachment that consists in an updated CV/UNDP P11 (Personal History) duly signed and economic offer in accordance with the indicated products. Applications without complete and duly signed P11 will not be considered for evaluation and will be treated as incomplete. The P11 form can be found at the following link: http://www.unwomen.org/en/about-us/employment.

Only the candidates selected for the short list will be contacted. Applications received after the deadline will not be considered.

UNDP and UN Women are committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, indigenous groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.

If you are experiencing difficulties with online job applications, please contact jobs.help@undp.org