Historique

1. Background and context

This project being evaluated represents the second phase in a strategic partnership focusing on promotion of the surveying works and the myriad products of surveying. The key objective of this intervention is to maintain provision of advisory services in developing the national capacities for effective geo-spatial surveys, generating multi-purpose knowledge from such surveys to efficiently boost national efforts in achieving the key directions of the Saudi Vision 2030 as well as promoting the national implementation of the Sustainable Development Goals (SDGs).

The completion of the previous phase has been instrumental in nurturing the idea of developing the foundation of financial sustainability whereby the General Commission of Survey (GCS) will achieve a high level of efficiency in all its hydrological and geospatial products. It is through this quality and efficiency that the GCS wishes to expand marketing of its products and to broaden the public awareness about its products and services. The core around which all aspects of this project revolve is the design and operationalizing of a National Centre for Geospatial Data.

On this basis, the project has four interconnected outputs:

1)            National Centre for Geospatial Data established and operationalized

2)            National capacities developed

3)            Advisory services provided towards achievement of financial sustainability and contribution to the national economy

4)            Advocacy promoted for a wider visibility of GCS

Capacity development will also focus on training in the core areas of land survey; geodetic survey; topographic survey’ and Cadastral survey.

In 2020, the mandate of GCS was revised, and the authority renamed the general Authority of Survey and Geospatial Information (GASGI) and the mandate under the old GCS changed to become more regulatory and less implementing. Article (4) of the Statute of the General Authority for Survey and Geospatial Information stipulates the following:

The Authority shall regulate, develop, supervise, and monitor the Sector in the Kingdom, except for activities relating to the Ministry of Defense, in a manner that achieves quality, enhances performance, and maintains security, in coordination with relevant agencies. The Authority may undertake any measure it deems necessary to achieve its objectives, including the following:

1. Setting and updating rules and standards relating to the Sector to achieve integrated use of the geospatial information system among relevant agencies and to ensure compliance with said rules and standards.
2. Proposing relevant laws upon obtaining the approval of the Board.
3. Approving and developing the national geospatial infrastructure, national geodetic reference, national geodetic networks, and marine hydrographic survey; providing and marketing Sector-related data, products, services, electronic applications, topographic and aerial maps, and marine navigational charts; and maintaining their security and confidentiality.
4. Developing and implementing strategic plans and conducting Sector-related studies and research in collaboration with relevant agencies.
5. Licensing Sector activities, overseeing the training and classification of practitioners, and setting relevant rules.
6. Protecting the interests of Sector stakeholders. ?
7. Developing the Sector to attract investments and enhancing its growth.
8. Building national capacities in the Sector, in cooperation with universities and specialized institutes within the Kingdom and abroad. ?
9. Coordinating and cooperating with its counterparts in other countries as well as relevant international agencies and organizations, in accordance with statutory procedures.
10. Representing the Kingdom locally and internationally, in accordance with statutory procedures. ?
11. Supervising the publication and updating of the Kingdom’s Atlases and developing them in coordination with relevant agencies. ?
12. Providing information, studies, and consultations on the Kingdom's land and maritime borders, and developing a database for such purpose in coordination with relevant agencies. ?
13. Providing Sector-related consultations and services to government and private agencies, and other entities within the Kingdom and abroad

[1] This is the entity that has overall responsibility for implementation of the project (award), effective use of resources and delivery of outputs in the signed project document and workplan.

Devoirs et responsabilités

1. Evaluation purpose, scope and objectives

This evaluation is the final evaluation for the afore mentioned project and comes after a 9 months extension of the project aimed at re-positioning the project to help GASGI meet its new mandate.  The evaluation and ensuing recommendations will help build a new project document serving GASCI better deliver its intended task and learn lessons from previous activities.

Scope and objectives of the evaluation include:

• Reviewing of the status of delivery of outputs as stated in the original project document:
  • National Centre for Geospatial Data established and operationalized
  • National capacities developed
  • Advisory services provided towards achievement of financial sustainability and contribution to the national economy
  • Advocacy promoted for a wider visibility of GCS
• Bottlenecks that may have impeded the delivery of the above
• Opportunities that may have been missed
• Opportunities that present themselves under the new mandate

Issues relate directly to the questions the evaluation must answer so that users will have the information they need for pending decisions or action. An issue may concern the relevance, coherence, efficiency, effectiveness or sustainability of the intervention. In addition, UNDP evaluations must address how the intervention sought to mainstream gender in development efforts, considered disability issues and applied the rights-based approach.

1. Evaluation criteria and key guiding questions

Evaluation questions define the information that the evaluation will generate. This section proposes the questions that, when answered, will give intended users of the evaluation the information they seek in order to make decisions, take actions or increase knowledge. Questions should be grouped according to the four or five OECD-DAC evaluation criteria: (a) relevance; (b) coherence; (c) effectiveness; (d) efficiency; and (e) sustainability (and any other criteria used).  

1. Methodology

Evaluation should employ a combination of qualitative and quantitative evaluation methods and instruments. The evaluator is expected to follow a participatory and consultative approach that ensures close engagement with the evaluation managers, implementing partners and male and female direct beneficiaries.  Methodological tools and approaches may include:

• Document review. This would include a review of all relevant documentation, inter alia
  • Project document (contribution agreement).
  • Theory of change and results framework.
  • Programme and project quality assurance reports.
  • Annual workplans.
  • Activity designs.
  • Consolidated quarterly and annual reports.
  • Results-oriented monitoring report.
  • Highlights of project board meetings. 
  • Technical/financial monitoring reports.
• Interviews and meetings with key stakeholders (men and women) such as key government counterparts, donor community members, representatives of key civil society organizations, United Nations country team (UNCT) members and implementing partners:
  • Semi-structured interviews, based on questions designed for different stakeholders based on evaluation questions around relevance, coherence, effectiveness, efficiency, and sustainability.
  • Key informant and focus group discussions with men and women, beneficiaries and stakeholders.
  • All interviews with men and women should be undertaken in full confidence and anonymity. The final evaluation report should not assign specific comments to individuals.
• Surveys and questionnaires including male and female participants in development programmes, UNCT members and/or surveys and questionnaires to other stakeholders at strategic and programmatic levels.
• Field visits and on-site validation of key tangible outputs and interventions.
• Other methods such as outcome mapping, observational visits, group discussions, etc.
• Data review and analysis of monitoring and other data sources and methods. To ensure maximum validity, reliability of data (quality) and promote use, the evaluation team will ensure triangulation of the various data sources.
• Gender and human rights lens. All evaluation products need to address gender, disability, and human right issues, wherever applicable.

The final methodological approach including interview schedule, field visits and data to be used in the evaluation should be clearly outlined in the inception report and fully discussed and agreed between UNDP, key stakeholders and the evaluator.

1. Evaluation products (deliverables)

These products include:

• Evaluation inception report (10-15 pages). The inception report should be carried out following and based on preliminary discussions with UNDP after the desk review and should be produced before the evaluation starts (before any formal evaluation interviews, survey distribution or field visits) and prior to the country visit in the case of international evaluators.
• Evaluation debriefings. Immediately following an evaluation, UNDP may ask for a preliminary debriefing and findings.
• Draft evaluation report (within an agreed length). A length of 40 to 60 pages including executive summary is suggested.
• Evaluation report audit trail. The programme unit and key stakeholders in the evaluation should review the draft evaluation report and provide an amalgamated set of comments to the evaluator within an agreed period of time, as outlined in these guidelines. Comments and changes by the evaluator in response to the draft report should be retained by the evaluator to show how they have addressed comments.
• Final evaluation report.
• Presentations to stakeholders

[1] The twin-track approach combines mainstream programmes and projects that are inclusive of persons with disabilities as well as programmes and projects that are targeted towards persons with disabilities. It is an essential element of any strategy that seeks to mainstream disability inclusion successfully. Also, see chapter 9 of the Technical Notes. Entity Accountability Framework. United Nations Disability and Inclusion Strategy: https://www.un.org/en/disabilitystrategy/resources

1. Implementation arrangements

The section describes the specific roles and responsibilities of all involved in this evaluation:

1. Evaluation commissioner: The Resident Representative
2. Evaluation manager: Lead the evaluation process and participate in all of its stages - evaluability assessment, preparation, implementation, management and use. Ensure quality assurance and manage the ERC portal
3. Evaluator:
   1. Fulfil the contractual arrangements under the TOR
   2. Develop the evaluation inception report, including an evaluation matrix and a gender responsive methodology, in line with the TOR, UNEG norms and standards and ethical guidelines
   3. Conduct data collection and field visits according to the TOR and inception report
   4. Produce draft reports adhering to UNDP evaluation templates, and brief the evaluation manager, programme/ project managers and stakeholders on the progress and key findings and recommendations
   5. Consider gender equality and women’s empowerment and other cross-cutting issues, check if all and respective evaluation questions are answered, and relevant data, disaggregated by sex, is presented, analysed and interpreted
   6. Finalize the evaluation report, incorporating comments and questions from the feedback/ audit trail. Record own feedback in the audit trail including those of the members of the team, the evaluation manager, the commissioning programme unit and key stakeholders.
4. Project manager:
   1. Provide inputs/ advice to the evaluation manager and evaluation reference group on the detail and scope of the TOR for the evaluation and how the findings will be used
   2. Ensure and safeguard the independence of evaluations
   3. Provide the evaluation manager with all required data (e.g. relevant monitoring data) and documentation (reports, minutes, reviews, studies, etc.), contacts/ stakeholder list etc.
   4. Ensure that data and documentation in general, but in particular related to gender equality and women’s empowerment and other cross-cutting issues, are made available to the evaluation manager
   5. Provide comments and clarification on the TOR, inception report and draft evaluation reports
   6. Respond to evaluation recommendations by providing management responses and key actions to all recommendations addressed to UNDP
   7. Ensure dissemination of the evaluation report to all the stakeholders including the project board
   8. Implement relevant key actions on evaluation recommendations

1. Time frame for the evaluation process

This section lists and describes all tasks and deliverables for which the evaluator will be responsible and accountable, as well as those involving the commissioning office (e.g. workplan, agreements, briefings, draft report, final report).

• Desk review.
• Briefings of evaluator.
• Finalizing the evaluation design and methods and preparing the detailed inception report.
• In-country data collection and analysis (visits to the field, interviews, questionnaires).
• Preparing the draft report.
• Stakeholder meeting and review of the draft report (for quality assurance).
• Incorporating comments and finalizing the evaluation report.

In addition, the evaluator may be expected to support UNDP efforts in knowledge sharing and dissemination.

Example of working day allocation and schedule for an evaluation (outcome evaluation)

Compétences

1. Required competencies

• Required qualifications: Advanced degree in a relevant field, a minimum of ten years’ experience conducting/ managing evaluations and relevant knowledge of the field of survey and geospatial information
• Technical competencies: team leadership skills and experience, technical knowledge in UNDP thematic areas, with specifics depending on the focus of the evaluation, data analysis and report writing etc.
• Technical knowledge and experience: Gender and disability inclusion competencies preferable. Technical knowledge and experience in other cross-cutting areas such equality, disability issues, rights-based approach, and capacity development.
• Language skills required: fluent English (reading, writing and spoken). Arabic a plus

1. Evaluation ethics

Statement that evaluation will be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’.[1]

“This evaluation will be conducted in accordance with the principles outlined in the UNEG ‘Ethical Guidelines for Evaluation’. The consultant must safeguard the rights and confidentiality of information providers, interviewees, and stakeholders through measures to ensure compliance with legal and other relevant codes governing collection of data and reporting on data. The consultant must also ensure security of collected information before and after the evaluation and protocols to ensure anonymity and confidentiality of sources of information where that is expected. The information knowledge and data gathered in the evaluation process must also be solely used for the evaluation and not for other uses with the express authorization of UNDP and partners.”

[1] UNEG, ‘Ethical Guidelines for Evaluation’, 2020. Access at: http://www.unevaluation.org/document/detail/2866

Qualifications et expériences requises

Evidence to be presented:

• resume
• work samples
• references

To support claims of knowledge, skills and experience.

The TOR should explicitly demand evaluators’ independence from any organizations that have been involved in designing, executing, or advising any aspect of the intervention that is the subject of the evaluation.[1] 

[1] For this reason, UNDP staff members based in other country offices, regional centres and headquarters units should not be part of the evaluation team.

• Required qualifications: Advanced degree in a relevant field, a minimum of ten years’ experience conducting/ managing evaluations and relevant knowledge of the field of survey and geospatial information
• Technical competencies: team leadership skills and experience, technical knowledge in UNDP thematic areas, with specifics depending on the focus of the evaluation, data analysis and report writing etc.
• Technical knowledge and experience: Gender and disability inclusion competencies preferable. Technical knowledge and experience in other cross-cutting areas such equality, disability issues, rights-based approach, and capacity development.
• Language skills required: fluent English (reading, writing and spoken). Arabic a plus

1. Application submission process and criteria for selection

As required by the procurement unit.

1. TOR annexes

Annexes can be used to provide additional detail about evaluation background and requirements to facilitate the work of evaluators. Some examples include:

• Documents to be consulted. A list of important documents and web pages that the evaluators should read at the outset of the evaluation and before finalizing the evaluation design and inception report. This should be limited to the critical information that the evaluation team needs. Data sources and documents may include:

• Relevant national strategy documents.
• Strategic and other planning documents (e.g., programme and project documents).
• Monitoring plans and indicators.
• UNDP evaluation policy, UNEG norms and standards and other policy documents.

• Evaluation matrix (suggested as a deliverable to be included in the inception report). The evaluation matrix is a tool that evaluators create as a map and reference in planning and conducting an evaluation. It also serves as a useful tool for summarizing and visually presenting the evaluation design and methodology for discussions with stakeholders. It details evaluation questions that the evaluation will answer, data sources, data collection and analysis tools or methods appropriate for each data source, and the standard or measure by which each question will be evaluated. Table 5 provides a sample evaluation matrix template.

Table 1. Sample evaluation matrix

• Schedule of tasks, milestones, and deliverables. Based on the time frame specified in the TOR, the evaluators present the detailed schedule.
• Required format for the evaluation report. The final report must include, but not necessarily be limited to, the elements outlined in the template for evaluation reports (see annex 4 below).
• Dispute and wrongdoing resolution process and contact details (annex 3)
• Pledge of ethical conduct in evaluation. UNDP programme units should request each member of the evaluation team to read carefully, understand and sign the ‘Pledge of Ethical Conduct in Evaluation of the United Nations system’.[1]

Interested individual consultants must submit the following documents/information to demonstrate their qualifications in one single PDF document:

• Technical Methodology/Proposal  
• Duly accomplished Confirmation of Interest and Submission of Financial Proposal Template using the template provided by UNDP (Annex II);
• Personal CV or P11, indicating all past experience from similar projects, as well as the contact details (email and telephone number) of the Candidate and at least three (3) professional references.

The interested offeror must read the Individual Consultant (IC) Procurement Notice, which can be viewed at https://procurement-notices.undp.org/view_notice.cfm?notice_id=80753  for more detail information about term of references, instructions to the offeror, and to download the documents to be submitted in the offer through online.

UNDP reserves rights to reject any applications that are incomplete.

Please be informed that we don’t accept applications submitted via email.

Interested Offerors are required to submit an application via UNDP Jobsite system as the application screening and evaluation will be done through UNDP Jobsite system. Please note that UNDP Jobsite system allows only one uploading of application document, so please make sure that you merge all your documents into a single file. Your on¬line application submission will be acknowledged where an email address has been provided. If you do not receive an e¬mail acknowledgement within 24 hours of submission, your application may not have been received. In such cases, please resubmit the application, if necessary. Please combine all your documents into one (1) single PDF document as the system only allows to upload maximum one document.

Any request for clarification/additional information on this procurement notice shall be communicated in writing to UNDP office or send to email mohammed.abbas@undp.org. While the Procurement Unit would endeavour to provide information expeditiously, only requests receiving at least 3 working days prior to the submission deadline will be entertained. Any delay in providing such information will not be considered as a reason for extending the submission deadline. The UNDP's response (including an explanation of the query but without identifying the source of inquiry) will be posted in the Individual Consultant (IC) Procurement Notice page as provided above. Therefore, all prospective Offerors are advised to visit the page regularly to make obtain update related to this Individual Consultant (IC) Procurement Notice

UNDP is committed to achieving workforce diversity in terms of gender, nationality and culture. Individuals from minority groups, indigenous groups and persons with disabilities are equally encouraged to apply. All applications will be treated with the strictest confidence.

UNDP does not tolerate sexual exploitation and abuse, any kind of harassment, including sexual harassment, and discrimination. All selected candidates will, therefore, undergo rigorous reference and background checks.

Annexes:

Annex-1 – Template Confirmation of Interest and Submission of Financial Proposal.

Annex-2 – Individual Consultant General Terms and Conditions.

Annex 3 : TOR

[1]http://www.unevaluation.org/document/detail/2866#:~:text=The%20UNEG%20Ethical%20Guidelines%20for%20Evaluation%20were%20first%20published%20in%202008.&text=This%20document%20aims%20to%20support,day%20to%20day%20evaluation%20practice.