Consultancy – FORMATIVE EVALUATION OF UNDP INNOVATION FACILITY


Lieu : Home Based
Date limite de candidature :21-Feb-18 (Minuit New York, États-Unis)
Temps Restant :0j 6h 22m
Catégorie supplémentaire :Géstion
Type de contrat :Individual Contract
Niveau du poste :International Consultant
Langues requises :
Anglais  
Date de commencement :
(date à laquelle le candidat sélectionné doit commencer)
05-Apr-2018
Durée du contrat initial40 working days
Durée prévue de la mission :40 working days


Historique

ABOUT THE INNOVATION FACILITY

Unlocking the power of innovation for social good and sustainable growth is a dedicated goal in the Agenda 2030 and it is a vehicle to achieve all 17 SDGs.  In 2014, UNDP set up a dedicated Innovation Facility with the support of the Government of Denmark. The Facility supports our partners – governments, civil society organizations, the private sector as well as UNDP Country Offices – in finding more effective solutions to development challenges.

The UNDP Innovation Facility (IF), hosted in the Development Impact Group, Bureau of Policy and Programme Support (BPPS), supports initiatives that a) strengthens UNDP’s position as a leading advisor on innovation for development; b) enables national development actors to co-create value; c) increases understanding of the role and value of innovation for development; d) supports social innovators both within the organization and from the broader development community; and finally, e) enhances UNDP’s own performance through innovative practices.

OUR APPROACH TO INNOVATION

UNDP’s presence in more than 170 countries and territories across the globe, allows us to experiment with different innovation methods, rapidly learn what works, and catalyze the right partnerships to bring what works to scale. Our approach to innovation is iterative: we test, evaluate and build new solutions and services based on practical experiments.

Our services help partners and UNDP to refine responses and develop new solutions. They include:

Reframing policy issues and redesign programming by identifying key insights into the needs of users through methods such as human-centered design, behavioural insights and social innovation camps

Connecting and co-designing with citizens, government, academia, and private sector organizations – leveraging local solutions and co-creating new solutions

Testing hypotheses by running rapid prototypes, parallel field tests and experiments

Partnering with new actors, including start-ups, innovation hubs, think tanks and the private sector, on building ‘shared value’

Between 2014 and 2017, the Innovation Facility supported over 142 initiatives in 85 countries with seed-funding awarded through a competitive process. To be successful a proposal needs to iterate pathways to reach a better understanding of a given development problem and then design a solution together with partners and people affected by the challenge.  Winning submissions must also carefully pay attention to the scaling potential of the solution. Across 2014 and 2015, our partners -- Governments, private sector, and Country Offices – took up well over 60% of the initiatives we funded.

To achieve these results, the UNDP Innovation Facility works with all parts of the organization to foster skills, iteratively develop methods and tools based on concrete interventions, to identify and share lessons and to remove organizational bottlenecks for innovation.

UNDP is also an active participant in the UN Innovation Network, a collaborative network of UN bodies that have established innovation teams. As a member of this Network, UNDP has also endorsed the 9 Principles of Innovation, which guide the implementation of the Innovation Facility.

UNDP’s new Strategic Plan spanning 2018 to 2021 emphasizes the need to innovate – to identify, test, evaluate and scale up novel approaches across UNDP’s subject areas, in programme development, management and review. The Strategic Plan identifies 6 results related to innovation including an indicator on: Percentage of country offices that pilot and/or scale innovative tools and methodologies.” This provides a vital opportunity for the Innovation Facility to review what it has achieved and position itself for the next phase of UNDP’s innovation journey.

UNDP would to conduct a light evaluation of the initiative.  This light evaluation is intended to improve performance as well as inform the strategic course and engagement of the Innovation Facility moving forward.


Devoirs et responsabilités

SCOPE OF WORK, RESPONSIBILITIES AND DESCRIPTION OF THE PROPOSED ANALYTICAL WORK

The objectives of the evaluation are:

  • Provide key lessons and inputs to UNDP management regarding the implementation of the UNDP Innovation Facility (2014 to 2017): with special focus to assess whether the current approach and investments trigger organizational change and innovation in UNDP’s country-level programming in the best way possible, given the organizational set up.
  • Inform the implementation and positioning of the next phase of the UNDP Innovation Facility (2019 – 2021), with regards to the 2018-2021 UNDP Strategic Plan and the larger UN Reform Agenda including the Innovation Lab that is being proposed (as of early 2018) at the Secretary General’s Office and the UN Innovation Network.
  • Provide recommendations to improve programme design, processes, and systems (including the monitoring and evaluation plan) for the operationalization of the next iteration of the Innovation Facility (2019 to 2021).

The evaluation will have 2 components. It will review the implementation and processes of the UNDP Innovation Facility (2014 to 2017) with regards to:

a. Change management.

b. Development impact.

The evaluation will take place in 2018 to inform the Innovation Facility’s next Project Document. This will shape its approach and operationalization. It will cover country, regional and corporate levels through a case study approach including desk reviews and strategic (virtual) interviews with select staff based in programme countries and regional hubs at different phases of their innovation journey, as well as colleagues at HQ on change management.

Specifically, with regard to the scope, the evaluation will:

  • Review the implementation and processes of the Innovation Facility: 2014 to 2017.

  • Recognizing that as originally formulated the Innovation Facility ProDoc did not contain an explicit TOC, review the appropriateness of the conceptual framework of the initiative, determining whether the objectives, the implicit theory of change and the results framework articulated were put sufficiently into action, revisited and updated and whether relevant, reliable and valid indicators, measures, tools and mechanisms are in place.

  • Assess the management, processes, and structure of the Innovation Facility including how effectively and efficiently the innovation could be translated in implementing the 2018-2021 UNDP Strategic Plan.

  • Assess whether the processes, structures, and implementation plans are sufficient to foster innovation at UNDP, in-line with the 9 UN Principles of Innovation for Development, the 2014-2017 UNDP Strategic Plan, and in-line with the objectives of the project.

  • Provide key insights on successes, failures and lessons of the UNDP Innovation Facility programmatic investments and advisory services in UNDP HQ, Regional Hubs and Country Offices reflecting on strategic objectives related to improved development impact, more inclusive processes as well as enhanced staff capacities, new service lines, additional resources mobilized and new partnerships created.

  • The assessment will culminate with recommendations for improvements and operational suggestions for the Innovation Facility. These proposed improvements will be based on and derive from the findings of the assessment, and will be in the context of implementing the 2018-2021 UNDP Strategic Plan.

    Users

    The key users of the light evaluation will be the Innovation Facility team, the UNDP Innovation Board as well as the Government of Denmark as funding partner.

    EVALUATION APPROACH AND METHODOLOGY

    The ‘light’ evaluation will be conducted by an international evaluator. The evaluation will be transparent, inclusive, and conducted in a participatory manner. The evaluation will utilize mixed methods approach, drawing on both primary and secondary, quantitative and qualitative data to come up with an overall assessment backed by clear evidence. The evaluation is expected to use a case study approach as one of its data gathering tools to capture in more detail the importance of context in explaining variations in results per country and regions. The evaluation will also utilise a theory-based approach taking into consideration strategic and planning documents.  The evaluation will also be informed by the project QA, the recent evaluations of UNDP’s institutional effectiveness and of the Strategic Plan (2014-2017).

    The evaluation consultant will develop the design for the evaluation including the approach, the evaluation criteria and questions contained in a matrix, and methodology for data collection and analysis. The criteria should draw from the UN/OECD-DAC’s 5 evaluation criteria: For example: Relevance: How well designed is the project to meet its broader objective to promote innovation across UNDP?; Effectiveness & Efficiency: How well has the project delivered the expected results?; Impact & Sustainability: To what extent is the project on track to influence the broader system in the countries or initiatives that have received funding?

    Indicative methods for data collection will include document review and interviews with key informants.

Evaluation consultants will be held to the highest ethical standards and are required to sign a Code of Conduct (Annex) upon acceptance of the assignment. UNDP evaluations are conducted in accordance with the principles outline in the UNEG ‘Ethical Guidelines for Evaluations’.

EVALUATION PROCESS, DELIVERABLES AND TIMETABLE:

The evaluation will include 4 main phases, each with distinct milestones and deliverables.

Main deliverables:

The final evaluation report and PowerPoint are expected by June 2018, across 30 to 40 working days. The proposed timeframe and expected deliverables will be discussed with the Evaluation consultant and refined during the inception phase. The final schedule of deliverables will be presented in the inception report. The Evaluation Unit reserves the right to request several versions of the report before sharing the report with other stakeholders and until it meets the quality standards set by UNEG.

The Evaluation consultant will be responsible for preparing and submitting the following deliverables:

  1. Inception report;

  2. Draft and final evaluation report;

  3. PowerPoint presentation of key findings and recommendations.

Phase

Deliverables

General Timeframe

Preparatory

The Innovation team will collect relevant documents, background for case studies, including surveys, and create a repository in google drive for the Evaluator.

1 Feb- 4 April

The Innovation team will prepare a preliminary interview list for the Evaluator.

Inception

The Evaluator will review documents and survey results

5 -30 April

The Evaluator will draft inception report should include (up to 5 pages):

  1. Evaluation design including a fully-fleshed out methodology;
  2. Time-table for the exercise.
  3. Relevant annexes: including questions for the interviewees; data collection methods and information sources.

The draft inception report will be reviewed by the Innovation team before the Evaluation expert moves to the next phase.

Data Collection

The Evaluator will draft 3 case studies to assess development impact:

  • Remote interviews with innovation focal points in countries and at regional hubs (no travel required).

Change management:

  • Select interviews at HQ and regional hubs.

1-13 May

Reporting

Draft final report: should outline clear evidence-based conclusions and findings. It should include focused, actionable recommendations (SMART), and a clear, standalone Executive Summary. (Maximum 40 pages including annexes).

It should include:

  1. Short description of the Innovation Facility and organizational context within UNDP, findings of the review of the implementation and processes of the Facility 2014 to 2017.
  2. Description of the methodology utilized;
  3. Findings of (issues identified under ‘scope’, page 2):

*Whether the conceptual framework was appropriate, actioned and updated with relevant, reliable and valid indicators, measures, tools and mechanisms.

*How effectively and efficiently the innovation could be translated in implementing the 2018-2021 UNDP Strategic Plan.

*The ability of the project to foster innovation at UNDP, in-line with the 9 UN Principles of Innovation for Development, and in-line with the objectives of the project.

*The assessment of the value of the current approach in triggering organizational change and innovation in UNDP’s country-level programming in the best way possible, given the organizational set up.

4. Lessons learned from the implementation of the Innovation Facility. This includes -- successes, failures and lessons of the UNDP Innovation Facility programmatic investments and advisory services in UNDP HQ, Regional Hubs and Country Offices reflecting on strategic objectives related to improved development impact, more inclusive processes as well as enhanced staff capacities, new service lines, additional resources mobilized and new partnerships created.

5. Forward-looking recommendations including actions to operationalize these for the consideration of management.

6. Relevant annexes.

14-30 May

Comments from the global Innovation team

Final report: includes comments from the Innovation team and partners.

A PPT summarizing the main findings and recommendations to be used by the Innovation team leader in the final de-briefing to the Innovation board and UNDP leadership. Preferably the consultant (team) delivers the final presentation onsite or virtually to UNDP’s Innovation Board.


Compétences

  • Strong analytical skills, including ability to rapidly analyze and integrate diverse information with a discerning sense for quality of data;
  • Ability to maintain confidentiality;
  • Consistently approaches work with energy and a positive, constructive attitude;
  • Proven organizational skills and ability to handle a large volume of work;
  • Strong oral and written communication skills.
  • Demonstrates integrity by modelling UN values and ethical standards, including UNEG norms;
  • Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability.
  • Ability to work under minimum supervision to meet short deadlines.
  • Commitment and drive to achieve challenging goals, and problem solving attitude.
  • Ability to identify client needs and deliver them promptly and accurately


Qualifications et expériences requises

Academic qualifications:

  • Master’s degree or equivalent in development studies, sociology, economics, social studies, international relations or other related fields is required.

Experience:

The evaluation consultant must have an extensive experience leading and conducting evaluations, as well as technical expertise in evaluation of social innovation/ evaluation of innovation funds. His/her primary responsibilities will be:

  • Conducting and leading the evaluation in all its phases and managing the inputs throughout the exercise;
  • Undertake the in-depth document review;
  • Designing the evaluation methodology;
  • Conduct interviews and actively collect relevant data to evaluate the project;
  • Assist with the management of the datasets generated during the exercise;
  • Create a google folder with relevant documentation;
  • Delivering the inception and final reports in line with the requested quality standards;
  • Assuring the quality of all deliverables.

Minimum experience required

  • 5 to 8 years of experience conducting research, including for evaluations required.

  • Experience in social innovation required.

  • Experience conducting different types of evaluations of cutting edge and innovative development project desirable.

  • Understanding of UNDP’s innovation policies and programming desirable.

  • Proven skills in evaluation methodology, research analysis, including quantitative and qualitative data collection and analysis techniques required.

  • Experience in development of stakeholder mappings and analysis required.

  • Demonstrated expertise/experience in developing theories of change, results frameworks, and evaluation and monitoring systems desirable.

  • Be fully acquainted with results-based management orientation and practices required.

  • Excellent report writing skills, analytical skills, and computer skills required.

Language:

  • Excellent command in written and spoken English is required.

Application Procedure

The application package containing the following (to be uploaded as one file):

  • Cover Letter with CV or P11 that presents the daily rate as well as relevant expertise and availability of the expert to perform this assignment, along with contact details (email and telephone number) of at least three (3) professional references (5 pages max): experience of the expert in carrying out similar evaluations of innovation portfolios; previous work with UN System/major multilaterals/bilaterals is an asset.

  • Online application with brief description of why the Offer considers her/himself the most suitable for the assignment;

  • Approach and implementation plan (2 pages max): The methodology proposed should be responsive to the TOR, as provided under SCOPE OF WORK, RESPONSIBILITIES AND DESCRIPTION OF THE PROPOSED ANALYTICAL WORK.

  • Samples and links for previous related writing works must be submitted

Note: The above documents need to be scanned in one file and uploaded to the online application as one document.

Shortlisted candidates (ONLY) will be requested to submit a Financial Proposal.

  • The financial proposal shall specify a total lump sum amount, and payment terms around the specific and measurable deliverables of the TOR. Payments are based upon output, i.e. upon delivery of the services specified in the TOR, and deliverables accepted and certified by the technical manager.

  • The financial proposal must be all-inclusive and take into account various expenses that will be incurred during the contract, including: the daily professional fee; cost of travel from the home base to the duty station and vice versa, where required; living allowances at the duty station; communications, utilities and consumables; life, health and any other insurance; risks and inconveniences related to work under hardship and hazardous conditions (e.g., personal security needs, etc.), when applicable; and any other relevant expenses related to the performance of services under the contract.

  • This consultancy is a home-based assignment, therefore, there is no envisaged travel cost to join duty station/repatriation travel.  

    In the case of unforeseeable travel requested by UNDP, payment of travel costs including tickets, lodging and terminal expenses should be agreed upon, between UNDP and Individual Consultant, prior to travel and will be reimbursed. In general, UNDP should not accept travel costs exceeding those of an economy class ticket. Should the IC wish to travel on a higher class he/she should do so using their own resources.

  • If the Offeror is employed by an organization/company/institution, and he/she expects his/her employer to charge a management fee in the process of releasing him/her to UNDP under a Reimbursable Loan Agreement (RLA), the Offeror must indicate at this point, and ensure that all such costs are duly incorporated in the financial proposal submitted to UNDP.

    The Financial Proposal is to be emailed as per the instruction in the separate email that will be sent to shortlisted candidates.

Evaluation process

Applicants are reviewed based on Required Skills and Experience stated above and based on the technical evaluation criteria outlined below.  Applicants will be evaluated based on cumulative scoring.  When using this weighted scoring method, the award of the contract will be made to the individual consultant whose offer has been evaluated and determined as:

  • Being responsive/compliant/acceptable; and

  • Having received the highest score out of a pre-determined set of weighted technical and financial criteria specific to the solicitation where technical criteria weighs 70% and Financial criteria/ Proposal weighs 30%.

Technical evaluation - Total 70% (700 points):

  • Criteria 1 5 to 8 years of experience conducting research, including for evaluations. Weight = 10%; Maximum Points: 100;
  • Criteria 2. Experience in social innovation. Weight = 10 %; Maximum Points: 100;
  • Criteria 3. Experience conducting different types of evaluations of cutting edge and innovative development project. Weight = 20 %; Maximum Points: 200;
  • Criteria 4: Understanding of UNDP’s innovation policies and programming. Weight = 5 %; Maximum Points: 50;
  • Criteria 5: Demonstrated expertise/experience in developing theories of change, results frameworks, and evaluation and monitoring systems. Weight = 5 %; Maximum Points: 50
  • Criteria 6: Be fully acquainted with results-based management orientation and practices. Weight = 10 %; Maximum Points: 100
  • Criteria 7: Excellent report writing skills, analytical skills, and computer skills. Weight = 10 %; Maximum Points: 100.

 Please note that only shortlisted candidates will be contacted.

Candidates obtaining a minimum of 70% (490 points) of the maximum obtainable points for the technical criteria (70 points) shall be considered for the financial evaluation.

Financial evaluation - Total 30% (300 points)

The following formula will be used to evaluate financial proposal:

p = y (µ/z), where

p = points for the financial proposal being evaluated

y = maximum number of points for the financial proposal

µ = price of the lowest priced proposal

z = price of the proposal being evaluated

Contract Award

Candidate obtaining the highest combined scores in the combined score of Technical and Financial evaluation will be considered technically qualified and will be offered to enter into contract with UNDP.

Institutional arrangement

The consultant will work under the guidance and direct supervision of Global Advisor on Innovation and Knowledge Management and will be responsible for the fulfilment of the deliverables as specified above. The final evaluation report will be approved by the Global Advisor on Innovation and Knowledge Management.

The principle responsibility for managing this evaluation resides with the UNDP Innovation team. The team will be responsible for providing the evaluator with key documents and help set up stakeholder interviews/select case studies. The Innovation team will also be responsible for reviewing the inception.

The Consultant will be responsible for providing her/his own laptop.

All evaluative exercises in the UN system are subject to UNEG norms and standards. Quality of deliverables for evaluations should follow UNEG guidelines.

Payment modality

In addition to providing a cover letter and CV, the financial proposal should provide a detailed costing for the scope of work and deliverables described above. The Financial Proposal shall list all major cost components associated with the services and the detailed breakdown of such costs, including fees, travel costs, per diem, etc. All outputs and activities described in the offer must be priced separately on a one-to-one correspondence.

Any output and activities described in the offer but not priced in the Financial Proposal shall be assumed to be included in the prices of other activities or items, as well as in the final total price. Schedule of payments:

  • 35% of contract: upon submission of inception report
  • 30% of contract: upon submission of the first draft report
  • 35% of contract: upon approval of final evaluation report.

Payments are based upon output, i.e. upon delivery of the services specified above and deliverables accepted and upon certification of satisfactory completion by the manager.

The work week will be based on 35 hours, i.e. on a 7 hour working day, with core hours being between 9h00 and 18h00 daily.

Annexes (click on the hyperlink to access the documents):

Any request for clarification must be sent by email to cpu.bids@undp.org 

The UNDP Central Procurement Unit will respond by email and will send written copies of the response, including an explanation of the query without identifying the source of inquiry, to all applicants.

 


Le PNUD s’engage à recruter un personnel divers en termes de genre, de nationalité et de culture. Nous encourageons de même les personnes issues des minorités ethniques, des communautés autochtones ou handicapées à postuler. Toutes les candidatures seront traitées dans la plus stricte confidentialité.


Si vous éprouvez des difficultés avec les candidatures en ligne, merci de contacter jobs.help@undp.org

© 2016 Programme des Nations Unies pour le développement