Background

The National Youth Commission (NAYCOM) was established by an Act of Parliament (No. 11 of 2009) which came into force on 22 December 2009. The Act opened up space for the Commission to "empower the youth to develop their potential, creativity and skills for national development......" Every year NAYCOM is required to provide a comprehensive analysis and documentation of the status of the youth in the country. This is meant to inform relevant national development policies and strategies in order to ensure that young women and men benefit from existing and emerging opportunities in the country.  Harnessing the potential and capacity of Sierra Leonean youth to build a peaceful and prosperous future is central to the reform programme of the government’s “Agenda for Prosperity”.   According to NAYCOM’s mission, NAYCOM “will secure such information from youth serving and youth group bodies as will be necessary to monitor, evaluate and regulate their implementation of national youth development strategies, building on best national and international practices, which have been commonly agreed with NAYCOM. It will provide timely and regular public information that will enable the independent assessment of the effectiveness of NAYCOM and of its public, private and not-for profit stakeholders in their respective roles. This will include, but not be limited to, reports on the extent of national progress to the youth development profile required for Sierra Leone’s sustainable transition to middle income country status by 2035”. Production of the status of the Youth Report requires the conduction of comprehensive studies on the social, economic, political, health, educational and cultural themes affecting youth development and how they perceive these issues or are perceived within the context of these societal variables

There are three priority functions for M&E in NAYCOM: monitoring the performance of NAYCOM as an organization, monitoring the situation of young people in Sierra Leone and providing a common framework for project monitoring by implementing partners. The M&E Approach for organization monitoring involves calculating the perception index of NAYCOM performance and the M&E tool for this is conducting Annual Youth and Stakeholder surveys. For situation monitoring the approach is calculating the perception index of the situation of youth. The M&E tool for this is also conducting Annual Youth and Stakeholder surveys. Situation monitoring can also be calculated using the six Key Youth Development Indicators (KYDIs) proposed in the NAYCOM strategic plan (based on the UN global youth report) and the composite index. The M&E tool for calculating the KYDIs is the Excel calculator for SEKYDI (Structured Evaluation if Key Youth Development Indicators) index.

The NAYCOM M&E framework consists of 12 key youth indicators. These consist of 6 quantitative outcome indicators (KYDIs) and 6 complementary qualitative process indicators to measure perception. The 6 outcome indicators are: demographics, education, basic needs, literacy, employment/mortality/health. The six qualitative process indicators are: participation in formal structures, perception of work, youth leadership, social cohesion, experience and skills and youth health.

In addition to these process and outcome indicators, there are also additional perception indicators looking at the organizational performance of NAYCOM for each of the process areas. These are: Delivery, Education, Advocacy, Support, Opportunities and Care.

Both the complementary index and the NAYCOM index are derived from qualitative assessment of perceptions as these can be measured through a set of two annual surveys - a youth survey and a stakeholder survey. The NAYCOM strategic plan has mandated the conduction of annual youth and stakeholders surveys to elicit data that will be used in an Annual Technical Conference. Through these surveys, participants (young people and other stakeholder groups) will be asked to rate their agreement or otherwise on their perception of processes within the youth sector and NAYCOM performance with statements on a scale with six levels of agreement (strongly agree, agree, mostly agree, mostly disagree, disagree, strongly disagree, plus a ‘don’t know’ option).

Duties and Responsibilities

In this vein, the National Youth Commission will be requiring the services of a consultant to undertake specific studies that will form the basis of the content to be included in the 2015 Annual Status of the Youth Report to be prepared by the National Youth Commission, under the following headings:

• Research on Selected Thematic Areas of Key Youth Development Indicators;
• Conduct Stakeholder and Youth Perception Surveys.

The  consultant will be required to provide an update on the Key Youth Development Indicators (KYDIs) identified in the NAYCOM Strategic Plan (2012-2018), conduct research on identified  thematic areas (youth-related issues) and how these issues impact on the status and development of youth in Sierra Leone.

The special thematic areas (youth related issues) to be studied are:

Youth and Civic Engagement:

• The extent to which the society is promoting or stifling youth participation/engagement in the political, social and economic spheres.

Youth and Access to Health Services:

• Youth perception on the infection, prevention and control of the EVD and their role in ensuring that the measures are observed. There is need to spell out the role of young people in preserving key health messages in the EVD response and also bring out the lessons learnt.

Youth and the Environment:

• How youth are contributing to the degradation of the environment and how they can help address this problem. The research may also innovative ways of youth recycling waste in our environment.

The consultant will also conduct NAYCOM Stakeholder and Youth Perception surveys.

The information gathered by this study will provide material for inclusion in the Annual Status of the Youth Report. The material will also assist the National Youth Commission to design and plan project activities that reflect the circumstances and needs of the youth population in the country. The findings of the Studies will be available to inform the Ministry of Youth Affairs and National Youth Commission as appropriate and will also be published as stand-alone reports or incorporated into the Annual Youth Report prepared by the National Youth Commission.

Review of KYDIs and research on Selected Thematic Areas of Key Youth Development Indicators

Consultants are encouraged to suggest valid and reliable methodology to undertake this research. However, this study will mainly be based on field work and  the chosen methodology will combine desk review (notably focusing on local and international university thesis and dissertations, as well as other scientific research and projects reports), retrieval of basic hard data (in collaboration with relevant Ministries) and some sort of qualitative investigation (interviews and/ or focus groups). The National Youth Commission, the Ministry of Youth Affairs and the UNDP will ensure that key documents pertaining to their activities are available to the consultant prior to the fieldwork. There will also be organized meetings with key stakeholders such as NAYCOM, UNDP, NGOs, Ministry of Youth Affairs, Clients/ beneficiaries of NAYCOM projects, members of local communities and other relevant organizations/ agencies.

Stakeholder and Youth Perception Survey

Stakeholder Survey:

The methodology described here is proposed in the NAYCOM M&E system. The stakeholder survey will collect the views of 10 people from each district as follows:

Stakeholder Group                               Female            Male

Youth-serving civil society                      1                      1

Business leaders                                   1                      1

Educators                                             1                      1

Media journalist                                     1                      1

Security Forces (Police/Army)                1                    1

Total                                                    5                       5

Each team is provided with 10 copies of the survey format (herein attached) per district. The district team will need to approach the above stakeholders in each district and explain to each person that they are completing a survey for NAYCOM to help understand more about the situation of youth. The team should inform respondents that the survey is optional, and is anonymous. They should check that the person is more than 35 years old. If a person is the right age and agrees to do the survey, then the volunteer should explain that they will read out about 20 statements and that the respondent just needs to say to each one whether they strongly agree, agree, mostly agree, mostly disagree, disagree, strong disagree, or don’t know. The team should read out each statement and make sure that the respondent understands it and then mark on the survey what the level of agreement is. All the statements should be read out until the form is complete. This is done until all the forms in each district are completed.

Youth Survey

The consultant should mobilize 6 enumerators i.e. three pairs (3 females, 3 males) for each district to administer the survey. Enumerators will work in female-male pairs and each pair will be provided with 30 copies of the survey format (herein attached). The three teams in each district should go to different areas to collect the data. The first team should go to a typical urban area in the area where the survey will be administered. The second team should go to a typical peri -urban area (on the edge of town) and the third team should go to a typical rural area in the district. At the agreed time, the teams should start approaching 5 young men and 5 young women who they do not know.

Each enumerator pair should explain to each respondent that they are completing a survey for NAYCOM to help understand more about the situation of youth. They should say that the survey is optional, and is anonymous. They should check that the person is not more than 35 years old. If a person is the right age and agrees to do the survey, then the enumerators should explain that they will read out about 20 statements and that the respondent just needs to say to each one whether they strongly agree, agree, mostly agree, mostly disagree, disagree, strong disagree, or don’t know. The enumerators should read out each statement and make sure that the respondent understands it. Then they should mark on the survey what the level of agreement is. All the statements should be read out until the form is complete.

The survey sample sizes for the two surveys are illustrated below:

Survey             Groups                  Group sample   Total sample     Confidence Interval        Confidence

                                                                                                     (national)                       level                                                                                                                                                                                  

Youth              14 Districts                     30               420                      +/-5                            95%

Stakeholder      Youth-serving CSOs       20               100                      +/-10                          95%

                        Business Leaders          20      

                        Educators                     20

                        Media                           20

                        Security forces              20

A strongly positive score will be quantified to '95'. This is because it is impossible for a qualitative measure to determine 100% certainty.In order to calculate the Complementary Index and the NAYCOM index, each statement in the survey format will be allocated a "positive" or a "negative" correlation (i.e. if a respondent strongly agree with a statement then it is either a highly positive or negative score, or vice versa if they strongly disagree.

A strong negative score will be quantified to '5'. This is because it is impossible for a qualitative measure to determine 0% certainty.

Intermediate scores will be evenly distributed, and quantified as '23', '41', '59', or '77'

Each indicator and each sub-indicator will be weighted equally. Each indicator can thus be calculated using the mean score for its sub-indicators. The maximum score for an indicator is 95. The minimum score is 5.

Indicatorn = AVERAGE (Sn1: Sn3 ), where S= sub-indicator score

The indicator score will be calculated for each district by entering the responses into the Excel Calculator. The calculator will automatically calculate the composite indexes for both the districts and nationally by calculating the mean of the relevant indicators. These values can be discussed during the Annual Technical Conference, and used in the Annual Youth Report. The maximum score for an index is 95 and the minimum score is 5.

Index NAYCOM = AVERAGE (S7.1:S7.7), where S= sub-indicator score

Index complimentary = AVERAGE (S1:S6), where S= indicator score

• Review sufficient, relevant and reliable national and international literatures;
• Prepare detail inception report of the study proposing the valid and reliable study design, methodology, time schedule and outline of the report;
• Develop data and information collection tools both for qualitative and quantitative information;
• Conduct personal interview and focus group discussions with key informants and other stakeholders for required qualitative information;
• Prepare draft report and submit to NAYCOM and UNDP;
• Refine the draft report as per the obtained feedbacks and present refined draft in the seminar organized by the client;
• Submit four hard copies and soft copy of the final report.

Calculate the Complementary Index (perception of youth issues) and the NAYCOM index (perception of NAYCOM) for 2015. Graphical representation should include the following:

•  Youth perception index for all districts;
•  NAYCOM perception index for all districts; and
• Graphical comparisons for youth perception index and NAYCOM index for rural, peri-urban and urban communities and their implication/analysis of the results;
• Graphical representation and comparison of the gender perspective for the youth perception index and the NAYCOM index and the implications;
• Graphical representation and comparison of the groups perspective for the youth perception index and the NAYCOM index and the implications;
• Analysis of the Youth indicators showing the strengths to build on and priority challenges and the implications;
• Analysis of the NAYCOM indicators showing the strengths to build on and priority challenges and the implication.

The consultant will be required  to submit:

Output 1:

• Inception report (on review of the KYDIs and research on selected thematic issues) prepared with detailed explanation of study methodologies, time schedule for the research from the signing of contract to the final report delivery within: one week of the signing of the contract with UNDP.

Output 2:

• Inception report (on the Stakeholder and Youth surveys) prepared with detailed explanation of suggested study methodology, time schedule for the survey from the signing of contract to the final report delivery within: one week of the signing of the contract with UNDP.

Output 3:

• Draft Report on the review of the KYDIs and research on selected thematic issues: within 45 days from start.

Output 4:

• Draft Report on the Stakeholder and Youth surveys: within 45 days from start.

Output 5:

• Final Report on the review of the KYDIs and research on selected thematic issues: at the end of 55 days.

Output 6:

• Final Report on the Stakeholder and Youth Surveys with calculations of the  complimentary index and NAYCOM index with graphical representations and analyses asindicated in V above: at the end of 55 days.

Reporting Mechanisms:

• The consultant will work under the supervision of the UNDP Programme Manager (YEEP)/NAYCOM Commissioner. The consultant will report on progress to NAYCOM and UNDP keeping in the loop other key staff in NAYCOM/UNDP.

Timeliness and Contractual Conditions:

• The research will consist of 55 working days. During this period, the consultant will be assigned office space in the Freetown NAYCOM facility and will work closely with UNDP country office, in seeking and collecting information.  In addition, as noted under “Functions and Responsibilities” the consultant should be available to answer questions, update any required information and take part in dissemination of findings, upon request, for the duration of the project.

Performance indicators:

• Contractor’s performance will be evaluated against the following criteria: timeliness, accuracy, responsibility, initiative, communication and quality of the products delivered.

Payment Schedule:

• 1st installment: 10% upon submission of inception report and a revised/updated work plan;
• 2nd installment: 40% upon presentation of progress against agreed outputs and submission of draft report as per deliverables;
• 3rd installment: 50% upon submission of the deliverables signed off by UNDP.

Competencies

Professionalism:

• Knowledge and understanding of theories, concepts and approaches in analyzing the field of Youth Employment, political affairs, sustainable development, policy analyses and humanitarian action;
• Strong analytical, presentation skills and ability to handle data and create new indicators will be a definite plus;
• Ability to work under pressure and meet strict deadlines;
• Knowledge of current development policies and activities;
• Ability to organize work and collaborate effectively with a wide range of teams and work with individuals of different national and cultural backgrounds;
• Basic knowledge of relevant institutional mandates, policies, guidelines;
• Knowledge of the institutions of the UN system.

Cultural Sensitivity:

• Code of conduct/ethics and keep in view the socio-cultural sensitivities while developing instruments of data collection, and interacting with the targeted population, or local community members etc.

Technology Awareness:

• Fully proficient computer skills and use of relevant software and other applications, e.g. word processing, spreadsheets and other statistical applications, internet, etc.

Teamwork:

• Good interpersonal skills and ability to establish and maintain effective partnerships and working relations in a multi-cultural, multi-ethnic environment with sensitivity and respect for diversity, including gender balance.

Required Skills and Experience

Education:

• Advanced degree in any of the following - Development Management, Sociology, Economics or any other relevant social science.

Experience:

• Mininum of 7 years experience in practice or research in the area of youth, youth employment, education, youth representation;
• A good working knowledge of statistics or econometrics or working as a team leader will be an additional benefit;
• Working experience in developing countries;
• Proven high quality writing skills in English.  (Submission of samples of previous work is mandatory).

Language:

• Fluency in written and spoken English is essential.

Evaluation of Criteria and Weighting

The consultant will be evaluated against a combination of technical and financial criteria. The maximum score is 100. Out of this, technical criteria equal 70% and financial criteria equal 30%.

The technical evaluation will take into account the following as per the weightings provided:

• Background and minimum educational qualification as defined in the TOR (10%);
• Practical experience in research in the area of youth, youth employment, education, youth representation and good working knowledge of statistics or econometrics (20%);
• Quality of the technical proposal (35%;
• English language fluency (5%).

Application Procedure:

Qualified and interested candidates are requested to send the following documents:

• Technical and financial proposal reflecting the consultancy fee and any other anticipated expenses that may be incurred to accomplish the required work;
• A detailed achievement-based CV;
• Filled P11 form (Application Form P11 - UNDP).

Note:

Applications from qualified female candidates are particularly encouraged