Background

The National Economic and Development Authority (NEDA) and the United Nations Development Programme (UNDP) Philippine country office have embarked on a partnership to strengthen the conduct of evaluations of priority government programs under the Philippine Development Program (PDP). Financed by NEDA and implemented with full UNDP country office support, the Strategic Monitoring and Evaluation (M&E) Project will help strengthen the M&E capacities of NEDA and key government agencies to support the achievement of the PDP and the Sustainable Development Goals (SDGs) through evidence-based decision making.

A key component of the project is the commissioning of independent evaluations on key themes and programs relevant to the PDP and the SDGs. These studies will evaluate the relevance, efficiency, effectiveness, and sustainability of priority social and economic programs that have been implemented or are being implemented by the government. The results of the evaluation studies are envisaged to inform how policies and programs are designed and implemented to achieve the desired results of the PDP and contribute to strengthening the government’s M&E systems.

One of these evaluations is on the implementation of the Anti-Red Tape Act (ARTA). Passed in 2007 as Republic Act (R.A.) No. 9485, ARTA seeks to promote integrity and curb corruption through greater transparency about the public’s transactions with the government. The Act required the simplification of frontline service procedures, formulation of service standards to be observed in every transaction, and publication of these standards for clients’ information. ARTA applies to all government offices, national government agencies (NGAs), local government units (LGUs) as well as government-owned and controlled corporations (GOCCs) that provide frontline services. In adopting simplified and standardized procedures, the law sought to reduce red tape and thereby curb opportunities for graft and corruption. Recently, the Ease of Doing Business Act and Efficient Government Service Delivery Act (EODB Act, R.A. No. 11032), also known as the Expanded ARTA law, was passed to strengthen the service efficiency aspects of the 2007 law and to emphasize improving business competitiveness.

To assess agencies’ compliance with ARTA and clients’ satisfaction on frontline services, the Civil Service Commission (CSC) has been conducting the Report Card Survey (RCS). Introduced in 2010, the RCS is held annually to rate frontline service offices’ compliance with ARTA requirements such as the presence of Citizen’s Charter, manned Public Assistance and Complaints Desks, Anti-Fixer campaign materials, and observance of “No Noon Break” policy. Apart from checking on these requirements, the RCS also surveys a sample of clients to assess their satisfaction on the services rendered by the frontline service office. CSC also collects bulk data on complaints from citizens through the Contact Center ng Bayan (CCB)

An independent evaluation is necessary to gain an objective view of the implementation by NGAs, GOCCs, and LGUs of the ARTA; the results so far in terms of outcomes and, if feasible, impacts; and the mechanisms for monitoring and evaluation of the Expanded ARTA law.

NEDA, through the UNDP, will commission such evaluation through the hiring of a team of individual consultants, including the Two Associate Evaluators for Case Study Development. Working with the evaluation team that will be led by a Governance Specialist / Lead Investigator, the associate evaluators will develop at least six (6) case studies of agencies who have improved their performance and whose performance have stagnated or worsened. An Evaluation Reference Group (ERG) has also been convened, with NEDA, CSC, DTI / National Competitiveness Council (NCC), and UNDP as members, to provide direction and input to the design and conduct of the study. 

Duties and Responsibilities

I. Scope of Services and Methodology

Under the overall guidance of the ERG of the ARTA study and reporting directly and regularly to the Strategic M&E Project Coordinator of UNDP, the consultants will:

1. Assess the efficiency and effectiveness of the implementation of entire ARTA program throughout the government and in selected NGAs in terms of:
   1. Processes and activities undertaken to comply with ARTA;
   2. Challenges and issues, including capacity constraints;
2. Best practices, enabling factors, and lessons learned;
3. Provide insights as to the extent the ARTA program has achieved its desired results or objectives of improving frontline services, easing doing business, and curbing corruption as well as the program’s unintended consequences through perceptions from key sectors such as academe, civil society, and private sector, and provide recommendations on how to sustain the efficiencies already achieved as well as to address the gaps;
4. Design a standard framework and methodology for the conduct of future impact evaluations on implementation of the ARTA program, including recommendations on tools, techniques, and innovations that can be used to improve monitoring and data collection.
5. In collaboration with the ERG, define a strategy to communicate and disseminate the results and findings of the evaluation study, including a) mapping of stakeholders with interest in the evaluation; b) a one-page brief and a maximum five (5)-page executive summary to accompany the dissemination of the report.

In undertaking the evaluation, the evaluation team will undertake two methodological tracks. First, a quantitative track which will involve statistical testing and analysis of the existing data gathered by CSC through its RCS, inspection checklist, contact center complaints, and other means and tools to a) define the statistical reliability of the data; and b) draw trends and other insights from the data on how ARTA has been implemented by the agencies.

For the qualitative track, which will be led by the associate evaluators for case study development, at least (6) case studies of NGAs/GOCCs (at least two (2)) and LGUs (at least four (4)) with relatively comparable service profiles and with equal number of improved and stagnant performers will be undertaken to a) identify the drivers and other factors for ARTA performance; and b) identify change in key stakeholders’ perceptions of corruption and ease of doing business. Key informant interviews and focus group discussions (FGDs) with government and non-government stakeholders (e.g., civil society, business, academe) will be conducted at the central office and select service delivery offices. Available data from the subject NGAs/GOCCs and LGUs will be analyzed. The two (2) associate evaluators will share an equal number of NGAs/GOCCs and LGUs.

From the findings from these two tracks, the evaluation study will design a standard framework and methodology for the conduct of impact evaluations in the future on the implementation of the ARTA program in the context of the recent amendments. The framework may include the development of a case study tool for the regular in-depth assessment of the top ARTA performers.

To undertake such, the Associate Evaluators for Case Study Development to be engaged for the study shall collectively undertake the following:

1. Preparatory work, including:
   1. Prepare case study tool and guide questions for the conduct of the study; and
   2. Identify proposed case studies and key informants
2. Field Work, including:
   1. Gather data for the case studies through the conduct of key informant interviews, facilitation of focus group discussions, and other means;
3. Analytical Work, including:
   1. Review and synthesize relevant literature and documents;
4. Reporting, Presentation, and Dissemination of Results:
   1. Prepare and submit a final report, subject to review by the ERG for this study, including the raw and processed data used in building the report;
   2. The consultants will also be tasked to make a presentation of preliminary or final results of the evaluation in a public forum;
   3. The consultants will also i) condense the findings in a one-page summary and a maximum five (5)-page executive summary, and ii) recommend strategies on how to communicate and disseminate the evaluation study and its findings.

The two (2) associate evaluators will each develop an equal share of the total number of case studies to be agreed up on with the UNDP and Lead Investgator, which shall be a total of two (2) NGAs/GOCCs and four (4) LGUs or their equivalent. The lead investigator is expected to oversee work and assure the quality of the outputs of the associate evaluators. The associate evaluators are expected to contribute draft sections to the evaluation report as agreed upon with the Lead Investigator and the Strategic M&E Project Coordinator of UNDP.

2. Expected Outputs

The evaluation team is expected to deliver the following:

1. An Inception Report collectively submitted by the team, as compiled by the lead investigator, which spells out the analytical framework, detailed methodology, and work plan for the evaluation. It should include the list of proposed NGAs/GOCCs for case study, including targeted locations of frontline service delivery offices (e.g., branches) to be visited, and the division of assignments among the associate evaluators. The inception report should include as attachments the following from the associate evaluators for case study development:  
   1. Interview and discussion questionnaires;
   2. List of targeted key informants to be interviewed and/or included to focus group discussions (FGDs).
2. A Draft Evaluation Report, according to the template or outline agreed upon at the inception stage, that provides an initial consolidation of the findings and recommendations of the study based on the data gathered and analyzed so far. Moreover:
   1. The draft report should include as attachments at least half of the case studies produced by the associate evaluators, as reviewed by the lead investigator.
   2. After presentation to the ERG, the consultants shall prepare a matrix or documentation of inputs from the ERG, with feedback on the inputs to be accepted and those not to be accepted and reasons for such recommendations.
3. A Final Draft Evaluation Report which refines and completes the consolidation and synthesis of the findings and recommendations of the study based on all the data gathered and analyzed. The final draft evaluation shall also include:
   1. A proposed framework for evaluating the impact of the implementation of the Expanded ARTA and other recommendations to improve the collection of data to prepare for quality analyses;
   2. Proposed recommendations or action items for implementing agencies on improving ARTA implementation, presented in a matrix or other relevant format;
   3. All the case studies produced by the associate evaluators and reviewed by the lead investigator, as attachments to the report and with summary boxes/sidebars integrated into the report proper;
   4. After presentation to the ERG, the consultants shall prepare a matrix or documentation of inputs from the ERG, with feedback on the inputs to be accepted and those not to be accepted and reasons for such recommendations.
4. A Final Publication-Ready Evaluation Report which makes necessary refinements or adjustments to the report based on the management responses to be provided by the CSC and other implementing agencies. The consultants are expected to respond to each of the Management Responses, in consultation with UNDP and NEDA. The consultants shall also:
   1. Present the evaluation report to a public forum, which may be the annual M&E Network Summit, as decided upon by the ERG. In doing so, they shall prepare a presentation slide deck;
   2. Produce condensed versions of the report, namely: i) a one-page summary of the key findings of the study; ii) a maximum five (5)-page executive summary;
   3. Submit a proposed communication plan containing recommended strategies and actions for communicating the study and its results to key stakeholders and the general public.

The consultants are expected to deliver the said outputs according to the following schedule:

The Associate Evaluators for Case Study Development are also each expected to submit:

1. Monthly Status Reports, consisting of maximum two (2) pages, outlining a summary of activities undertaken and deliverables submitted, as well as issues encountered and lessons learned;
2. Raw and Processed Data used in the study, including but not limited to interview transcripts and/or notes, interview results/thematic matrices, and all other documentation made during the conduct of the case studies, together with each version of the Report submitted as well as when required by UNDP or NEDA (through UNDP). 

Competencies

• Demonstrates integrity by modeling the UN’s values and ethical standards;
• Promotes the vision, mission, and strategic goals of UNDP;
• Displays cultural, gender, religion, race, nationality and age sensitivity and adaptability;
• Treats all people fairly without favoritism;
• Expertise in data collection and analysis
• Ability to work under pressure and tight deadlines;
• Strong analytical and research skills; and
• Excellent organizational, and communication skills;

Required Skills and Experience

Professional Qualifications of the Successful Consultants

The Associate Evaluators shall each have the following minimum qualifications:

1. Filipino nationals or expatriates currently residing in the Philippines only;
2. At least two (2) years of work or consultancy experience in the monitoring and evaluation of development programs and projects, with preference to those with demonstrated specialization/experience in evaluations; 
3. At least four (4) years of overall work or consultancy experience in the government, international development organizations, non-profits, among others. Previous employment or consultancy experience with UN agencies is an asset;
4. At least an undergraduate degree in economics, political science, social science, public administration, management, or other relevant fields. A master’s degree is advantageous;
5. Having published research work in relevant policy/program areas and/or research output from consultancy projects is preferred. Research works may include applied research studies, e.g. evaluation, action research, policy papers, etc.;
6. Having satisfactorily completed projects with the public and/or development sector, including but not limited to government, international development organizations, international financial institutions, and non-government organizations is preferred;
7. Demonstrated knowledge of and experience in the application of various research methodologies, with demonstrated specialization in qualitative research. Demonstrated knowledge of quantitative research, in addition to the requirement, is advantageous;
8. Demonstrated specialization, through professional and academic qualification, in any of the following policy and program areas is advantageous:
   1. Democratic Governance – including but not limited to anti-corruption, government efficiency and organizational development, public finance management, results-based management, public administration, among others;
   2. Economic Development – including but not limited to economic and fiscal policy, transport and non-transport infrastructure development, competitiveness and entrepreneurship, agriculture policy, industrial policy, services and trade, among others.     
9. UNDP gives preference to consultants who demonstrate the following values:
   1. Gender Equality – achieving gender equality and gender mainstreaming are key principles and strategies of UN system agencies, therefore, UNDP encourages the deployment of staff and consultants (male/female) at a balanced ratio based on the requirements. As such, in forming the evaluation team, UNDP will strive to achieve a balanced composition of consultants.  
   2. Integrity – UNDP implements a policy of zero tolerance on proscribed practices, including fraud, corruption, collusion, unethical practices, and obstruction. UNDP is committed to preventing, identifying and addressing all acts of fraud and corrupt practices against UNDP as well as third parties involved in UNDP activities. UNDP requires all proposers to conduct themselves in a professional, objective and impartial manner. Proposers must strictly avoid conflicts with other assignments or their own interests and act without consideration for future work. UNDP reserves the right to reject bidders who are in an actual or potential conflict of interest or have been involved in unethical practices.

Application Requirements

Applicants are requested to upload the following documents in one file:

1. Duly accomplished Letter of Confirmation of Interest and Availability that indicates the all-inclusive lumpsum contract price, supported by a breakdown of costs, as per template provided; If an Offeror is employed by an organization/company/institution, and he/she expects his/her employer to charge a management fee in the process of releasing him/her to UNDP under Reimbursable Loan Agreement (RLA), the Offeror must indicate at this point, and ensure that all such costs are duly incorporated in the financial proposal submitted to UNDP.
2. Personal CV or P11, indicating all past experience from similar projects, as well as the contact details (email and telephone number) of the Candidate and at least three (3) professional references; 
3. Brief description of why the individual considers him/herself as the most suitable for the assignment, and a methodology, if applicable, on how they will approach and complete the assignment.

Complete and detailed TOR along with the application requirements can be accessed thru this link: http://procurement-notices.undp.org/