REQUEST FOR CONSULTANTS TO CONDUCT MID TERM EVALUATION

The Adventist Development and Relief Agency (ADRA) is a global humanitarian organization with a mission to work with people in poverty and distress to create just and positive change. ADRA Somalia belongs to the world wide network, comprised of more than 130 supporting and implementing country offices. ADRA Somalia is seeking to recruit a consultant to conduct Mid term evaluation in the following project locations Puntland (Bari and Mudug); Galmudug (Galgaduud, Dhusamareb, Galinsor and Adado districts); SouthWest State (Burhakaba, Baidoa, Bardaale and Hudur); Hir-Shabelle (Beletweyne and Mahas district); Jubbaland (Lower Jubba region in Kismayo and Afmadow districts), Banadir (Mogadishu); Somaliland (Awdal, Togdheer, Sool and Sanaag).

1. PURPOSE AND OBJECTIVE OF THE CONSULTANCY

The mid-term evaluation will cover the period from March 2019 to the present. This will be done through a participatory process that will involve a diverse range of different project stakeholders.

The purpose of the evaluation (MTE) is to assess the continued relevance of the intervention and the progress made towards achieving its planned objectives, provide information that is credible and useful, enabling the incorporation of lessons learned into the decision-making process, and further an opportunity to make modifications to ensure the achievement of the desired objectives within the remaining lifetime of the project.

The overall MTE objective is to make an appraisal, as systematic and objective as possible, of the SOWASDIP project, its design, implementation and results, while extracting lessons from the implementation process. The performance is judged against the project indicators compared with baseline information and overall project targets. Broadly, the MTE is a strategic review of performance and projects to deliver the following outcomes:

1. Assess the relevance and coherence of the project’s design in relation to/theory of change and country needs.**
2. Assess the relevance and coherence of the project’s design in relation to the initial analysis of the underlying root causes to the development objectives identified for the project.**
3. Assess how the project is perceived and valued by the target groups.**
4. Identify the contributions of the project to, the SDGs, Somali NDP, MoEWR and MoH objectives, the ADRAs objectives and its synergy with other projects and programs in both countries.
5. Analyse the implementation strategies of the project with regard to their potential effectiveness in achieving the project outcomes, development objectives and impacts (i.e. in relation to the identified Theory of Change); including unexpected results and factors affecting project implementation (positively and negatively).
6. Review the institutional set-up, capacity for project implementation, coordination mechanisms and the use and usefulness of management tools including the project monitoring tools and work plans.
7. Asses the implementation efficiency of the project.
8. Review the strategies for outcomes’ sustainability and orientation to impact.
9. Identify lessons and potential good practices for the key stakeholders.
10. Provide strategic recommendations for the different key stakeholders to improve implementation of the project activities and attainment of project objectives.

2. Scope of Work

The scope of work is broad and must address purpose and objectives, the key evaluation questions (enumerated below), deliver on the activities outlined in the Clause 6 (Timeframe) as well as ensure the following tasks:

1. Familiarize with the local WASH context in Somalia, past and ongoing water and sanitation and hygiene-related projects, the WASH Sector Strategic Plans, and the SOWASDIP project document.
2. Review project proposal, logframe, baseline and interim reports. Review all relevant reports, studies and surveys on the WASH sector in Somalia and synthesize the information to ensure that data collection is focused and useful to the evaluation being undertaken.
3. Review tools and data from the baseline evaluation and prepare all tools and sampling plans and review them with the ADRA team before embarking on field work. Where possible, utilize electronic data collection tools (Kobo) and databases accessible in Excel.
4. Constitute the survey team (in agreement with ADRA & the Ministry) and ensure it meets the laid down policy requirements. Set off the survey team to pre-test and refine the data collection tools and deploy to collect required data.
5. Capture and document in a tabular form technical details of each water system (infrastructure, water yield of each water system etc.) and the population feasibly reached by the system.
6. Enter and analyze the evaluation data (jointly with select WASH project staff partners – for learning purposes). Relevant data analysis software such as SPSS will be used.
7. Review the crosscutting themes including gender and non-discrimination, and just transition to environmental sustainability incorporate in the MTE to the relevant sections to the extent possible.
8. Participate in briefing and consultative meetings on the assignment at specific stages as defined in Clause 6. Debrief WASH / SOWASDIP project management staff and the respective Ministries on the process and findings of the MTE.
9. By reviewing the MEAL framework, evaluate the project log-frame in detail, and propose revisions to the proposed indicators where necessary, based on the findings of the MTE.
10. Assess the overall design strategy and implementation approaches of the SOWASDIP programme and propose methods of ensuring that the project delivers in a relevant, effective, efficient manner and achieves maximum impact and complementarity with other actions.
11. Prepare and submit comprehensive but concise, well-structured MTE report with findings that include visual aids (e.g. graphs, charts and maps). All data and survey tools will also be annexed.

3. Deliverables

The following services and outputs are expected:

I. An Inception Report prior to the commencement of the MTE, that shall be approved by ADRA, MoEWR, MoH and Sida explaining the detailed evaluation design and the implementation plan.

II. Detailed and comprehensive MTE tools to be used in capturing all the information required, for the mid-term and end of project evaluations. The tools should be discussed and agreed on before utilization and thereafter be annexed to the MTE report.

III. Training the WASH project staff (and partners participating in the survey) on the conduct of the MTE.

IV. Debrief sessions and power-point presentation for the ADRA, MoEWR, MoH and Sida.

V. Comprehensive draft and final MTE report. A compulsory annex to the MTE report is the M&E plan for the project, summarizing how data on the variables/indicators listed in the SOWASDIP log-frame, among others identified by the consultant and the WASH project team should be garnered and reported on. M&E data collection templates should also form part of the M&E plan.

VI. Soft copy of the database of the primary data analyzed and used in the report.

The draft and final reports should be submitted in soft copy to ADRA (and SIDA) within 2 weeks of completing field work. The final report will be submitted by the consultant 2 weeks after receiving consolidated comments from MoEWR, MoH Sida , and ADRA’s review team. ADRA’s Program Manager / Director will approve the report if it meets organizational minimum standards. The report should not be more than 30 pages (excluding the annexes) and should contain relevant parts such as an executive summary, findings, lessons learnt, recommendations and annexes.

4. Profile of the Consultant

The principal consultant for the assignment should have Masters degree in any related field of science or relevant discipline from a recognized institution with proven technical and field experience. Teams or firms in which one of key consultants for the assignment is a Somali national will be preferred. Besides having a good experience of working in this sector, the consultant must also have:

· A minimum of 7 years and extensive experience in research including designing and conducting large scale (WASH) studies, inception studies, baseline, midline and final evaluations.

· Mastery of using participatory methodologies in monitoring and evaluation of WASH sector work in a developing country context.

· Proven experience in qualitative and quantitative data collection methods.

· Ability to analyse information, evaluate options and to think and plan strategically, and present complex information in a concise and convincing manner, using innovative forms of communication.

· Proficiency in computer skills and excellent facilitation and report writing skills in English.

· Familiarity with the Somali context and WASH sector.

· Experience of working in a politically insecure environment.

Familiarity with previous work of similar nature will be an added advantage