Terms of Reference of a Consultant to Conduct End-Line Assessment for the WaSH Protection and Livelihood Support to Drought and conflict Affected Popu

Terms of Reference of a Consultant to Conduct End-Line Assessment for the WaSH Protection and Livelihood Support to Drought and conflict Affected Populations in Lower Juba Region Somalia.

Background

In response to the dire humanitarian and persistent drought situation in Somalia, CARE Somalia and its local partners; Wajir South Development Association (WASDA), Ministry of Gender and Jubba Land Refugee and IDPs Affairs commission (JRIA) implemented a two-year project dubbed ‘’WASH, protection and livelihoods support to drought and conflict affected population in Lower Juba region, Somalia, 2019 – 2021’’. The project is funded by the Global Affaires Canada-DFATD-IHA and commenced on 1^st April 2019 with an expected end date of 31^st March 2021. The intervention response has three components; (a) Meeting immediate needs and livelihoods, (b) WASH assistance to affected populations in Kismayo, Afmadow and Badhaadhe districts, targeting returnees, IDPs and vulnerable households from the host community and (c) Protection, including capacity support to local partners in offering protection services.

The multi-year (2 Years) project was designed to build on the livelihoods and Water, Sanitation and Hygiene (WASH) gains made during the previous phases of GAC–IHA funded project which were implemented from May2016 to March 2019 in the districts of Kismayo, Afmadow and Badhaadhe. The project recognized the considerable protection needs of vulnerable groups and sought to address these in partnership with the State authorities responsible for coordinating protection services to the returnee and IDP populations. The project goal was to save lives, alleviate suffering and maintain human dignity of the most vulnerable rural and urban households in the districts of Kismayo, Afmadow and Badhaadhe in the Lower Juba Region of Somalia through WASH, protection, and livelihood interventions.

The interventions took the form of conditional cash transfers (Cash for Work – CfW), targeting able and willing beneficiaries meeting minimum criteria to take part in rehabilitation of key community identified infrastructure such as water pans and market access roads; unconditional transfers (direct Cash transfer, for the population displaced by floods, the elderly and women headed households); restocking for pastoralist dropouts; as well as WASH interventions – rehabilitation of water sources (boreholes and shallow wells), construction of latrines, provision of hygiene education, hygiene kits, NFI kits and training of water management committees and training of village saving and loan associations (VS&L). Monthly cash transfers to beneficiaries for work wages and unconditional cash was undertaken by CARE through Hormuud telecommunication Company, using electronic cash voucher (EVC).

The intermediate outcome of the project was to reduce the vulnerability of crisis-affected people, particularly women, girls, and boys in Lower Juba (Kismayo, Afmadow and Badhaadhe districts), Somalia. In order to accomplish this, CARE implemented activities that addressed the immediate needs of returnees, IDPs and improve livelihoods of host communities, addressed WASH conditions, and provided Protection related assistance to a target of 51,662 (25,633 men and 26,028 women) for a period of two years in the three districts of Lower Juba region.

Project Objectives

Ultimate Outcome

· Lives saved, suffering alleviated and human dignity maintained through WASH, livelihoods and protection interventions for crisis-affected women, men, boys and girls in Lower Juba, Somalia.

Intermediate Outcomes

· Increased and equitable use of gender-responsive assistance by crisis-affected people to meet basic WASH needs in Lower Juba

· Livelihoods Increased and equitable use of gender-responsive assistance by crisis-affected people to meet basic needs

· Increased and equitable use of gender-responsive protection services for vulnerable men, women, boys and girls in Lower Juba

Immediate Outcomes

· Improve access to equitable and sustainable WASH services for vulnerable women, girls, boys and men in returnee, IDP and host communities

· Improve access to equitable livelihoods assistance for vulnerable men, women, boys and girls in returnee, IDP and host communities.

· Improve access to equitable protection services for vulnerable men, women, boys and girls in returnee, IDP and host communities.

Objectives of the End-line assessment

The overall objective of the end-line assessment is to assess and provide reliable end-line information on project performance against set parameters (see annexA of the PFM) on the three project components i.e. Livelihoods, (including cash interventions), WASH and Protection. The end-line assessment report will identify best practices and key lessons in technical aspects as well as the program management approach to facilitate continued learning and improvement of humanitarian emergency response. Findings of this final end-line assessment will be shared with GAC, and with the humanitarian community working in Somalia, through the Somalia NGO Consortium, the UN Cluster system, the wider CARE international family, as well as through local networks.

End-line assessment Questions

· to what extent does the project comply with OECD-DAC criteria on efficiency, effectiveness, appropriateness/relevance, sustainability and short-term intended and unintended impacts?

· To what extent did the project delivered required support to enable targeted household maintain food security?

· What are the possible linkages between restocking, unconditional and conditional cash transfer programs in emergency in building community resilience?

· How did the project contributed to increasing community’s access to clean, safe and affordable water for household and livestock use?

· To what extent did the project provide protection support to vulnerable people in the community and how these services changed the lives of the GBV victims or survivors?

What are the key lessons learnt and best practices from the program implementation, operating context and the response type as well?

End-line Assessment Criteria

The end-line assessment will be done in line with OECD-DAC recommended criteria based on the five criteria relevance, effectiveness, efficiency, sustainability and impact. The end-line assessment will contribute to both strengthening accountability of CARE International in Somalia to its donors and key stakeholders including beneficiaries, and to learn from this experience to inform future programing.

Relevance

· Was the project consistent with the sector policies and strategies of the Government of Somalia more so to Jubba Land state?

· To what extent did the project respond to the needs and priorities of the affected people/ communities it targeted, with specific reference to the experiences and opinions of women, girls and other vulnerable and/or marginalized groups.

· To what extent was the flexible and multiyear funding fit into the needs of the target population and how different was this funding from the annual funding?

Effectiveness

· To what extent has the project increased the capacity of Water accessibility and enhanced operation and maintenance of the water points? Are the results satisfactory?

· To what extent has the project enhanced communal and personal hygiene practices through the attainment knowledge, attitude and practice changes?

· What were the key drivers and barriers that impacted on the delivery of the project outputs?

· To what extent has the project used learning to improve delivery?

Efficiency

· Were resources utilized and managed in an efficient manner? Would it have been possible to achieve the same results at a lower cost?

· Were the project activities implemented within the planned time and financial targets?

· What factors and constraints affected project implementation including technical, managerial, organizational, institutional and socio-economic policy issues in addition to other external factors unforeseen during the project design?

Sustainability**

· Has the government shown and likely to show adequate commitment for the functioning of water supply and sanitation system delivered by the project?

· What is the level of community ownership, as reflected in the participation of the community in the project supported WASH community-based structures?

· Is the project supported community-based structures adequate and have a long term vision and strategy for operating, maintaining and regulating the water supply and sanitation infrastructure/system? Do they have capacity to maintain the benefits from the project without the support from CARE or any other donor? If yes, how? If no, what will be the principal challenges in sustaining the program benefits?

Impact**

· Has the project contributed to the improvement in the quality of life of the people in affected districts?

· Has the project contributed to the improvement in environmental sustainability in the project area?

· Have there been any other changes (positive and negative) at household, school or community level as a result of project? Has the project affected people in ways that were not originally intended? If yes, what has changed?

· what was the role of the relationship between program partners to deliver the assistance? Was it supportive or hindered the service delivery process?

· What is the gendered impact of the project in the areas of intervention?

Equity

· Was the project aligned with CARE International in Somalia’s equity agenda in addressing the needs of the target groups (i.e.to what extent the initiative reached different groups including the most marginalized)?

· Did the project contribute to equitable participation and benefits to various groups (men, women, boys and girls and differently abled people)?

· Over the past 2 years, were there any undertakings by the project to promote equity? If yes, how? If no, why not?

Changing the Nature of Program

Based on your experience and expertise, are there areas that should have been done differently with respect to: Priorities, Implementation strategies: Implementation, monitoring process and management and other factors.**

Approach and Methodology

This end-line study is a performance end-line assessment that adopts a non-experimental design for simple pre-post comparison of results using mixed-methods involving both quantitative and qualitative data. Data collection will involve a quantitative beneficiary household survey; document reviews, beneficiary and stakeholder interviews. A comparative analysis approach will be used to report on project achievements for selected indicator values.

Its expected that the consultant to propose a suiting and detailed end-line assessment methodology encompassing the appropriate end-line assessment method, sampling, data analysis, presentation and reporting and ethical consideration of the end-line assessment.

Scope of the End-line assessment

The end-line assessment will cover Kismayo, Afmadow and Badhaadhe districts of Lower Juba, Somalia, Specifically the 18 locations where the project activities has been implemented i.e. 8 in Badhaadhe District; 9 in Afmadow and 1 in Kismayo. These locations are, Kuda, Julai, Kulbiyow, Waraq, Hida, Qoqani, Tabta, Godaya, Diif, Hagardatag, Dardar, Tula Burwaqo, Dobley, Hosingo, Degelema, Raskiamboni, Kismayo and Gobweyn. The participants of the end-line assessment survey will include IDPs, Returnees, host Rural and Urban Communities in the target area as well as government authorities and partner agencies.

Responsibilities of CARE

· CARE will provide all logistics support including flights, accommodation, transport, enumerators recruitment etc.

· Commission the consultancy fee for the study

· Introduce the consultant to relevant stakeholders

· Review and approve the study instruments/tools

· Support the consultant in field data collection while supervising the entire process.

· Provide input to the draft report and approve the final report

Responsibilities of the Consultant

· Develop appropriate methodology and tools for the data collection and analysis process. The tools will be shared and approved by CARE before starting field work.

· Develop a practical work plan for the work

· Undertake a desk-based review and lead field level data collection

· Train enumerators who will be involved in the data collection.

· Carry out all Key Informant Interviews and Focus Group Discussions if selected as data collection tools.

· Debrief CARE Somalia/Somaliland after completing the assignment and validate the findings prior to submitting final report.

· Prepare and submit end-line assessment report to CARE Somalia/Somaliland as per time frame set in the ToR.

Key Deliverables

The end-line assessment deliverables are:

I. Inception Report: For review, the end-line assessment team should submit to CARE an inception report presenting findings from the desk review and/or examination of data to date. The inception Report should include

a. Detailed end-line assessment methodology

b. Proposed sample size with specific detail on sampling approach and methodology

c. Assessment Matrix

d. Procedures for ethical consideration

e. Revised work plan

f. Data collection methodology, including data collection tools for all indicators

g. Proposed data analysis methods and the tools and technologies to be used.

II. Draft End-line assessment Report: The end-line assessment team should share a draft end-line assessment report that addresses all the questions identified in the TOR and any other issues the team considers to have a bearing on the objectives of the end-line assessment. Once the initial draft end-line assessment report is submitted, CARE will have 5 working days in which to review, comment on the initial draft and submit the consolidated comments to the end-line assessment team. The end-line assessment team will then be asked to submit a revised final draft report within 5 working days, and again CARE will review and send comments on this final draft report within 3 working days of its submission.

III. Final End-line assessment Report: The end-line assessment team will be asked to take no more than 7 days working days (or as agreed upon in the work plan) to respond to and incorporate final end-line assessment report comments from CARE. The end-line assessment team lead will then submit the final report to the Emergency Director in CARE International in Somalia/Somaliland. A fact sheet (one page) for each thematic area and a succinct presentation should accompany the final report.

IV. Submission of Dataset(s) to the Development Data Library: The consultant must submit the report to CARE in a machine-readable, non-proprietary format, any dataset created or obtained in performance of this award. The dataset should be organized and documented for use by even those not fully familiar with the intervention or valuation. The data sets to be submitted include

i. All data collection tools used for the assignment

ii. Raw and cleaned data sets (Qualitative and Quantitative)

iii. Generated codebooks and syntaxes preferably in SPSS or STATA formats

iv. Qualitative codebook, audio types, transcriptions and translations.

v. All Photos documented for end-line assessment purposes

vi. GPS Coordinates for all sampled locations

vii. Presentations

Report format.

The main body of the report (draft and final version) must not exceed 35-40 pages (excluding annexes). One of the annexes should the Performance Monitoring Table-PFM indicating the results of the indicators as per the end-line assessment and the change observed comparing to the baseline.

The draft and final report should include the following sections:

1. Executive Summary**

2. Introduction**

· Purpose of the end-line assessment

· Organization context

· Logic and assumptions of the end-line assessment

· Overview of the project

3. End-line assessment Methodology**

· End-line assessment plan

· Strengths and weaknesses of selected design and research methods

· Summary of problems and issues encountered

1. Findings

· Overall Results.

(This section should include the table showing the data collected for each of the indicators in Annex 1 and performance against the indicators)

· Assessment of accuracy of reported results

· Relevance

· Effectiveness

· Efficiency

· Sustainability

· Impact

5. Conclusions

· Summary of achievements against end-line assessment questions

6. Summary of achievements against rationale for Department of Foreign Affairs, Trade and Development (DFATD)? funding

· Overall impact and value for money of Department of Foreign Affairs, Trade and Development (DFATD) funded activities

6. Lessons learnt (where relevant)**

· Project level – management, design, implementation

· Policy level

· Sector level

· Department of Foreign Affairs, Trade and Development (DFATD) level

7**. Recommendations**

8. Annexes**

9. Table summarizing the findings according to the OECD-DAC criteria (relevance, effectiveness, efficiency, sustainability and impact.)

· Final end-line assessment terms of reference

· End-line assessment framework

· Data collection tools

· List of people/institutions interviewed in qualitative data collection

· List of the tools used for data collection

· Details of the end-line assessment team

· PMF of the project

Duration of the Assignment

The duration of the assignment is 20 working days after signing of contract. Days are inclusive of travelling, fieldwork and reporting. The end-line assessment is expected to take place from 1^st to 20^th of March 2021.

Activity

Time Frame

1

Inception Meetings and Finalization of Inception Report (with tools attached)

Week 1 of signing of contract

2

Hiring Enumerators, Pretest of tools and Training of Enumerators

Week 1 of signing of contract

3

Fieldwork –Data Collection –Qualitative and Quantitative

Week 2

4

Data Entry and Cleaning

Week 2 and 3

5

Data Analysis and Production of Tables

Week 3

6

Final-End line Study Report Preparation

Week 3

7

Formal presentation of results to stakeholders

Within 1 week –After completion of study

Qualification of the Consultant

The end-line assessment will be external. The consultant/s will have to be a team or persons with vast experience in performing end-line assessments or end-line assessments for similar projects funded by USAID/Canadian government as well as someone with vast experience in Somalia/Somaliland to better understand the context. Other qualifications for the consultant/s are listed below.

· Six (6) years’ international humanitarian and development experience for the lead consultant or a member of the consultancy team

· Proven humanitarian end-line assessment experience

· Solid experience and understanding of cash policy and delivery, including various delivery mechanisms

· Solid experience and understanding of CVA and its inter-connectedness to other sectors especially food security, nutrition and livelihoods.

· Strong knowledge of the drivers of malnutrition and poor health in the Somalia context and experience in evaluating health and nutrition programs.

· Strong knowledge and experience in the Somalia context (teams including Somali speakers are desirable and if unfeasible, it should be outlined how the team will obtain local feedback in their methodology.

· Knowledge and understanding of the World Humanitarian Summit’s Grand Bargain and OECD DAC Criteria

· Strong experience and knowledge in application of humanitarian standards like SPHERE and Core Humanitarian Standards (CHS)

· Good understanding of integrated approach to programming and ability to make recommendations based on the end-line assessment findings

· Ability to see the big picture and make practical recommendations for delivery and improvements on the ground

· Ability to absorb, consolidate analyse and communicate large amounts of data and information simply and concisely

· Experience and ability to operate in security volatile environments

· Experience of working with local partners and private sector in particular the financial/payments sector

· Excellent inter-personal skills

· Willingness to travel to Somali/Somaliland under the CARE international security framework.

· Good participatory facilitation and workshop design skills

· Excellent English report writing skills

How to apply:

All applications MUST be accompanied by a technical and financial proposal including a brief outline of the proposed methodology, 3 references with contacts and a tentative work plan as well as the candidate’s availability during the month of March & April 2021. The proposals shouldn’t exceed 10 pages. Deadline for submission of technical and financial proposals is 13^th of February 2021.

Interested consultants or firms are expected to conduct their own security and accessibility of the target project locations before application. Updated CVs of individuals or profile of applying company expressing interest to conduct the assessment should be sent to SOM.consultant@som.care.org . Please indicate “End-line assessment’’.

Annex A: Performance Monitoring Table.

Outcome Description

Indicator (# or %)

Target

Baseline Results

Ultimate Outcome

1000: Lives saved, suffering alleviated and human dignity maintained through WASH, livelihoods and protection interventions for crisis-affected women, men, boys and girls in Lower Juba, Somalia.

Decrease in % of targeted households reporting incidents of diarrheal in preceding 4 weeks

80% decrease

15.5% (14.2% F, 16.8% M)

% decrease of GBV incidences in the project areas**

50% decrease**

0% (0% F 0% M)**

Intermediate Outcomes

1100: Increased and equitable use of gender-responsive assistance by crisis-affected people to meet basic WASH needs in Lower Juba

% of targeted people (M/F) using adequate hygiene practices

80% M & 80%F

42% (43.7% F, 38.5% M)

% of targeted people (M/F) who report satisfaction with regards to relevance, timeliness and accountability of WASH assistance

80%

N/A

% of women in leadership positions

20%

0%

1200: Livelihoods Increased and equitable use of gender-responsive assistance by crisis-affected people to meet basic needs**

% of people (M/F) supported who report recovering household goods, assets and/or income opportunities

75% M, 75%W

0%

% of targeted people (M/F) who report satisfaction with regards to relevance, timeliness and accountability of livelihoods assistance

80%

0%

1300: Increased and equitable use of gender-responsive protection services for vulnerable men, women, boys and girls in Lower Juba**

% of GBV survivors (M/F) referred who use services they were referred to

80%

0%

% of targeted people (M/F) who report satisfaction with regards to relevance, timeliness, and accountability of GBV assistance

80%

0%

Immediate Outcomes

1110: Improve access to equitable and sustainable WASH services for vulnerable women, girls, boys and men in returnee, IDP and host communities

# people (M/F) who accessed safe drinking water

18,711 (9,543 males; 9,168 females)

# of people (M/F) who accessed adequate sanitation

1,800 individuals (918 m & 882 f)

% of crisis-affected people (M/F) who know 3 out of the 5 critical times for handwashing

80% M, 80% F

76.3% (76.6% F, 74.8% M)

1210: Improve access to equitable livelihoods assistance for vulnerable men, women, boys and girls in returnee, IDP and host communities

# of people (M/F) benefiting from community assets rehabilitated through a gender-sensitive Cash for Work (CFW) activities

600 households – 3,600 individuals (1,836 m & 1,764 f)

# of households and people (M/F) benefiting from Unconditional cash assistance (UCT) provided

200 households – 1,200 individuals (612 m & 588 f)

# of HH and people (M/F) benefiting from Livestock restocking for rural pastoralists that have been negatively affected by drought

300 households – 1,800 individuals (m 918; f882)

1310: Improve access to equitable protection services for vulnerable men, women, boys and girls in returnee, IDP and host communities

% of women and girls, men and boys, demonstrating positive attitudes towards ending GBV

60% women & girls, 60% men & boys

0%

% of people (M/F) trained who have increased knowledge on GBV prevention and protection

100%

0%