Terms of Reference – External Impact Evaluation BMZ-financed FSP Project in Mogadishu, Somalia

The specific objectives of the evaluation are:

• To assess the impact and effectiveness of the activities implemented in the FSP Mogadishu
• To evaluate the efficiency of the project in relation to beneficiaries, cost and timeframe of the project.
• To assess the current figures of the Objectively Verifiable Indicators as found in the impact matrix
• To assess the sustainability of the project (institutional, social, financial, etc.) –

To make recommendations for improving future interventions.

The desired results of the evaluation are:

• To document the impact of the project with special emphasis on the impact the project has had on women and children.
• To provide commentary on the overall project design, the intervention logic and an analysis of the strategy and methodology used in the FSP Mogadishu.
• To critically examine the impact matrix and verifiable indicators found in the original proposal and provide postproject figures along with a narrative explaining the reasons for under/over performance achievement

. – To draw conclusions, make recommendations and state lessons learnt for future strategy and improvements in implementation of the project.

• To provide commentary on the current political, social and cultural factors influencing the implementation of the project. –

To document the communities’ attitude towards the project

. Scope of work

Geographical reach and evaluation time

The final evaluation will cover the intervention zone of the FSP Mogadishu comprising of two districts namely Barwaqo and Bandarwanag of Heliwa District. The evaluation is intended to be carried out within five weeks from the date of signing the contract as it is detailed in the table below.

Outputs and Deliverables The external evaluator should prepare the following key deliverables: – Evaluation design – contains the evaluation framework; detailed evaluation methodology; work plan and budget – Developed evaluation tools – Draft evaluation report – Draft report will be prepared in line with the proposed structure outlined in section 10 of this document and should be submitted to national project management, electronically via e-mail – Final evaluation report – The findings of the external evaluation shall be presented in a written report following the proposed outline. Attachments – Templates of applied evaluation tools (questionnaires; main areas for focus groups and etc.). Final evaluation report should be submitted to National Director in English, in electronic and hard formats. 6. Expert profile of the Evaluation tea

The consultant must have: –

Proven competency in monitoring and evaluation, including impact assessment or project evaluation

• A university degree in social sciences, development studies or economy, project planning and management background – A good understanding of development work
• A good understanding of child rights and issues affecting vulnerable children
• Good facilitation and interpersonal skills
• Proven experience in participatory processes and data collection methods
• Strong skills in coordinating teamwork – Strong analytical and conceptual skills – Excellent written communication skills
• Ability to transfer complex concepts and ideas into practical and simple language
• Ideally experience in organising research processes with/for SOS Children’s Villages
• Ideally have experience and credibility in providing evaluating services to BMZ FSP financed project

The evaluation team should consist of the number of persons which can be affordable in accordance with the approved evaluation budget. Roles and responsibilities in the team are distributed in accordance to the competence, level of expertise and requirements of the evaluation team. In order to be more time effective, the work with the documents, meetings with the project team, beneficiaries, partners and stakeholders can be done simultaneously and divided among evaluation team members. Team leader of the evaluation team is responsible for:

• Quality and timely fulfilment of the ToR with expected results of the evaluation

• Overall evaluation design of the process • Elaborated evaluation plan indicating each step of the process

• Effective distribution of the responsibilities among evaluation team members

• Quality and timely implementation of the evaluation plan

• Effective and quality data collection

• Data compilation and analysing aimed at reaching goal of the evaluation

• Preparation and submission of high quality and consistent evaluation report in due course

• External evaluators should not be biased and have any reason for conflict of interests. Evaluation team must respect participating communities’ culture, social norms, values and behavior; and maintain appropriate relationships with participants to this evaluation. Selection criteria : The criteria that will be used for selection of the successful consultant are as follows:

• Method: The proposed method for evaluating the impact of the project is suitable. – Timetable/work plan: The timetable/work plan are realistic and meet the needs of the project – Cost: The cost of the proposal given the availability of data, analysis, method, and other aspects of the proposal are reasonable and feasible. – Experience: The level of training and experience of the consultants in undertaking impact evaluations and recommendations from organisations for which the consultant(s) have worked previously. – Proposals should include details on data use, indicators of impact, method, and strategy for institutional analysis, work plan, costs, and CV of the consultant.
  .**Mode of payment:** Payment will be made in three instalments as indicated below • 1 st Instalment: The consultant shall receive 25% of the total agreed amount upon signing of the contract • 2 nd Instalment: The consultant shall receive 25% after the submission of the draft report, and after having received feedback from relevant stakeholders. This phase includes presentation of the draft report. • 3 rd Instalment: The consultant shall receive the remaining 50% of the total payment after incorporating all of the feedbacks received from various stakeholders and the submission of the final report.