TERMS OF REFERENCE FOR THE FINAL EVALUATION OF ESPIG PROJECT IN SOMALILAND

INVITATION TO BID FOR CONSULTANCY

Save the Children International (SCI) Somaliland program hereby invites interested consultants to bid for the consultancy assignment detailed below

1

Title of Consultancy

TERMS OF REFERENCE FOR THE FINAL EVALUATION OF ESPIG PROJECT IN SOMALILAND

2

SCI Contracting Office

Save the Children, Somaliland

3

Period of Consultancy

30 working days starting from contracting date.

4

Consultant type required

Individual or Firm

5

Responsibility for Logistics arrangements and Costs

The consultant will be responsible for organizing logistical issues with no facilitation from SCI as per the consultancy agreement.

6

Taxation Provisions

Consultant shall be responsible for all Taxes arising from the consultancy in line with the Somaliland Tax regulations applicable at the SCI Hargeisa Office

7

Travel requirements

Consultant will manage all travel costs

8

Security requirements

Consultant will comply with standard Save the Children Security procedures, including the completion of SCI online security training prior to travel to Somaliland

9

Qualification and Experience

Individual consultants and companies are eligible to apply this consultancy service. However, the applicant must have the following profiles.

  • Should have proven record/prior work of final evaluation with similar education programs in similar context.
  • Must have knowledge/qualification on basic (Early Childhood, primary and Alternative Basic Education) education and educational statistics.
  • The applicant must have at least 5 years working experience in conducting assessments, evaluations, and monitoring projects in a fragile environment.
  • The applicant must have deep understanding and knowledge on Monitoring, Evaluation, Accountability, Learning and Research.
  • The applicant must have basic knowledge and experience in assessing the quality of the school infrastructure and the learning environment.
  • The consultant company must have legal valid registration proving its existence and presence.

10

Evaluation Criteria

The following award criteria will be used during the evaluation of the technical proposals.

Evaluation criteria

Weighting marks

Relevancy of the technical proposal to the ToR-15 Marks

Reasonability of the costs presented in the financial proposal-20 Marks

Prior experience for the applicants in doing similar assignments AND the qualifications of the technical team-15 Marks

Methodology and techniques to be applied well stipulated-10 Marks

Interview scores-40 Marks

11-Application Procedure

Individuals/Firms interested in this evaluation are expected to provide the following documentation:

  • A technical proposal with a detailed response to the TOR, with specific focus on the scope of work, methodology and timelines.
  • Initial work plan and indication of availability
  • A financial proposal detailing the daily rate expected including accommodation, transportation, stationary, data collectors, research assistances and all other cost related to this assignment. (Operational and consultancy fees).
  • Two copies of recent and similar studies previously conducted by the consultant.
  • Company profile and a detailed curriculum vitae (CV) of the lead consultant with contact details (the CV should include at least three traceable references)

12 Closing date for Applications

Interested candidates shall submit their applications through somaliland.procurement@savethechildren.org no later than 07th January 2023 at 3:30PM (Hargeisa Time)

Terms of Reference (ToR)

Complete ToR with details appended below attached herewith as Annex 1.

  • Purpose of the consultancy,
  • Introduction of the project,
  • Background of the consultancy,
  • Objectives of the consultancy,
  • Proposed methodology and approach,
  • Scope of work,
  • Key deliverables / outputs
  • Activity timelines

TERMS OF REFERENCE FOR THE FINAL EVALUATION OF ESPIG PROJECT IN SOMALILAND.

  1. Background

Save the children area office in Somaliland have been implementing an education program titled as Education Sector Program Implementation Grant (ESPIG). The ESPIG is four years and nine months (1st July 2018 – 31st March 2023) education project funded by the Global Partnership for Education (GPE). The ESPIG project is designed to respond directly to the challenges identified in the Somaliland Education Sector Strategic Plan (ESSP) 2017-2021 facing the MOES in its efforts to provide educational services to boys and girls in Somaliland. These challenges are addressed under three headings: Access and Equity, Quality and Learning Outcome, and Efficient and Effective Education System.

The program centers on primary education, with a strong focus on efficient and effective education systems to institutionalize systems and processes that support Access and Equity, and Quality and Learning. The coverage area for the project is all the six administrative regions for Somaliland namely Marodi-jeh, Awdal, Sahil, Togdheer, Sool and Sanaag. The main partner for the project is the Ministry of Education and Higher Studies for Somaliland.

The overall objective of the program is “by 2022, girls and boys of primary school age, in Somaliland, have acquired the skills and competencies, through safe, protective learning environments”, with an overall outcome indicator of “% girls and boys who demonstrate improved learning/developmental outcomes”

The program has three interrelated outcomes with clear targets shown below table which contribute to the realization of the project purpose and specific objective.

Outcomes

Key Program Targets

Outcome 1:

Enrolment in primary schools supported under the GPE increase by 20% over their baselines, with 50% girls.

  • The national Gross Enrolment Rate (F/M) for Somaliland increases to 64% in 2022.
  • 20% (50% girls) increase of enrolment in the support primary schools.
  • 285 classrooms/ABE/ECE centers constructed/rehabilitated, including WASH and accessibility for children with disabilities.
  • 53,700 girls and boys enrolled in ESPIG supported primary schools and ABE Centers.
  • 48 Girl Friendly Spaces constructed/rehabilitated in the supported schools.
  • 90% girls who report satisfaction with Girl Friendly Space facilities.
  • 3,700 children in the drought affected schools who benefited from the school feeding program supported by the project.

Outcome 2:

Pedagogical skills of primary school and ECE teachers (25% women) improved through professional training and certification.

  • 77% of the teachers (F/M) demonstrating improved teaching practices in the classroom.
  • 100% of the trained teachers certified (qualified).
  • 80% schools which meet minimum quality standards.
  • Somaliland National College of Education operationalized.
  • Somaliland ECE Policy Framework and Minimum Standards, developed and validated, including Health and Safety.
  • Somaliland ECE Curriculum developed and implemented.
  • Somaliland ECE Teacher Training Curriculum developed and implemented.
  • The formal Primary Education curriculum is reviewed, and the ABE Curriculum is revised in line with the primary school syllabus.
  • The national examinations for the primary education in Somaliland are supported.

Outcome 3.

Established efficient, effective, and functional monitoring system at MOES central and devolved levels (REO/DEO/school).

  • 32 QASSOs trained on results-based monitoring and supervision.
  • At least 16 monitoring and supervision visits conducted by QASSO using agreed minimum standards.
  • The EMIS software operationalized and decentralized to the regions.
  • Disaster and Emergency Response Strategic Plan for education is developed.
  1. Purpose of the final evaluation

The purpose of this evaluation is to assess performance and achievement of the program by focusing on the extent to which the activities are suited to the priorities and polices of the target group (relevance); achievement of purpose and planned results (effectiveness); sound management and value for money (efficiency); likely continuation of achieved results (sustainability), mutual reinforcements (coherence); and GPE value added. The final evaluation process should also highlight challenges encountered during the project implementation: document key lessons learnt, contributions to any intended and unintended impacts at school, community, and system levels; and the best practices which can be replicated for future programs.

  1. Objectives of the final evaluation

The specific objectives of this final evaluation are to:

  • Asses the relevance, efficiency, sustainability, coherence, and effectiveness of the program implementation approach and indorse practical recommendations for future programming.
  • Ascertain the level to which the project employs the implementation modalities and approach as per the agreement with the Global Partnership for Education (GPE).
  • Establish the extent to which the project interventions contributed towards the stated program outcomes in the approved proposal.
  • Assess quality and maintenance of school infrastructure constructed/rehabilitated by the project.
  • Measure the extent to which the management, coordination and supervision capacity of education institutions including MOE central and regional administrations, examination board and teacher training college have been strengthened by the program.
  • Derive lessons learned and best practices to improve the quality of program implementation and explain how they can be applied in the similar projects.
  • Recommend improvements for the longer-term education intervention strategy for the same or similar intervention areas and/or communities
  1. Evaluation Criteria

The evaluator is expected to employ OECD/DAC evaluation criteria for this exercise, the following guiding evaluation questions are expected to be followed:

Relevance

  • To what extent were the project objectives valid for the Save the Children, MoEHS and target communities?
  • Analyse appropriateness of the project design, relevance of the project strategies and approaches in light of the operational context (Somaliland national development plan, National Education Strategies and priorities as well as SC strategic plan) and its adaptation over the three years.
  • To what extent the project reached the most marginalized and deprived and which strategies have been most useful for ensuring that?
  • To what extent was the project to the context and child rights situation?
  • To what extent does the project meet target clients’ needs as outlined in the project document and was it designed based on target clients’ needs?
  • Assess the extent to which the project interventions meet the holistic needs of children’s education and the extent to which the project took into consideration longer- term needs of the target schools.

Effectiveness

  • To what extent project achieved planned objectives and results?
  • Indicate for each expected outcome and output (result) what has been accomplished in relation to what has been stated in the project document and logical framework?
  • Have the monitoring and results-based management systems (including MEAL/M&E framework) used contributed to the effectiveness of the project and if so, why and how?
  • Document the strategies that have proven particularly effectiveness in achieving the results.
  • What were the major underlying factors (internal and external) influencing the achievement or non-achievement of the results within the three years of project implementation?

Efficiency

  • How economically the project inputs (funds, expertise, time, etc.) were converted into expected results, the quality-of-service provision, project monitoring and make recommendations for improving efficiency of similar or future projects operating in the same context.
  • To what extent where the strategies employed to achieve results were cost-effective? What other more efficient and cost-effective strategies would have been used?
  • How efficiently have the lessons learned along the way been utilized in improving the projects? (It is expected that the lessons learned during the implementation of the projects will be documented as a part of the assignment)

Impact

  • What is the key short term and long-term changes produced by project, positive or negative, intended, or unintended and what are the key factors behind these changes?
  • What real difference has the ESPIG project activities made for the direct, and indirect stakeholders of girls and boys of primary school age, in Somaliland, have acquired the skills and competencies, through safe, protective learning environments
  • What are the lasting changes achieved by ESPIG project.
  • Identify and analyse the significant changes that the project has brought in children’s education. What real difference has the intervention made in achieving the Somaliland’s Education Stratiegic Plan Targets?
  • Document any evidence of practical success (case stories).

Sustainability

  • Assess the sustainability of the results (will the outcomes endure; how likely does continuing progress towards the impact seem), and what are the major factors contributing or hindering sustainability.
  • Assess to what extent and how the project has increased the accountability and capacity of duty bearers. Document ownership and involvement of government at different levels, and other key stake holders.
  • What were the major factors which influenced the achievement or non-achievement of sustainability of the project?
  • To what extent will the results/benefits last/continue at school, community, and systems.

In addition to the above OECD/DAC criteria, the evaluation team will also assess:

  • Coverage and targeting: Assess the extent to which the planned coverage and targeting was achieved and its appropriateness to the local situation
  • Integration: Analyse the impact of the integrated approach in realizing the project objective and make recommendations for improving the delivery of holistic programs for target communities.

Based on the findings of the above generate lessons learnt, challenges, and best practices make a realistic and feasible recommendations for girls and boys of primary school age, in Somaliland, have acquired the skills and competencies, through safe, protective learning environments

  1. Scope of the final evaluation

The program covers all six administrative regions of Somaliland (Awdal, Marodijeeh, Sahil, Togdheer, Sool and Sanag) and currently targets 270 primary schools. 75% of the target primary schools are in the rural areas and 25% in the urban settlements. 25 schools for Alternative Basic Education (ABE) are also among the targets. However, the evaluation process will draw a representative sample from the target considering proportionality for the target groups. The newly constructed or rehabilitated classrooms should be sampled adequately.

An external consultant under the guidance of the SCI education team and the Ministry of Education will lead the whole process of the final evaluation. The consultant will develop the data collection tools, train the data collection team, coordinate the field data collection process, interpret the data, and produce a comprehensive final evaluation report.

  1. Methodology of the final evaluation

The methodology to be adopted by the evaluation shall generate both quantitative and qualitative information, that specific methodology to employ should be participatory, and to enable triangulating data from the key stakeholders including children. Quantitatively, it should include well developed study tools or questionnaires with proper random selection of participants where appropriate. Qualitatively, it should mainly comprise of desk review, use of primary and secondary data and field consultations with the different stakeholders (children’s & teachers benefiting from the project, CECs, REOs/DEOs office, teacher training college and MOES departments. Case studies are expected to be used to document changes brought about by the project on specific cases, lessons learnt and good practices that can be replicated elsewhere. The lead researcher (consultant) will be responsible for further development of the methodology and the evaluation tools to show how data for each evaluation objective will be captured.

  1. Expected Tasks and Deliverables

The consultant is expected to perform throughout the process of the assignment from inception to dissemination of the report findings. Some key activities during these phases include the development of data collection tools, document review, data collection, analysis/interpretation, report writing, and presentation to key stakeholders.

  1. Duration of the Assignment

The final evaluation will be conducted from February – March 2023. The consultant shall develop detailed work plan in his technical proposal and will be reviewed and approved by the SC education management team.

  1. Roles and responsibilities

a) The Consultant:

  • Referring the relevant terms of reference, the consultant will develop a technical proposal with a clear methodological approach, a work plan, budget, and tools that will be approved by the SCI education management team.
  • Develop a detailed work plan for the study and share with Save the Children for input and approvals.
  • Produce an inception report demonstrating his/her capacity to handle the consultancy by explicitly explaining his/her understanding of the TOR that he/she deems sufficient serve the study purpose.
  • The inception report should exhaustively cover the proposed design and methodology, analysis plan, suggested final report format and in line with the agreed evaluation design and data collections tools at global level.
  • Recruit and remunerate the data collection team/enumerators and provide the transportation during the field data collection exercise.
  • Train all data collection team (enumerators) members on the use of the tools and the agreed methodology.
  • Conduct final project evaluation – field work for data collection on all outcome, output, and result indicators in line with approved methodology, data analysis and interpretation in favor of the objectives of the evaluation.
  • Analyse primary collected data in line with the study questions and draft a report accordingly
  • Share the draft final evaluation report analysed datasets with the SCI education team and the MoE&S for inputs/feedback in a validation meeting.
  • Upon satisfactory review of the draft report by SCI and MoE, the consultant will present and submit a comprehensive final evaluation report in both hard and electronic copy to Save the Children.

b) Save the Children:

  • Approve the design, methodology and the data collection tools for the final evaluation.
  • Remunerate the MOES staff participating the field data collection work.
  • Schedule and manage appointments for the data collection process.
  • Provide logistic support for the MOES teams participating the assignment.
  • Ensure that key staff from the education program are available for interviews when needed.
  • Provide project documents (proposal, log frame, baseline information, reports, etc.).
  • Provide feedback and comments on the draft evaluation report prior to the completion of the final report.
  1. Reporting Arrangements

The consultant will report directly to Save the Children office in Hargeisa. The Area MEAL Manager will be the focal person who will lead this exercise in coordination with the education program team and the MOE&S at all levels.

  1. Presentation of the Results

The consultancy is expected to produce a quality report focusing on each project outcome with deep dives on project output indicators as well, which provides clear information during implementation, differentiating findings, conclusions, and recommendations. The consolidated summary shall pull together the key intended and unintended findings from the project target areas and stakeholder, recommendations should focus on improving similar programming in the future. In addition to the report the consultancy shall submit raw data, methodology used, interview outlines, list of people interviewed/met, etc. SC Somaliland office will disseminate the findings and lessons learnt, which means the consultancy shall have no exclusive copyright of the report.

  1. Copyright and Intellectual Property Rights

The title rights, copyrights, and all other rights of whatever nature in any materials used or generated under the provisions of this consultancy will exclusively be vested with Save the Children Somalia/Somaliland Country Office. All products developed under this consultancy belong to the project exclusively, guided by the rules of the grant contract. Under no circumstances will the consultant use the information of this evaluation for publication or dissemination to any individual or organization without official prior written permission from Save the Children Somalia/Somaliland Country Office.

  1. Organizational Roles and Responsibility

The consultancy will be contracted by and report to Save the Children in Somaliland. The project team, country office technical team will also support the final evaluation, providing necessary and available documents and information needed, they will also provide technical assistance.

Location:The consultancy will take place in Somaliland.

Evaluation criteria

Weighting marks

Relevancy of the technical proposal to the ToR-15 Marks

Reasonability of the costs presented in the financial proposal-20 Marks

Prior experience for the applicants in doing similar assignments AND the qualifications of the technical team-15 Marks

Methodology and techniques to be applied well stipulated-10 Marks

Interview scores-40 Marks

  1. Terms and Conditions

Professional Fee: The consultant will come up with his/her own rate, which will be subject to negotiation within the bounds of donor requirements, market price and set standards of SC in Somaliland. The consultant is expected to estimate all relevant costs for the exercise, including costs for data collectors, vehicle rent, venue, stationary, travel costs, accommodation, and others, which he/she is expecting to incur while undertaking activities related to this evaluation.

  1. Code of Conduct

Save the Children’s work is based on deeply held values and principles of child safeguarding, and it is essential that our commitment to children’s rights and humanitarian principles is supported and demonstrated by all members of staff and other people working for and with Save the Children. Save the Children’s Code of Conduct sets out the standards which all staff members must adhere to, and the consultant is bound to sign and abide to the Save the Children’s Code of Conduct.

A contract will be signed by the consultant before commencement of the action. The contract will detail terms and conditions of service, aspects on inputs and deliverables. The Consultant will be expected to treat as private and confidential any information disclosed to her/him or with which she/he may come into contact during her/his service. The Consultant will not therefore disclose the same or any particulars thereof to any third party or publish it in any paper without the prior written consent of Save the Children. Any sensitive information (particularly concerning individual children) should be treated as confidential.

An agreement with a consultant will be rendered void if Save the Children discovers any corrupt activities have taken place either during the sourcing, preparation, and implementation of the consultancy agreement.

  1. Mandatory Security Training

The consultant shall be expected to go through mandatory On-line Security and Hostage and Kidnap trainings and submit the certificate of completion to SC before the commencement of the task. Failure to deliver this will lead to an automatic disqualification. SC will advise on the security plan on appointment.

  1. Expected Profile of the Consultant

Individual consultants and companies are eligible to apply this consultancy service. However, the applicant must have the following profiles.

  • Should have proven record/prior work of final evaluation with similar education programs in similar context.
  • Must have knowledge/qualification on basic (Early Childhood, primary and Alternative Basic Education) education and educational statistics.
  • The applicant must have at least 5 years working experience in conducting assessments, evaluations, and monitoring projects in a fragile environment.
  • The applicant must have deep understanding and knowledge on Monitoring, Evaluation, Accountability, Learning and Research.
  • The applicant must have basic knowledge and experience in assessing the quality of the school infrastructure and the learning environment.
  • The consultant company must have legal valid registration proving its existence and presence.
  1. Application Procedure and Requirements

Candidates interested in the position are expected to provide the following documentation:

  • A technical proposal with a detailed response to the TOR, with specific focus on the scope of work, methodology and timelines.
  • Initial work plan and indication of availability
  • A financial proposal detailing the daily rate expected including accommodation, transportation, stationary, data collectors, research assistances and all other cost related to this assignment. (Operational and consultancy fees).
  • Two copies of recent and similar studies previously conducted by the consultant.
  • Company profile and a detailed curriculum vitae (CV) of the lead consultant with contact details (the CV should include at least three traceable references)

How to apply

Interested candidates shall submit their applications through somaliland.procurement@savethechildren.org no later than 07th January 2023 at 3:30PM (Hargeisa Time)

Related Posts

Leave a Comment

%d bloggers like this: