Deutsche Stiftung Weltbevolkerung (DSW)

Reporter Dec30,2020

Terms of Reference for Project End Line evaluation 

1. Background

Deutsche Stiftung Weltbevölkerung (DSW) and Amhara Development Association (ADA) have been implementing “Improve Adolescent Gins’ Sexual and Reproductive Health and Nutritional Practices” project in 10 districts of South Gondar Awi and West Gojjam zones in Amhara region since February 2017. The overall objective of the project is to contribute to the successful implementation of the National Nutrition Program in Amhara region in Ethiopia. Specifically, the program aims to improve sexual reproductive health and nutritional practices focusing on adolescent girls in 10 districts in Amhara region by 2020 by achiving the following outcomes.

Result 1: Adolescent girls’ awareness and knowledge on nutrition and SRH increased by 2020.

Indicator: 75 % increase in the number of adolescent girls who can describe the impact of the interrelation of teen age pregnancy, poor fetus development, low birth weight and stunting

Result 2: Social norms, attitudes and perceptions in communities regarding nutrition and SRH are favourable for adolescent girls

Indicator: 200 community leaders who promote adolescent nutrition and SRHR are trained

Result 3: Access to user-friendly SRH and adolescent girls nutrition services increased

Indicator: 50 % more young married women and girls accessing SRH services

Indicator. 50 health facilities offering youth-friendly services

Result 4: Improved multi-sector approach (agriculture, children /youth/ women, health) to SRH and nutrition of adolescent girls by 2020

Indicator:30 authorities in the health, agriculture, children / youth / women sectors mention SRH and nutrition in their programs.

Result 5: Capacities in the design and management of integrated SRH and nutrition projects of ADA are strengthened by 2020

  • Indicator. ADA independently developed 3 integrated project concepts
  • Knowledge and skills in the design and implementation of trainings in integrated projects of 5 ADA staff strengthened

Problem Analysis

The average age of women at first marriage is 15.1 years in the Amhara region. Girls of this age have little access to SRH information and health services, which contributes to the high incidence of early pregnancies. In the region, an above-average number of girls are underdeveloped by malnutrition and pregnancies are a high health risk for themselves and the unborn child. Therefore, ADA and DSW have been implementing the project which integrates these two problem areas into one approach – to provide information about SRH and healthy nutrition and access to youth-friendly health services for growing girls in 10 districts of the region. Thus, the project contributes to the improved SRH and to achieve the objectives of the National Nutrition Program (NNP II).

Project target groups

The main target group of the project are adolescents in the ten project districts of the Amhara region. The focus is on girls because they should be prioritized according to national nutritional strategy and because there is a widespread gender inequality which also leads to the fact that boys are given preferential treatment in their daily diet. To overcome this inequality, the project also targeted adolescent boys. In general the project targeted to address 528,000 adolescents living in the ten districts with information and knowledge about SRHR and nutrition to achieve positive change in their nutritional behavior. In addition, parents and other community members are also targeted to benefit from the project activities. Other target groups that are planned to benefit from capacity building and thus contribute to the project success are teachers and administrative staff in schools, employees of local authorities in the fields of agriculture, health, children, youth and women, and employees in the municipal administrations (Kebeles). Finally, the total population of the 10 Woredas – 2,029,603 people believed to benefit from strengthened capacity in the health sector and local administrations and authorities.

2. Rationale and purpose

The ANSRH project included a baseline measure of the project’s key indicators shortly after commencement. The end line survey is intended to provide an insight into the impact ANSRH has had in bringing about change in the same indicators during implementation.

3. Objectives and scope of the consultancy

To conduct an end line survey and produce an end line report for the ANSRH project. The end line survey will include collection and analysis of quantitative and qualitative data corresponding to the original baseline survey. The report will present achievements against project targets and a comparison of the end line data findings against the baseline data findings. It will highlight significant as well as important findings that might inform future, similar actions.

The baseline study was conducted in ten districts of three zones in Amhara region. Namely, 1. West Gojjam Zone: Mecha, S/Achefer, Jabi, Dembecha 2. Awi Zone: Banja, Guangu, Ankasha 3. South Gondar Zone: Fogera, Dera, E/Estie. The end line survey is expected to sample research participants from the same districts.

4. Specific Objectives of End-line evaluation

  • To assess the extent to which the project outputs have been achieved taking into account the indicators given in the project document.
  • To evaluate the level of contribution of the outputs towards the achievement of the expected project objectives, goal and impact
  • To assess the relevance, effectiveness, and efficiency of interventions as well as, the sustainability of the results, and the degree of soilsfaction of the beneficiaries.
  • To evaluate the appropriateness of the strategies and approaches used for implementing the project:
  • To identify major external factors that influenced or impacted on the implementation of the project and evaluate their implication on future interventions
  • To highlightlessons learned from the project and makerecommendations for future strategies.

5. EVALUATION CRITERIA

The evaluator should analyse the programme based on the evaluation criteria outlined below. Initial evaluation questions are proposed, it is anticipated that these will be refined and data sources identified in the methodology design and work plan report,

1. Relevance: Were the objectives of the project in line with the needs and priorities of the beneficiaries and government partners

  • To what extent were the objectives consistent with addressing gaps in the health system
  • Were the services provided in line with the needs of the target beneficiaries? 
  • To what extent were the needs of the fothers incorporated in project implementation?
  • Was the project design relevant to the context:

2. Efficiency: What measures were taken during implementation to ensure efficient use of resources

  • Were the methods of project management and supervision sufficient for effective implementation
  • Were there alternate methods of implementation that could have delivered the same results at lower costs
  • What were the budget lines and expenditure over the project period?
  • Are there any best practices that can be identified?

3. Effectiveness: To what extent were the planned outputs and outcomes outlined in the project proposal and logical framework achieved?

  • What were the obstacles to effective implementation?
  • Were the activities undertaken sufficient to achieve the desired outcomes?
  • Was service delivery of the health sector improved
  • To what extent was the knowledge of adolescents improved?
  • To what extent have these activities generated unexpected effects? If so, what were the effects and who has benefited?
  • What would have made these initiatives more effective?

4. Sustainability: To what extent can the interventions be maintained without external funding?

  • Is there sufficient budget allocation and human resource capacity among key agencies to continue project activities and scale them up?
  • Are stakeholders willing and able to keep ANSRH clubs operational and continue activities and scale them up?
  • How can the collaboration established between ADA, education and health sectors strengthened and sustained ?

6. DESIGN AND METHODS

A cross-sectional study will be conducted in the project implementation area. The consultant is expected to conduct a participatory evaluation providing for meaningful involvement by project partners, beneficiaries and other interested parties. Primary and secondary data is expected to be gathered using a mixed method to evaluate programme implementation. Thus, the evaluation will involve collecting the following data:

Quantitative data: It will be used to measure indicators of the project expressed in terms of numbers/percentages (quantitative indicators). Information will be collected using questionnaire survey which will be administered to a sample of adolescents and households. The consultant is expected to determine the sampling technique and size which would be representative, and adequate to detect the changes observed and do basic descriptive statistics,

Qualitative data:Qualitative information will be collected through Focus Group Discussions (FGDs), Key Informant Interviews(Klis)and In-depth Interviews (IDIs) with key stakeholders including beneficiaries, community leaders, community/traditional leaders, local government offices, civil society organisations , donors, local implementing partners, project staff and others to complement the information collected through quantitative approaches.

Secondary documentation: Review of related documents will also be important to establish key insights relevant to the effective implementation of the project.

7. ROLES AND RESPONSIBILITES OF THE CONSULTANT

The consultant will be expected to:

  • Design methodology for the collection of quantitative and qualitative data for the end line surveys.
  • Revise the baseline tools and create any new tools necessary to answer the evaluation questions.
  • Organize and facilitate training workshop for data collectors and other end-lien team members on survey implementation, including the survey protocol and tools to be used and pilot testing of the tool. Plan and coordinate the necessary logistics to collect the data in accordance with the selected methodology.
  • Conduct the end-line evaluation at the project locations to measure key indicators as defined in the project logical framework
  • Collect and analyse available secondary data to augment the endline survey findings.
  • Analyse and interpret data to develop a comprehensive and standalone end-line report.
  • Conduct comparative analysis of the end-line data with the baseline findings.
  • Share key findings and insights from the end-line survey with relevant staff through consultations.

8. EXPECTED DELIVERABLES

  • Submit an inception report/proposal which responds to the scope of work by adding any further detail or clarification regarding the study approach, method, or implementation arrangements.
  • Field work implementation plan (to be submitted before field work begins). This field work plan should be presented to DSW and ADA for comment, and revised as necessary prior to commencing field work.
  • Cleaned data sets in SPSS format with data correctly organized variables named and labelled.
  • Final survey questionnaires and qualitative data collection guides.
  • A comprehensive final end-line evaluation report that meets agreed formats.
  • High quality validation of the information collected through a validation workshop of the findings.

9. TIMEFRAME

The task is anticipated to last between 3-4 weeks with submission of final deliverables. The schedule outlined below is estimated and open to revision. The consultant will be expected to start working at the third week of January January 2021 and complete all responsibilities outlined in the scope of Work and deliverables by end of February 2021.

The chosen consulting firm will coordinate with the Monitoring and Evaluation Officer, Program manager and field staff in the planning and implementation of the data collection,

10. SKILLS & EXPERIENCE Education:

  • Master’s degree in diversfied decipline such as public health, Nutrition, social science, health monitoring, development Studies, or related field.
  • Required Experience and skills
  • At least 10 years’ experience in the design and implementation of evaluations, assessments or baseline surveys including qualitative and quantitative data collection.
  • Previous work experience in the area of Adolescent and Youth Sexual Reproductive Health, Adolescent Nutrition
  • Excellent knowledge and understanding of research methodologies and processes.
  • Experience in the development of Monitoring and Evaluation frameworks
  • Experience in gathering and systematizing large amounts of data.
  • Experience managing a diverse team and providing capacity building and training support.

11. SUBMISSION OF PROPOSAL

  • The proposal shall include technical and financial sections. The financial section needs to describe the consultant’s professional fee and other expenses in detail
  • The technical proposal should include:
  • Consultants profile including past achievements
  • Introduction: A brief overview of the assignment as understood by the bidder
  • Detail methodology and approach including work plan (i.e. research techniques to be used, sampling, field operation plan, quality assurance and time frame)
  • Current CV of the consultants
  • Detail itemized work plan
  • Detailed itemized budget and price justification by unit cost per activity being proposed under the financial proposal
  • Three references from organizations that proves the capacity of the consultant to carry out an assessment/evaluation
  • Annexes: Any documents, which the consultant feels will assist proposal review team in evaluating the proposal

Prospective consultanting firms should submit written technical and financial proposals and other detalls listed above with in 10 working days after this advertisment to:

DSW Ethiopia

P.O BOX 31217

Addis Ababa