Independent Endline Evaluation - Consultancy Announcement
Project Management / Program Management
About the Employer
Job Description
Terms of Reference
Independent Endline Evaluation — Consultancy Announcement
Restoring Lives with Dignity: Cyclone Ditwah Emergency Response Project
1. Project at a Glance
- Project — Restoring Lives with Dignity: Cyclone Ditwah Emergency Response Project
- Funder — U.S. Department of State — Bureau of Population, Refugees and Migration (PRM)
- Implementer — World Vision Lanka (WVL)
- Location — Locations across five provinces (Central, Eastern, North Central, North Western)
- Project Period — 15 December 2025 – 14 June 2026 | 8,750 individuals / 1,750 households
- Application Deadline — 20 May 2026 — Submit to: World Vision Lanka, Strategy, Impact & Evidence
2. Evaluation Purpose & Specific Objectives
The endline evaluation is a summative performance evaluation assessing relevance, effectiveness, timeliness, and efficiency against intended outcomes; implementation quality; accountability to affected populations; and sustainability of results.
- SO1 Assess outcome-level achievement across food security, nutrition, WASH, and protection, disaggregated by sex, age, and vulnerability.
- SO2 Evaluate relevance and appropriateness of modality selection relative to the distinct needs of estate, coastal, post-war affected, and ADP-linked communities.
- SO3 Examine implementation quality — targeting, distribution, coordination, safeguarding — and assess resource efficiency relative to outputs/outcomes.
- SO4 Assess effectiveness of accountability and safeguarding systems (CPRM/SMAP, hotlines, helpdesks, PSEA) in ensuring safe, dignified, participatory delivery.
- SO5 Document sustainability practices, lessons learned, and generate actionable recommendations for future WV emergency preparedness and response.
3. Methodology & Scope
The evaluation will combine quantitative and qualitative methods to assess relevance, effectiveness, efficiency, timeliness, and sustainability, and to capture lessons and recommendations for future programming.
- Quantitative
- Participant-Based Survey (PDS): ~300 households stratified by location (9 DSDS) and sex of head of household; stratified random sampling (95% CI, 80% power, 10% non-response rate); plus ~150 structured WASH/CF observations.
- Digital data collection via KoBoToolbox or SMAP; tools translated into Sinhala and Tamil.
- Qualitative
- 36 Key Informant Interviews across all 9 locations with WV Lanka staff, GPI/PHM officers, community leaders, VDMIC members, local suppliers, coordination partners.
- 16 Focus Group Discussions (8–10 participants each) — separate groups for women, men, adolescents, persons with disabilities, and elderly — covering all 5 provinces.
4. Key Evaluation Questions
- What is the extent to which project interventions achieved intended outcomes and impacts against the identified results framework?
- What is the effectiveness of implementation — including targeting, delivery approaches, coordination, and safeguarding?
- To what extent are accountability mechanisms and safeguarding systems effective and accessible to affected populations?
- How sustainable are the project achievements and what factors influence sustainability at community and program levels?
- What are the lessons learned and recommendations to inform future WV emergency programming?
5. Deliverables
- Inception Report — Sampling plan, tools, draft analysis plan, detailed timeline & budget — Due 25 Jun 2026
- Data Collection Tools — Beneficiary survey, KII/FGI guides, checklists — translated into Sinhala & Tamil — Due 30 Jun 2026
- Enumerator Training — Min. 3 days — Due 1–3 Jul 2026
- Raw Data Files — Clean & raw datasets, transcripts, codebook (English) — Due 19 Jul 2026
- Draft Evaluation Report — Per WV/PRM-aligned report template (Annex E) — Due 22 Jul 2026
- Final Report + Impact Brief — Revised report incorporating WV & WVUS feedback — Due 30 Jul 2026
6. Proposed Timeline
- Finalize consultant selection — Responsibility: WV Strategy, MEAL Team — Deadline: 15 Jun 2026
- Desk review + Inception Report (sampling, tools, budget) — Consultant — Deadline: 25 Jun 2026
- WV/WVL review of inception report & tools — WV MEAL
- Enumerator training and field data collection — Consultant — 1–15 Jul 2026
- Draft report submission for WV/PRM feedback — Consultant — 16–24 Jul 2026
- Final report submission — Consultant — 30 Jul 2026
7. Ethical Requirements
- Informed consent; voluntary participation with scripted explanation of rights to decline or withdraw at any time.
- Do No Harm: Evaluation screening for distressing topics; referral pathways established prior to data collection.
- Confidentiality & anonymity: Protected PII; raw data not shared beyond approved team without written consent.
- Child protection: Children under 18 interviewed only with a responsible adult present; all enumerators sign WV Child and Adult Safeguarding Policy.
- Data integrity: Findings presented honestly; triangulated findings across multiple data sources.
8. Consultant Qualifications
- Minimum Master’s degree in social sciences, public health, international development, statistics, or a related field.
- Demonstrated experience in mixed-methods evaluation including quantitative household surveys and qualitative inquiry (KIs, FGIs).
- Proven experience in humanitarian emergency response evaluation in Sri Lanka or comparable context; PRM/BHA or equivalent funding project experience highly desirable.
- Proficiency in KoBoToolbox, or equivalent; and in SPSS, R, or Stata for statistical analysis.
- Excellent English report writing; Sinhala and/or Tamil language capability is a strong asset.
- Strong team leadership skills to coordinate multi-location data collection across five provinces.
9. How to Apply
- To apply, submit: (i) Technical proposal responding to this TOR — proposed methodology, sampling approach, and team composition; (ii) Financial proposal with detailed budget breakdown (RMs, CVs of all team members).
- Provide examples of previous evaluation reports from comparable studies; (iii) Overview of minimum three similar evaluations conducted; (iv) Contact details for two professional references.
- Submit to World Vision Lanka — WVL Procurement, [email protected]
10. Support Provided by World Vision Lanka
- Full project documentation: proposal, M&E Plan, Indicator Tracking Table, PDM reports, progress reports.
- Participant registration database disaggregated by location, sex, and vulnerability category.
- Field logistics coordination support across all line locations.
- Day-to-day coordination via the National DMEAL Specialist; technical oversight from WVUS MEAL Specialist.
Note: Alternate evaluation methods to those described herein require prior approval from World Vision Lanka and PRM. The final framework must align with PRM reporting requirements.
