1. Background to the project and rationale for conducting an end of project evaluation
DanChurchAid (DCA) has implemented humanitarian support projects for refugee and host communities in Turkana County through its partners since 1995, 3 years after the establishment of Kakuma refugee camp in 1992. For many years, all DCA supported projects in education, protection, Community Managed Disaster Risk reduction (CMDRR), livelihoods and WASH were implemented through international and local partners, mainly through the Lutheran World Federation (LWF) and later also through Lotus Kenya Action for Development Organization (LOKADO). In January 2017 DCA Kenya started direct implementation work in Kakuma refugee Camp. The aim of this strategic change in approach was to enhance its overall added value to its funded project, support partners at closer operational level and take up the role of piloting innovation in humanitarian programming.
1.1 Status of implementation
In 2020, DCA self-implements the bulk of projects targeting refugee and host community populations, with some funding implemented through continued partnership with LWF and a new partner – Turkana Christian Development Mission (TCDM), identified as a local actor for COVID-19 response initiatives. The project in question (1010375-15) is funded from the humanitarian (‘HUM’) budget line of the Danida Framework Partnership funding allocated to the DCA Kenya Country Office. The project objectives in 2020 are as follows:
Overall project objective **
Resilience of vulnerable refugees and host community is strengthened through support to sustainable livelihoods and appropriate humanitarian response.
The project had 4 specific objectives, namely:
Vulnerable refugees and local communities are empowered and have enhanced sustainable livelihoods.
Refugee and local community youth are economically empowered to live dignified lives.
Improved financial inclusion for refugee and host communities
Enhanced and systematic programming that enhances attainment of Core Humanitarian Standards (CHS) commitments
*Production activities:*****
The DCA Kenya direct implemented project in 2018 was aimed at enhancing food security and income generation for refugee households in Kakuma Refugee Camp and Kalobeyei settlement focusing on vegetable production through the promotion of shed nets and multi-story vegetable gardening and chicken production as livelihoods activities for refugee households. Further, the project also supported action research on cricket production with a view of developing a low cost, locally produced source of dietary proteins for malnourished children in the camp. Overall, during the year 2020, DCA supported the expansion of vegetable production to 360 households (40 hosts: 320 refugees using climate smart technologies such as Multistory gardens (MSGs) and shade houses.
DCA has also been supporting fish trade in Kakuma and Kalobeyei through linkages to fisherfolk on Lake Turkana in the form of capacity building, market infrastructure development and provision of business capital, especially during the COVID-19 pandemic. In 2019 and 2020 DCA has supported a total of 180 fish traders.
Financial Inclusion:
In 2019, DCA Kenya started mobilizing the beneficiaries supported in agronomic activities to form Village Savings and Loan Associations (VSLAs) that would advance affordable credit for borrowers and a return on their savings as well as grants for members in distress. To date, DCA has a portfolio of 41 VSLAs with over 750 members both refugees and the host community, with approximately 83% being women. DCA Kenya is also part of a multi-country initiative to trial the digitization of VSLA Facilitator training; this is currently being tested with VSLA facilitators through Simulation game App, the ledgers/records, and financial service linkages to digitize the cash box through financial account/wallets.**
With the strategic commitment to expand cash-based intervention, DCA Kenya explored a multi-purpose cash transfer program to cushion the communities in Kakuma and Kalobeyei following a household need and market assessment conducted by DCA/LWF/HI in December 2019 in refugee and host communities. In 2020, DCA reached 450 most vulnerable host community households (at least 2,700 people) with a 5-monthly multipurpose cash transfer to cover their basic survival needs, especially after the Covid-19 outbreak.
DCA has a strong focus on youth as the primary stakeholder. DCA Kenya has been working with the youth directly and through partners. Between 2018 – 2019, DCA tested a new approach – the blended learning methodology – to train youth on business and entrepreneurship skills training. So far, over 300 youth entrepreneurs have been trained using the methodology, with over 95% demonstrating improved business performance, 32% starting new enterprises, and over 80% participating in peer-to-peer learning. Credit to the blended learning approach, DCA is currently piloting DCA youth enterprise fund as the next step after training, as well as a Chatbot; an artificial intelligence tool offering preparatory training content for youth entrepreneurs. In addition, DCA is developing employability and work readiness program for youth job seekers as well as exploring online business targeting youth.
**
2. Evaluation Purpose Objectives and Intended Use
The purpose for this evaluation is two-fold. On the one hand, it will establish the substantial evidence of the contribution made towards the achievement of the principal objectives of the project by assessing the performance of the project (effectiveness, efficiency, relevance, impact and sustainability) and ensure accountability towards the donor and the project beneficiaries and on the other hand the evaluation will assess the lessons learnt in the implementation of the project.
The evaluation will have three objectives:
Objective 1: Evaluate to what extent the project has delivered effective, efficient, relevant, impactful and sustainable interventions to beneficiaries as set in the project log frame (especially in contributing to the set outcomes and goals).
Objective 2: Assess the key lessons learned for the project and establish recommendations for future project interventions.
Objective 3: Analyze and document cross project synergies between projects 1010375-13 & 1010375-20 and make relevant recommendations to enhance it.
2a. Intended users of the evaluation
The intended users of the evaluation are:
Organization
Focal Person
Contact Details
Remarks/Possible Interest
DCA
Head of Program – Kenya (Patrick Kibuku).
Area Manager – (Edwin Siala).
patrick.kenya@dca.dk
eosi@dca.dk
Lessons learnt, best practices & how they can be used to improve future programming.
Other Stakeholders.
Edith Imbolokonye Ingutia
Chair - Livelihoods Technical Working Group
ingutia@unhcr.org
Share lessons learnt with a view to improve Livelihoods programming in Kakuma/ Kalobeyei
3. Specific Evaluation Questions
The evaluation will assess the following evaluation criteria and include all of the following questions:
Objective 1: Evaluate to what extent the project has delivered effective, efficient, relevant and timely interventions to beneficiaries as set in the project log frame (especially in contributing to the set outcomes and goals).
I. Effectiveness:
The evaluation should assess the following:
o To what extent have the intended objectives (Outcomes and Goals) indicated in the project log frame been reached?
o To what extent have the project results contributed to the overall goal? Was the response effective in responding to the needs?
o What were the major factors influencing the achievement of the objectives of the project?
o What opportunities for collaboration have been utilized and how have these contributed to increased effectiveness? Or otherwise?
o Have proper accountability and risk management framework(s) been in place to minimize risks on program failure?
o Is the intervention relevant in relation to the needs and priorities of the intended beneficiaries?
o To what extent have the project beneficiaries been reached and what mechanisms were in place to improve coverage?
II. Efficiency:
o How efficient was the use of project resources(inputs) to realise the set results?
o Were the investment and recurrent costs justified?
o Was the project implementation modality considered to have been cost-efficient and quality oriented?
o What choices were made for leveraging other opportunities for collaboration and non-collaboration during program design? Why were these choices made?
o What were the outcomes of these choices in ensuring effective and efficient program implementation?
III. Relevance/Impact
o How relevant were the interventions implemented in addressing community needs?
o Have the interventions contributed in addressing the community needs identified by project?
o How do beneficiaries perceive the relevance of the project and how have the interventions implemented improved their lives? Are there any stories of change?
o How has the collaboration between DCA and other stakeholders contributed to appropriate response of specific needs and priorities of the beneficiaries?
o To what extent was project able to adapt and provide appropriate response to context changes and emerging local needs/priorities of beneficiaries?**
IV. Impact
o What positive and negative, primary and secondary long-term effects have been produced by a development intervention, directly or indirectly, intended or unintended?**
o Did the quality of activities, delivered by project meet the needs and expectations of the beneficiaries? What improvements can be considered?
V. Sustainability
o What is the probability of long - term benefits as a result of the project interventions?
o Will the intended benefits continue when development co – operation is terminated?
o Is local ownership established?
Objective 2: Assess the key lessons learned for the project and establish recommendations for future project interventions.
Learning
The evaluation should at least include one lesson learned and recommendation per evaluation category, i.e. effectiveness, efficiency, relevance, impact and sustainability.
o What are the key lessons learned?
o What improvements have been proposed to improve project impact?
Sustainability
o Is there evidence that the initiative is likely to grow – scaling up and out – beyond the project life?
o What are recommendations for the future and what will be the added value of implementing them? Consider at least the below questions:
Objective 3: The evaluation is also expected to analyse and document cross project synergies between projects 1010375 – 15, 1010375 – 13 and 1010375 – 20 and make relevant recommendations to enhance it.
This evaluation is expected to analyse and document the synergies that exist with other projects including VSLA Gaming App (1010375 - 20) – a research project for training VSLA facilitators using VSLA Simulation Game App and DCA Enterprise Fund (1010375 - 13) – that aims to provide capital to youth owned enterprises through revolving fund, and on the other hand receive individual donations to refinance the kitty, both implemented in Kakuma and Kalobeyei and the opportunities available to leverage the impact of these projects for the benefit of communities.
Scope of the Evaluation
Geographical area: This evaluation will be done in Kakuma and Kalobeyei areas of Turkana West Sub county, Turkana County where DCA implements this project. The sample size will be drawn from both host community and refugee communities in Kakuma and Kalobeyei settlement.
Time Frame: The evaluation will take not more than 25 days to complete. This period will cover designing of the survey tools, data collection, data analysis, report writing and dissemination.
Technical scope: Whereas the evaluation scope will primarily be informed by assessing the project contribution in realising the objectives (outcome and goal level) as outlined by the relevant aspects in the log frame, it is expected that the following will be highlighted:
Use of innovative approaches and technologies in humanitarian programming such as Multi storey gardens (MSGs), cricket farming and youth empowerment initiatives. This is expected to enable DCA and its partners account to its constituents, back donors and the government of Kenya for its commitments towards this project.
Market readiness assessment for the use of farm inputs vouchers in Kakuma and Kalobeyei.
The application of Core Humanitarian standards in DCA work
DCA is a CHS certified organisation. The evaluation will also assess the extent to which DCA applied the nine CHS commitments in working with communities in this project to ensure accountability to beneficiaries. This will also guide & compliment the above DAC criteria during the evaluation.
Approach and Methodology
The evaluation approach shall be utilization focused. As such, the evaluator should arrange individual meetings with individual intended users before and after the evaluation (de-briefing).
The following should be observed:
· Attention should be given to collect information: from all types of stakeholders, with special focus on women/youth (both girls and boys) from the refugees and host communities and project implementing staff.
· Initial findings and recommendations made as a result of the evaluation shall be shared with DCA, partners and right holders in a participatory way, so that they have an opportunity to discuss the recommendations before they are finalised.
· As much as possible, the evaluation shall recommend systems to check that recommendations are incorporated in future planning and proposals are documented and followed up.
Methodology.
· Literature review of all relevant project documents including Strategy, Evaluation reports, progress reports, financial reports, documents and materials produced during the project including relevant documents (e.g. evaluation)
· Conducting Household surveys based on an appropriate sampling design.
· Individual Key Informants interviews and focus group interviews with stakeholders and target community representatives (both beneficiaries and non-beneficiaries), relevant Partners, senior management and relevant staff, relevant GoK departments, private sector partners and UN agencies.
· Market survey specifically related to input vouchers.
Evaluation management and values
The evaluator must not compromise the values of DCA and should adhere to the Guiding Principles for Evaluators of the American Evaluation Association.
This evaluation should adhere to and be guided by the DCA evaluation policy. The evaluator should refer any questions or emerging issues to the DCA Kenya Head of Program (patrick.kenya@dca.dk).
The general terms and conditions of this consultancy are:
· Logistics: DCA will cover the cost of the consultant(s) travel to the field and back, meals, and accommodation.
· Professional fee: The consultant(s) will be paid professional fees in accordance with this TOR and within DCA’s approved rates.
· Tax 5% withholding income tax payable to the Government of Kenya (GoK) shall be deducted from the consultants’ fees during payment when relevant.
· A contract will be signed by the consultant(s) prior to commencement of this consultancy which will detail additional terms and conditions of service, aspects on inputs and deliverables.
· Full term of consultancy: document review, field work and report writing should not exceed 25 days.
Other specifics on who makes decisions on what and what resources does DCA mobilise to support the evaluation, e.g. logistical support will be contained in the consultancy contract.
Professional Qualifications of the Team
Required qualifications
· A multi-disciplinary consultant (s) with a Master’s Degree in a relevant discipline in social science (or equivalent).
· Experienced in nexus programming especially in Sustainable Livelihoods, value chains and financial inclusion/inclusive markets (in humanitarian settings) **
· Proven expertise on mainstreaming Rights Based Approach and Gender approaches in sustainable livelihoods programming. **
· Proven experience from conducting evaluations and studies for NGO implementing humanitarian and development assistance in the Horn of Africa and Kenya in particular.
· Proven experience in conducting evaluations and research and using multiple methodologies including household surveys, participatory evaluation methodology, appreciative enquiry methods, focus group interviews, etc.
Reports
The final evaluation report should follow the format 1-3-25 as described in Annex 2. Failure to comply with this format results is considered breach of these Terms of Reference.
Meetings and workshops
An initial meeting will be conducted between the consultant and DCA staff. This meeting will outline the scope of the evaluation and agree on the evaluation parameters including, tools, evaluation design, methodology, respondents that will be interviewed, locations to be covered and timelines to be used during the evaluation. The consultant will also outline the resources and documents that he/she will need to deliver the task and use the opportunity to clarify expectations of DCA. Alongside the review of the relevant existing literature and project documents, the consultant will embark on developing the tools that will be used for data collection. A meeting will be organized between the consultant and DCA to share and review these tools and to give feedback before the tools are validated for use in data collection.
The consultant will subsequently conduct a two day workshop with selected enumerators to train them on the tools, methods and approaches to data collection.
Suggested timeline
The envisaged evaluation period is 25 consultancy days distributed around time for preparation, field work, travel, and report writing, to be outlined in the technical proposal. The timeline proposed by the consultant(s) should also take this into account, and ideally should propose preparation/desk research and any adherence to Covid19 protocols as laid down by the Ministry of Health.
Budget and Payment
· The consultant(s) will receive remuneration under the following terms of payment, which will be based on the output of the work and not on the duration that it might take:
· The Lead Consultant(s) shall be paid based on a daily rate. This shall be calculated based on 25 consultancy days timeline in the section above.
· 30 % of the total shall be paid upon signing of the contractual agreement.
· The remaining 70% shall be paid after a final satisfactory report and other outputs are submitted and satisfactorily signed off by DCA.
Structure of the Proposal and Submission Guidelines
All expressions of interest should include:
Technical Proposal highlighting: brief explanation about the consultants (s) with evidence of previous experience in this kind of work; profile of the consultancy firm to be involved in undertaking the consultancy; understanding of the TOR, the task to be accomplished as well as draft consultancy framework and plan and at least three referees.
Financial Proposal: The financial proposal should provide cost estimates for services rendered including daily consultancy fees related to the consultants excluding accommodation and living costs; transport cost, stationeries, and supplies needed for data collection; costs related to persons that will participate from partners and government officers.
Curriculum Vitae: A detailed Curriculum vitae of the consultants(s) detailing the academic, professional and technical experience relevant to this job.
Additional References or Resources
Resources particularly relevant to the project are:
- Project documents: a) 2020 Project proposal document and Logframe for 1010375-15, 13 &20
- DCA Project progress reports and monitoring reports.
- Danida Hum funding - End of Project Evaluation report/s of 2019.
- DCA Evaluation guidelines & Humanitarian Assistance policy.
- DCA Strategy document.
How to apply:
For any questions or clarifications on the TOR kindly reach out to: Patrick Kibuku, DCA Head of Program (HoP) – Kenya. Email: patrick.kenya@dca.dk
YOUR APPLICATION AND PROPOSALS SHOULD BE SUBMITTED TO: procurementkenya@dca.dk NOT LATER THAN 18th DECEMBER 2020