Evaluation of the IOM Project “Improving the Protection of Vulnerable Migrants Travelling through the Horn of Africa, 2013-2015, and previous phases”
Evaluation context
The International Organization for Migration (IOM) is committed to the principle that humane and orderly migration benefits migrants and society. As the leading international organization for migration, IOM acts with its partners in the international community to: assist in meeting the growing operational challenges of migration management; advance understanding of migration issues; encourage social and economic development through migration, and; uphold the human dignity and well-being of migrants.
Due to a variety of factors the Horn of Africa remains an area where volatile, insecure conditions continue to motivate large numbers of people to move within and across borders. These irregular migration flows include refugees, asylum seekers, smuggled and trafficked persons, and economic migrants. The push and pull factors mobilizing these population movements are varied, with some migrants fleeing from the Horn of Africa due to political unrest, persecution, and conflict, while others are leaving situations of extreme resource scarcity, drought, crop failure, food insecurity, and severe poverty.
IOM has been working with government and partners in Kenya, Somaliland, Puntland, Djibouti, and Ethiopia to promote the humane management of these mixed migration flows through the Swiss funded project “Improving the Protection of Vulnerable Migrants Travelling through the Horn of Africa,” This project commenced implementation in 2010 and is currently in its third phase of funding., The aims are :
1. Target populations demonstrate increased willingness to opt for safer migration options
2. Vulnerable irregular migrants and their host populations benefit from enhanced protection mechanism; and
3. Government officials demonstrate an enhanced understanding of their role in mixed migration, and a related willingness to coordinate with other relevant stakeholders.
Evaluation purpose
IOM and Switzerland conduct project and programme evaluations as part of their commitment to improved results based management. Evaluation results are used to improve decision-making and evaluate performance of the project partner, and to improve project and programme design and implementation. The purpose of this evaluation is to review the effectiveness and impact of the Swiss funded project, assess prospects for sustainability, identify links/synergies between this action and other existing initiatives that deal with mixed migration, identify and document lessons learned and best practices (M&E processes of the project design and implementation), and inform the development of follow up projects and programmes.
Evaluation scope
This evaluation will focus on all three phases of the project entitled “Improving the Protection of Vulnerable Migrants Travelling through the Horn of Africa and the context in which this project is placed, The geographic scope consists of Djibouti, Ethiopia, Kenya, Somalia (Somaliland and Puntland) and potentially Yemen, dating from, March 2010 till present.
Evaluation Objectives
The objectives of the evaluation are to:
1. Assess the relevance of the project’s intended outcomes and impact.
2. Assess the efficiency and cost-effectiveness of project implementation.
3. Assess the effectiveness of the project in reaching its stated objectives.
4. Assess prospects for sustainability.
5. Assess the appropriateness of the project design
6. Assess management arrangements, including monitoring and evaluation, for achieving its stated objectives
7. Identify lessons learned and best practices.
8. Assess the relevance and impact of the project within the regional context
9. Assess existing proposed follow up programmes and make recommendations for improvements.
Evaluation questions
A complete list of evaluation questions and sub-questions will be jointly developed together with the evaluation consultant. The below questions are indicative of the types of questions to be addressed in the evaluation:
Relevance
1. How appropriate are the project’s intended results for the context within which it operates, as well as meeting the needs of the target group?
2. Has the project impacted on the theory of change underlying the project?
3. To what extent were the opportunities for synergies with or needs of stakeholders and the regional governments taken into account in project design?
4. How well does the project fit into other IOM activities in migration (country office activities) and how well does it complement activities of other actors?
5. What is the added value of creating a regional project vs project with the same content in every targeted country?
Effectiveness
1. To what extent did the project do target populations demonstrate increased willingness to opt for safer migration options?
2. To what extent did vulnerable irregular migrants and their host populations benefit from enhanced protection mechanism?
3. To what extent do government officials demonstrate an enhanced understanding of their role in mixed migration, and a related willingness to coordinate with other relevant stakeholders?
4. What is the quality of the project outcomes and what is the level of beneficiary
satisfaction.
1. Were the project activities successful in meeting the intended impact hypothesis?
Given the baselines set at the start of the project?
Process and efficiency
1. How cost-effective is the project?
2. How efficient is the overall management of the project? How appropriate is project design to achieve its objectives in the context in which it operates?
3. What external factors affected the implementation of the project and how were they managed?
4. How effectively were the programme performance and results monitored?
5. How efficient and appropriate is the project set up/approach to achieve the objectives?
6. How effective is IOM’s capacity for M&E in designing and implementing the proposed project?
7. What monitoring procedures were implemented?
8. How were the baselines established and used on subsequent results reporting?
9. To what extent have lessons learnt of previous phases been taken into account in the overall project steering?
Sustainability
1. Were suitable strategies for sustainability developed and implemented?
2. To what extent are the project results likely to be sustained in the long-term?
How well has IOM developed capacity building of local actors and developed sustainable exit strategies?
Have linkages/synergies been created with other regional and country specific initiatives?
Evaluation deliverables
The consultant will produce the following:
1. Revised terms of reference for the evaluation, if required.
2. A draft evaluation inception report, inclusive of evaluation matrix (questions and sub questions, indicators and data sources), proposed methodology, and proposed work plan.
3. A final inception report, incorporating IOM’s and Switzerlands comments and agreed upon work plan.
4. A PowerPoint presentation debrief at the end of on-site data collection.
5. A draft evaluation report (including narrative and financial analysis).
6. A final evaluation report which includes a clear set of recommendations for eventual future phases.
Evaluation methodology
Review of existing reports and documents; A large stakeholder analysis including in-depth interviews with IOM, SDC, partners in Mixed Migration (eg DRC, UNHCR, IGAD etc), key informants such as front line law enforcement officials, government officials, and members of local, national, and regional coordination bodies; and questionnaires and focus group discussions with migrants.
For the document review, the following documents will be provided upon signature of contract:
• Project documents (for all three phases)
• Project budgets
• Interim reports and final reports
• Monitoring reports
• IOM strategy papers
Based on the initial desk review and interviews, the inception report (max 10 pages) should provide preliminary findings and details on the evaluation methodology. The inception report should clarify the evaluation questions (and specify what can be or cannot be answered) and if needed, suggest additional questions. It should ideally include an evaluation matrix. The inception report should also specify the limits to the evaluation and provide a realistic time frame, it is therefore important this is received finalized before the field work commences. Assistance will be provided in the identification of key stakeholders, and in organizing the schedule of interviews, focus groups, and site visits.
Evaluation Workplan
The detailed evaluation workplan will be agreed upon between the project manager in IOM Kenya and the consultant. The evaluation will take place over an 8-week period (Mar 20th to May 20th, 2015), including two weeks travel and in country time in Kenya, Ethiopia, Djibouti, and Yemen. A general workplan is presented below.
ActivityDays Location 1 2 3 4 5 6 7 8 Initial document review and revision of ToRs 7 Home-based X Draft inception brief (10 pages) Home-based X Travel Travel X Management interviews and meetings 35 Kenya X Final inception brief Kenya X Travel, in country interviews, and data collection Kenya, Ethiopia, Djibouti, SL, and PL X X X Travel 12 Travel X Draft evaluation report Home-based X Final evaluation report Home-based X
Schedule of events, deliverables, and payments
Payments will be made in two installments according to the following schedule:
DescriptionInstallment Approximate dates Payment Signature of contract and revised ToR 20 Mar 15 Inception Report 28 March 15 Travel and field work April 1st Draft evaluation report 1st installment May 10th 50%Comments on the draft May 12th Powerpoint debrief May 13th Draft evaluation report May 14th IOM review of draft report and submission of consolidated feedback May 18th Final evaluation report 2nd and final installmentMay 20th 50%
Required Competencies
Behavioural
• takes responsibility and manages constructive criticism;
• works effectively with all clients and stakeholders;
• promotes continuous learning; communicates clearly;
• takes initiative and drives high levels of performance management;
• plans work, anticipates risks and sets goals within area of responsibility;
• displays mastery of subject matter;
• contributes to a collegial team environment;
• creates a respectful office environment free of harassment and retaliation and promotes the prevention of sexual exploitation and abuse (PSEA);
• incorporates gender-related needs, perspectives, and concerns, and promotes equal gender participation
• displays awareness of relevant technological solutions;
• works with internal and external stakeholders to meet resource needs of IOM.
Technical
• delivers on set objectives on hardship situations;
• effectively coordinates actions with other implementing partners;
• works effectively with local authorities, stakeholders, beneficiaries and the broader community to advance country office or regional objectives.
Required Qualifications and Experience
• completed advanced university degree from an accredited academic institution
preferably in Management, Business Administration, Sociology, Law
or related field;
• five years of professional experience (or seven years for candidates holding a first level university degree) in project monitoring and evaluation);
• Background in Migration, Protection
• previous experiences with IOM and with UN specialized agencies an advantage;
• experience in liaising with national and international organizations.
• experience in evaluating projects of similar scope and complexity
Languages
Fluency in English is required. Working knowledge of French, Somali/Amharic, Arabic, and/or local languages an advantage.
HOW TO APPLY:
Submit applications’ cover letter and updated CVs, including daytime telephone or
e-mail contact to:
Human Resources Department, International Organization for Migration (IOM), P.O. Box 55040 – 00200, Nairobi, Kenya or send via e-mail to hrnairobi@iom.int
CLOSING DATE: 11TH March, 2015
Only shortlisted applicants will be contacted