External Independent Final Evaluation of the project
“CONTRIBUTION FOR EMERGENCY RESPONSE ACTIVITIES INCLUDED IN IOM
GLOBAL STRATEGIC PREPAREDNESS AND RESPONSE PLAN CORONAVIRUS
(IOM COVID GSRP)”
Commissioned by IOM Egypt Country Office
In March 2019, World Health Organization (WHO) declared Corona Virus Disease 2019
(COVID-19) as a Pandemic following the spread of the virus in more than 196 countries around
the globe. As of 7 February 2021, the total number of confirmed cases have exceeded more than
105 million cases leaving more than 2 million people dead. The Ministry of Health and
Population (MOHP) in Egypt recorded 169,106 confirmed cases in total with 2,872 deaths. The
virus, characterized by its fast transmission, poses high threats to Egypt, with population reaches
close to 100 million, in addition to the more than six million migrants who are mainly
concentrated in urban areas. Cairo has a population density of 19,376 people per square
kilometre (50,180/sq. mi), creating a conducive scenario for communicable diseases to easily
spread. With 20 million people living in the Greater Cairo area, COVID-19 represents a tangible
threat to the population – migrants and host communities alike, if not properly responded.
The Government of Egypt exerts all efforts to respond to COVID-19 in accordance with its
“National Action Plan on Health Security (NAPHS) 2019 – 2023” that was launched in 2018
based on the International Health Regulations – Joint External Evaluation report to strengthen
the country’s capacity to prepare for, detect and respond to public health risks. These
multisectoral collective efforts are led by the prime minister under the direct supervision of the
president ensuring proper coordination between all relevant ministries, with the Ministry of Health and Population on the frontline.
The United Nations Country Team (UNCT) has developed the Country Preparedness and Response Plan (CPRP) led by WHO Egypt to support the Ministry of Health and Population in fighting against COVID-19 through building the capacity of the public health system to be able to accommodate the increase in the number of new COVID-19 cases, which is already saturating and overwhelming the existing national capacities. This is of particular importance when related to the limited number of hospital beds and available resources required to deal with severe respiratory viral illness.
IOM works on enhancing the health emergency response capacity of the Government of Egypt against COVID-19, as a part of the UNCT CPRP, starting with coordinating and implementing the national preparedness and response plan, providing medical and socio-economic assistance to vulnerable migrants, and raising awareness among migrants and host community on the preventive measures to limit the spread of this pandemic.
Specifically, this project funded by Denmark aimed to achieve the above overarching goal through the realization of the below complimentary medium-term results (outcomes):
The Government of Egypt has enhanced capacity and counts with the necessary support to coordinate and implement the national preparedness and response plan.
Vulnerable migrants with COVID-19 related illness and other life-threatening conditions have timely access to quality health services and other essential migrant protection and assistances provided by IOM in the effort to relieve the overwhelmed Egypt public health system due to fact increase in new cases of COVID-19.
Migrant population and host communities have increased awareness on the preventive actions to limit the spread of respiratory viruses including COVID-19.
The final evaluation is being conducted to assess the extent to which the project was successful in achieving the set short, medium and long-term goals. The evaluation is also expected to document the elements that worked well and those that did not work and under which circumstances. The evaluation is also expected to document lessons learned and good practices as well as to draw recommendations to inform the improvement in future similar project development and implementation. The evaluation findings will be used by IOM and its partners to make case for follow up funding with current and other donors, in addition to the assessment of the response to COVID-19.
The evaluation will cover the entire period of project implementation (1st July 2020 to 31st March 2021) of the “CONTRIBUTION FOR EMERGENCY RESPONSE ACTIVITIES INCLUDED IN IOM GLOBAL STRATEGIC PREPAREDNESS AND RESPONSE PLAN CORONAVIRUS DISEASE 2019 (IOM COVID GSRP) ” project up to the time of the evaluation. The evaluation will address all project components including capacity building of the government of Egypt to respond to COVID-19, provision of medical assistance to vulnerable migrants, and risk communication and community engagement.
The evaluation will assess the performance of the project against the OECD-DAC criteria of relevance/appropriateness, effectiveness, coherence efficiency, and sustainability. The evaluation is also expected to assess the extent to which the project integrated cross-cutting issues of gender and human rights and the environment. Since this is the end term evaluation, the evaluation is expected to focus on implementation process and the final outcomes, looking at the extent to which the project meets the WHO guideline in terms of project delivery quality particularly in case of direct health services.
The below questions are indicative questions to be addressed in the evaluation under each evaluation criterion:
• To what extent did project interventions and delivery strategies meet the needs of beneficiaries?
• Did the project target the right beneficiaries?
• Have the projects’ assumptions been accurate?
• Were the resources (including the budget) adequate to responding to the needs identified and implement all activities?
• Were the objectives relevant to the needs of the project’s key target groups?
• Were the project outputs and outcomes achieved in accordance with the stated plans? If no, why not? In particular:
• To what extent was the project adapted to changing external conditions in order to ensure project outcomes are achieved?
• What were the major external factors influencing the achievement of the project’s expected outputs and outcomes?
• How effectively were the project results monitored?
• What were the main obstacles or barriers that the project encountered during implementation?
• To what extent were resources (time, funds, expertise) adequate to implement the activities and achieve the outputs?
• Were the project activities undertaken as scheduled and were outputs delivered on time? If not, what was the reason for possible delays?
• How well were the resources (funds, expertise, and time) efficiently used and converted into results?
• What measures have been taken to ensure that resources are efficiently used?
• To what extent can long-term changes be observed (whether intended or unintended, positive or negative)?
• Has the project served to design or inform discussion of follow-up projects (actual or planned)?
• Are the benefits generated likely to continue once external support ceased?
• To what extent have target groups and possibly other relevant stakeholders been involved in project planning and implementation?
• What should have been done differently to better guarantee sustainability, if applicable?
• To what extent were gender mainstreaming issues considered in design and implementation?
• Were any barriers to equal gender participation identified in design or implementation, and was anything done to address these barriers?
• Was the planning and design process for the project participatory and non-discriminatory?
• To what extent has the project helped to ensure respect of relevant human rights of migrants?
The evaluator may identify additional questions during the process to better respond to the evaluation purpose.
The evaluator will be responsible for developing a detailed evaluation methodology that will be followed to respond to the above evaluation purpose and questions. However, it is expected that a mix methods approach will be followed to get diverse data required to reach an objective assessment of whether the project achieved what was set out to do and draw useful recommendations and conclusions. Data collection methods may include a combination of document review, key informant interviews, surveys, and other data collection methods as necessary to satisfactorily respond to the above set of evaluation questions.
IOM will share relevant background documents and project records as needed by the evaluator or evaluation team. These will include, amongst others, progress, training and other reports, institutional documents, meeting minutes as well as other relevant information products produced during the implementation. The evaluation must follow the IOM Data Protection Principles, UNEG norms and standards for evaluations, and relevant ethical guidelines.
The deliverables expected from the Evaluator include the following:
• An inception report that clearly outlines the evaluation approach and tools to be used. The inception report must also include an evaluation matrix and a detailed work plan.
• A maximum of 30-page long draft analytical evaluation report in English without annexes. The draft of the report will be presented to IOM for comments and inputs, after which the evaluator will finalize the report and submit the final evaluation report to IOM.
• A final analytical evaluation report that reflects comments/feedback from IOM.
• A two-page evaluation brief in English and Arabic.
All deliverables are to be written in English and meet good language standards. The final report should meet the standards laid out in the UNEG Quality Checklist for Evaluation Reports.
Below presented is a provisional work plan that will be updated with the selected evaluation consultant.
Activity Responsible Timeline
Desk review in preparation for a detailed inception report, including the evaluation matrix and the data collection tools
Data processing, analysis and interpretation
Preliminary findings presentation preparation and debriefing
Evaluation report drafting and finalization
Drafting and finalization of two-page evaluation brief
Facilitation of the development of the management follow up response to the evaluation recommendation
Evaluation budget payment schedule:
The evaluator’s fee will be all inclusive. The fees include all costs related to flights, hotel accommodation, field trips to relevant implementation sites, translation and any other cost associated with the completion of the evaluation assignment. In case of travel restriction due to restrictions related to COVID 19, the evaluation methodology will be adjusted favoring online data collection methods where possible. In such context, evaluation budget will also be adjusted, as necessary. Disbursement of the evaluation consultancy fees will be paid upon satisfactory submission and approval of the following deliverables by IOM:
• Inception report
• Draft evaluation report
• Final evaluation report
• Evaluation brief
Required Qualifications and Experience:
The lead evaluator is expected to have the following minimum qualifications and experience:
• Minimum master’s degree in evaluation methods, Public Health or Epidemiology social research and /or, social science, development studies.
• Minimum of 7 years of experience in managing and/or evaluating development projects/programmes/initiatives.
• Proven experience evaluating project addressing public health emergencies is an advantage.
• Demonstrated experience and familiarity with migration dynamics and demonstrated knowledge of Middle East and North Africa (MENA).
• Fluency in English is required, and Fluency in Arabic is an advantage
How to apply
- Application procedure
Interested candidates are expected to submit their technical and financial proposals and their CVs, cover letter as well as their recent evaluation report examples no later than the 28th of February 2021 by midnight on IOM Egypt Website www.egypt.iom.int. Please compile all the documents in one PDF. Also, please note that the proposal must provide details on the methodology and approach to the assignment.
Duly completed proposal should be submitted to IOM Egypt Website.
Applications with missing documents will be treated as incomplete and will not be considered for further assessment.
Late submissions will not be considered.
Kindly note that for efficiency reasons, only shortlisted candidates will be contacted.