Data Quality Assessment (DQA) Consultant

Position: Data Quality Assessment (DQA) Consultant, Somalia

Background

Social Impact (SI) is a global development management consulting firm. We provide monitoring, evaluation, strategic planning, and capacity building services to advance development effectiveness. Our mission is to help global development organizations and programs be more effective at improving people’s lives.

SI is implementing the USAID Somalia’s Evaluation, Learning, and Monitoring Initiative (ELMI) Activity which provides support for monitoring, evaluation, and program related services to USAID/Somalia. The current USAID (United States Agency for International Development) strategy for Somalia aims to build a durable foundation for a more stable, democratic, and prosperous Somalia in three primary technical areas: (1) democracy, stabilization, and governance; (2) education; and (3) economic growth.

USAID/Somalia regularly collects performance data from its Implementing Partners (IPs) and analyses it to make management decisions. Since poor quality data could affect conclusions about performance and lead to faulty decision making, USAID requires that all Missions / Offices conduct regular DQAs to ensure that the USAID staff are aware of the: strengths and weaknesses of the data, as determined by applying the five data quality standards; and extent to which the data integrity can be trusted to influence management decisions (ADS 201).

A DQA often entails site visits to physically inspect records maintained by IPs. However, travel restrictions for USAID staff in Somalia limit the ability of Activity Managers to conduct site visits, hence the need for DQA consultancy services.

Position Summary

SI is recruiting DQA Consultants (at least two) to plan and conduct DQA for up to 21 indicators for five USAID projects in the health, democracy, stabilization and governance and economic growth sectors. Reporting to the ELMI Deputy Chief of Party (DCOP), the DQA Consultants will undertake desk review of Activity documents, conduct primary data collection, undertake data analysis, and prepare and submit a DQA report outlining key findings and recommendations to improve data quality. The consultants may also be required to provide associated training and mentoring to USAID staff on DQA.

The assignment is expected to run for a period of approximately three months beginning on/around August 15, 2024, to October 15, 2024. The actual level of effort (LoE) with each consultant will be determined in consultation with SI during the negotiation and contracting phase. The place of performance will be in Nairobi and/or Somalia (in locations where USAID Somalia has funded activities).

Responsibilities and Tasks

With technical guidance and oversight from the ELMI DCOP, the consultants will be responsible for the following tasks:

• Desk Review: The DQA Consultants will review relevant project documents; the Activity Monitoring, Evaluation and Learning Plan (AMELP); Indicator Performance tracking tables; IP quarterly reports; and USAID Standard or Custom indicator lists and definitions, among other documents, to inform tool development and identify issues to be covered in the subsequent steps of the DQA process.
• Inception meeting with USAID staff: The consultants will participate in an inception meeting with USAID Activity managers and program office staff to level expectations on the DQA process. The inception meeting(s) will also include the implementing partners and sub-partners, where applicable.
• Development and/or finalization of data collection tools and protocols: The consultants will develop all the required data collection tools and protocols for the DQA. This may also entail reviewing and customizing existing data collection protocols and checklists.
• DQA training/sensitization: The consultants will conduct brief training or sensitization session for both USAID staff and IPs on the DQA process and data collection tools.
• Data Collection: The DQA Consultants will conduct primary data collection and verification and administer a system assessment protocol both at the IP and sub partners’ level. They will also conduct site visits to selected primary data collection sites. Please note that non-Somalis are not allowed to travel outside Mogadishu International Airport (MIA) and the consultant will be required to work with qualified DQA assistants to complete the data collection outside MIA.
• Debrief meeting with IP and USAID: At the end of the data collection exercise, the consultants will undertake a debrief for the relevant IP and USAID staff to share any emerging issues from the DQA process.
• Data Analysis: The DQA Consultant will lead analysis and writing of findings. They will oversee the review of each indicator against the five quality standards and complete a DQA checklist for each indicator. The analysis should also demonstrate any identified discrepancies in the assessed indicators.
• Documentation and Reporting: The DQA Consultants will draft and submit a detailed DQA report to ELMI using a template to be provided. The report will: (i) outline the overall approach and methodology used in conducting the DQA; (ii) present findings in terms of the five data quality standards for each indicator; (iii) summarize recommendations for improving data quality; and (iv) include a completed DQA checklist for each of the indicators. A final report incorporating all comments and feedback from the IP, USAID and ELMI will be submitted at the end of the exercise.
• Validation and Dissemination of findings and recommendations: The Consultants will share preliminary findings and recommendations with the IP for validation before sharing with USAID. S/he will also develop an action plan, that will be discussed and agreed upon with the IP and USAID, to address the identified gaps. The action plan should also include a timeframe for completing the agreed actions.
• Supervisory Responsibility: The consultants will supervise DQA Assistants who will be engaged separately by SI to support field-level data collection.

Qualifications:

• Master’s degree in social sciences, international relations, economics, statistics, and/or any other relevant field from a recognized university.
• Minimum ten years’ experience in monitoring and evaluation in USAID context.
• Ability to work with and lead teams.
• Demonstrated experience planning and implementing rigorous DQAs of USAID indicators.
• A firm grasp of USAID ADS 201 policy and requirements on DQAs.
• Technical knowledge in democracy, stabilization and governance (DSG), economic growth (EG) or health sectors will be an added advantage.
• Ability to diplomatically communicate and work effectively with a wide range of stakeholders, including USAID IPs.
• Strong analytical and writing skills, with proven experience in synthesizing and analysing data into summarized reports and findings.
• Excellent English writing skills and speaking ability.
• Basic written and oral proficiency in Somali is desired.
• Good understanding of Somali operating environment or conflict affected and fragile states.
• Willingness and ability to travel to Mogadishu, Somalia as needed.

Deliverables:

All deliverables must be consistent with USAID ADS directives, as informed by TIPS #12: Data Quality Standards. SI anticipates the Consultants to produce the following deliverables:

• Inception report containing a summary of issues emerging from the desk review together with data collections tools and work plan.
• Draft DQA report for each of the assessed indicators and implementing partners.
• PowerPoint presentation of DQA findings and recommendations.
• Final report and presentation, inclusive of complete DQA checklist for each indicator and summary report of findings and recommendations; and
• DQA action plan for each implementing partner (IP) containing the findings, agreed actions and timeframe.

The final list of deliverables will be included in the consultant agreement.

Come join our energetic and innovative team! We offer you the opportunity to play a leading role in the growth of our company, work as part of a creative and committed team, and make a difference in the well-being of our world.

To learn more about Social Impact, please visit our website: http://www.socialimpact.com

SI is an EEO/AA/ADA Veterans Employer.

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability or protected veteran status.

Only selected candidates will be contacted for an interview.

Applications should be received by close of business (East African time) on Wednesday August 7, 2024