Local Capacity Strengthening through Intentional Evaluation Partnerships in Nigeria Dr. Samson Adebayo, DRMC, presenting at the AEA 2023 conference. © 2023 Jessica Fehringer/D4I November 14, 2024 By Data for Impact In Nigeria, D4I conducted a multi-activity evaluation of USAID/Nigeria’s Health, Population, and Nutrition (HPN) activities. As part of this process, D4I employed various methods and strategies to facilitate demand-driven local capacity strengthening (LCS) for conducting analyses and evaluations. The work in Nigeria aligns with USAID’s support for LCS as a driver of localization, and its priority to ensure that USAID programs are “inclusive, equitable, and responsive to local needs.” It also satisfies the requirements for the CBLD-9 standard indicator, which measures improved performance by local organizations resulting from capacity strengthening. In 2023, local actors and D4I presented on these capacity strengthening activities during a panel presentation and roundtable discussion at the 2023 American Evaluation Association Conference (AEA). D4I partnered with Data Research and Mapping Consult, Ltd. (DRMC), a research organization founded and based in Nigeria, to conduct the HPN Multi-Activity Evaluation. During this process, D4I and DRMC worked together to identify and design a set of activities that would best strengthen the organization’s capacity to conduct qualitative research. The team was intentional about leveraging natural opportunities to integrate capacity strengthening support within the context of their working partnership, which was designed to deliver high-quality evaluation results for use by program personnel in Nigeria. As a first step for capacity action planning, DRMC used the MERL-focused RECAP tool developed by D4I. Based on the assessment’s outcomes, DRMC identified qualitative research and dissemination as focus areas for capacity strengthening. Together, D4I and DRMC discussed and reached consensus on performance goals and metrics related to these areas, and D4I decided to implement capacity strengthening interventions through training and learning-by-doing. Training opportunities were integrated during every stage of the evaluation process and collaboratively engaged DRMC in targeted evaluation activities for learning. One of these opportunities included training on Most Significant Change (MSC). MSC is a complexity-aware qualitative method for evaluation that helps capture local perspectives and systems change, an approach championed by USAID as part of localization. D4I conducted a detailed review of the steps involved in leading state-level MSC workshops and implemented several practice runs with DRMC to allow the staff to gain fluency in the method. This in-depth training resulted in successful two-day MSC workshops in Kebbi, Zamfara, and Ebonyi, co-led by DRMC. “…the contacts I had with D4I greatly enhanced my research capabilities…I have learned more about qualitative data collection methodology…My skills on thematic analysis were also significantly improved…For the first time, I was introduced to and mastered the Most Significant Change methodology.” —DRMC staff member In the data analysis phase of the evaluation work, D4I conducted in-person and virtual training on thematic analysis and memo writing with DRMC researchers, along with engaging DRMC in collaborative development of the codebooks and coding of qualitative data. This training and support helped prepare DRMC for the dissemination phase, with successful joint presentations of findings and the opportunity for DRMC to attend and present at the AEA conference in October 2023 and co-moderate a global webinar in February 2024. DRMC staff reflected on this experience and identified a few facilitators and challenges to the approach. The facilitators included using a participatory tool to drive change, applying an integrated approach, and adopting a systems perspective. The challenges included competing interests in activity timelines, reliance on remote communication channels due to long-distance collaboration, and increased difficulty in measuring performance compared to assessing latent capacity. “Our partnership with D4I will surely impact positively on our future work…With the theoretical and practical knowledge acquired, we will now be able to carry out qualitative studies in a better way (in research design, data collection and analysis).” —DRMC staff member D4I gained valuable insights into effective LCS from this process. DRMC and D4I drafted an LCS results framework which served as a starting point for developing performance metrics and clarifying goals and priorities to ensure that capacity strengthening investments work in support of the local organizations. From capacity action planning to performance assessment, D4I’s partnership with DRMC offers a useful model for LCS in partnerships designed around evaluation implementation. Learn more about D4I’s collaboration with DRMC in this case study.
