#

The Importance of Measuring Impact and Independent 3rd Party Evaluations:

Seed Effect’s Partnership with Dr. Steve DeLoach

At Seed Effect, we believe that the hard places are worth investing in, that true transformation can’t happen apart from the Gospel, and that how we help truly matters. We also believe that a strong foundation in Listening, Monitoring, and Evaluation (LME) is vital to effectively implement our program and achieve meaningful impact. These practices allow us to remain true to our mission, improve our programs, and deepen our impact in the communities we serve. Rooted in humility and commitment to transparency, our approach to data and feedback reflects our dedication to accountability, stewardship, and respect for the dignity of those we serve. 

Understanding that our members’ needs are significant and their time is valuable, we must adopt an empowering, dignifying, effective, and measurable approach to ensure we are stewarding their time well and meeting their needs.

So, how do we know that our program is effective? How do we ensure that our efforts make a tangible difference in the lives of those we serve?

To understand our effectiveness, we combine several strategies, tools, and metrics for assessment, including:

      • Having a clear mission and vision

      • Completing a thorough needs assessment and baseline data collection

      • Designing our 3-year savings and loan program to meet economic and spiritual needs

      • Establishing measurable goals

      • Listening, collecting substantial data, and using tools such as key performance indicators to track quantitative metrics, including outputs and outcomes

      • Gathering members’ stories, testimonies, and qualitative feedback to further evaluate transformation

      • Conducting independent, third-party evaluations

We are grateful to partner with Dr. Steve DeLoach, Chair of the Economics Department at Elon University, for independent, third-party evaluations that objectively assess our programs and their impact

This relationship is pivotal in ensuring that our approach is data-informed and that our impact is measurable. This commitment to evidence-based, independent evaluation helps confirm efficacy and allows us to make informed adjustments for continuous improvement. Ultimately, it ensures that we remain accountable to our mission, partners, and the communities we serve, delivering sustainable change with integrity and transparency.

Independent Impact Assessment

In 2018, Dr. DeLoach began an independent impact assessment of Seed Effect’s program to examine whether Seed Effect members experienced increased self-reliance and empowerment compared to non-participants in the same communities. DeLoach’s study consisted of 1,491 individuals surveyed between 2018 and early 2020, including 939 South Sudanese refugees and 552 Ugandans.

Results of the study support the idea that Seed Effect’s program significantly and positively affects both refugee and host community participants. DeLoach’s review includes the impact of participation on asset accumulation. He reports, 

“Relative to non-participants, members of Seed Effect’s groups on average experienced significant increases in most asset categories over the course of one year.” 

You can read more about his findings and view the report here

Control Study (RCT): Lamwo, Uganda

In 2022, Dr. DeLoach initiated a control study in Lamwo, Uganda, coinciding with the launch of Seed Effect’s seventh branch. With this study, Dr. DeLoach surveyed treatment and control populations known to be interested in joining a savings and loan group. This study includes three data collection points spanning over two years:

      • After mobilizing 60 groups of interested individuals, 40 were randomly selected to immediately start receiving training as savings and loan groups (treatment group) while the remaining 20 would wait one year before receiving training (control group). A sample of both populations were surveyed to serve as the baseline for the study. 

      • One year later, the control groups started receiving training as savings and loan groups. At this point, the sample from both populations was surveyed again – the treatment group having just completed their first year of operation and the control group ending their time with no training from Seed Effect.

      • Two years after the baseline, the sample from both populations was surveyed for a final time. At this point, the treatment groups that were initially trained have been operating for two years while the control groups have been operating for one year.

The last round of data collection will take place in the Fall of 2024 and will then be ready for analysis. We are excited to see what fresh insights Dr. DeLoach will find in this control study that will reveal what impact is being made and what opportunities there are to improve Seed Effect’s operations to serve all of our locations even better. 

Additional Evaluations

Over the next year, Dr. DeLoach and his team will analyze the efficacy of our new agriculture training and the impact of our “Plan for a Better Business” training. They will also analyze the impact of group composition (e.g., all farmers, all mothers with dependents, etc.) on the relative effectiveness of the groups.

We have found that it’s impossible to know whether our strategies lead to tangible outcomes without listening to our members and collecting data. Without independent evaluation, it becomes challenging to ensure objectivity and transparency, as internal biases can cloud our judgment. Working with Dr. DeLoach and his team offers Seed Effect an external, expert perspective on our program’s performance. Their evaluations are unbiased and grounded in rigorous economic analysis, which provides a level of credibility that internal assessments alone cannot achieve. Third-party evaluations help us ensure that the interpretation of the results is sound, confirming that our conclusions are based on evidence rather than assumptions or internal perspectives. It also allows us to dive deep into the data and gain insights into what’s working, what needs improvement, and how we can adjust our programs for maximum impact.

Watch Dr. DeLoach’s assessment of Seed Effect after a recent trip to Uganda.  

Seed Effect’s partnership with ELON and Dr. DeLoach ensures we remain focused on what works, backed by research and measurable results.  By embracing data-informed insights, we can continue to refine our approach and bring hope and economic empowerment to underserved communities, ensuring that our mission is fulfilled effectively and with accountability.

Article Info

Nov 4, 2024

More From The Blog

Group Spotlight: God is Good

Group Spotlight: God is Good

The twelve tribes represented in “God is Good” Seed Effect Savings & Loan Group meet at Ebenezer Baptist church, planted by Seed Effect partner, Empower One.  When they first arrived in Baratuku refugee settlement, poverty was rampant within the community. But as...

Dallas Happy Hour @ TBK Rooftop – November 7, 2024

Dallas Happy Hour @ TBK Rooftop – November 7, 2024

Join us for a Fall Happy Hour!Join us as we share stories of what God is doing through the support and partnership of people like YOU to bring the hope of Jesus and economic empowerment to Northern Uganda and South Sudan! Gather with us as we enjoy hors d’oeuvres and...

September 2024 Prayer Requests

September 2024 Prayer Requests

Praise!  New members are continuing to come to know Jesus and provide for their families with dignity. The Lord continues to provide financially to be able to expand our program to reach more members! We have hired a new Executive Assistant to help us with US...

Get updates from the Seed Effect Team.

Read stories about our members, get updates from the field, and stay connected.