Learning from AgResults

AgResults learning takes two forms:

  1. Learning generated from the experience of AgResults in designing and implementing projects;
  2. Learning generated from the External Evaluator in its independent ongoing review of AgResults projects.

Since 2013, AgResults has developed a variety of knowledge products, which can be found in the Learning Library below. The library is searchable by keyword and by a specific AgResults project, using the "All Tags" drop-down box.

RECENT PRODUCTS:

bloc 1
bloc 2
bloc 3

Learning Library

Evaluator Lessons Learned 8: Impact Evaluation Methods

In Learning Library Tagged in Evaluator, Kenya Storage, Nigeria Aflasafe, Vietnam Emissions 32 downloads

Download (pdf, 312 KB)

Evaluator Lessons Learned 8_Impact Evaluation Methods.pdf

Evaluator Lessons Learned 8: Impact Evaluation Methods

This brief by External Evaluator Abt Associates discusses quantitative methods for conducting impact assessments of smallholder farmer benefits from donor-devised interventions that stimulate private sector engagement in markets for technologies benefiting the farmers. The brief presents three AgResults Pay-for-Results competitions as examples and offers seven lessons for evaluators.

Senegal Crop Storage Finance Process Tracing Evaluation – Baseline

In Learning Library Tagged in Evaluator, Senegal Crop Storage Finance 89 downloads

Download (pdf, 719 KB)

AgResults Process Tracing Baseline Evaluation Senegal.pdf

Senegal Crop Storage Finance Process Tracing Evaluation – Baseline

This report from External Evaluator IDinsight documents findings from the baseline Process Tracing evaluation of the AgResults Senegal Crop Storage Finance Challenge Project. The purpose of the baseline Process Tracing evaluation was to assess the state of the storage finance market during early stages of the project and assess if the preconditions are in place for the project to have its intended impact.

Evaluation Final Report: Vietnam GHG Emissions Reduction Challenge Project Popular

In Learning Library Tagged in Evaluator, Vietnam Emissions 317 downloads

Download (pdf, 1.86 MB)

AgResults Final Evaluation Report_Vietnam GHG Challenge Project.pdf

Evaluation Final Report: Vietnam GHG Emissions Reduction Challenge Project

This evaluation final report by Abt Associates shows that Pay-for-Results spurred private sector development and dissemination of emissions-reducing, yield-enhancing technology packages among smallholder farmers in Vietnam. A 2100-farmer survey showed that AgResults farmers achieved 14 percent higher yields than comparison farmers and used practices associated with lower emissions. However, project measurements of emissions were uncertain, so evaluators could not determine emissions impact. Future projects should pay attention to reliability of field-based emissions measurements.

Evaluator Lessons Learned 7: Vietnam GHG Emissions Evaluation Findings Popular

In Learning Library Tagged in Evaluator, Vietnam Emissions 280 downloads

Download (pdf, 537 KB)

Evaluator Lessons Learned 7_Vietnam GHG Emissions Evaluation Findings.pdf

Evaluator Lessons Learned 7: Vietnam GHG Emissions Evaluation Findings

This brief summarizes the final evaluation report of the Vietnam GHG Emissions Reduction Challenge Project, showing that PfR can spur the private sector to develop and disseminate emissions-reducing technology packages for smallholder farmers. AgResults farmers achieved 14 percent higher yields than comparison farmers and were more likely to use practices associated with lower GHG emissions. The project’s main challenge was obtaining reliable measurements of emissions.

Sustainability Assessment: Kenya On-Farm Storage Challenge Project Popular

In Learning Library Tagged in Evaluator, Kenya Storage 357 downloads

Download (pdf, 1.18 MB)

Sustainability Assessment AgResults Kenya On-Farm Storage Challenge Project_March 2021.pdf

Sustainability Assessment: Kenya On-Farm Storage Challenge Project

This sustainability assessment by External Evaluator Abt Associates looking at the Kenya On-Farm Storage Challenge Project affirms that Pay-for-Results projects can catalyze development of a smallholder- and gender-inclusive, sustainable market for beneficial agricultural technologies. Since the project ended, there have been new entrants to the market, ongoing product innovation, and a 250% increase in sales of on-farm storage products attributable to AgResults.

Summary of Evaluator Findings and Lessons from AgResults Prize Competitions: 2013-2020 Popular

In Learning Library Tagged in Evaluator, Kenya Storage, Nigeria Aflasafe, Uganda Legumes, Zambia PVA Maize 544 downloads

Download (pdf, 985 KB)

Summary of Evaluator Findings and Lessons from AgResults Prize Competitions 2013-2020.pdf

Summary of Evaluator Findings and Lessons from AgResults Prize Competitions: 2013-2020

This report by External Evaluator Abt Associates summarizes independent evaluation findings from competitions in Nigeria, Kenya, Uganda, and Zambia and offers guidance for future prize sponsors. It provides evidence that Pay-for-Results (PfR) competitions can spur development of markets for technologies benefitting smallholder farmers. It also offers guidance on how to determine whether PfR is an appropriate design option and how to maximize farmer benefits.

Evaluation Design: Tanzania Dairy Productivity Challenge Project Popular

In Learning Library Tagged in Evaluator, Tanzania Dairy 527 downloads

Download (pdf, 1.31 MB)

AgResults Tanzania Evaluation Design.pdf

Evaluation Design: Tanzania Dairy Productivity Challenge Project

The evaluation design for the Tanzania Dairy Productivity Challenge Project by Abt Associates lays out a mixed-methods approach. To assess impact on dairy producers, the evaluator will use a quasi-experimental design to gauge technology adoption and subsequent impacts on income and consumption. The approach will use a structure, conduct, performance framework to assess market impact.

Evaluation Close-Out Assessment: Zambia Biofortified Maize Challenge Project Popular

In Learning Library Tagged in Evaluator, Zambia PVA Maize 637 downloads

Download (pdf, 985 KB)

2020 12 29 Zambia close out assessment.pdf

This assessment by External Evaluator Abt Associates, updated in December 2020, found that the AgResults project played a role in creating a niche market for PVA maize, although with limited development impact because the market involved mostly better-off smallholder farmers and urban consumers. Findings suggested that the market would likely be sustained in the short to medium term.

Evaluator Lessons Learned #6: Zambia Biofortified Maize Evaluation Findings Popular

In Learning Library Tagged in Evaluator, Zambia PVA Maize 341 downloads

Download (pdf, 448 KB)

Evaluator Lessons Learned 6_ Zambia PVA Maize Evaluation Findings_Dec 2020.pdf

Evaluator Lessons Learned #6: Zambia Biofortified Maize Evaluation Findings

This brief summarizes the close-out assessment of the Zambia Biofortified Maize Challenge Project. External Evaluator Abt Associates found that the competition helped develop a niche market for Pro-Vitamin A maize, although Vitamin A-deficient populations were a small portion of those who consumed the maize. The brief underscores the importance of directly targeting intended beneficiaries in project design.

Evaluator Lessons Learned #3: Nigeria Aflasafe Project Evaluation Findings Popular

In Learning Library Tagged in Evaluator, Nigeria Aflasafe 1330 downloads

Download (pdf, 824 KB)

Evaluator Lessons Learned 3_Nigeria Aflasafe Project Evaluation Findings_Nov 2020.pdf

Evaluator Lessons Learned #3: Nigeria Aflasafe Project Evaluation Findings

This brief, updated in November 2020, summarizes evaluation findings for the Nigeria project. External Evaluator Abt Associates found that AgResults helped create a niche market for Aflasafe-treated maize and an increase in farmers’ uptake of Aflasafe and net maize income. Market sustainability is uncertain due to unstable market conditions and delays in implementation of aflatoxin-related policies.

Evaluation Final Report: Nigeria Aflasafe Challenge Project Popular

In Learning Library Tagged in Evaluator, Nigeria Aflasafe 2618 downloads

Download (pdf, 2.30 MB)

Final Evaluation Report_Nigeria_2020.pdf

Evaluation Final Report: Nigeria Aflasafe Challenge Project

The Nigeria Aflasafe Challenge Project evaluation (published in February 2019, end-of-project update added November 2020) found that the project succeeded in creating a niche market for Aflasafe-treated maize. Aflasafe adoption increased by 56 percentage points, and average net income from maize increased by 16 percent. The sustainability of the market is uncertain.

Evaluation End-of-Project Update: Nigeria Aflasafe Challenge Project Popular

In Learning Library Tagged in Evaluator, Nigeria Aflasafe 384 downloads

Download (pdf, 1.04 MB)

Nigeria Evaluation End of Project Update_November_2020.pdf

Evaluation End-of-Project Update: Nigeria Aflasafe Challenge Project

Evaluator Abt Associates revisited the Nigeria Aflasafe Challenge Project at its conclusion, two years after the comprehensive mixed-methods assessment. They found that private sector involvement in the Aflasafe-treated maize market had increased despite reduction in the AgResults incentive, but that the Aflasafe-treated maize market’s sustainability was uncertain given general maize market instability and delayed implementation of aflatoxin-related policies.

Evaluator Lessons Learned #5: Incorporating a Gender Lens into Challenge Projects Popular

In Learning Library Tagged in Evaluator, Kenya Storage 538 downloads

Download (pdf, 383 KB)

Evaluator Lessons Learned 5_Incorporating a Gender Lens into Challenge Projects_updated.pdf

This brief by External Evaluator Abt Associates explores how Pay-for-Results (PfR) projects could potentially perpetuate disadvantages that women face in agricultural market systems and suggests project design approaches to improve gender outcomes. It also presents results from AgResults’ Kenya PfR project that led to unique benefits for women.

Final Report: Nigeria Aflasafe Challenge Project Popular

In Learning Library Tagged in Evaluator, Nigeria Aflasafe 1555 downloads

Download (pdf, 923 KB)

AgResults Nigeria Aflasafe Challenge Project_final report.pdf

More than 4.5 billion people in developing countries are exposed to aflatoxins, one of the world’s most carcinogenic substances, through their diets. Yet a biocontrol solution exists: AflasafeTM. The AgResults Nigeria AflasafeTM Challenge Project (2013-2019) used a Pay-for-Results (PfR) prize competition to motivate the private sector to overcome critical barriers preventing widespread adoption of AflasafeTM among Nigerian smallholder farmers working in the maize sector. Over six years, the competition engaged 41 competitors to reach 75,788 farmers, producing more than 315,000MT of AflasafeTM-treated maize.

Evaluation Design: FMD Vaccine Challenge Project Popular

In Learning Library Tagged in Evaluator, FMD Vaccine 671 downloads

Download (pdf, 1.53 MB)

FMD Evaluation Design Document_2021.01.18.pdf

Evaluation Design: FMD Vaccine Challenge Project

The evaluation design for the Foot and Mouth Disease (FMD) Vaccine Challenge Project, by IDinsight, lays out a mixed-methods approach relying primarily on qualitative process-tracing techniques. The document highlights the role of data collected from potential vaccine manufacturers, buyers, policymakers, and others to explore how the project impacts the development and uptake of FMD vaccines in Eastern Africa.

Evaluator Lessons Learned #4: Kenya On-Farm Storage Challenge Project Evaluation Findings Popular

In Learning Library Tagged in Evaluator, Kenya Storage 587 downloads

Download (pdf, 760 KB)

Evaluator Lessons Learned 4_Kenya On-Farm Storage Project Evaluation Findings.pdf

This brief by External Evaluator Abt Associates summarizes the evaluation of the AgResults Kenya On-Farm Storage Challenge Project. Abt Associates found that the competition created an emerging market for improved on-farm storage devices and increased adoption of on-farm storage technologies. However, impacts on farmer income were small. The brief underscores the challenge of constructing an accurate theory of change.

Evaluation: Vietnam Challenge Project RCT Adherence Report Popular

In Learning Library Tagged in Evaluator, Vietnam Emissions 604 downloads

Download (pdf, 1.13 MB)

Evaluation Design Vietnam GHG Emissions Reduction Challenge Project RCT Report.pdf

Abt Associates’ evaluation design of the Vietnam GHG Emissions Reduction Challenge Project envisions a randomized control design. This report assesses the success of the initial randomization and confirms that competitors adhered to rules respecting communes set aside for control; it also confirms similarities between control and treatment groups at baseline.

Evaluation Design: Vietnam GHG Emissions Reduction Challenge Project Popular

In Learning Library Tagged in Evaluator, Vietnam Emissions 415 downloads

Download (pdf, 2.45 MB)

Evaluation Design AgResults Vietnam 2020 06 05.pdf

Evaluation Design: Vietnam GHG Emissions Reduction Challenge Project

The evaluation design for the Vietnam GHG Emissions Reduction Challenge Project, by Abt Associates, lays out a mixed methods approach, including a randomized control design. The document highlights the role of interviews, surveys, and farmer diaries to explore the effect of the Vietnam project on the market for emissions-reducing technologies and to estimate impacts on farmers’ knowledge, attitude, practices, and incomes.

Brucellosis Vaccine Challenge Project: 2019 Interim Assessment Popular

In Learning Library Tagged in Brucellosis (Global), Evaluator 640 downloads

Download (pdf, 911 KB)

Brucellosis Vaccine C hallenge Project 2019 Interim Evaluation Assessment.pdf

This assessment by External Evaluator Abt Associates reflects the experience of competitors in the Brucellosis Vaccine Challenge Project from mid-2018 to mid-2019. Most competitors reported that the competition had helped advance their B. melitensis vaccine R&D. However, many of them anticipated challenges completing the safety and efficacy trials due to resource constraints.

Can Pull Mechanisms Achieve Agriculture Development Objectives? Evidence from AgResults External Evaluation Popular

In Learning Library Tagged in Evaluator, Kenya Storage, Nigeria Aflasafe, Uganda Legumes, Zambia PVA Maize 597 downloads

Download (pdf, 3.30 MB)

AgResults External Evaluation Presentation_February 2020.pdf

This DFID Chief Economist Seminar Series presentation from February 2020 summarizes External Evaluator Abt Associates' findings about the use of “pull mechanisms” or “prize competitions” to develop markets that provide innovative agricultural technologies to smallholder farmers. Findings suggest that pull mechanisms can create markets as long as the binding constraints inhibiting market development are within the manageable interest of the companies competing for the prize.