Learning from AgResults

AgResults learning takes two forms:

  1. Learning generated from the experience of AgResults in designing and implementing projects;
  2. Learning generated from the External Evaluator in its independent ongoing review of AgResults projects.

Since 2013, AgResults has developed a variety of knowledge products, which can be found in the Learning Library below. The library is searchable by keyword and by a specific AgResults project, using the "All Tags" drop-down box.

RECENT PRODUCTS:

bloc 1
bloc 2
bloc 3

Learning Library

pdf Evaluator Lessons Learned #3: Nigeria Aflasafe Project Evaluation Findings Popular

In Learning Library Tagged in Evaluator, Nigeria Aflasafe 746 downloads

Download (pdf, 824 KB)

Evaluator Lessons Learned 3_Nigeria Aflasafe Project Evaluation Findings_Nov 2020.pdf

Evaluator Lessons Learned #3: Nigeria Aflasafe Project Evaluation Findings

This brief, updated in November 2020, summarizes evaluation findings for the Nigeria project. External Evaluator Abt Associates found that AgResults helped create a niche market for Aflasafe-treated maize and an increase in farmers’ uptake of Aflasafe and net maize income. Market sustainability is uncertain due to unstable market conditions and delays in implementation of aflatoxin-related policies.

pdf Evaluation Final Report: Nigeria Aflasafe Challenge Project Popular

In Learning Library Tagged in Evaluator, Nigeria Aflasafe 1492 downloads

Download (pdf, 2.30 MB)

Final Evaluation Report_Nigeria_2020.pdf

Evaluation Final Report: Nigeria Aflasafe Challenge Project

The Nigeria Aflasafe Challenge Project evaluation (published in February 2019, end-of-project update added November 2020) found that the project succeeded in creating a niche market for Aflasafe-treated maize. Aflasafe adoption increased by 56 percentage points, and average net income from maize increased by 16 percent. The sustainability of the market is uncertain.

pdf Evaluation End-of-Project Update: Nigeria Aflasafe Challenge Project

In Learning Library Tagged in Evaluator, Nigeria Aflasafe 7 downloads

Download (pdf, 1.04 MB)

Nigeria Evaluation End of Project Update_November_2020.pdf

Evaluator Abt Associates revisited the Nigeria Aflasafe Challenge Project at its conclusion, two years after the comprehensive mixed-methods assessment. They found that private sector involvement in the Aflasafe-treated maize market had increased despite reduction in the AgResults incentive, but that the Aflasafe-treated maize market’s sustainability was uncertain given general maize market instability and delayed implementation of aflatoxin-related policies.

pdf Evaluator Lessons Learned #5: Incorporating a Gender Lens into Challenge Projects

In Learning Library Tagged in Evaluator, Kenya Storage 49 downloads

Download (pdf, 383 KB)

Evaluator Lessons Learned 5_Incorporating a Gender Lens into Challenge Projects_updated.pdf

This brief by External Evaluator Abt Associates explores how Pay-for-Results (PfR) projects could potentially perpetuate disadvantages that women face in agricultural market systems and suggests project design approaches to improve gender outcomes. It also presents results from AgResults’ Kenya PfR project that led to unique benefits for women.

pdf Final Report: Nigeria Aflasafe Challenge Project Popular

In Learning Library Tagged in Evaluator, Nigeria Aflasafe 217 downloads

Download (pdf, 923 KB)

AgResults Nigeria Aflasafe Challenge Project_final report.pdf

More than 4.5 billion people in developing countries are exposed to aflatoxins, one of the world’s most carcinogenic substances, through their diets. Yet a biocontrol solution exists: AflasafeTM. The AgResults Nigeria AflasafeTM Challenge Project (2013-2019) used a Pay-for-Results (PfR) prize competition to motivate the private sector to overcome critical barriers preventing widespread adoption of AflasafeTM among Nigerian smallholder farmers working in the maize sector. Over six years, the competition engaged 41 competitors to reach 75,788 farmers, producing more than 315,000MT of AflasafeTM-treated maize.

pdf Evaluator Lessons Learned #4: Kenya On-Farm Storage Challenge Project Evaluation Findings Popular

In Learning Library Tagged in Evaluator, Kenya Storage 175 downloads

Download (pdf, 760 KB)

Evaluator Lessons Learned 4_Kenya On-Farm Storage Project Evaluation Findings.pdf

This brief by External Evaluator Abt Associates summarizes the evaluation of the AgResults Kenya On-Farm Storage Challenge Project. Abt Associates found that the competition created an emerging market for improved on-farm storage devices and increased adoption of on-farm storage technologies. However, impacts on farmer income were small. The brief underscores the challenge of constructing an accurate theory of change.

pdf Evaluation: Vietnam Challenge Project RCT Adherence Report

In Learning Library Tagged in Evaluator, Vietnam Emissions 42 downloads

Download (pdf, 1.13 MB)

Evaluation Design Vietnam GHG Emissions Reduction Challenge Project RCT Report.pdf

Abt Associates’ evaluation design of the Vietnam GHG Emissions Reduction Challenge Project envisions a randomized control design. This report assesses the success of the initial randomization and confirms that competitors adhered to rules respecting communes set aside for control; it also confirms similarities between control and treatment groups at baseline.

pdf Evaluation Design: Vietnam GHG Emissions Reduction Challenge Project

In Learning Library Tagged in Evaluator, Vietnam Emissions 12 downloads

Download (pdf, 2.45 MB)

Evaluation Design AgResults Vietnam 2020 06 05.pdf

The evaluation design for the Vietnam GHG Emissions Reduction Challenge Project, by Abt Associates, lays out a mixed methods approach, including a randomized control design. The document highlights the role of interviews, surveys, and farmer diaries to explore the effect of the Vietnam project on the market for emissions-reducing technologies and to estimate impacts on farmers’ knowledge, attitude, practices, and incomes.

pdf Evaluation Close-Out Assessment: Zambia Biofortified Maize Challenge Project Popular

In Learning Library Tagged in Evaluator, Zambia PVA Maize 193 downloads

Download (pdf, 967 KB)

Evaluation CloseOut Assessment Zambia.pdf

This assessment by External Evaluator Abt Associates found that the AgResults project played a role in creating a niche market for PVA maize, although with limited development impact because the market involved mostly better-off smallholder farmers and urban consumers. Findings suggested that the market would likely be sustained in the short to medium term.

pdf Brucellosis Vaccine Challenge Project: 2019 Interim Assessment Popular

In Learning Library Tagged in Brucellosis (Global), Evaluator 233 downloads

Download (pdf, 911 KB)

Brucellosis Vaccine C hallenge Project 2019 Interim Evaluation Assessment.pdf

This assessment by External Evaluator Abt Associates reflects the experience of competitors in the Brucellosis Vaccine Challenge Project from mid-2018 to mid-2019. Most competitors reported that the competition had helped advance their B. melitensis vaccine R&D. However, many of them anticipated challenges completing the safety and efficacy trials due to resource constraints.

pdf Can Pull Mechanisms Achieve Agriculture Development Objectives? Evidence from AgResults External Evaluation Popular

In Learning Library Tagged in Evaluator, Kenya Storage, Nigeria Aflasafe, Uganda Legumes, Zambia PVA Maize 171 downloads

Download (pdf, 3.30 MB)

AgResults External Evaluation Presentation_February 2020.pdf

This DFID Chief Economist Seminar Series presentation from February 2020 summarizes External Evaluator Abt Associates' findings about the use of “pull mechanisms” or “prize competitions” to develop markets that provide innovative agricultural technologies to smallholder farmers. Findings suggest that pull mechanisms can create markets as long as the binding constraints inhibiting market development are within the manageable interest of the companies competing for the prize.

pdf Evaluation Final Report: Kenya On-Farm Storage Challenge Project Popular

In Learning Library Tagged in Evaluator, Kenya Storage 582 downloads

Download (pdf, 1.82 MB)

Final Evaluation Report_Kenya_2020.pdf

The external evaluation of the Kenya On-Farm Storage Challenge Project found that the project created an emerging market for improved on-farm storage products in Kenya. Impacts on farmer income and food security were small, and the main reported benefit of adoption was reduced use of pesticide dust in maize stored for home consumption.

pdf Evaluation Baseline Report: Brucellosis Vaccine Challenge Project

In Learning Library Tagged in Brucellosis (Global), Evaluator 97 downloads

Download (pdf, 939 KB)

Baseline Report AgResults Brucellosis 2019 09 24.pdf

This baseline report by External Evaluator Abt Associates describes the Brucellosis vaccine landscape at baseline. Evaluators found that the vaccine market is weak and no new vaccines to control Brucellosis have been developed in recent years. Evaluators also found that the Milestone 1 prize seemed to incentivize some new entities to initiate Brucellosis vaccine R&D.

pdf USAID BFS Evaluating Pull Mechanisms, Initial Lessons Popular

In Learning Library Tagged in Evaluator 531 downloads

Download (pdf, 758 KB)

USAID_BFS_Evaluating_Pull_Mechanisms_Initial_Lessons.pdf

USAID BFS Evaluating Pull Mechanisms, Initial Lessons

This presentation includes an overview of AgResults pull mechanisms, the evaluation framework for the external evaluation and initial lessons learned. The authors are Tulika Narayan and Denise Mainville of Abt Associates and Denise Mainville Consulting.

pdf Evaluation Baseline Report: Uganda Legume Seed Challenge Project Popular

In Learning Library Tagged in Evaluator, Uganda Legumes 481 downloads

Download (pdf, 1.27 MB)

Baseline Report AgResults Uganda 2018 08.pdf

Evaluation Baseline Report: Uganda Legume Seed Challenge Project

This report presents baseline evaluation results for the Uganda Legume Seed Challenge Project, which was terminated early. It includes findings from a survey of 1,800 smallholders, in-depth interviews with a subset of farmers, and seed quality assessment results using seed from 300 farmers who reported using quality seed.

pdf Evaluator Lessons Learned #2: Pull Mechanisms for Overcoming Market Failures in the Agriculture Sector Popular

In Learning Library Tagged in Evaluator, Kenya Storage 749 downloads

Download (pdf, 3.00 MB)

Evaluator Lessons Learned 2_Pull Mechanisms for Overcoming Market Failures in the Agriculture Sector.pdf

Evaluator Lessons Learned #2: Pull Mechanisms for Overcoming Market Failures in the Agriculture Sector

Pull mechanisms require a solid understanding of the market and the motivations of the private sector. This November 2017 brief, with examples from AgResults’ work in Kenya, provides guidance for development practitioners interested in incorporating pull mechanisms in their own work.

pdf A Framework for Evaluating Innovation Challenges Popular

In Learning Library Tagged in Evaluator 1050 downloads

Download (pdf, 1013 KB)

A Framework for Evaluating Innovation Challenges.pdf

A Framework for Evaluating Innovation Challenges

Governments and philanthropists are increasingly considering prize contests to spark creative solutions to thorny social problems. But only a few contests have been systematically evaluated. This March 2017 evaluation framework — based on AgResults’ work to evaluate Brucellosis vaccine development — can be applied to any innovation challenge.

pdf Evaluation Design: Uganda Legume Seed Challenge Project Popular

In Learning Library Tagged in Evaluator, Uganda Legumes 372 downloads

Download (pdf, 1.18 MB)

Evaluation Design AgResults Uganda 2017 02 07.pdf

Evaluation Design: Uganda Legume Seed Challenge Project

The Uganda Legume Seed Challenge Project’s evaluation design envisions a performance evaluation using a pre-post design to assess project success in creating a smallholder-inclusive market for quality legume seed. It uses a structure-conduct-performance framework to assess market impact and a baseline-endline comparison of smallholder farmer survey data to understand smallholder benefits.

pdf Evaluation Baseline Report: Zambia Biofortified Maize Challenge Project Popular

In Learning Library Tagged in Evaluator, Zambia PVA Maize 401 downloads

Download (pdf, 1.50 MB)

Baseline Report AgResults Zambia 2016 04 04 Redacted.pdf

Evaluation Baseline Report: Zambia Biofortified Maize Challenge Project

The baseline report for the Zambia Biofortified Maize Challenge Project evaluation uses data from 212 interviews of maize market actors (including smallholders, rural non-farming residents, retailers, and millers), as well as 1,013 interviews with urban shoppers. It presents findings about market actors’ and consumers’ awareness, production, purchase, and consumption of pro-Vitamin A maize.

pdf Evaluation Design: Brucellosis Vaccine Challenge Project Popular

In Learning Library Tagged in Brucellosis (Global), Evaluator 458 downloads

Download (pdf, 1.59 MB)

Evaluation Design AgResults Brucellosis 2016 04.pdf

Evaluation Design: Brucellosis Vaccine Challenge Project

The evaluationdesign for the Brucellosis Vaccine Challenge Project lays out the approach to assessing the project's influence in stimulating the development of an improved Brucella melitensis vaccine. Evaluators used a qualitative assessment and counterfactual disease study to examine technology development and used cost-effectiveness simulations as well.