Summary: Experimentation, Innovation, and Economics
(Michael Kremer, Nobel Lecture, 2019)
Kremer’s lecture explores how experimentation and
innovation drive economic progress, especially in global development. He
demonstrates that both technological breakthroughs and social innovations
(like new ways to deliver health or education) often result from systematic,
iterative trials—randomized controlled trials (RCTs)—that allow us to
rigorously test what works. Kremer’s work has shifted development economics
from grand theories to empirical, data-driven interventions, revealing
which policies actually improve lives and why. He emphasizes that collaboration,
open science, and adaptive learning are key to solving persistent
challenges in poverty, health, and education.
π¦ THOUGHT CARD:
EXPERIMENTATION, INNOVATION & DEVELOPMENT
1. Background Context
Traditional economics often relied on theoretical models or
sweeping policies to address development. But progress on global poverty,
health, and education was slow, and many “expert” solutions failed in the real
world. Kremer and colleagues pioneered the use of randomized controlled
trials (RCTs) in development—borrowing rigor from medicine to test which
policies and innovations actually work. This empirical revolution has
reshaped not only economics, but also policy design and philanthropy.
2. Core Concept
- Experimentation
is central to both science and social progress: iterative, data-driven
testing allows us to separate signal from noise, and refine what
works.
- Randomized
controlled trials (RCTs): By randomly assigning different
interventions to groups, we learn about real causal effects—not just
correlations or beliefs.
- Innovation
isn’t just about technology; it’s also about new delivery models,
incentives, and social systems.
- Scaling
up: Small, successful trials can inform large-scale policies—but
context matters, and learning must continue as innovations are adapted.
3. Examples / Variations
- Education:
RCTs tested interventions like deworming (reducing absenteeism), providing
textbooks, or changing incentives for teachers. Sometimes, cheap and
simple solutions outperformed expensive ones.
- Health:
Testing different ways to distribute vaccines, mosquito nets, or
information about HIV prevention revealed what actually led to healthier
communities.
- Agriculture:
Trials on fertilizer use, insurance models, or improved seeds identified
what increased yields and incomes.
- Behavioral
Insights: Testing “nudges” (reminders, default options) for savings,
immunization, or schooling.
- Open
Science Models: Collaborative research and transparent data sharing,
accelerating progress.
Variations:
- RCTs
can be adapted to test policy innovations in rich and poor countries
alike—provided ethical standards are met.
- Adaptive
trials: Iterative designs where interventions are modified as data comes
in.
4. Latest Relevance
- Global
Health (COVID-19): Rapid vaccine development, testing, and delivery
benefited from decades of experimental insight and collaboration.
- Policy
Design: Governments, NGOs, and philanthropists increasingly demand
“evidence-based” interventions—allocating resources based on what RCTs
reveal.
- Learning
Loops: Iterative experimentation is vital in a world of uncertainty,
where no single solution fits all contexts.
- Technology
Adoption: Open science accelerates innovation, but also raises
challenges of equity and access.
- AI
& Data Science: New fields are applying the “RCT mindset” to
algorithms, digital education, and more.
5. Visual or Metaphoric Form
- Telescope
Lens: Each experiment sharpens our view; many trials together bring
complex realities into focus.
- Feedback
Loop: Policy is designed, tested, learned from, and redesigned—a
spiral of adaptive improvement.
- Seedling
Field: Hundreds of ideas are planted, but only those tested and tended
survive to bear fruit.
- Puzzle
Pieces: Experiments reveal how small changes fit together to solve big
problems.
6. Resonance from Great Thinkers / Writings
- Francis
Bacon: Scientific progress comes through careful, systematic
experimentation.
- Karl
Popper: True knowledge advances by subjecting ideas to falsification—let
the data speak.
- Esther
Duflo & Abhijit Banerjee: Kremer’s colleagues, advocates of the
“experimental revolution” in development.
- John
Maynard Keynes: “When the facts change, I change my mind.” Embracing
adaptive learning.
- Amartya
Sen: True development expands capabilities; experimentation helps
identify what really works.
7. Infographic or Timeline Notes
Timeline:
- 1990s:
Early RCTs in education and health (e.g., deworming in Kenya).
- 2000s:
Rapid expansion of experimental development economics.
- 2010s:
Global adoption of evidence-based policy, open science collaborations.
- 2020s:
RCTs applied to COVID-19 response, digital innovation, AI ethics.
Experimentation Loop:
Idea → Small-Scale Test (RCT) → Results → Adapt/Refine → Scale
or Re-Test → Wider Impact
8. Other Tangents from this Idea
- Ethics
of Experimentation: Ensuring participants are protected and benefits
are shared.
- Limitations:
Not all questions can be answered by RCTs; context and qualitative
insights matter.
- Scaling
Challenges: What works in one place may need adaptation elsewhere.
- Collaboration:
The value of cross-disciplinary and cross-sector partnerships.
- Innovation
Diffusion: How tested ideas spread and adapt in new environments.
Reflective Prompt:
Where in your life, work, or society could more rigorous experimentation
replace guesswork or tradition? What’s one idea you’d want to test, learn from,
and scale for broader impact?