The Politics of Evidence and Results in International Development critically examines the context and history of the current demands for results-oriented measurement and for evidence of value for money. The book looks at how organizations and individuals embrace, resist, adapt or comply with these demands. Practitioner case studies illuminate different sets of relationships in the aid chain, examining the impact of the demands for results and evidence on the pursuit of rights-based approaches and enquiring into whether the growing emphasis on upward accountability is trumping mutual learning. The book’s challenging conclusion identifies power-aware strategies for development practitioners, enabling them to generate and use results and evidence for transformational ends.
This book will inspire development professionals and organizations to cultivate their political skills. It will encourage them to play the results and evidence game to support their own, not someone else’s agendas.
|Rosalind Eyben and Irene Guijt|
|2 Uncovering the politics of evidence and results|
|3 Mapping the results landscape: insights from a crowdsourcing survey|
|4 The politics and practice of value for money|
|5 The politics of juggling multiple accountability disorder|
|6 Theory of change as best practice or next trick?|
|Marjan van Es and Irene Guijt|
|7 Aid bureaucracy and support for disabled peoples’ organizations|
|Ola Abu Alghaib|
|8 The results agenda in Swedish development cooperation: cycles of failure or reform Success?|
|9 Valuing children’s knowledge: the politics of listening|
|10 Unwritten reports: lessons from an NGO collective|
|Bernward Causemann and Eberhard Gohl|
|11 Playing the rules of the game and other strategies|
‘This report from the aid trenches is a brilliant exploration of how power and politics can distort or even wreck a potentially sound idea (measuring impact), and provides valuable advice on how to turn the results agenda into a positive force.'
Duncan Green, Senior Strategic Adviser, Oxfam GB
'While few would question the value of evidence-informed policy, not enough questions have been asked about the politics of evidence itself. This radical and thought-provoking book challenges the reader to consider how the evidence and results agenda in international development has the potential to dilute efforts to pursue transformational change in favour of incremental, more easily measured but less impactful improvements. Importantly, the authors remind us that the production of evidence isn’t a technical process but a deeply political one, where some voices, some ways of counting, are valued more than others.’
Heather Marquette, Director of the Developmental Leadership Program (DLP) and the Governance and Social Development Resource Centre (GSDRC), University of Birmingham
‘Approaches to development, and methods to evaluate development results, run the gamut from simple to complex. Across this spectrum of diverse development initiatives and accompanying calls for rigorous evidence of results, there is one constant: politics. Thus has it always been and thus will it inevitably be. The danger is that acknowledging the intrinsically political nature of development evaluation leads to cynicism. This book not only avoids that danger, it offers concrete strategies for generating and using results and evidence that support transformational development. Such development seeks to change power dynamics that sustain inequality, foment injustice, and undermine human rights. Far from avoiding or lamenting politics, this book shows that being sophisticated about political games and playing those games astutely can enhance transformation while meeting accountability demands and learning what works for whom in what ways under what conditions. Political sophistication becomes an asset that makes dealing with power effectively an opportunity not a quagmire. But you have to know how to play the game. This is the instruction manual.’
Michael Quinn Patton, author of Utilization-Focused Evaluation
‘The Politics of Results and Evidence in International Development shows that designing development projects that are easily measurable, rather than development projects that address underlying causes, can be counter-productive. Even so, it states that transformational development and the results agenda can be mutually supportive, if you know what and how to do it. This book provides some pointers.’
Marco Segone, Director, Independent Evaluation Office, UNWomen, and Chair, United Nations Evaluation Group
‘Despite the common sense appeal of the push for improved accountability and focus on results, it is clear that these can and often do lead to reduced transparency and performance. This timely book not only documents how this occurs, in specific and diverse examples, it explains what can and should be done differently.’
Patricia J. Rogers, Professor of Public Sector Evaluation and Director, BetterEvaluation, RMIT University, Melbourne, Australia
Rosalind Eyben Rosalind Eyben is a Emeritus Fellow at the Institute of Development Studies, Sussex, studying power and relations in international aid.
Irene Guijt Irene Guijt is an independent consultant, Visiting Fellow at the Department of Forestry at ANU, Research Associate for the International Institute for Environment and Development in London and Research Associate for Overseas Development Institute.
Chris Roche Chris Roche is Director of the Institute for Human Security and Social Change, La Trobe University, Melbourne, Australia
Cathy Shutt Catherine Shutt is an independent consultant and tutor with the Institute of Development Studies and University of Sussex.
Qualitative research and the evaluation of development impact: incorporating authenticity into the assessment of rigour
Journal of Development Effectiveness, Vol. 9 (2017), Iss. 2 P.263https://doi.org/10.1080/19439342.2017.1306577 [Citations: 9]
Evidence, corruption, and reform: the importance of context-sensitivity
Crime, Law and Social Change, Vol. 68 (2017), Iss. 4 P.477https://doi.org/10.1007/s10611-017-9697-z [Citations: 1]
Development NGOs and Languages
Crack, Angela M.
2020https://doi.org/10.1007/978-3-030-51776-2_3 [Citations: 0]
The politics of pleasure in girl-centred sport for development programming
Third World Thematics: A TWQ Journal, Vol. 2 (2017), Iss. 1 P.87https://doi.org/10.1080/23802014.2017.1365624 [Citations: 3]
Twinning “Practices of Change” With “Theory of Change”
van Waegeningh, Cornelie
van Wessel, Margit
American Journal of Evaluation, Vol. 39 (2018), Iss. 2 P.221https://doi.org/10.1177/1098214017727364 [Citations: 7]
The Geography of Development Studies: Leaving No One Behind
Forum for Development Studies, Vol. 45 (2018), Iss. 1 P.167https://doi.org/10.1080/08039410.2017.1345786 [Citations: 7]
Cultures of evaluation: tales from the end of the line
Journal of Development Effectiveness, Vol. 8 (2016), Iss. 4 P.553https://doi.org/10.1080/19439342.2016.1244701 [Citations: 1]
CHAPTER 10: Conclusion: negotiating knowledge, evidence, learning and power
2016https://doi.org/10.3362/9781780449258.010 [Citations: 1]
What room for politics and change in global climate governance? Addressing gender in co-benefits and safeguards
Environmental Politics, Vol. 27 (2018), Iss. 5 P.917https://doi.org/10.1080/09644016.2018.1479115 [Citations: 12]
Towards an Inclusive Systemic Evaluation for the SDGs: Gender equality, Environments and Marginalized voices (GEMs)
Lewis, Ellen D.
Evaluation, Vol. 24 (2018), Iss. 2 P.220https://doi.org/10.1177/1356389018766093 [Citations: 11]
Does local ownership bring about effectiveness? The case of a transnational advocacy network
van Wessel, Margit
Third World Quarterly, Vol. 38 (2017), Iss. 6 P.1310https://doi.org/10.1080/01436597.2016.1257908 [Citations: 13]
A clash of values: Deep-rooted discord between empowering, participatory, community-driven development and results-focused, evidence-based evaluation
Kelly, Leanne M.
Community Development, Vol. 52 (2021), Iss. 5 P.607https://doi.org/10.1080/15575330.2021.1936101 [Citations: 2]
Managing relationships in qualitative impact evaluation of international development: QuIP choreography as a case study
Bekkum, Wilm van
Evaluation, Vol. 24 (2018), Iss. 2 P.169https://doi.org/10.1177/1356389018763243 [Citations: 4]
Making good on donors’ desire to Do Development Differently
Third World Quarterly, Vol. 39 (2018), Iss. 1 P.68https://doi.org/10.1080/01436597.2017.1369030 [Citations: 15]
Putting the “Strategic” into Strategic Religious Engagement
The Review of Faith & International Affairs, Vol. 19 (2021), Iss. sup1 P.78https://doi.org/10.1080/15570274.2021.1983361 [Citations: 0]
‘It Takes Two to Tango’: South–South Cooperation Measurement Politics in a Multiplex World
Trajber Waisbich, Laura
Global Policy, Vol. 13 (2022), Iss. 3 P.334https://doi.org/10.1111/1758-5899.13086 [Citations: 0]
Evaluation in Small Development Non-Profits
Alternative Routes: So What and Now What?
Kelly, Leanne M.
2021https://doi.org/10.1007/978-3-030-58979-0_8 [Citations: 0]
Bureaucratic Tools in (Gendered) Organizations: Performance Metrics and Gender Advisors in International Development
Gender & Society, Vol. 34 (2020), Iss. 1 P.56https://doi.org/10.1177/0891243219874058 [Citations: 10]
Evaluation in Small Development Non-Profits
Practitioner Perceptions of Evaluation in Small Non-Profits
Kelly, Leanne M.
2021https://doi.org/10.1007/978-3-030-58979-0_7 [Citations: 0]
An evidence cycle framework for community development initiatives
Browne, Geoffrey R
(2022)https://doi.org/10.1093/cdj/bsac011 [Citations: 1]
Rethinking research partnerships: Evidence and the politics of participation in research partnerships for international development
Journal of International Development, Vol. 31 (2019), Iss. 7 P.523https://doi.org/10.1002/jid.3417 [Citations: 14]
Tracing the Link Between Transformative Education and Social Action Through Stories of Change
den Heyer, Molly
Journal of Transformative Education, Vol. 19 (2021), Iss. 4 P.421https://doi.org/10.1177/15413446211045165 [Citations: 1]
Accountability versus learning in aid evaluation: A practice-oriented exploration of persistent dilemmas
Evaluation, Vol. 28 (2022), Iss. 3 P.356https://doi.org/10.1177/13563890221100848 [Citations: 0]
Audit as confession: The instrumentalisation of ethics for management control
Critique of Anthropology, Vol. 42 (2022), Iss. 1 P.20https://doi.org/10.1177/0308275X221074834 [Citations: 0]
¿Medimos lo que es valioso o valoramos lo que es medible? Comparación interorganizacional del uso de evaluaciones en una reserva de la biósfera
Gestión y Ambiente, Vol. 23 (2020), Iss. 1https://doi.org/10.15446/ga.v23n1.79714 [Citations: 0]
Professionalisms at War? Interpreting in Conflict and Post-Conflict Situations
Journal of War & Culture Studies, Vol. 12 (2019), Iss. 3 P.268https://doi.org/10.1080/17526272.2019.1644415 [Citations: 4]
Ethical and Methodological Issues in Large Qualitative Participatory Studies
American Behavioral Scientist, Vol. 63 (2019), Iss. 5 P.584https://doi.org/10.1177/0002764218775782 [Citations: 3]
More humanitarian accountability, less humanitarian access? Alternative ideas on accountability for protection activities in conflict settings
International Review of the Red Cross, Vol. 100 (2018), Iss. 907-909 P.287https://doi.org/10.1017/S1816383119000031 [Citations: 0]
Monitoring and evaluation for thinking and working politically
Evaluation, Vol. 28 (2022), Iss. 1 P.36https://doi.org/10.1177/13563890211053028 [Citations: 1]
The Palgrave Handbook of Development Cooperation for Achieving the 2030 Agenda
Conceptualising Ideational Convergence of China and OECD Donors: Coalition Magnets in Development Cooperation
2021https://doi.org/10.1007/978-3-030-57938-8_10 [Citations: 0]
Agenda Setting and Evidence in Maternal Health: Connecting Research and Policy in Timor-Leste
Frontiers in Public Health, Vol. 3 (2015), Iss.https://doi.org/10.3389/fpubh.2015.00212 [Citations: 4]
Language, NGOs and inclusion: the donor perspective
Crack, Angela M.
Development in Practice, Vol. 29 (2019), Iss. 2 P.159https://doi.org/10.1080/09614524.2018.1546827 [Citations: 8]
Providing social assistance and humanitarian relief: The case for embracing uncertainty
Development Policy Review, Vol. 40 (2022), Iss. 5https://doi.org/10.1111/dpr.12613 [Citations: 1]
Unmasking power as foundational to research on sexual and reproductive health and rights
Ruano, Ana Lorena
BMJ Global Health, Vol. 6 (2021), Iss. 4 P.e005482https://doi.org/10.1136/bmjgh-2021-005482 [Citations: 3]
The Politics of Development Metrics and Measurement: Impact Evaluations in Fairtrade‐certified Plantation Agriculture
Development and Change, Vol. 50 (2019), Iss. 6 P.1531https://doi.org/10.1111/dech.12452 [Citations: 2]
Researcher effects in survey‐based research: Insights from research in South Sudan
(2022)https://doi.org/10.1111/dpr.12629 [Citations: 0]
The rise of managerialism in international NGOs
Review of International Political Economy, Vol. 27 (2020), Iss. 4 P.970https://doi.org/10.1080/09692290.2019.1657478 [Citations: 11]
Framing the results agenda in Swedish development co-operation
Development Policy Review, Vol. 35 (2017), Iss. P.O338https://doi.org/10.1111/dpr.12298 [Citations: 0]
Fifty years of capacity building: Taking stock and moving research forward 1
Kacou, Kablan P.
Ika, Lavagnon A.
Munro, Lauchlan T.
(2022)https://doi.org/10.1002/pad.1993 [Citations: 0]
Negotiating effectiveness in transnational advocacy evaluation
van Wessel, Margit
Evaluation, Vol. 24 (2018), Iss. 1 P.51https://doi.org/10.1177/1356389017733210 [Citations: 7]
Ownership and Results in Swedish General Budget Support to Mozambique
Forum for Development Studies, Vol. 44 (2017), Iss. 3 P.377https://doi.org/10.1080/08039410.2017.1388279 [Citations: 3]
Do results-based management frameworks frustrate or facilitate effective development practice? Irish international development sector experiences
Murphy, Susan P.
De Marco, Angelina
Development in Practice, Vol. 29 (2019), Iss. 6 P.697https://doi.org/10.1080/09614524.2019.1604631 [Citations: 3]
Reshaping Monitoring, Evaluation and Learning for Locally Led Adaptation
(2021)https://doi.org/10.46830/wriwp.20.00060 [Citations: 2]
Partnerships between philanthrocapitalists and donors: the case of Girl Hub
Shutt, Catherine Ann
Development in Practice, Vol. 31 (2021), Iss. 7 P.909https://doi.org/10.1080/09614524.2021.1938516 [Citations: 0]
Worthwhile or wasteful? Assessing the need for a radical revision of evaluation in small-sized development NGOs
Kelly, Leanne M.
Development in Practice, Vol. 32 (2022), Iss. 2 P.201https://doi.org/10.1080/09614524.2021.1937540 [Citations: 0]
Local capacity building after crisis
Disaster Prevention and Management: An International Journal, Vol. 29 (2019), Iss. 2 P.214https://doi.org/10.1108/DPM-12-2018-0378 [Citations: 1]
International aid and development: hearing multilingualism, learning from intercultural encounters in the history of OxfamGB
Language and Intercultural Communication, Vol. 17 (2017), Iss. 4 P.518https://doi.org/10.1080/14708477.2017.1368207 [Citations: 17]
Can We Know Better?
CHAPTER 3: Lenses and lock-ins
2017https://doi.org/10.3362/9781780449449.003 [Citations: 0]
Innovation@DFID: Crowdsourcing New Ideas at the UK's Department for International Development
(2017)https://doi.org/10.2139/ssrn.2999652 [Citations: 0]
Lessons in a bottle: The outsized impacts of soda in development practice
Journal of International Development, Vol. 34 (2022), Iss. 6 P.1071https://doi.org/10.1002/jid.3617 [Citations: 0]
CHAPTER 1: Introduction: why do NGOs need to negotiate knowledge?
2016https://doi.org/10.3362/9781780449258.001 [Citations: 4]
Participation for Transformative Learning in Development Management: The Case of a Master in International Development Projects in the Universitat Politècnica de València (Spain)
Blanes, Jordi Peris
Fernández, Iván Cuesta
Procedia - Social and Behavioral Sciences, Vol. 228 (2016), Iss. P.237https://doi.org/10.1016/j.sbspro.2016.07.035 [Citations: 0]
Attributing Development Impact
CHAPTER 2 Comparing the QuIP with other approaches to development impact evaluation
2019https://doi.org/10.3362/9781780447469.002 [Citations: 1]