Two concurrent trends have emerged in development in recent years which are incompatible in their current form. Firstly, new public management, comprising evidence-based policy and the results agenda, has come become ubiquitous among policymakers in recent years. Secondly, there has been a realization of the utility of systemic approaches to development programming in order to bring about sustainable change for larger numbers of people. This paper highlights the negative impacts of this former trend on development and, more acutely, its incompatibility with the latter trend. The paper then highlights emerging, positive signs of a change in thinking in development, to lead to a more pragmatic and contextually nuanced approach to measuring progress. It identifies the need for further research in this area, and calls for an evaluation of approaches rather than a search for a silver bullet. The paper draws on a review of the evidence together with a number of key informant interviews with practitioners.

Abdulla, S., Kikumbih, N., Massanja, H., Mshinda, H., Nathtan, R., Savigny, D., Armstrong-Schellenberg, J. and Victoria, C. (2001) Mosquito Nets, Poverty and Equity in Rural Southern Tanzania, Tanzania: Ifakara Health Research and Development Centre.

Altenburg, T. (2005) ‘The private sector and development agencies: how to form successful alliances. Critical issues and lessons learned from leading donor programs’, 10th International Business Forum, New York: 2005.

Banerjee, A.V., Duflo, E., Glennerster, R. and Kothari, D. (2010) ‘Improving immunisation coverage in rural India: clustered randomised controlled evaluation of immunisation campaigns with and without incentives’, BMJ: British Medical Journal 340, C2220 <http://dx.doi.org/10.1136/bmj.c2220≯.

Barzelay, M. (2001) The New Public Management: Improving Research and Policy Dialogue, Oakland, CA: University of California Press.

Bates, M.A., Glennerster, R., Gumede, K. and Duflo, E. (2012) ‘The price is wrong’, Field Actions Science Reports: The Journal of Field Actions, Special Issue 4.

Bernard, C. (1957) An Introduction to the Study of Experimental Medicine, Mineola, NY: Courier Dover Publications.

Black, N. (2001) ‘Evidence based policy: proceed with care’, BMJ: British Medical Journal 323: 275 <http://dx.doi.org/10.1136/bmj.323.7307.275≯.

Blackman, T. (2001) ‘Complexity theory and the new public management’, Social issues 1(2) <http://www.whb.co.uk/socialissues/tb.htm≯ [Accessed December 2014]. http://www.whb.co.uk/socialissues/tb.htm

Bloom, G., Kanjilal, B., Lucas, H. and Peters, D. (2012) Transforming Health Markets in Asia and Africa, Abingdon, UK: Routledge.

Bovaird, T. and Davies, R. (2011) ‘Outcome-based service commissioning and delivery: does it make a difference?’ Research in Public Policy Analysis and Management 21: 93-114 <http://www.eur.nl/fileadmin/ASSETS/fsw/Bestuurskunde/ipmn/Tony_Bovaird_-_Outcomebased_strategic_commissioning_Does_it_make_a_difference.pdf≯. http://www.eur.nl/fileadmin/ASSETS/fsw/Bestuurskunde/ipmn/Tony_Bovaird_-_Outcomebased_strategic_commissioning_Does_it_make_a_difference.pdf

Chambers, R. (1997) Whose Reality Counts?: Putting the First Last, Rugby: Intermediate Technology Publications Ltd (ITP).

Clark, G. (2008) A Farewell to Alms: A Brief Economic History of the World, Princeton, NJ: Princeton University Press.

Cohen, J. and Dupas, P. (2010) ‘Free distribution or cost-sharing? Evidence from a randomized malaria prevention experiment’, Quarterly Journal of Economics 125: 1 <http://dx.doi.org/10.3386/w14406≯.

Creevey, L., Downing, J., Dunn, E., Northrip, Z., Snodgrass, D. and Cogan Wares, A. (2010) ‘Time to learn: an evaluation strategy for revitalised foreign assistance’, in USAID (ed.), Private Sector Development Impact Assessment Initiative, Washington, DC: USAID.

Dang, H.-A., Knack, S. and Rogers, H. (2009) International Aid and Financial Crises in Donor Countries, Washington, DC: World Bank.

DFID (2009) Building the Evidence to Reduce Poverty: The UK's Policy on Evaluation for International Development, London: DFID.

DFID (2011) How to Note: Reviewing and Scoring Projects, London: DFID.

DFID (2012) ‘Support to the Construction and Real Estate Sector Growth and Employment in States (GEMS) Programme: GEMS 2 Annual Review’ [pdf], London: DFID <https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213898/2012-GEMS2-AR-report.pdf≯ [accessed 24 October 2014]. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213898/2012-GEMS2-AR-report.pdf

Domberger, S. and Rimmer, S. (1994) ‘Competitive tendering and contracting in the public sector: a survey’, International Journal of the Economics of Business 1: 439-53.

Dovers, S. and Handmer, J. (2012) The Handbook of Disaster and Emergency Policies and Institutions, Abingdon, UK: Routledge.

Droop, J., Isenman, P. and Mlalazi, B. (2008) Paris Declaration on Aid Effectiveness: Study of Existing Mechanisms to Promote Mutual Accountability (MA) between Donors and Partner Countries at the International Level: A Study Report, Oxford: Oxford Policy Management.

Dupas, P. (2009) ‘What matters (and what does not) in households’ decision to invest in malaria prevention?’ The American Economic Review 99(2): 224-30 <http://dx.doi.org/10.1257/aer.99.2.224≯.

Dupas, P. (2010) Short-run Subsidies and Long-run Adoption of New Health Products: Evidence from a Field Experiment, Cambridge, MA: National Bureau of Economic Research.

Easterly, W. (2002) ‘The cartel of good intentions: the problem of bureaucracy in foreign aid’, The Journal of Policy Reform 5: 223-50 <http://dx.doi.org/10.1080/1384128032000096823≯.

Easterly, W. (2006) The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good, New York: Penguin.

Easterly, W. and Pfutze, T. (2008) ‘Where does the money go? Best and worst practices in foreign aid’, Journal of Economic Perspectives 22(2): 29-52 <http://dx.doi.org/10.1257/jep.22.2.29≯.

Elliot, D., Gibson, A. and Hitchins, R. (2008) ‘Making markets work for the poor: rationale and practice’, Enterprise Development and Microfinance 19: 101-19 <http://dx.doi.org/10.3362/1755-1986.2008.011≯.

Elton, L. (2004) ‘Goodhart's Law and performance indicators in higher education’, Evaluation & Research in Education 18: 120-8 <http://dx.doi.org/10.1080/09500790408668312≯.

Emmi, A., Ozlem, E., Maja, K. and Ilan, R. (2011) Value for Money: Current Approaches and Evolving Debates, London: London School of Economics.

Espeland, W.N. (1997) ‘Authority by the numbers: Porter on quantification, discretion, and the legitimation of expertise’, Law & Social Inquiry 22: 1107-33.

Eyben, R. (2012) Relationships for Aid, London: Routledge.

Feinstein, O.N. and Picciotto, R. (2000) Evaluation and Poverty Reduction: Selected Proceedings from a World Bank Seminar, Washington, DC: World Bank Publications.

Ferlie, E. (1996) The New Public Management in Action, New York: Oxford University Press.

Gasper, D. (1997) Logical Frameworks’: A Critical Assessment: Managerial Theory, Pluralistic Practice, ISS Working Paper Series/General Series vol. 264: 1-46.

Gray, A. and Jenkins, B. (1995) ‘From public administration to public management: reassessing a revolution?’ Public Administration 73: 75-99.

Hall, A., Rasheed Sulaiman, V., Clark, N. and Yoganand, B. (2003) ‘From measuring impact to learning institutional lessons: an innovation systems perspective on improving the management of international agricultural research’, Agricultural Systems 78: 213-41.

Haque, M.S. (2007) ‘Revisiting the new public management’, Public Administration Review 67: 179-82.

Harland, C., Knight, L., Lamming, R. and Walker, H. (2005) ‘Outsourcing: assessing the risks and benefits for organisations, sectors and nations’, International Journal of Operations & Production Management 25: 831-50 <http://dx.doi.org/10.1108/01443570510613929≯.

Harrison, T. (2000) ‘Urban policy: addressing wicked problems’, in S. Nutley, H. Davies and P. Smith (eds), What works? Evidence Based Policy and Practice in Public Services, pp. 207-228, London: Policy Press.

Heierli, U. and Lengeler, C. (2008) Should Bednets be Sold, or Given Free? Berne, Switzerland: Swiss Agency for Development and Cooperation.

Hoffmann, V., Barrett, C.B. and Just, D.R. (2009) ‘Do free goods stick to poor households? Experimental evidence on insecticide treated bednets’, World Development 37: 607-17 <http://dx.doi.org/10.1016/j.worlddev.2008.08.003≯.

Hood, C. (1991) ‘A public management for all seasons?’ Public Administration 69: 3-19.

Hood, C. and Peters, G. (2004) ‘The middle aging of new public management: into the age of paradox?’ Journal of Public Administration Research and Theory 14: 267-82 <http://dx.doi.org/10.1093/jopart/muh019≯.

Hopwood, A.G. and Miller, P. (1994) Accounting as Social and Institutional Practice, Cambridge: Cambridge University Press.

Hummelbrunner, R. (2010) ‘Beyond logframe: critique, variations and alternatives’, in N. Fujita (ed.), Beyond Logframe; Using Systems Concepts in Evaluation, pp. 1-34, Tokyo: FASID. ICAI (2012) DfID Report and Annual Accounts 2013-14 [pdf], <https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/331591/annual-report-accounts-2013-14a.pdf≯ [accessed 24 October 2014]. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/331591/annual-report-accounts-2013-14a.pdf

Johnsen, Å. (2005) ‘What does 25 years of experience tell us about the state of performance measurement in public policy and management?’ Public Money and Management 25: 9-17.

Kabeer, N. (2003) Gender Mainstreaming in Poverty Eradication and the Millennium Development Goals: A Handbook for Policy Makers and Other Stakeholders, London: Commonwealth Secretariat; Ottawa: International Development Research Centre.

Kabeer, N., Piza, C. and Taylor, L. (2012) ‘What are the economic impacts of conditional cash transfer programmes? A systematic review of evidence’, London: EPPI Centre, Social Science Research Unit, Institute Of Education & University Of London.

Karlan, D., Goldberg, N. and Copestake, J. (2009) ‘Randomized control trials are the best way to measure impact of microfinance programmes and improve microfinance product designs’, Enterprise Development and Microfinance 20: 167-76 <http://dx.doi.org/10.3362/1755-1986.2009.017≯.

Klein, R.J., Eriksen, S.E., Næss, L.O., Hammill, A., Tanner, T.M., Robledo, C. and O’Brien, K.L. (2007) ‘Portfolio screening to support the mainstreaming of adaptation to climate change into development assistance’, Climatic Change 84: 23-44 <http://dx.doi.org/10.1007/s10584-007-9270-3≯.

Kusek, J.Z. and Rist, R.C. (2004) Ten Steps to a Results-based Monitoring and Evaluation System: A Handbook for Development Practitioners, Washington, DC: World Bank Publications.

Lapsley, I. (2009) ‘New public management: the cruellest invention of the human spirit?’ Abacus 45(1): 1-21.

Ledgerwood, J., Earne, J. and Nelson, C. (2013) The New Microfinance Handbook: A Financial Market System Perspective, Washington, DC: World Bank Publications.

Lengeler, C., Grabowsky, M. and McGuire, D. (2007) ‘Quick wins versus sustainability: options for the upscaling of insecticide-treated nets’, The American Journal of Tropical Medicine and Hygiene 77: 222-6.

Madaus, G.F., Ryan, J.P., Kellaghan, T. and Airasian, P.W. (1987) ‘Payment by results: an analysis of a nineteenth century performance-contracting programme’, The Irish Journal of Education/Iris Eireannach an Oideachais 2: 80-91.

Mehrotra, S. (2004) ‘International development targets and official development assistance’, in Pronk, J.P., Catalysing Development: A Debate on Aid, London: Wiley-Blackwell.

Minogue, M., Polidano, C. and Hulme, D. (1998) Beyond the New Public Management: Changing Ideas and Practices in Governance, Cheltenham: Edward Elgar.

Moser, C. (2005) ‘Has gender mainstreaming failed? A comment on international development agency experiences in the South’, International Feminist Journal of Politics 7: 576-90 <http://dx.doi.org/10.1080/14616740500284573≯.

Nutley, S.M., Davies, H.T. and Smith, P.C. (2000) What Works? Evidence-based Policy and Practice in Public Services, London: Policy Press.

OECD (2012) ‘Development aid flows’ [online] <www.oecd.org/statistics/datalab/aid-flows.htm≯ [accessed 1 July 2013]. www.oecd.org/statistics/datalab/aid-flows.htm

OECD (2013) Query Wizard for International Development Statistics, Paris: Organisation for Economic Cooperation and Development.

Patton, M.Q. (2010) Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use, New York: Guilford Press.

Pawson, R. (2004) ‘Evidence based policy’, in B. Carter and C. New (eds.), Making Realism Work: Realist Social Theory and Empirical Research, pp. 26-49 London: Routledge.

Power, M. (1997) The Audit Society: Rituals of Verification, Oxford: Oxford University Press.

Pronk, J.P. (2001) ‘Aid as a catalyst’, Development and Change 32: 611-29 <http://dx.doi.org/10.1111/1467-7660.00219≯.

Rapple, B. (1994) ‘Payment by results: an example of assessment in elementary education from nineteenth century Britain’, Education Policy Analysis Archives 2(1) 1-21 <http://dx.doi.org/10.14507/epaa.v2n1≯.

Rogerson, A. (2005) ‘Aid harmonisation and alignment: bridging the gaps between reality and the Paris reform agenda’, Development Policy Review 23: 531-52 <http://dx.doi.org/10.1111/j.1467-7679.2005.00301.x≯.

Rogerson, A. (2011) ‘What if development aid were truly “catalytic”?’ ODI Background Note November 2011, London: Overseas Development Institute.

Sackett, D.L., Rosenberg, W.M., Gray, J., Haynes, R.B. and Richardson, W.S. (1996) ‘Evidence based medicine: what it is and what it isn't’, BMJ: British Medical Journal 312: 71.

Solesbury, W. (2001) Evidence Based Policy: Whence it Came and Where it's Going, London: ESRC UK Centre for Evidence Based Policy and Practice.

Stern, E., Stame, N., Mayne, J., Forss, K., Davies, R. and Befani, B. (2012) Broadening the Range of Designs and Methods for Impact Evaluations: Report of a Study Commissioned by the Department for International Development [pdf] DFID working paper <www.dfid.gov.uk/r4d/pdf/outputs/misc_infocomm/DFIDWorkingPaper38.pdf≯ [accessed 22 October 2014]. www.dfid.gov.uk/r4d/pdf/outputs/misc_infocomm/DFIDWorkingPaper38.pdf

Stubbs, P. (2003) ‘International non-state actors and social development policy’, Global Social Policy 3: 319-48 <http://dx.doi.org/10.1177/14680181030033003≯.

Te Velde, D.W., Ahmed, M.M., Alemu, G., Bategeka, L., Calí, M., Castel-Branco, C., Chansa, F., Dasgupta, S., Foresti, M. and Hangi, M. (2008) The Global Financial Crisis and Developing Countries, ODI Background Note, London: Overseas Development Institute.

Thomas, S. (2008) ‘Results measurement and programme-based approaches’ in ‘Methods and Instruments for the Evaluation and Monitoring of VET Services: Conference Proceedings’, Königswinter, 10-11 December 2009, 55-61.

Vielajus, M., Hudson, A., Jonsson, L. and Neu, D. (2009) ‘The Challenge of Accountability for Development Agencies within their Own Countries and before their Peers’ in Transparent, Reliable, Understandable and Interactive: Challenges in Donors’ Domestic Accountability: Conference Proceedings’, AFD-DEVCOM Workshop, 15-16 December 2009, Paris.

Abdulla, S., Kikumbih, N., Massanja, H., Mshinda, H., Nathtan, R., Savigny, D., Armstrong-Schellenberg, J. and Victoria, C. (2001) Mosquito Nets, Poverty and Equity in Rural Southern Tanzania, Tanzania: Ifakara Health Research and Development Centre.

Altenburg, T. (2005) ‘The private sector and development agencies: how to form successful alliances. Critical issues and lessons learned from leading donor programs’, 10th International Business Forum, New York: 2005.

Banerjee, A.V., Duflo, E., Glennerster, R. and Kothari, D. (2010) ‘Improving immunisation coverage in rural India: clustered randomised controlled evaluation of immunisation campaigns with and without incentives’, BMJ: British Medical Journal 340, C2220 <http://dx.doi.org/10.1136/bmj.c2220≯.

Barzelay, M. (2001) The New Public Management: Improving Research and Policy Dialogue, Oakland, CA: University of California Press.

Bates, M.A., Glennerster, R., Gumede, K. and Duflo, E. (2012) ‘The price is wrong’, Field Actions Science Reports: The Journal of Field Actions, Special Issue 4.

Bernard, C. (1957) An Introduction to the Study of Experimental Medicine, Mineola, NY: Courier Dover Publications.

Black, N. (2001) ‘Evidence based policy: proceed with care’, BMJ: British Medical Journal 323: 275 <http://dx.doi.org/10.1136/bmj.323.7307.275≯.

Blackman, T. (2001) ‘Complexity theory and the new public management’, Social issues 1(2) <http://www.whb.co.uk/socialissues/tb.htm≯ [Accessed December 2014]. http://www.whb.co.uk/socialissues/tb.htm

Bloom, G., Kanjilal, B., Lucas, H. and Peters, D. (2012) Transforming Health Markets in Asia and Africa, Abingdon, UK: Routledge.

Bovaird, T. and Davies, R. (2011) ‘Outcome-based service commissioning and delivery: does it make a difference?’ Research in Public Policy Analysis and Management 21: 93-114 <http://www.eur.nl/fileadmin/ASSETS/fsw/Bestuurskunde/ipmn/Tony_Bovaird_-_Outcomebased_strategic_commissioning_Does_it_make_a_difference.pdf≯. http://www.eur.nl/fileadmin/ASSETS/fsw/Bestuurskunde/ipmn/Tony_Bovaird_-_Outcomebased_strategic_commissioning_Does_it_make_a_difference.pdf

Chambers, R. (1997) Whose Reality Counts?: Putting the First Last, Rugby: Intermediate Technology Publications Ltd (ITP).

Clark, G. (2008) A Farewell to Alms: A Brief Economic History of the World, Princeton, NJ: Princeton University Press.

Cohen, J. and Dupas, P. (2010) ‘Free distribution or cost-sharing? Evidence from a randomized malaria prevention experiment’, Quarterly Journal of Economics 125: 1 <http://dx.doi.org/10.3386/w14406≯.

Creevey, L., Downing, J., Dunn, E., Northrip, Z., Snodgrass, D. and Cogan Wares, A. (2010) ‘Time to learn: an evaluation strategy for revitalised foreign assistance’, in USAID (ed.), Private Sector Development Impact Assessment Initiative, Washington, DC: USAID.

Dang, H.-A., Knack, S. and Rogers, H. (2009) International Aid and Financial Crises in Donor Countries, Washington, DC: World Bank.

DFID (2009) Building the Evidence to Reduce Poverty: The UK's Policy on Evaluation for International Development, London: DFID.

DFID (2011) How to Note: Reviewing and Scoring Projects, London: DFID.

DFID (2012) ‘Support to the Construction and Real Estate Sector Growth and Employment in States (GEMS) Programme: GEMS 2 Annual Review’ [pdf], London: DFID <https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213898/2012-GEMS2-AR-report.pdf≯ [accessed 24 October 2014]. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213898/2012-GEMS2-AR-report.pdf

Domberger, S. and Rimmer, S. (1994) ‘Competitive tendering and contracting in the public sector: a survey’, International Journal of the Economics of Business 1: 439-53.

Dovers, S. and Handmer, J. (2012) The Handbook of Disaster and Emergency Policies and Institutions, Abingdon, UK: Routledge.

Droop, J., Isenman, P. and Mlalazi, B. (2008) Paris Declaration on Aid Effectiveness: Study of Existing Mechanisms to Promote Mutual Accountability (MA) between Donors and Partner Countries at the International Level: A Study Report, Oxford: Oxford Policy Management.

Dupas, P. (2009) ‘What matters (and what does not) in households’ decision to invest in malaria prevention?’ The American Economic Review 99(2): 224-30 <http://dx.doi.org/10.1257/aer.99.2.224≯.

Dupas, P. (2010) Short-run Subsidies and Long-run Adoption of New Health Products: Evidence from a Field Experiment, Cambridge, MA: National Bureau of Economic Research.

Easterly, W. (2002) ‘The cartel of good intentions: the problem of bureaucracy in foreign aid’, The Journal of Policy Reform 5: 223-50 <http://dx.doi.org/10.1080/1384128032000096823≯.

Easterly, W. (2006) The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good, New York: Penguin.

Easterly, W. and Pfutze, T. (2008) ‘Where does the money go? Best and worst practices in foreign aid’, Journal of Economic Perspectives 22(2): 29-52 <http://dx.doi.org/10.1257/jep.22.2.29≯.

Elliot, D., Gibson, A. and Hitchins, R. (2008) ‘Making markets work for the poor: rationale and practice’, Enterprise Development and Microfinance 19: 101-19 <http://dx.doi.org/10.3362/1755-1986.2008.011≯.

Elton, L. (2004) ‘Goodhart's Law and performance indicators in higher education’, Evaluation & Research in Education 18: 120-8 <http://dx.doi.org/10.1080/09500790408668312≯.

Emmi, A., Ozlem, E., Maja, K. and Ilan, R. (2011) Value for Money: Current Approaches and Evolving Debates, London: London School of Economics.

Espeland, W.N. (1997) ‘Authority by the numbers: Porter on quantification, discretion, and the legitimation of expertise’, Law & Social Inquiry 22: 1107-33.

Eyben, R. (2012) Relationships for Aid, London: Routledge.

Feinstein, O.N. and Picciotto, R. (2000) Evaluation and Poverty Reduction: Selected Proceedings from a World Bank Seminar, Washington, DC: World Bank Publications.

Ferlie, E. (1996) The New Public Management in Action, New York: Oxford University Press.

Gasper, D. (1997) Logical Frameworks’: A Critical Assessment: Managerial Theory, Pluralistic Practice, ISS Working Paper Series/General Series vol. 264: 1-46.

Gray, A. and Jenkins, B. (1995) ‘From public administration to public management: reassessing a revolution?’ Public Administration 73: 75-99.

Hall, A., Rasheed Sulaiman, V., Clark, N. and Yoganand, B. (2003) ‘From measuring impact to learning institutional lessons: an innovation systems perspective on improving the management of international agricultural research’, Agricultural Systems 78: 213-41.

Haque, M.S. (2007) ‘Revisiting the new public management’, Public Administration Review 67: 179-82.

Harland, C., Knight, L., Lamming, R. and Walker, H. (2005) ‘Outsourcing: assessing the risks and benefits for organisations, sectors and nations’, International Journal of Operations & Production Management 25: 831-50 <http://dx.doi.org/10.1108/01443570510613929≯.

Harrison, T. (2000) ‘Urban policy: addressing wicked problems’, in S. Nutley, H. Davies and P. Smith (eds), What works? Evidence Based Policy and Practice in Public Services, pp. 207-228, London: Policy Press.

Heierli, U. and Lengeler, C. (2008) Should Bednets be Sold, or Given Free? Berne, Switzerland: Swiss Agency for Development and Cooperation.

Hoffmann, V., Barrett, C.B. and Just, D.R. (2009) ‘Do free goods stick to poor households? Experimental evidence on insecticide treated bednets’, World Development 37: 607-17 <http://dx.doi.org/10.1016/j.worlddev.2008.08.003≯.

Hood, C. (1991) ‘A public management for all seasons?’ Public Administration 69: 3-19.

Hood, C. and Peters, G. (2004) ‘The middle aging of new public management: into the age of paradox?’ Journal of Public Administration Research and Theory 14: 267-82 <http://dx.doi.org/10.1093/jopart/muh019≯.

Hopwood, A.G. and Miller, P. (1994) Accounting as Social and Institutional Practice, Cambridge: Cambridge University Press.

Hummelbrunner, R. (2010) ‘Beyond logframe: critique, variations and alternatives’, in N. Fujita (ed.), Beyond Logframe; Using Systems Concepts in Evaluation, pp. 1-34, Tokyo: FASID. ICAI (2012) DfID Report and Annual Accounts 2013-14 [pdf], <https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/331591/annual-report-accounts-2013-14a.pdf≯ [accessed 24 October 2014]. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/331591/annual-report-accounts-2013-14a.pdf

Johnsen, Å. (2005) ‘What does 25 years of experience tell us about the state of performance measurement in public policy and management?’ Public Money and Management 25: 9-17.

Kabeer, N. (2003) Gender Mainstreaming in Poverty Eradication and the Millennium Development Goals: A Handbook for Policy Makers and Other Stakeholders, London: Commonwealth Secretariat; Ottawa: International Development Research Centre.

Kabeer, N., Piza, C. and Taylor, L. (2012) ‘What are the economic impacts of conditional cash transfer programmes? A systematic review of evidence’, London: EPPI Centre, Social Science Research Unit, Institute Of Education & University Of London.

Karlan, D., Goldberg, N. and Copestake, J. (2009) ‘Randomized control trials are the best way to measure impact of microfinance programmes and improve microfinance product designs’, Enterprise Development and Microfinance 20: 167-76 <http://dx.doi.org/10.3362/1755-1986.2009.017≯.

Klein, R.J., Eriksen, S.E., Næss, L.O., Hammill, A., Tanner, T.M., Robledo, C. and O’Brien, K.L. (2007) ‘Portfolio screening to support the mainstreaming of adaptation to climate change into development assistance’, Climatic Change 84: 23-44 <http://dx.doi.org/10.1007/s10584-007-9270-3≯.

Kusek, J.Z. and Rist, R.C. (2004) Ten Steps to a Results-based Monitoring and Evaluation System: A Handbook for Development Practitioners, Washington, DC: World Bank Publications.

Lapsley, I. (2009) ‘New public management: the cruellest invention of the human spirit?’ Abacus 45(1): 1-21.

Ledgerwood, J., Earne, J. and Nelson, C. (2013) The New Microfinance Handbook: A Financial Market System Perspective, Washington, DC: World Bank Publications.

Lengeler, C., Grabowsky, M. and McGuire, D. (2007) ‘Quick wins versus sustainability: options for the upscaling of insecticide-treated nets’, The American Journal of Tropical Medicine and Hygiene 77: 222-6.

Madaus, G.F., Ryan, J.P., Kellaghan, T. and Airasian, P.W. (1987) ‘Payment by results: an analysis of a nineteenth century performance-contracting programme’, The Irish Journal of Education/Iris Eireannach an Oideachais 2: 80-91.

Mehrotra, S. (2004) ‘International development targets and official development assistance’, in Pronk, J.P., Catalysing Development: A Debate on Aid, London: Wiley-Blackwell.

Minogue, M., Polidano, C. and Hulme, D. (1998) Beyond the New Public Management: Changing Ideas and Practices in Governance, Cheltenham: Edward Elgar.

Moser, C. (2005) ‘Has gender mainstreaming failed? A comment on international development agency experiences in the South’, International Feminist Journal of Politics 7: 576-90 <http://dx.doi.org/10.1080/14616740500284573≯.

Nutley, S.M., Davies, H.T. and Smith, P.C. (2000) What Works? Evidence-based Policy and Practice in Public Services, London: Policy Press.

OECD (2012) ‘Development aid flows’ [online] <www.oecd.org/statistics/datalab/aid-flows.htm≯ [accessed 1 July 2013]. www.oecd.org/statistics/datalab/aid-flows.htm

OECD (2013) Query Wizard for International Development Statistics, Paris: Organisation for Economic Cooperation and Development.

Patton, M.Q. (2010) Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use, New York: Guilford Press.

Pawson, R. (2004) ‘Evidence based policy’, in B. Carter and C. New (eds.), Making Realism Work: Realist Social Theory and Empirical Research, pp. 26-49 London: Routledge.

Power, M. (1997) The Audit Society: Rituals of Verification, Oxford: Oxford University Press.

Pronk, J.P. (2001) ‘Aid as a catalyst’, Development and Change 32: 611-29 <http://dx.doi.org/10.1111/1467-7660.00219≯.

Rapple, B. (1994) ‘Payment by results: an example of assessment in elementary education from nineteenth century Britain’, Education Policy Analysis Archives 2(1) 1-21 <http://dx.doi.org/10.14507/epaa.v2n1≯.

Rogerson, A. (2005) ‘Aid harmonisation and alignment: bridging the gaps between reality and the Paris reform agenda’, Development Policy Review 23: 531-52 <http://dx.doi.org/10.1111/j.1467-7679.2005.00301.x≯.

Rogerson, A. (2011) ‘What if development aid were truly “catalytic”?’ ODI Background Note November 2011, London: Overseas Development Institute.

Sackett, D.L., Rosenberg, W.M., Gray, J., Haynes, R.B. and Richardson, W.S. (1996) ‘Evidence based medicine: what it is and what it isn't’, BMJ: British Medical Journal 312: 71.

Solesbury, W. (2001) Evidence Based Policy: Whence it Came and Where it's Going, London: ESRC UK Centre for Evidence Based Policy and Practice.

Stern, E., Stame, N., Mayne, J., Forss, K., Davies, R. and Befani, B. (2012) Broadening the Range of Designs and Methods for Impact Evaluations: Report of a Study Commissioned by the Department for International Development [pdf] DFID working paper <www.dfid.gov.uk/r4d/pdf/outputs/misc_infocomm/DFIDWorkingPaper38.pdf≯ [accessed 22 October 2014]. www.dfid.gov.uk/r4d/pdf/outputs/misc_infocomm/DFIDWorkingPaper38.pdf

Stubbs, P. (2003) ‘International non-state actors and social development policy’, Global Social Policy 3: 319-48 <http://dx.doi.org/10.1177/14680181030033003≯.

Te Velde, D.W., Ahmed, M.M., Alemu, G., Bategeka, L., Calí, M., Castel-Branco, C., Chansa, F., Dasgupta, S., Foresti, M. and Hangi, M. (2008) The Global Financial Crisis and Developing Countries, ODI Background Note, London: Overseas Development Institute.

Thomas, S. (2008) ‘Results measurement and programme-based approaches’ in ‘Methods and Instruments for the Evaluation and Monitoring of VET Services: Conference Proceedings’, Königswinter, 10-11 December 2009, 55-61.

Vielajus, M., Hudson, A., Jonsson, L. and Neu, D. (2009) ‘The Challenge of Accountability for Development Agencies within their Own Countries and before their Peers’ in Transparent, Reliable, Understandable and Interactive: Challenges in Donors’ Domestic Accountability: Conference Proceedings’, AFD-DEVCOM Workshop, 15-16 December 2009, Paris.

Abdulla, S., Kikumbih, N., Massanja, H., Mshinda, H., Nathtan, R., Savigny, D., Armstrong-Schellenberg, J. and Victoria, C. (2001) Mosquito Nets, Poverty and Equity in Rural Southern Tanzania, Tanzania: Ifakara Health Research and Development Centre.

Altenburg, T. (2005) ‘The private sector and development agencies: how to form successful alliances. Critical issues and lessons learned from leading donor programs’, 10th International Business Forum, New York: 2005.

Banerjee, A.V., Duflo, E., Glennerster, R. and Kothari, D. (2010) ‘Improving immunisation coverage in rural India: clustered randomised controlled evaluation of immunisation campaigns with and without incentives’, BMJ: British Medical Journal 340, C2220 <http://dx.doi.org/10.1136/bmj.c2220≯.

Barzelay, M. (2001) The New Public Management: Improving Research and Policy Dialogue, Oakland, CA: University of California Press.

Bates, M.A., Glennerster, R., Gumede, K. and Duflo, E. (2012) ‘The price is wrong’, Field Actions Science Reports: The Journal of Field Actions, Special Issue 4.

Bernard, C. (1957) An Introduction to the Study of Experimental Medicine, Mineola, NY: Courier Dover Publications.

Black, N. (2001) ‘Evidence based policy: proceed with care’, BMJ: British Medical Journal 323: 275 <http://dx.doi.org/10.1136/bmj.323.7307.275≯.

Blackman, T. (2001) ‘Complexity theory and the new public management’, Social issues 1(2) <http://www.whb.co.uk/socialissues/tb.htm≯ [Accessed December 2014]. http://www.whb.co.uk/socialissues/tb.htm

Bloom, G., Kanjilal, B., Lucas, H. and Peters, D. (2012) Transforming Health Markets in Asia and Africa, Abingdon, UK: Routledge.

Bovaird, T. and Davies, R. (2011) ‘Outcome-based service commissioning and delivery: does it make a difference?’ Research in Public Policy Analysis and Management 21: 93-114 <http://www.eur.nl/fileadmin/ASSETS/fsw/Bestuurskunde/ipmn/Tony_Bovaird_-_Outcomebased_strategic_commissioning_Does_it_make_a_difference.pdf≯. http://www.eur.nl/fileadmin/ASSETS/fsw/Bestuurskunde/ipmn/Tony_Bovaird_-_Outcomebased_strategic_commissioning_Does_it_make_a_difference.pdf

Chambers, R. (1997) Whose Reality Counts?: Putting the First Last, Rugby: Intermediate Technology Publications Ltd (ITP).

Clark, G. (2008) A Farewell to Alms: A Brief Economic History of the World, Princeton, NJ: Princeton University Press.

Cohen, J. and Dupas, P. (2010) ‘Free distribution or cost-sharing? Evidence from a randomized malaria prevention experiment’, Quarterly Journal of Economics 125: 1 <http://dx.doi.org/10.3386/w14406≯.

Creevey, L., Downing, J., Dunn, E., Northrip, Z., Snodgrass, D. and Cogan Wares, A. (2010) ‘Time to learn: an evaluation strategy for revitalised foreign assistance’, in USAID (ed.), Private Sector Development Impact Assessment Initiative, Washington, DC: USAID.

Dang, H.-A., Knack, S. and Rogers, H. (2009) International Aid and Financial Crises in Donor Countries, Washington, DC: World Bank.

DFID (2009) Building the Evidence to Reduce Poverty: The UK's Policy on Evaluation for International Development, London: DFID.

DFID (2011) How to Note: Reviewing and Scoring Projects, London: DFID.

DFID (2012) ‘Support to the Construction and Real Estate Sector Growth and Employment in States (GEMS) Programme: GEMS 2 Annual Review’ [pdf], London: DFID <https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213898/2012-GEMS2-AR-report.pdf≯ [accessed 24 October 2014]. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213898/2012-GEMS2-AR-report.pdf

Domberger, S. and Rimmer, S. (1994) ‘Competitive tendering and contracting in the public sector: a survey’, International Journal of the Economics of Business 1: 439-53.

Dovers, S. and Handmer, J. (2012) The Handbook of Disaster and Emergency Policies and Institutions, Abingdon, UK: Routledge.

Droop, J., Isenman, P. and Mlalazi, B. (2008) Paris Declaration on Aid Effectiveness: Study of Existing Mechanisms to Promote Mutual Accountability (MA) between Donors and Partner Countries at the International Level: A Study Report, Oxford: Oxford Policy Management.

Dupas, P. (2009) ‘What matters (and what does not) in households’ decision to invest in malaria prevention?’ The American Economic Review 99(2): 224-30 <http://dx.doi.org/10.1257/aer.99.2.224≯.

Dupas, P. (2010) Short-run Subsidies and Long-run Adoption of New Health Products: Evidence from a Field Experiment, Cambridge, MA: National Bureau of Economic Research.

Easterly, W. (2002) ‘The cartel of good intentions: the problem of bureaucracy in foreign aid’, The Journal of Policy Reform 5: 223-50 <http://dx.doi.org/10.1080/1384128032000096823≯.

Easterly, W. (2006) The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good, New York: Penguin.

Easterly, W. and Pfutze, T. (2008) ‘Where does the money go? Best and worst practices in foreign aid’, Journal of Economic Perspectives 22(2): 29-52 <http://dx.doi.org/10.1257/jep.22.2.29≯.

Elliot, D., Gibson, A. and Hitchins, R. (2008) ‘Making markets work for the poor: rationale and practice’, Enterprise Development and Microfinance 19: 101-19 <http://dx.doi.org/10.3362/1755-1986.2008.011≯.

Elton, L. (2004) ‘Goodhart's Law and performance indicators in higher education’, Evaluation & Research in Education 18: 120-8 <http://dx.doi.org/10.1080/09500790408668312≯.

Emmi, A., Ozlem, E., Maja, K. and Ilan, R. (2011) Value for Money: Current Approaches and Evolving Debates, London: London School of Economics.

Espeland, W.N. (1997) ‘Authority by the numbers: Porter on quantification, discretion, and the legitimation of expertise’, Law & Social Inquiry 22: 1107-33.

Eyben, R. (2012) Relationships for Aid, London: Routledge.

Feinstein, O.N. and Picciotto, R. (2000) Evaluation and Poverty Reduction: Selected Proceedings from a World Bank Seminar, Washington, DC: World Bank Publications.

Ferlie, E. (1996) The New Public Management in Action, New York: Oxford University Press.

Gasper, D. (1997) Logical Frameworks’: A Critical Assessment: Managerial Theory, Pluralistic Practice, ISS Working Paper Series/General Series vol. 264: 1-46.

Gray, A. and Jenkins, B. (1995) ‘From public administration to public management: reassessing a revolution?’ Public Administration 73: 75-99.

Hall, A., Rasheed Sulaiman, V., Clark, N. and Yoganand, B. (2003) ‘From measuring impact to learning institutional lessons: an innovation systems perspective on improving the management of international agricultural research’, Agricultural Systems 78: 213-41.

Haque, M.S. (2007) ‘Revisiting the new public management’, Public Administration Review 67: 179-82.

Harland, C., Knight, L., Lamming, R. and Walker, H. (2005) ‘Outsourcing: assessing the risks and benefits for organisations, sectors and nations’, International Journal of Operations & Production Management 25: 831-50 <http://dx.doi.org/10.1108/01443570510613929≯.

Harrison, T. (2000) ‘Urban policy: addressing wicked problems’, in S. Nutley, H. Davies and P. Smith (eds), What works? Evidence Based Policy and Practice in Public Services, pp. 207-228, London: Policy Press.

Heierli, U. and Lengeler, C. (2008) Should Bednets be Sold, or Given Free? Berne, Switzerland: Swiss Agency for Development and Cooperation.

Hoffmann, V., Barrett, C.B. and Just, D.R. (2009) ‘Do free goods stick to poor households? Experimental evidence on insecticide treated bednets’, World Development 37: 607-17 <http://dx.doi.org/10.1016/j.worlddev.2008.08.003≯.

Hood, C. (1991) ‘A public management for all seasons?’ Public Administration 69: 3-19.

Hood, C. and Peters, G. (2004) ‘The middle aging of new public management: into the age of paradox?’ Journal of Public Administration Research and Theory 14: 267-82 <http://dx.doi.org/10.1093/jopart/muh019≯.

Hopwood, A.G. and Miller, P. (1994) Accounting as Social and Institutional Practice, Cambridge: Cambridge University Press.

Hummelbrunner, R. (2010) ‘Beyond logframe: critique, variations and alternatives’, in N. Fujita (ed.), Beyond Logframe; Using Systems Concepts in Evaluation, pp. 1-34, Tokyo: FASID. ICAI (2012) DfID Report and Annual Accounts 2013-14 [pdf], <https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/331591/annual-report-accounts-2013-14a.pdf≯ [accessed 24 October 2014]. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/331591/annual-report-accounts-2013-14a.pdf

Johnsen, Å. (2005) ‘What does 25 years of experience tell us about the state of performance measurement in public policy and management?’ Public Money and Management 25: 9-17.

Kabeer, N. (2003) Gender Mainstreaming in Poverty Eradication and the Millennium Development Goals: A Handbook for Policy Makers and Other Stakeholders, London: Commonwealth Secretariat; Ottawa: International Development Research Centre.

Kabeer, N., Piza, C. and Taylor, L. (2012) ‘What are the economic impacts of conditional cash transfer programmes? A systematic review of evidence’, London: EPPI Centre, Social Science Research Unit, Institute Of Education & University Of London.

Karlan, D., Goldberg, N. and Copestake, J. (2009) ‘Randomized control trials are the best way to measure impact of microfinance programmes and improve microfinance product designs’, Enterprise Development and Microfinance 20: 167-76 <http://dx.doi.org/10.3362/1755-1986.2009.017≯.

Klein, R.J., Eriksen, S.E., Næss, L.O., Hammill, A., Tanner, T.M., Robledo, C. and O’Brien, K.L. (2007) ‘Portfolio screening to support the mainstreaming of adaptation to climate change into development assistance’, Climatic Change 84: 23-44 <http://dx.doi.org/10.1007/s10584-007-9270-3≯.

Kusek, J.Z. and Rist, R.C. (2004) Ten Steps to a Results-based Monitoring and Evaluation System: A Handbook for Development Practitioners, Washington, DC: World Bank Publications.

Lapsley, I. (2009) ‘New public management: the cruellest invention of the human spirit?’ Abacus 45(1): 1-21.

Ledgerwood, J., Earne, J. and Nelson, C. (2013) The New Microfinance Handbook: A Financial Market System Perspective, Washington, DC: World Bank Publications.

Lengeler, C., Grabowsky, M. and McGuire, D. (2007) ‘Quick wins versus sustainability: options for the upscaling of insecticide-treated nets’, The American Journal of Tropical Medicine and Hygiene 77: 222-6.

Madaus, G.F., Ryan, J.P., Kellaghan, T. and Airasian, P.W. (1987) ‘Payment by results: an analysis of a nineteenth century performance-contracting programme’, The Irish Journal of Education/Iris Eireannach an Oideachais 2: 80-91.

Mehrotra, S. (2004) ‘International development targets and official development assistance’, in Pronk, J.P., Catalysing Development: A Debate on Aid, London: Wiley-Blackwell.

Minogue, M., Polidano, C. and Hulme, D. (1998) Beyond the New Public Management: Changing Ideas and Practices in Governance, Cheltenham: Edward Elgar.

Moser, C. (2005) ‘Has gender mainstreaming failed? A comment on international development agency experiences in the South’, International Feminist Journal of Politics 7: 576-90 <http://dx.doi.org/10.1080/14616740500284573≯.

Nutley, S.M., Davies, H.T. and Smith, P.C. (2000) What Works? Evidence-based Policy and Practice in Public Services, London: Policy Press.

OECD (2012) ‘Development aid flows’ [online] <www.oecd.org/statistics/datalab/aid-flows.htm≯ [accessed 1 July 2013]. www.oecd.org/statistics/datalab/aid-flows.htm

OECD (2013) Query Wizard for International Development Statistics, Paris: Organisation for Economic Cooperation and Development.

Patton, M.Q. (2010) Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use, New York: Guilford Press.

Pawson, R. (2004) ‘Evidence based policy’, in B. Carter and C. New (eds.), Making Realism Work: Realist Social Theory and Empirical Research, pp. 26-49 London: Routledge.

Power, M. (1997) The Audit Society: Rituals of Verification, Oxford: Oxford University Press.

Pronk, J.P. (2001) ‘Aid as a catalyst’, Development and Change 32: 611-29 <http://dx.doi.org/10.1111/1467-7660.00219≯.

Rapple, B. (1994) ‘Payment by results: an example of assessment in elementary education from nineteenth century Britain’, Education Policy Analysis Archives 2(1) 1-21 <http://dx.doi.org/10.14507/epaa.v2n1≯.

Rogerson, A. (2005) ‘Aid harmonisation and alignment: bridging the gaps between reality and the Paris reform agenda’, Development Policy Review 23: 531-52 <http://dx.doi.org/10.1111/j.1467-7679.2005.00301.x≯.

Rogerson, A. (2011) ‘What if development aid were truly “catalytic”?’ ODI Background Note November 2011, London: Overseas Development Institute.

Sackett, D.L., Rosenberg, W.M., Gray, J., Haynes, R.B. and Richardson, W.S. (1996) ‘Evidence based medicine: what it is and what it isn't’, BMJ: British Medical Journal 312: 71.

Solesbury, W. (2001) Evidence Based Policy: Whence it Came and Where it's Going, London: ESRC UK Centre for Evidence Based Policy and Practice.

Stern, E., Stame, N., Mayne, J., Forss, K., Davies, R. and Befani, B. (2012) Broadening the Range of Designs and Methods for Impact Evaluations: Report of a Study Commissioned by the Department for International Development [pdf] DFID working paper <www.dfid.gov.uk/r4d/pdf/outputs/misc_infocomm/DFIDWorkingPaper38.pdf≯ [accessed 22 October 2014]. www.dfid.gov.uk/r4d/pdf/outputs/misc_infocomm/DFIDWorkingPaper38.pdf

Stubbs, P. (2003) ‘International non-state actors and social development policy’, Global Social Policy 3: 319-48 <http://dx.doi.org/10.1177/14680181030033003≯.

Te Velde, D.W., Ahmed, M.M., Alemu, G., Bategeka, L., Calí, M., Castel-Branco, C., Chansa, F., Dasgupta, S., Foresti, M. and Hangi, M. (2008) The Global Financial Crisis and Developing Countries, ODI Background Note, London: Overseas Development Institute.

Thomas, S. (2008) ‘Results measurement and programme-based approaches’ in ‘Methods and Instruments for the Evaluation and Monitoring of VET Services: Conference Proceedings’, Königswinter, 10-11 December 2009, 55-61.

Vielajus, M., Hudson, A., Jonsson, L. and Neu, D. (2009) ‘The Challenge of Accountability for Development Agencies within their Own Countries and before their Peers’ in Transparent, Reliable, Understandable and Interactive: Challenges in Donors’ Domestic Accountability: Conference Proceedings’, AFD-DEVCOM Workshop, 15-16 December 2009, Paris.

Abdulla, S., Kikumbih, N., Massanja, H., Mshinda, H., Nathtan, R., Savigny, D., Armstrong-Schellenberg, J. and Victoria, C. (2001) Mosquito Nets, Poverty and Equity in Rural Southern Tanzania, Tanzania: Ifakara Health Research and Development Centre.

Altenburg, T. (2005) ‘The private sector and development agencies: how to form successful alliances. Critical issues and lessons learned from leading donor programs’, 10th International Business Forum, New York: 2005.

Banerjee, A.V., Duflo, E., Glennerster, R. and Kothari, D. (2010) ‘Improving immunisation coverage in rural India: clustered randomised controlled evaluation of immunisation campaigns with and without incentives’, BMJ: British Medical Journal 340, C2220 <http://dx.doi.org/10.1136/bmj.c2220≯.

Barzelay, M. (2001) The New Public Management: Improving Research and Policy Dialogue, Oakland, CA: University of California Press.

Bates, M.A., Glennerster, R., Gumede, K. and Duflo, E. (2012) ‘The price is wrong’, Field Actions Science Reports: The Journal of Field Actions, Special Issue 4.

Bernard, C. (1957) An Introduction to the Study of Experimental Medicine, Mineola, NY: Courier Dover Publications.

Black, N. (2001) ‘Evidence based policy: proceed with care’, BMJ: British Medical Journal 323: 275 <http://dx.doi.org/10.1136/bmj.323.7307.275≯.

Blackman, T. (2001) ‘Complexity theory and the new public management’, Social issues 1(2) <http://www.whb.co.uk/socialissues/tb.htm≯ [Accessed December 2014]. http://www.whb.co.uk/socialissues/tb.htm

Bloom, G., Kanjilal, B., Lucas, H. and Peters, D. (2012) Transforming Health Markets in Asia and Africa, Abingdon, UK: Routledge.

Bovaird, T. and Davies, R. (2011) ‘Outcome-based service commissioning and delivery: does it make a difference?’ Research in Public Policy Analysis and Management 21: 93-114 <http://www.eur.nl/fileadmin/ASSETS/fsw/Bestuurskunde/ipmn/Tony_Bovaird_-_Outcomebased_strategic_commissioning_Does_it_make_a_difference.pdf≯. http://www.eur.nl/fileadmin/ASSETS/fsw/Bestuurskunde/ipmn/Tony_Bovaird_-_Outcomebased_strategic_commissioning_Does_it_make_a_difference.pdf

Chambers, R. (1997) Whose Reality Counts?: Putting the First Last, Rugby: Intermediate Technology Publications Ltd (ITP).

Clark, G. (2008) A Farewell to Alms: A Brief Economic History of the World, Princeton, NJ: Princeton University Press.

Cohen, J. and Dupas, P. (2010) ‘Free distribution or cost-sharing? Evidence from a randomized malaria prevention experiment’, Quarterly Journal of Economics 125: 1 <http://dx.doi.org/10.3386/w14406≯.

Creevey, L., Downing, J., Dunn, E., Northrip, Z., Snodgrass, D. and Cogan Wares, A. (2010) ‘Time to learn: an evaluation strategy for revitalised foreign assistance’, in USAID (ed.), Private Sector Development Impact Assessment Initiative, Washington, DC: USAID.

Dang, H.-A., Knack, S. and Rogers, H. (2009) International Aid and Financial Crises in Donor Countries, Washington, DC: World Bank.

DFID (2009) Building the Evidence to Reduce Poverty: The UK's Policy on Evaluation for International Development, London: DFID.

DFID (2011) How to Note: Reviewing and Scoring Projects, London: DFID.

DFID (2012) ‘Support to the Construction and Real Estate Sector Growth and Employment in States (GEMS) Programme: GEMS 2 Annual Review’ [pdf], London: DFID <https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213898/2012-GEMS2-AR-report.pdf≯ [accessed 24 October 2014]. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/213898/2012-GEMS2-AR-report.pdf

Domberger, S. and Rimmer, S. (1994) ‘Competitive tendering and contracting in the public sector: a survey’, International Journal of the Economics of Business 1: 439-53.

Dovers, S. and Handmer, J. (2012) The Handbook of Disaster and Emergency Policies and Institutions, Abingdon, UK: Routledge.

Droop, J., Isenman, P. and Mlalazi, B. (2008) Paris Declaration on Aid Effectiveness: Study of Existing Mechanisms to Promote Mutual Accountability (MA) between Donors and Partner Countries at the International Level: A Study Report, Oxford: Oxford Policy Management.

Dupas, P. (2009) ‘What matters (and what does not) in households’ decision to invest in malaria prevention?’ The American Economic Review 99(2): 224-30 <http://dx.doi.org/10.1257/aer.99.2.224≯.

Dupas, P. (2010) Short-run Subsidies and Long-run Adoption of New Health Products: Evidence from a Field Experiment, Cambridge, MA: National Bureau of Economic Research.

Easterly, W. (2002) ‘The cartel of good intentions: the problem of bureaucracy in foreign aid’, The Journal of Policy Reform 5: 223-50 <http://dx.doi.org/10.1080/1384128032000096823≯.

Easterly, W. (2006) The White Man's Burden: Why the West's Efforts to Aid the Rest Have Done So Much Ill and So Little Good, New York: Penguin.

Easterly, W. and Pfutze, T. (2008) ‘Where does the money go? Best and worst practices in foreign aid’, Journal of Economic Perspectives 22(2): 29-52 <http://dx.doi.org/10.1257/jep.22.2.29≯.

Elliot, D., Gibson, A. and Hitchins, R. (2008) ‘Making markets work for the poor: rationale and practice’, Enterprise Development and Microfinance 19: 101-19 <http://dx.doi.org/10.3362/1755-1986.2008.011≯.

Elton, L. (2004) ‘Goodhart's Law and performance indicators in higher education’, Evaluation & Research in Education 18: 120-8 <http://dx.doi.org/10.1080/09500790408668312≯.

Emmi, A., Ozlem, E., Maja, K. and Ilan, R. (2011) Value for Money: Current Approaches and Evolving Debates, London: London School of Economics.

Espeland, W.N. (1997) ‘Authority by the numbers: Porter on quantification, discretion, and the legitimation of expertise’, Law & Social Inquiry 22: 1107-33.

Eyben, R. (2012) Relationships for Aid, London: Routledge.

Feinstein, O.N. and Picciotto, R. (2000) Evaluation and Poverty Reduction: Selected Proceedings from a World Bank Seminar, Washington, DC: World Bank Publications.

Ferlie, E. (1996) The New Public Management in Action, New York: Oxford University Press.

Gasper, D. (1997) Logical Frameworks’: A Critical Assessment: Managerial Theory, Pluralistic Practice, ISS Working Paper Series/General Series vol. 264: 1-46.

Gray, A. and Jenkins, B. (1995) ‘From public administration to public management: reassessing a revolution?’ Public Administration 73: 75-99.

Hall, A., Rasheed Sulaiman, V., Clark, N. and Yoganand, B. (2003) ‘From measuring impact to learning institutional lessons: an innovation systems perspective on improving the management of international agricultural research’, Agricultural Systems 78: 213-41.

Haque, M.S. (2007) ‘Revisiting the new public management’, Public Administration Review 67: 179-82.

Harland, C., Knight, L., Lamming, R. and Walker, H. (2005) ‘Outsourcing: assessing the risks and benefits for organisations, sectors and nations’, International Journal of Operations & Production Management 25: 831-50 <http://dx.doi.org/10.1108/01443570510613929≯.

Harrison, T. (2000) ‘Urban policy: addressing wicked problems’, in S. Nutley, H. Davies and P. Smith (eds), What works? Evidence Based Policy and Practice in Public Services, pp. 207-228, London: Policy Press.

Heierli, U. and Lengeler, C. (2008) Should Bednets be Sold, or Given Free? Berne, Switzerland: Swiss Agency for Development and Cooperation.

Hoffmann, V., Barrett, C.B. and Just, D.R. (2009) ‘Do free goods stick to poor households? Experimental evidence on insecticide treated bednets’, World Development 37: 607-17 <http://dx.doi.org/10.1016/j.worlddev.2008.08.003≯.

Hood, C. (1991) ‘A public management for all seasons?’ Public Administration 69: 3-19.

Hood, C. and Peters, G. (2004) ‘The middle aging of new public management: into the age of paradox?’ Journal of Public Administration Research and Theory 14: 267-82 <http://dx.doi.org/10.1093/jopart/muh019≯.

Hopwood, A.G. and Miller, P. (1994) Accounting as Social and Institutional Practice, Cambridge: Cambridge University Press.

Hummelbrunner, R. (2010) ‘Beyond logframe: critique, variations and alternatives’, in N. Fujita (ed.), Beyond Logframe; Using Systems Concepts in Evaluation, pp. 1-34, Tokyo: FASID. ICAI (2012) DfID Report and Annual Accounts 2013-14 [pdf], <https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/331591/annual-report-accounts-2013-14a.pdf≯ [accessed 24 October 2014]. https://www.gov.uk/government/uploads/system/uploads/attachment_data/file/331591/annual-report-accounts-2013-14a.pdf

Johnsen, Å. (2005) ‘What does 25 years of experience tell us about the state of performance measurement in public policy and management?’ Public Money and Management 25: 9-17.

Kabeer, N. (2003) Gender Mainstreaming in Poverty Eradication and the Millennium Development Goals: A Handbook for Policy Makers and Other Stakeholders, London: Commonwealth Secretariat; Ottawa: International Development Research Centre.

Kabeer, N., Piza, C. and Taylor, L. (2012) ‘What are the economic impacts of conditional cash transfer programmes? A systematic review of evidence’, London: EPPI Centre, Social Science Research Unit, Institute Of Education & University Of London.

Karlan, D., Goldberg, N. and Copestake, J. (2009) ‘Randomized control trials are the best way to measure impact of microfinance programmes and improve microfinance product designs’, Enterprise Development and Microfinance 20: 167-76 <http://dx.doi.org/10.3362/1755-1986.2009.017≯.

Klein, R.J., Eriksen, S.E., Næss, L.O., Hammill, A., Tanner, T.M., Robledo, C. and O’Brien, K.L. (2007) ‘Portfolio screening to support the mainstreaming of adaptation to climate change into development assistance’, Climatic Change 84: 23-44 <http://dx.doi.org/10.1007/s10584-007-9270-3≯.

Kusek, J.Z. and Rist, R.C. (2004) Ten Steps to a Results-based Monitoring and Evaluation System: A Handbook for Development Practitioners, Washington, DC: World Bank Publications.

Lapsley, I. (2009) ‘New public management: the cruellest invention of the human spirit?’ Abacus 45(1): 1-21.

Ledgerwood, J., Earne, J. and Nelson, C. (2013) The New Microfinance Handbook: A Financial Market System Perspective, Washington, DC: World Bank Publications.

Lengeler, C., Grabowsky, M. and McGuire, D. (2007) ‘Quick wins versus sustainability: options for the upscaling of insecticide-treated nets’, The American Journal of Tropical Medicine and Hygiene 77: 222-6.

Madaus, G.F., Ryan, J.P., Kellaghan, T. and Airasian, P.W. (1987) ‘Payment by results: an analysis of a nineteenth century performance-contracting programme’, The Irish Journal of Education/Iris Eireannach an Oideachais 2: 80-91.

Mehrotra, S. (2004) ‘International development targets and official development assistance’, in Pronk, J.P., Catalysing Development: A Debate on Aid, London: Wiley-Blackwell.

Minogue, M., Polidano, C. and Hulme, D. (1998) Beyond the New Public Management: Changing Ideas and Practices in Governance, Cheltenham: Edward Elgar.

Moser, C. (2005) ‘Has gender mainstreaming failed? A comment on international development agency experiences in the South’, International Feminist Journal of Politics 7: 576-90 <http://dx.doi.org/10.1080/14616740500284573≯.

Nutley, S.M., Davies, H.T. and Smith, P.C. (2000) What Works? Evidence-based Policy and Practice in Public Services, London: Policy Press.

OECD (2012) ‘Development aid flows’ [online] <www.oecd.org/statistics/datalab/aid-flows.htm≯ [accessed 1 July 2013]. www.oecd.org/statistics/datalab/aid-flows.htm

OECD (2013) Query Wizard for International Development Statistics, Paris: Organisation for Economic Cooperation and Development.

Patton, M.Q. (2010) Developmental Evaluation: Applying Complexity Concepts to Enhance Innovation and Use, New York: Guilford Press.

Pawson, R. (2004) ‘Evidence based policy’, in B. Carter and C. New (eds.), Making Realism Work: Realist Social Theory and Empirical Research, pp. 26-49 London: Routledge.

Power, M. (1997) The Audit Society: Rituals of Verification, Oxford: Oxford University Press.

Pronk, J.P. (2001) ‘Aid as a catalyst’, Development and Change 32: 611-29 <http://dx.doi.org/10.1111/1467-7660.00219≯.

Rapple, B. (1994) ‘Payment by results: an example of assessment in elementary education from nineteenth century Britain’, Education Policy Analysis Archives 2(1) 1-21 <http://dx.doi.org/10.14507/epaa.v2n1≯.

Rogerson, A. (2005) ‘Aid harmonisation and alignment: bridging the gaps between reality and the Paris reform agenda’, Development Policy Review 23: 531-52 <http://dx.doi.org/10.1111/j.1467-7679.2005.00301.x≯.

Rogerson, A. (2011) ‘What if development aid were truly “catalytic”?’ ODI Background Note November 2011, London: Overseas Development Institute.

Sackett, D.L., Rosenberg, W.M., Gray, J., Haynes, R.B. and Richardson, W.S. (1996) ‘Evidence based medicine: what it is and what it isn't’, BMJ: British Medical Journal 312: 71.

Solesbury, W. (2001) Evidence Based Policy: Whence it Came and Where it's Going, London: ESRC UK Centre for Evidence Based Policy and Practice.

Stern, E., Stame, N., Mayne, J., Forss, K., Davies, R. and Befani, B. (2012) Broadening the Range of Designs and Methods for Impact Evaluations: Report of a Study Commissioned by the Department for International Development [pdf] DFID working paper <www.dfid.gov.uk/r4d/pdf/outputs/misc_infocomm/DFIDWorkingPaper38.pdf≯ [accessed 22 October 2014]. www.dfid.gov.uk/r4d/pdf/outputs/misc_infocomm/DFIDWorkingPaper38.pdf

Stubbs, P. (2003) ‘International non-state actors and social development policy’, Global Social Policy 3: 319-48 <http://dx.doi.org/10.1177/14680181030033003≯.

Te Velde, D.W., Ahmed, M.M., Alemu, G., Bategeka, L., Calí, M., Castel-Branco, C., Chansa, F., Dasgupta, S., Foresti, M. and Hangi, M. (2008) The Global Financial Crisis and Developing Countries, ODI Background Note, London: Overseas Development Institute.

Thomas, S. (2008) ‘Results measurement and programme-based approaches’ in ‘Methods and Instruments for the Evaluation and Monitoring of VET Services: Conference Proceedings’, Königswinter, 10-11 December 2009, 55-61.

Vielajus, M., Hudson, A., Jonsson, L. and Neu, D. (2009) ‘The Challenge of Accountability for Development Agencies within their Own Countries and before their Peers’ in Transparent, Reliable, Understandable and Interactive: Challenges in Donors’ Domestic Accountability: Conference Proceedings’, AFD-DEVCOM Workshop, 15-16 December 2009, Paris.