Evidence-based Policy: In Search of a Method

Pawson, Ray

doi:10.1177/1358902002008002512

Cited by 403Evaluation and Performance AssessmentMeta-analysis and systematic reviewsHealth Policy Implementation Science

Evidence-based Policy: In Search of a Method

Pawson, Ray·2002·Evaluation

DOI 10.1177/1358902002008002512

Open this paper in CoChat — free account

Abstract

Evaluation research is tortured by time constraints. The policy cycle revolves quicker than the research cycle, with the result that `real time' evaluations often have little influence on policy making. As a result, the quest for evidence-based policy has turned increasingly to systematic reviews of the results of previous inquiries in the relevant policy domain. However, this shifting of the temporal frame for evaluation is in itself no guarantee of success. Evidence, whether new or old, never speaks for itself. Accordingly, there is debate about the best strategy of marshalling bygone research results into the policy process. This article joins the imbroglio by examining the logic of the two main strategies of systematic review: `meta-analysis' and `narrative review'. Whilst they are often presented as diametrically opposed perspectives, this article argues that they share common limitations in their understanding of how to provide a template for impending policy decisions. This review provides the background for Part II of the article (to be published in the next issue, Evaluation 8[3]), which considers the merits of a new model for evidence-based policy, namely `realist synthesis'.

Integrity signals

Registry

Crossref · 10.1177/1358902002008002512

Cites

25 of 25 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

The scoping study's charting approach was akin to a narrative review.
“Our charting approach was akin to a 'narrative review' (Pawson 2002: 171)”
From Scoping studies: towards a methodological framework (2005) · cites this paper as Pawson 2002: 171

On the Social Origins of Dictatorship and Democracy
Moore, B. (1984) · doi:10.1007/978-1-349-86027-2_4 · Cited by 2,709 · see citing works
Social Origins of Dictatorship and Democracy: Lord and Peasant in the Making of the Modern World.
Ness, G. D., & Moore, B. (1967) · American Sociological Review · doi:10.2307/2092029 · Cited by 2,285 · see citing works
Realism and Social Science
Sayer, A. (2000) · doi:10.4135/9781446218730 · Cited by 2,259 · see citing works
Meta-analysis of psychotherapy outcome studies.
Smith, M. L., & Glass, G. V. (1977) · American Psychologist · doi:10.1037/0003-066x.32.9.752 · Cited by 2,154 · see citing works
The Comparative Method: Moving Beyond Qualitative and Quantitative Strategies
Ragin, C. C. (2014) · doi:10.1525/9780520957350 · Cited by 2,130 · see citing works
Efficacy of BCG Vaccine in the Prevention of Tuberculosis
Colditz, G. A. (1994) · JAMA · doi:10.1001/jama.1994.03510330076038 · Cited by 1,944 · see citing works
Realism and social science
Sayer, A. (2000) · Cited by 1,753 · see citing works
The Conduct of Inquiry
Salas, M. D. L. N. J., & Kaplan, A. (1967) · Revista española de la opinión pública · doi:10.2307/40180865 · Cited by 1,362 · see citing works
Big Structures, Large Processes, Huge Comparisons
Roth, G., & Tilly, C. (1986) · The American Historical Review · doi:10.2307/1858143 · Cited by 1,346 · see citing works
Rationale and Standards for the Systematic Review of Qualitative Literature in Health Services Research
Popay, J., Rogers, A., & Williams, G. (1998) · Qualitative Health Research · doi:10.1177/104973239800800305 · Cited by 987 · see citing works
Primary prevention mental health programs for children and adolescents: A meta-analytic review
Durlak, J. A., & Wells, A. M. (1997) · American Journal of Community Psychology · doi:10.1023/a:1024654026646 · Cited by 963 · see citing works
Foundations of Program Evaluation: Theories of Practice.
Chen, H.-T., Shadish, W. R., Cook, T. D., & Leviton, L. C. (1992) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2074800 · Cited by 534 · see citing works
Including qualitative research in systematic reviews: opportunities and problems
Dixon‐Woods, M., Fitzpatrick, R. M., & Roberts, K. (2001) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2001.00257.x · Cited by 298 · see citing works
The relevance of systematic reviews to educational policy and practice
Davies, P. (2000) · Oxford Review of Education · doi:10.1080/713688543 · Cited by 286 · see citing works
Mediators and moderators in meta-analysis: There's a reason we don't let dodo birds tell us which psychotherapies should have prizes.
Shadish, W. R., & Sweeney, R. B. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.59.6.883 · Cited by 253 · see citing works
Mediators and moderators in meta-analysis: There's a reason we don't let dodo birds tell us which psychotherapies should have prizes.
Shadish, W. R., & Sweeney, R. B. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.6.883 · Cited by 177 · see citing works
An illustrated guide to the methods of meta‐analysis
Sutton, A. J., Abrams, K. R., & Jones, D. R. (2001) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2001.00281.x · Cited by 106 · see citing works
Meta-analysis: A mixed meta-phor?
Gallo, P. S. (1978) · American Psychologist · doi:10.1037/0003-066x.33.5.515 · Cited by 84 · see citing works
A review of the effectiveness and appropriateness of peer-delivered health promotion interventions for young people
Harden, A., Weston, R., & Oakley, A. (1999) · Cited by 72 · see citing works
Evolutionary epistemology
Jarvie, I. C. (1988) · Critical Review · doi:10.1080/08913818908459516 · Cited by 37 · see citing works
Demonstration, Exemplification, Duplication and Replication in Evaluation Research
Tilley, N. (1996) · Evaluation · doi:10.1177/135638909600200104 · Cited by 28 · see citing works
A Meta‐Analytic Review of Primary Prevention Programs for Children and Adolescents: Contributions and Caveats
Weissberg, R. P., & Bell, D. (1997) · American Journal of Community Psychology · doi:10.1023/a:1024666329372 · Cited by 26 · see citing works
Evidence-based Medicine and Child Mental Health Services: A Broad Approach to Evaluation is Needed
Barnes, J., Stein, A. L., & Rosenberg, W. M. (1997) · Children & Society · doi:10.1111/j.1099-0860.1997.tb00014.x · Cited by 14 · see citing works
A critique of hypertension treatment trials and of their evaluation
Robertson, J. I. S. (2001) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2001.00300.x · Cited by 8 · see citing works
Injury Prevention for Young Children
Walker, B. L. (1996) · Greenwood Publishing Group Inc. eBooks · doi:10.5040/9798216187325 · Cited by 1 · see citing works

Flagged first, then by citations

1 of the 26 references couldn’t be matched to a known paper.

Research works printed but not linked: 7

Hunt, M., 1997, How Science Takes Stock
McGuire, J.B., 1997, Children and Society, 11, 89
Moore, B., 1966, Social Origins of Dictatorship and Democracy
Pawson, R., 1997, Realistic Evaluation
Ragin, C., 1987, The Comparative Method
Shadish, W., 1991, Foundations of Program Evaluation
Towner, E., 1996, Reducing Childhood Accidents - The Effectiveness of Health Promotion Interventions: A Literature Review

Sorted by citations

Scoping studies: towards a methodological framework
Arksey, H., & O'Malley, L. (2005) · International Journal of Social Research Methodology · doi:10.1080/1364557032000119616 · Cited by 36,742 · see citing works
Developing design propositions through research synthesis
Denyer, D., Tranfield, D., & van Aken, J. E. (2008) · Organization Studies · doi:10.1177/0170840607088020 · Cited by 1,057 · see citing works
11 Evidence in Management and Organizational Science: Assembling the Field’s Full Weight of Scientific Knowledge Through Syntheses
Rousseau, D. M., Manning, J., & Denyer, D. (2008) · Academy of Management Annals · doi:10.5465/19416520802211651 · Cited by 1,031 · see citing works
Guidance on the conduct of narrative synthesis in sytematic reviews
Popay, J., Roberts, H. M., Sowden, A. J., Petticrew, M. P., Arai, L., Rodgers, M., & Britten, N. (2006) · Cited by 690 · see citing works
Realist synthesis - an introduction
Pawson, R., Greenhalgh, T., Harvey, G., & Walshe, K. (2004) · UCL Discovery (University College London) · Cited by 570 · see citing works
Self-citation
Large‐System Transformation in Health Care: A Realist Review
Best, A., Greenhalgh, T., Lewis, S. J., Saul, J. E., Carroll, S., & Bitz, J. (2012) · Milbank Quarterly · doi:10.1111/j.1468-0009.2012.00670.x · Cited by 575 · see citing works
Policy analytical capacity and evidence‐based policy‐making: Lessons from Canada
Howlett, M. P. (2009) · Canadian Public Administration · doi:10.1111/j.1754-7121.2009.00070_1.x · Cited by 533 · see citing works
Theories of Change and Realistic Evaluation: Peas in a Pod or Apples and Oranges?
Blamey, A., & Mackenzie, M. (2007) · Evaluation · doi:10.1177/1356389007082129 · Cited by 383 · see citing works
A realist diagnostic workshop
Pawson, R., & Manzano, A. (2012) · Evaluation · doi:10.1177/1356389012440912 · Cited by 348 · see citing works
Self-citation
Evaluating impact from research: A methodological framework
Reed, M. S., Ferré, M., Martín-Ortega, J., Blanche, R., Lawford-Rolfe, R., Dallimer, M., & Holden, J. (2021) · Research Policy · doi:10.1016/j.respol.2020.104147 · Cited by 354 · see citing works
The Practical Relevance of Management Research: Turning the Debate on Relevance into a Rigorous Scientific Research Program
Kieser, A., Nicolai, A. T., & Seidl, D. N. (2015) · Academy of Management Annals · doi:10.5465/19416520.2015.1011853 · Cited by 314 · see citing works
A time-responsive tool for informing policy making: rapid realist review
Saul, J. E., Willis, C. D., Bitz, J., & Best, A. (2013) · Implementation Science · doi:10.1186/1748-5908-8-103 · Cited by 278 · see citing works
Review Research as Scientific Inquiry
Kunisch, S., Denyer, D., Bartunek, J. M., Menz, M., & Cardinal, L. B. (2022) · Organizational Research Methods · doi:10.1177/10944281221127292 · Cited by 277 · see citing works
Evidence in Management and Organizational Science: Assembling the Field's Full Weight of Scientific Knowledge through SynthesesPreprint
Rousseau, D. M., Manning, J., & Denyer, D. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1309606 · Cited by 997 · see citing works
Evidence‐based practice in educational research: a critical realist critique of systematic review
Clegg, S. (2005) · British Journal of Sociology of Education · doi:10.1080/01425690500128932 · Cited by 197 · see citing works
Nothing as Practical as a Good Theory
Pawson, R. (2003) · Evaluation · doi:10.1177/1356389003094007 · Cited by 194 · see citing works
Self-citation
How unemployment and precarious employment affect the health of young people: A scoping study on social determinants
Vancea, M., & Utzet, M. (2017) · Scandinavian Journal of Public Health · doi:10.1177/1403494816679555 · Cited by 193 · see citing works
Implementing Evidence-Based Social Work Practice
Mullen, E. J., Bledsoe, S. E., & Bellamy, J. L. (2007) · Research on Social Work Practice · doi:10.1177/1049731506297827 · Cited by 193 · see citing works
Social impact bonds: a wolf in sheep's clothing?
McHugh, N., Sinclair, S., Roy, M. J., Huckfield, L., & Donaldson, C. (2013) · Journal of Poverty and Social Justice · doi:10.1332/204674313x13812372137921 · Cited by 180 · see citing works
Utilization and development of systematic reviews in management research: What do we know and where do we go from here?
Rojon, C., Okupe, A., & McDowall, A. (2021) · International Journal of Management Reviews · doi:10.1111/ijmr.12245 · Cited by 192 · see citing works
Strategic planning of urban infrastructure for environmental sustainability: Understanding the past to intervene for the future
Malekpour, S., Brown, R. R., & de Haan, F. J. (2015) · Cities · doi:10.1016/j.cities.2015.05.003 · Cited by 154 · see citing works
Realistic Evaluation Bloodlines
Pawson, R., & Tilley, N. (2001) · American Journal of Evaluation · doi:10.1177/109821400102200305 · Cited by 154 · see citing works
Self-citation
Interventions aiming to improve school achievements of children in out-of-home care: A scoping review
Forsman, H., & Vinnerljung, B. (2012) · Children and Youth Services Review · doi:10.1016/j.childyouth.2012.01.037 · Cited by 149 · see citing works
Implementing the Sustainable Development Goals: A Review of Strategic Tools and Frameworks Available to Organisations
Grainger-Brown, J., & Malekpour, S. (2019) · Sustainability · doi:10.3390/su11051381 · Cited by 145 · see citing works
Payment by results and social impact bonds in the criminal justice sector: New challenges for the concept of evidence-based policy?
Fox, C., & Albertson, K. (2011) · Criminology & Criminal Justice · doi:10.1177/1748895811415580 · Cited by 141 · see citing works
Intervention as a research strategy
Oliva, R. (2019) · Journal of Operations Management · doi:10.1002/joom.1065 · Cited by 139 · see citing works
Evidence and Policy and Naming and Shaming
Pawson, R. (2002) · Policy Studies · doi:10.1080/0144287022000045993 · Cited by 135 · see citing works
Self-citation
Towards a Comprehensive Conceptual Framework of Active Travel Behavior: a Review and Synthesis of Published Frameworks
Götschi, T., de Nazelle, A. J., Brand, C., & Gerike, R. (2017) · Current Environmental Health Reports · doi:10.1007/s40572-017-0149-9 · Cited by 134 · see citing works
THE POLICY AND POLITICS OF POLICY APPRAISAL: EMERGING TRENDS AND NEW DIRECTIONS
Turnpenny, J. R., Radaelli, C. M., Jordan, A., & Jacob, K. H. (2009) · Journal of European Public Policy · doi:10.1080/13501760902872783 · Cited by 126 · see citing works
The Evidence For and Against Evidence-Based Practice
Mullen, E. J., & Streiner, D. L. (2004) · Brief Treatment and Crisis Intervention · doi:10.1093/brief-treatment/mhh009 · Cited by 122 · see citing works
Using Research to Inform Healthcare Managers' And Policy Makers' Questions: From Summative to Interpretive Synthesis
Lomas, J. (2005) · Healthcare policy · doi:10.12927/hcpol..17567 · Cited by 119 · see citing works
Critical Realism as emancipatory action: the case for realistic evaluation in practice development
Wilson, V., & McCormack, B. (2006) · Nursing Philosophy · doi:10.1111/j.1466-769x.2006.00248.x · Cited by 119 · see citing works
The “realist search”: A systematic scoping review of current practice and reporting
Booth, A., Briscoe, S., & Wright, J. M. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1386 · Cited by 116 · see citing works
New Directions in Policing: Balancing Prediction and Meaning in Police Research
Greene, J. R. (2013) · Justice Quarterly · doi:10.1080/07418825.2013.840389 · Cited by 116 · see citing works
Innovation and Organisational Performance: Evidence and a Research AgendaPreprint
Walker, R. M. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1306909 · Cited by 109 · see citing works
Health Assets in a Global Context
Morgan, A. R., Davies, M., & Ziglio, E. (2010) · Springer eBooks · doi:10.1007/978-1-4419-5921-8 · Cited by 106 · see citing works
Intergenerational Transmission of Parental Adverse Childhood Experiences and Children’s Outcomes: A Scoping Review
Zhang, L., Mersky, J. P., Gruber, A. M., & Kim, J. (2022) · Trauma Violence & Abuse · doi:10.1177/15248380221126186 · Cited by 106 · see citing works
Robotic Gait Training for Individuals With Cerebral Palsy: A Systematic Review and Meta-Analysis
Carvalho, I., Pinto, S. M., Chagas, D. D. V., Praxedes, J., Oliveira, T. D. S., & Batista, L. A. (2017) · Archives of Physical Medicine and Rehabilitation · doi:10.1016/j.apmr.2017.06.018 · Cited by 102 · see citing works
The realist approach to evaluation research: an introduction
Hewitt, G., Sims, S., & Harris, R. G. (2012) · International Journal of Therapy and Rehabilitation · doi:10.12968/ijtr.2012.19.5.250 · Cited by 100 · see citing works
Value-Based Reimbursement Decisions for Orphan Drugs: A Scoping Review and Decision Framework
Paulden, M., Stafinski, T., Menon, D., & McCabe, C. J. (2014) · PharmacoEconomics · doi:10.1007/s40273-014-0235-x · Cited by 99 · see citing works
The Development of Management and Leadership Capability and its Contribution to Performance: the Evidence, the Prospects and the Research Need
Williams, S., Hirsh, W., & Burgoyne, J. G. (2004) · Lancaster EPrints (Lancaster University) · Cited by 96 · see citing works
Are simulated patients effective in facilitating development of clinical competence for healthcare students? A scoping review
Williams, B. A., & Song, J. J. Y. (2016) · Advances in Simulation · doi:10.1186/s41077-016-0006-1 · Cited by 94 · see citing works
Podologues: conversations created by science podcasts
Birch, H., & Weitkamp, E. (2010) · New Media & Society · doi:10.1177/1461444809356333 · Cited by 92 · see citing works
Meta-integration for synthesizing data in a systematic mixed studies review: insights from research on autism spectrum disorder
Frantzen, K. K., & Fetters, M. D. (2016) · Quality & Quantity · doi:10.1007/s11135-015-0261-6 · Cited by 91 · see citing works
Improving organizational capacity to address health literacy in public health: a rapid realist review
Willis, C. D., Saul, J. E., Bitz, J., Pompu, K., Best, A., & Jackson, B. (2014) · Public Health · doi:10.1016/j.puhe.2014.01.014 · Cited by 88 · see citing works
Crime Prevention: Principles, Perspectives and Practices
Sutton, A., Cherney, A., & White, R. (2010) · UTAS Research Repository · Cited by 86 · see citing works
Secondary prevention programmes for coronary heart disease: a meta-regression showing the merits of shorter, generalist, primary care-based interventions
Clark, A. M., Hartling, L., Vandermeer, B., Lissel, S. L., & McAlister, F. A. (2007) · European Journal of Cardiovascular Prevention & Rehabilitation · doi:10.1097/hjr.0b013e328013f11a · Cited by 84 · see citing works
New Labour and evidence based policy making: 1997-2007
Wells, P. (2007) · People Place and Policy Online · doi:10.3351/ppp.0001.0001.0004 · Cited by 80 · see citing works
Realistic Evaluation and QCA
Befani, B., Ledermann, S., & Sager, F. (2007) · Evaluation · doi:10.1177/1356389007075222 · Cited by 86 · see citing works
Manual for Designing, Implementing and Evaluating Road Safety Communication Campaigns
Delhomme, P., de Dobbeleer, W., Forward, S. E., Simões, A., Adamos, G., Areal, A., Chappé, J., Eyssartier, C., Loukopoulos, P., Nathanail, E., et al. (2009) · HAL · Cited by 80 · see citing works
Supporting successful implementation of public health interventions: protocol for a realist synthesis
MacDonald, M., Pauly, B., Wong, G., Schick‐Makaroff, K., van Roode, T., Strosher, H., Kothari, A. R., Valaitis, R. K., Manson, H. E., O’Briain, W., et al. (2016) · Systematic Reviews · doi:10.1186/s13643-016-0229-1 · Cited by 78 · see citing works
Dealing With Complex Causality in Realist Synthesis
Sager, F., & Andereggen, C. (2011) · American Journal of Evaluation · doi:10.1177/1098214011411574 · Cited by 74 · see citing works
How shall we examine and learn about public-private partnerships (PPPs) in the health sector? Realist evaluation of PPPs in Hong Kong
Wong, E. L., Yeoh, E., Chau, P. Y. K., Yam, C. H. K., Cheung, A. W. L., & Fung, H. (2015) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.11.012 · Cited by 72 · see citing works
Evidence‐based Engagement in the Voluntary Sector: Lessons from Canada
Laforest, R., & Orsini, M. (2005) · Social Policy and Administration · doi:10.1111/j.1467-9515.2005.00451.x · Cited by 69 · see citing works
Partnership, policy and politics: initial teacher education in England under New Labour
Furlong, J. J., McNamara, O., Campbell, A., Howson, J., & Lewis, S. (2008) · Teachers and Teaching · doi:10.1080/13540600802037728 · Cited by 70 · see citing works
Overseas and over here: policy transfer and evidence-based policy-making
Legrand, T. (2012) · Policy Studies · doi:10.1080/01442872.2012.695945 · Cited by 71 · see citing works
Harnessing local knowledge for scientific knowledge production: challenges and pitfalls within evidence-based sustainability studies
Persson, J., Johansson, E. L., & Olsson, L. (2018) · Ecology and Society · doi:10.5751/es-10608-230438 · Cited by 69 · see citing works
Principles and purposes of European Union Cohesion policy evaluation
Batterbury, S. C. E. (2006) · Regional Studies · doi:10.1080/00343400600600504 · Cited by 68 · see citing works
Empowering change: Realist evaluation of a Scottish Government programme to support normal birth
Cheyne, H., Abhyankar, P., & McCourt, C. (2013) · Midwifery · doi:10.1016/j.midw.2013.07.018 · Cited by 68 · see citing works
Gamma-Hydroxybutyrate (GHB): A Scoping Review of Pharmacology, Toxicology, Motives for Use, and User Groups
Brennan, R., & Hout, M. C. V. (2014) · Journal of Psychoactive Drugs · doi:10.1080/02791072.2014.921746 · Cited by 68 · see citing works
The Contribution of Enterprise Architecture to the Achievement of Organizational Goals: A Review of the Evidence
Boucharas, V., van Steenbergen, M., Jansen, S., & Brinkkemper, S. (2010) · Lecture notes in business information processing · doi:10.1007/978-3-642-16819-2_1 · Cited by 64 · see citing works
Disparities in diabetes mellitus among Caribbean populations: a scoping review
Bennett, N. R., Francis, D., Ferguson, T. S., Hennis, A. J. M., Wilks, R., Harris, E. N., MacLeish, M. M., & Sullivan, L. W. (2015) · International Journal for Equity in Health · doi:10.1186/s12939-015-0149-z · Cited by 63 · see citing works
An Evaluation of Faculty Development Programs for Clinician–Educators: A Scoping Review
Alexandraki, I., Rosasco, R. E., & Mooradian, A. D. (2020) · Academic Medicine · doi:10.1097/acm.0000000000003813 · Cited by 62 · see citing works
Middle‐Class Political Activism and Middle‐Class Advantage in Relation to Public Services: A Realist Synthesis of the Evidence Base
Matthews, P. J., & Hastings, A. (2012) · Social Policy and Administration · doi:10.1111/j.1467-9515.2012.00866.x · Cited by 58 · see citing works
Fear‐related barriers to physical activity among adults with overweight and obesity: A narrative synthesis scoping review
Hamer, O., Larkin, D. T., Relph, N., & Dey, P. (2021) · Obesity Reviews · doi:10.1111/obr.13307 · Cited by 59 · see citing works
What does success look like for air quality policy? A perspective
Monks, P. S., & Williams, M. L. (2020) · Philosophical Transactions of the Royal Society A Mathematical Physical and Engineering Sciences · doi:10.1098/rsta.2019.0326 · Cited by 54 · see citing works
Suicide in later life: public health and practitioner perspectives
Manthorpe, J., & Iliffe, S. (2010) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2473 · Cited by 52 · see citing works
Sport and Social Inclusion: Evidence-Based Policy and Practice
Coalter, F. (2017) · Social Inclusion · doi:10.17645/si.v5i2.852 · Cited by 52 · see citing works
The judgement process in evidence-based medicine and health technology assessment
Kelly, M. P., & Moore, T. A. (2011) · Social Theory & Health · doi:10.1057/sth.2011.21 · Cited by 52 · see citing works
Concepts and approaches in the evaluation of health promotion
de Carvalho, A. I., Bodstein, R., Hartz, Z., & Matida, Á. H. (2004) · Ciência & Saúde Coletiva · doi:10.1590/s1413-81232004000300002 · Cited by 51 · see citing works
Gender, health, labor, and inequities: a review of the fair and alternative trade literature
Terstappen, V., Hanson, L., & McLaughlin, D. (2012) · Agriculture and Human Values · doi:10.1007/s10460-012-9377-7 · Cited by 49 · see citing works
Key findings about hearing loss in the working-life: a scoping review from a well-being perspective
Granberg, S., & Gustafsson, J. (2021) · International Journal of Audiology · doi:10.1080/14992027.2021.1881628 · Cited by 48 · see citing works
Kitchen chemistry: A scoping review of the diversionary use of pharmaceuticals for non‐medicinal use and home production of drug solutions
Hout, M. C. V. (2014) · Drug Testing and Analysis · doi:10.1002/dta.1622 · Cited by 49 · see citing works
Cognitive skills programmes for offenders
Hollin, C. R., & Palmer, E. J. (2009) · Psychology Crime and Law · doi:10.1080/10683160802190871 · Cited by 48 · see citing works
Crime Prevention: Principles, Perspectives and Practices
Sutton, A., Cherney, A., & White, R. (2008) · Cambridge University Press eBooks · doi:10.1017/cbo9780511804601 · Cited by 122 · see citing works
Meta-Evaluation: Discovering What Works Best in Welfare Provision
Ashworth, K., Cebulla, A., Greenberg, D. H., & Walker, R. (2004) · Evaluation · doi:10.1177/1356389004045075 · Cited by 48 · see citing works
Conceptualising the built environment to inform sustainable urban transitions
Nielsen, J., & Farrelly, M. A. (2019) · Environmental Innovation and Societal Transitions · doi:10.1016/j.eist.2019.07.001 · Cited by 47 · see citing works
Disparities in cardiovascular disease among Caribbean populations: a systematic literature review
Francis, D. K., Bennett, N., Ferguson, T., Hennis, A., Wilks, R., Harris, E., MacLeish, M., & Sullivan, L. (2015) · BMC Public Health · doi:10.1186/s12889-015-2166-7 · Cited by 39 · see citing works
Dietary, Food Service, and Mealtime Interventions to Promote Food Intake in Acute Care Adult Patients
Cheung, G., Pizzola, L., & Keller, H. (2013) · Journal of Nutrition in Gerontology and Geriatrics · doi:10.1080/21551197.2013.809673 · Cited by 44 · see citing works
Using a matrix-analytical approach to synthesizing evidence solved incompatibility problem in the hierarchy of evidence
Walach, H., & Loef, M. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2015.03.027 · Cited by 44 · see citing works
Age at referral for diagnosis and rehabilitation services for cerebral palsy: a scoping review
Boychuck, Z., Bussières, A., Goldschleger, J., Majnemer, A., & The Prompt Group (2018) · Developmental Medicine & Child Neurology · doi:10.1111/dmcn.14034 · Cited by 44 · see citing works
Does regulatory impact assessment lead to better policy?
Carroll, P. J. (2010) · Policy and Society · doi:10.1016/j.polsoc.2010.03.009 · Cited by 44 · see citing works
Using systematic review methods within a Ph.D. dissertation in political science: challenges and lessons learned from practice
Daigneault, P., Jacob, S., & Ouimet, M. (2012) · International Journal of Social Research Methodology · doi:10.1080/13645579.2012.730704 · Cited by 43 · see citing works
Measuring research influence on drug policy: A case example of two epidemiological monitoring systems
Ritter, A. J., & Lancaster, K. (2012) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2012.02.005 · Cited by 43 · see citing works
Do Orthopaedic Surgeons Acknowledge Uncertainty?
Teunis, T., Janssen, S. J., Guitton, T. G., Ring, D., & Parisien, R. C. (2015) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-015-4623-0 · Cited by 43 · see citing works
Offending Behaviour Programmes and Contention: Evidence‐Based Practice, Manuals, and Programme Evaluation
Hollin, C. R. (2006) · Wiley eBooks · doi:10.1002/9780470713341.ch2 · Cited by 43 · see citing works
Evaluating social innovations and their contribution to social value: the benefits of a ‘blended value’ approach
Dayson, C. (2016) · Policy & Politics · doi:10.1332/030557316x14564838832035 · Cited by 42 · see citing works
Life quality and health in adolescents and emerging adults with epilepsy during the years of transition: a scoping review
Thomson, L., Fayed, N., Sedarous, F., & Ronen, G. M. (2013) · Developmental Medicine & Child Neurology · doi:10.1111/dmcn.12335 · Cited by 41 · see citing works
Involving Patients in Reducing Decision Uncertainties Around Orphan and Ultra-Orphan Drugs: A Rare Opportunity?
Menon, D., Stafinski, T., Dunn, A., & Short, H. (2014) · Patient · doi:10.1007/s40271-014-0106-8 · Cited by 40 · see citing works
Goals of evaluation and types of evidence
Berriet-Solliec, M., Labarthe, P., & Laurent, C. (2014) · Evaluation · doi:10.1177/1356389014529836 · Cited by 39 · see citing works
Poor Quality of Data in Africa: What Are the Issues?
Kinyondo, A., & Pelizzo, R. (2018) · Politics &amp Policy · doi:10.1111/polp.12277 · Cited by 41 · see citing works
Evaluating change in health care practice: lessons from three studies
Redfern, S., Christian, S., & Norman, I. J. (2003) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2003.00387.x · Cited by 40 · see citing works
Dynamics of the charcoal and indigenous timber trade in Zambia: A scoping study in Eastern, Northern and Northwestern provinces
Gumbo, D., Moombe, K. B., Kabwe, G., Ojanen, M., Ndhlovu, E., Sunderland, T. C. H., & Kandulu, M. M. (2013) · Center for International Forestry Research (CIFOR) eBooks · doi:10.17528/cifor/004113 · Cited by 39 · see citing works
Evaluating the London 2012 Games’ impact on sport participation in a non-hosting region: a practical application of realist evaluation
Chen, S., & Henry, I. P. (2015) · Leisure Studies · doi:10.1080/02614367.2015.1040827 · Cited by 40 · see citing works
The complexity of teacher professional growth – unravelling threads of purpose, opportunity and response
Taylor, P. (2020) · Professional Development in Education · doi:10.1080/19415257.2020.1747106 · Cited by 39 · see citing works
The use of indicators in environmental policy appraisal: lessons from the design and evolution of water security policy measures
Howlett, M. P., & Cuenca, J. S. (2016) · Journal of Environmental Policy & Planning · doi:10.1080/1523908x.2016.1207507 · Cited by 39 · see citing works
Water governance research in Africa: progress, challenges and an agenda for research and action
Olagunju, A. O., Thondhlana, G., Chilima, J. S., Sène-Harper, A. L., Compaoré, W. R. N., & Ohiozebau, E. (2019) · Water International · doi:10.1080/02508060.2019.1594576 · Cited by 38 · see citing works
The impact of national and international assessment programmes on education policy, particularly policies regarding resource allocation and teaching and learning practices in developing countries
Best, M., Knight, P., Lietz, P. N., Lockwood, C. S., Nugroho, D., & Tobin, M. (2013) · ACEReSearch Repository (Australian Council for Educational Research) · Cited by 37 · see citing works
How Surgeons Make Decisions When the Evidence Is Inconclusive
Hageman, M. G. J. S., Guitton, T. G., & Ring, D. (2013) · The Journal Of Hand Surgery · doi:10.1016/j.jhsa.2013.02.032 · Cited by 37 · see citing works
The 'presence' of evaluation theory and practice in educational and social development: toward an inclusive approach
Saunders, M. (2006) · London Review of Education · doi:10.1080/14748460600855526 · Cited by 36 · see citing works

Evidence-based policy: the promise of ‘realist synthesis’
Pawson, R. (2002) · Evaluation · doi:10.1177/135638902401462448 · Cited by 729 · see citing works
Self-citation
ESRC UK Centre for Evidence Based Policy and Practice: Working Paper 4 Evidence Based Policy: II. The Promise of ‘Realist Synthesis’
Pawson, R., & Mary, Q. (2011)
Self-citation
An emerging framework for including different types of evidence in systematic reviews for public policy
Oliver, S., Harden, A., Rees, R., Shepherd, J., Brunton, G., Garcia, J., & Oakley, A. (2005) · Evaluation · doi:10.1177/1356389005059383 · Cited by 221 · see citing works
Evidence and Policy and Naming and Shaming
Pawson, R. (2002) · Policy Studies · doi:10.1080/0144287022000045993 · Cited by 135 · see citing works
Self-citation
Flexible synthesis can deliver more tailored and timely evidence for research and policy
Martin, P. A., Christie, A. P., Shackelford, G. E., Hood, A. S. C., Wang, S., Li, B., Morgan, W. H., Lee, M., Aldridge, D. C., & Sutherland, W. J. (2023) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2221911120 · Cited by 16 · see citing works

Authors: Pawson, R.
Affiliations: Queen Mary University of London (GB)
Corresponding author: Pawson, Ray
ORCID: Pawson, Ray
Venue: Evaluation
Publisher: SAGE Publications
Published: 2002-04
Volume: 8
Issue: 2
Pages: 157-181
ISSN: 1356-3890 (ISSN-L)
1461-7153
DOI: 10.1177/1358902002008002512
OpenAlex: W2073020593
Semantic Scholar: 0a46f8e2fe3872100f441ff87ecd471f3fcf7e09
Cited by: 403
References: 26
Citations by year: 2026: 7 · 2025: 16 · 2024: 19 · 2023: 25 · 2022: 18 · 2021: 28 · 2020: 20 · 2019: 18 · 2018: 11 · 2017: 16 · 2016: 11 · 2015: 21 · 2014: 30 · 2013: 18 · 2012: 22
FWCI: 17.56
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Evaluation (publishedVersion)
OpenGrey (Institut de l'Information Scientifique et Technique) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Management Science and Operations Research › Evaluation and Performance Assessment
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Health Sciences › Health Professions › General Health Professions › Health Policy Implementation Science
Keywords: evidence-based policy, systematic reviews, meta-analysis, realist synthesis, policy cycle, science-policy interface, policy decision-making

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Evidence-based Policy: In Search of a Method

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks