The DOI matches its Crossref record.
Fourth-Generation Evaluation
Abstract
Naturalistic program evaluation strategies are gaining acceptance within the evaluation profession. They are especially useful in the examination of the transaction, or process, components of programs. One of their disadvantages is that they demand extensive quantities of evaluator time and effort which are difficult to arrange. Guba refers to evaluation conducted within the naturalistic paradigm (as distinct from the use of naturalistic techniques) as fourth-generation evaluation. This article describes an evaluation study in the health field that attempted to stay within the naturalistic paradigm while mitigating some of the drawbacks of the methodological process of naturalistic evaluation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Items 101–183 of 183
Inquiry into Issues of Trustworthiness and Quality in Narrative Studies: A Perspective
Loh, J. (2015) · The Qualitative Report · doi:10.46743/2160-3715/2013.1477 · Cited by 300
Wisdom, J. P., Cavaleri, M. A., Onwuegbuzie, A. J., & Green, C. A. (2012) · Health Services Research · doi:10.1111/j.1475-6773.2011.01344.x · Cited by 299
Wallerstein, N. (1999) · Social Science & Medicine · doi:10.1016/s0277-9536(99)00073-8 · Cited by 292
Doctors' communication of trust, care, and respect in breast cancer: qualitative study
Wright, E. B., Holcombe, C., & Salmon, P. (2004) · BMJ · doi:10.1136/bmj.38046.771308.7c · Cited by 291
Eakin, J. M., & Mykhalovskiy, E. (2003) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2003.00392.x · Cited by 287
Qualitative methods in sport: a concise overview for guiding social scientific sport research
Smith, B., & Caddick, N. (2012) · Asia Pacific Journal of Sport and Social Science · doi:10.1080/21640599.2012.701373 · Cited by 286
Greaves, C. J., & Farbus, L. (2006) · Journal of the Royal Society for the Promotion of Health · doi:10.1177/1466424006064303 · Cited by 284
Authenticity in Constructivist Inquiry: Methodological Considerations Without Prescription
Manning, K. (1997) · Qualitative Inquiry · doi:10.1177/107780049700300105 · Cited by 284
Emotional labor and nursing: an under‐appreciated aspect of caring work
Henderson, A. (2001) · Nursing Inquiry · doi:10.1046/j.1440-1800.2001.00097.x · Cited by 283
Connelly, F. M., & Clandinin, D. J. (1999) · Issues in Educational Research · doi:10.1016/b978-008043349-3/50013-x · Cited by 283
Evaluating qualitative management research: Towards a contingent criteriology
Johnson, P., Buehring, A., Cassell, C., & Symon, G. (2006) · International Journal of Management Reviews · doi:10.1111/j.1468-2370.2006.00124.x · Cited by 283
Govaerts, M. J. B., van der Vleuten, C. P. M., Schuwirth, L. W. T., & Muijtjens, A. M. M. (2007) · Advances in Health Sciences Education · doi:10.1007/s10459-006-9043-1 · Cited by 282
Novice to Expert: An Exploration of How Professionals Learn
Daley, B. J. (1999) · Adult Education Quarterly · doi:10.1177/074171369904900401 · Cited by 275
Research on Evaluation Use: A Review of the Empirical Literature From 1986 to 2005
Johnson, K., Greenseid, L. O., Toal, S. A., King, J. A., Lawrenz, F., & Volkov, B. (2009) · American Journal of Evaluation · doi:10.1177/1098214009341660 · Cited by 272
Qualitative Contributions to Resilience Research
Ungar, M. (2003) · Qualitative Social Work · doi:10.1177/1473325003002001123 · Cited by 271
Physics students' epistemologies and views about knowing and learning
Roth, W., & Roychoudhury, A. (1994) · Journal of Research in Science Teaching · doi:10.1002/tea.3660310104 · Cited by 266
Scribner, J. P., Cockrell, K. S., Cockrell, D. H., & Valentine, J. W. (1999) · Educational Administration Quarterly · doi:10.1177/00131619921968491 · Cited by 266
Evaluating batterer counseling programs: A difficult task showing some effects and implications
Gondolf, E. W. (2004) · Aggression and Violent Behavior · doi:10.1016/j.avb.2003.06.001 · Cited by 263
Sipe, L. R. (2000) · Reading Research Quarterly · doi:10.1598/rrq.35.2.4 · Cited by 262
Wu, Y.-H., Wrobel, J., Cornuet, M., Kerhervé, H., Damnée, S., & Rigaud, A.-S. (2014) · Clinical Interventions in Aging · doi:10.2147/cia.s56435 · Cited by 261
Luft, J. A., Kurdziel, J. P., Roehrig, G. H., & Turner, J. (2004) · Journal of Research in Science Teaching · doi:10.1002/tea.20004 · Cited by 257
The Merits of Mixing Methods in Evaluation
Greene, J. C., Benjamin, L., & Goodyear, L. (2001) · Evaluation · doi:10.1177/13563890122209504 · Cited by 255
Know-how to lead digital transformation: The case of local governments
Pittaway, J. J., & Montazemi, A. R. (2020) · Government Information Quarterly · doi:10.1016/j.giq.2020.101474 · Cited by 289
Reconstructing Program Theories: Methods Available and Problems to be Solved
LEEUW, F. (2003) · The American Journal of Evaluation · doi:10.1016/s1098-2140(02)00271-0 · Cited by 254
Beswick, K. (2012) · Educational Studies in Mathematics · doi:10.1007/s10649-011-9333-2 · Cited by 253
A closer look at the role of mentor teachers in shaping preservice teachers' professional identity
Izadinia, M. (2015) · Teaching and Teacher Education · doi:10.1016/j.tate.2015.08.003 · Cited by 242
Dimensions of everyday eating and drinking episodes
Bisogni, C. A., Falk, L. W., Madore, E., Blake, C. E., Jastran, M., Sobal, J., & Devine, C. M. (2007) · Appetite · doi:10.1016/j.appet.2006.09.004 · Cited by 201
What a Long, Strange Trip It's Been…: Twenty-Five Years of Qualitative and New Paradigm Research
Lincoln, Y. S. (2010) · Qualitative Inquiry · doi:10.1177/1077800409349754 · Cited by 185
Why adolescents don't disclose incidents of bullying and harassment
deLara, E. W. (2012) · Journal of School Violence · doi:10.1080/15388220.2012.705931 · Cited by 189
Lincoln, Y. S. (2007) · The Blackwell Encyclopedia of Sociology · doi:10.1002/9781405165518.wbeosn006 · Cited by 158
Li, J., & De Luca, R. (2014) · Studies in Higher Education · doi:10.1080/03075079.2012.709494 · Cited by 154
Tolman, D. L., & Szalacha, L. A. (1999) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.1999.tb00338.x · Cited by 151
Qualitative and quantitative inquiries are not incompatible: A call for a new partnership
Reichardt, C. S., & Rallis, S. F. (1994) · New Directions for Program Evaluation · doi:10.1002/ev.1670 · Cited by 151
Emotions and Positional Identity in Becoming a Social Justice Science Teacher: Nicole's Story
Rivera Maulucci, M. S. (2013) · Journal of Research in Science Teaching · doi:10.1002/tea.21081 · Cited by 147
Calder, M. J., Richter, M. S., Mao, Y., Kovacs Burns, K., Mogale, R. S., & Danko, M. (2016) · Canadian Journal of Higher Education · doi:10.47678/cjhe.v46i2.184585 · Cited by 141
Critical Realism as emancipatory action: the case for realistic evaluation in practice development
Wilson, V., & McCormack, B. (2006) · Nursing Philosophy · doi:10.1111/j.1466-769x.2006.00248.x · Cited by 119
Weaving an interpretivist stance throughout mixed methods research
McChesney, K., & Aldridge, J. (2019) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2019.1590811 · Cited by 118
Abendroth, M., Lutz, B. J., & Young, M. E. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2011.10.003 · Cited by 116
Finding Voice and Passion: Critical Race Theory Methodology in Science Teacher Education
Mensah, F. M. (2019) · American Educational Research Journal · doi:10.3102/0002831218818093 · Cited by 109
Creating a culture of data use for continuous improvement: A case study of an Edison Project school
Sutherland, S. (2004) · American Journal of Evaluation · doi:10.1177/109821400402500302 · Cited by 106
Rycroft-Malone, J., Wilkinson, J., Burton, C. R., Harvey, G., McCormack, B., Graham, I., & Staniszewska, S. (2013) · Journal of Health Services Research & Policy · doi:10.1177/1355819613498859 · Cited by 98
When academics integrate research skill development in the curriculum
Willison, J. W. (2012) · Higher Education Research & Development · doi:10.1080/07294360.2012.658760 · Cited by 92
Goberna-Tricas, J., Banús-Giménez, M. R., Palacio-Tauste, A., & Linares-Sancho, S. (2011) · Midwifery · doi:10.1016/j.midw.2010.10.004 · Cited by 88
Transforming Beef By-products into Valuable Ingredients: Which Spell/Recipe to Use?
Henchion, M., McCarthy, M., & O’Callaghan, J. (2016) · Frontiers in Nutrition · doi:10.3389/fnut.2016.00053 · Cited by 83
Riazi, A. M., Rezvani, R., & Ghanbar, H. (2023) · Research Methods in Applied Linguistics · doi:10.1016/j.rmal.2023.100065 · Cited by 79
Denzin, N. K. (2015) · The Blackwell Encyclopedia of Sociology · doi:10.1002/9781405165518.wbeost050.pub2 · Cited by 75
Hall, V., Conboy-Hill, S., & Taylor, D. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1917 · Cited by 71
An exploration of the hydration care of older people: A qualitative study
Godfrey, H., Cloete, J., Dymond, E., & Long, A. (2012) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2012.04.009 · Cited by 67
University of Melbourne, Brunzell, T., Stokes, H., University of Melbourne, Waters, L., & University of Melbourne (2018) · Australian Journal of Teacher Education · doi:10.14221/ajte.2018v43n2.7 · Cited by 66
Canton-Thompson, J., Gebert, K. M., Thompson, B., Jones, G., Calkin, D., & Donovan, G. (2008) · Journal of Forestry · doi:10.1093/jof/106.8.416 · Cited by 65
Quest, A. D., Fullerton, A., Geenen, S., & Powers, L. (2012) · Children and Youth Services Review · doi:10.1016/j.childyouth.2012.04.018 · Cited by 61
Gask, L., Bower, P., Lamb, J., Burroughs, H., Chew-Graham, C., Edwards, S., Hibbert, D., Kovandžić, M., Lovell, K., Rogers, A., et al. (2012) · BMC Health Services Research · doi:10.1186/1472-6963-12-249 · Cited by 61
Gillum, T. L. (2009) · Violence Against Women · doi:10.1177/1077801208328375 · Cited by 60
Vanner (2015) · doi:10.1177/1609406915618094 · Cited by 59
Disruption, control and coping: responses of and to the person with dementia in hospital
POROCK, D., CLISSETT, P., HARWOOD, R. H., & GLADMAN, J. R. F. (2015) · Ageing and Society · doi:10.1017/s0144686x13000561 · Cited by 55
Menon, D. (2020) · Journal of Science Teacher Education · doi:10.1080/1046560x.2020.1718863 · Cited by 51
Lewis, B. F., & Collins, A. (2001) · Journal of Research in Science Teaching · doi:10.1002/tea.1020 · Cited by 51
Care Transition Experiences of Spousal Caregivers: From a Geriatric Rehabilitation Unit to Home
Byrne, K., Orange, J. B., & Ward-Griffin, C. (2011) · Qualitative Health Research · doi:10.1177/1049732311407078 · Cited by 50
Brown, D., & McCormack, B. G. (2011) · Implementation Science · doi:10.1186/1748-5908-6-9 · Cited by 47
Moving on: transition experiences of young adults with chronic pain
Higginson, A., Forgeron, P., Harrison, D., Finley, G. A., & Dick, B. D. (2019) · Canadian Journal of Pain · doi:10.1080/24740527.2019.1587707 · Cited by 40
Wozniak, L., Soprovich, A., Rees, S., Al Sayah, F., Majumdar, S. R., & Johnson, J. A. (2015) · Canadian Journal of Diabetes · doi:10.1016/j.jcjd.2015.05.004 · Cited by 36
Using theory-based evaluation to build evidence-based health and social care policy and practice
Bonner, L. (2003) · Critical Public Health · doi:10.1080/0958159031000100224 · Cited by 33
An exploration of life skill development through sport in three international high schools
Hayden, L. A., Whitley, M. A., Cook, A. L., Dumais, A., Silva, M., & Scherer, A. (2015) · Qualitative Research in Sport, Exercise and Health · doi:10.1080/2159676x.2015.1011217 · Cited by 33
Eckerström, J., Flyckt, L., Carlborg, A., Jayaram‐Lindström, N., & Perseius, K. (2020) · International Journal of Mental Health Nursing · doi:10.1111/inm.12736 · Cited by 32
Astbury, N. M., Albury, C., Nourse, R., & Jebb, S. A. (2020) · PLOS ONE · doi:10.1371/journal.pone.0238645 · Cited by 30
The Kalamazoo Promise and Perceived Changes in Teacher Beliefs, Expectations, and Behaviors
Jones, J. N., Miron, G., & Kelaher-Young, A. J. (2012) · The Journal of Educational Research · doi:10.1080/00220671.2010.517575 · Cited by 27
Beginning again: West African women's experiences of being migrants in Australia
Ogunsiji, O., Wilkes, L., Jackson, D., & Peters, K. (2012) · Journal of Transcultural Nursing · doi:10.1177/1043659612441018 · Cited by 26
Challenges and Dilemmas in Implementing Random Assignment in Educational Research
Ong-Dean, C., Huie Hofstetter, C., & Strick, B. R. (2011) · American Journal of Evaluation · doi:10.1177/1098214010376532 · Cited by 26
Bakker, M., Schipper, K., Geurts, A. C., & Abma, T. A. (2017) · Disability and Rehabilitation · doi:10.3109/09638288.2016.1172673 · Cited by 25
Ligier, F., Rassy, J., Fortin, G., van Haaster, I., Doyon, C., Brouillard, C., Séguin, M., & Lesage, A. (2020) · BMC Public Health · doi:10.1186/s12889-020-09636-y · Cited by 25
Gumus, E., & Alan, H. (2025) · International Nursing Review · doi:10.1111/inr.70017 · Cited by 25
Vachon, B., Durand, M.-J., & LeBlanc, J. (2010) · Advances in Health Sciences Education · doi:10.1007/s10459-009-9200-4 · Cited by 24
Patients' explanatory models for heart failure and COPD exacerbations
Russell, C. K., Geraci, T., Hooper, A., Shull, L., & Gregory, D. M. (1998) · Clinical Nursing Research · doi:10.1177/105477389800700206 · Cited by 19
Naidoo, K. (2017) · Research in Science Education · doi:10.1007/s11165-016-9550-x · Cited by 17
Enhancing access to experiential learning in a science and technology degree programme
Coll, R. K., Lay, M. C., & Zegwaard, K. E. (2002) · Journal of Vocational Education & Training · doi:10.1080/13636820200200195 · Cited by 17
Makuya, D., & Sedibe, M. (2021) · Interchange · doi:10.1007/s10780-021-09429-1 · Cited by 13
Jones, N. L., Read, J., Field, B., Fegan, C., Simpson, E., Revitt, C., Lanfranchi, V., & Ciranvenga, F. (2022) · British Journal of Occupational Therapy · doi:10.1177/03080226211000265 · Cited by 9
Art processes: a research tool for acquired brain injury and residential design
Smith, D., Wright, C. J., Lakhani, A., & Zeeman, H. (2017) · Arts & Health · doi:10.1080/17533015.2017.1354899 · Cited by 9
The Ontario quandary: Principals’ perceptions of accountability policy and social justice
Wang, F. (2017) · Journal of School Leadership · doi:10.1177/105268461702700304 · Cited by 6
Caracterización de la procrastinación académica en estudiantado universitario peruano
Duda-Macera, B., & Gallardo-Echenique, E. (2022) · Revista Electrónica Educare · doi:10.15359/ree.26-2.20 · Cited by 5
LEWIS, D. M., TREAGUST, D. F., & CHANDRASEGARAN, A. L. (2013) · COSMOS · doi:10.1142/s0219607712500061 · Cited by 3
(2007) · doi:10.1044/0161-1461(2008/003
(2000) · doi:10.1002/1098-237x(200101)85:1<50::aid-sce5>3.0.co;2-g
Metadata
- Authors
- Neufeld, A., & Ryan, A. G.
- Venue
- Canadian Journal of Program Evaluation
- Publisher
- University of Victoria Libraries
- Published
- 1988-09
- Volume
- 3
- Issue
- 2
- Pages
- 77-91
- ISSN
- 0834-1516 (ISSN-L)
- 1496-7308
- OpenAlex
- W4362505439
- Cited by
- 5,913
- References
- 0
- FWCI
- 22.54
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.