Cited by 623Human Resource Development and Performance EvaluationEvaluation and Performance AssessmentEvaluation of Teaching Practices

The DOI matches its Crossref record; 41 of the 44 references it cites were found in a registry or an index.

A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence

Bates, Reid·2004·Evaluation and Program Planning

DOI 10.1016/j.evalprogplan.2004.04.011

Open this paper in CoChat — free account

Integrity signals

Registry

Crossref · 10.1016/j.evalprogplan.2004.04.011

Cites

41 of 41 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Evaluating Training Programs : The Four Levels
Kirkpatrick, D. L. (2009) · Cited by 4,720
Principles of Biomedical Ethics.
(1984) · Annals of Internal Medicine · doi:10.7326/0003-4819-100-1-168_1 · Cited by 4,559
Utilization-Focused Evaluation
(2018) · Sage eBooks · doi:10.4135/9781506326139.n729 · Cited by 2,315
Application of cognitive, skill-based, and affective theories of learning outcomes to new methods of training evaluation.
Kraiger, K., Ford, J. K., & Salas, E. (1993) · Journal of Applied Psychology · doi:10.1037/0021-9010.78.2.311 · Cited by 1,831 · cited 1×
“Kraiger, Ford and Salas (1993) have forwarded a multidimensional model of learning outcomes from training and have described a process training evaluators could use to developing learning evaluation measures (Kraiger & Jung, 1997).”
Background
The science of training: a decade of progress
Salas, E., & Cannon-Bowers, J. A. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.471 · Cited by 1,703
Techniques for Evaluating Training Programs
Kirkpatrick, D. L. (1975) · Training and development journal · Cited by 1,234
Training and Development in Work Organizations
Tannenbaum, S. I., & YUKL, G. A. (1992) · Annual Review of Psychology · doi:10.1146/annurev.ps.43.020192.002151 · Cited by 1,023
The adult learner
Knowles, M. S., Holton, E. F., & Swanson, R. A. (1973) · Cited by 970
The flawed four‐level evaluation model
Holton, E. F. (1996) · Human Resource Development Quarterly · doi:10.1002/hrdq.3920070103 · Cited by 965
Principles of Biomedical Ethics
Beauchamp, T. L., & Childless, J. F. (1991) · International Clinical Psychopharmacology · doi:10.1097/00004850-199100620-00013 · Cited by 964

Flagged first, then by citations

Show all 44 references

3 of the 44 references couldn’t be matched to a known paper.

Research works printed but not linked: 3

Ford, 1995, The application of cognitive constructs and principles to the instructional systems design model of training: Implications for needs assessment, design, and transfer, International Review of Industrial and Organizational Psychology, 10, 1
Grider, 1988, Evaluating valuations, Training and Development Journal, 42, 11
Schwandt, T. A., (1998). How we think about evaluation practice. Paper presented at the American Evaluation Association Conference, Chicago, IL.

Sorted by citations

Items 301–400 of 623

A Relationship Study Of Student Satisfaction With Learning Online And Cognitive Load
Bradford, G. R. (2010) · Journal of International Crisis and Risk Communication Research · Cited by 4
Advances in Training Evaluation Research
Ford, J. K., & Sinha, R. (2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199234738.003.0013 · Cited by 4
An assessment of a just-in-time training intervention in a manufacturing organization
Wilkie, B. J. (2013) · Aquila Digital Community (University of Southern Mississippi) · Cited by 4
Training Effectiveness of Skill Certification System: The Case of Automotive Industry in Thailand
Homklin, T. (2014) · Hiroshima University Acedemic Information Repository (Hiroshima University) · Cited by 4
The Relationship among Training Policy, Knowledge Transfer, and Performance Improvement: A Study of Private Sector Organizations in the Kingdom of Saudi Arabia.
Shafloot, F. M. (2012) · ScholarWorks - WMU (Western Michigan University) · Cited by 4
Clinical-year Students’ Competency in Chest X-ray Interpretation: A Theoretical-based Intervention
Hegazi, T. M., Kurdi, K., Alfayez, A. A., Alhammad, A. A., Aldakheel, A. A., Alshahrani, R. S., Alotaibi, G., AlQahtani, M. I., Jarrar, M., Ola, H. A. A., et al. (2025) · Saudi Journal of Medicine and Medical Sciences · doi:10.4103/sjmms.sjmms_623_24 · Cited by 3
“[17] All assessments were based on Bloom’s revised taxonomy to assess multiple cognitive levels.”
Influential
Evaluating the Effectiveness of Existing In-service Training Courses on Infection Prevention and Control in Nurses: An Evaluation Using the Kirkpatrick Model
Faraz, R., Khajeali, N., Kalantarion, M., & Kheiri, B. (2024) · Shiraz E-Medical Journal · doi:10.5812/semj-147225 · Cited by 3
An Assessment of the Effectiveness of Computer-based Training for Newly Commissioned Surface Warfare Division Officers
Bowman, W. R., Crawford, A., & Mehay, S. L. (2008) · Defense Technical Information Center (DTIC) · Cited by 3
Critical Care Education and Skills Validation Course for Internal Medicine Physicians in the Military
Sattler, L. A., Hunninghake, J., Sjulin, T. J., Sobieszczyk, M. J., Molina, M. M., Markelz, A. E., & Walter, R. J. (2021) · Military Medicine · doi:10.1093/milmed/usab210 · Cited by 3
Using socially distanced and online simulation training to improve the confidence of junior doctors in psychiatry
Hewson, T., Foster, H., & Sanderson, R. (2022) · BJPsych Bulletin · doi:10.1192/bjb.2022.18 · Cited by 3
Evaluative Analysis On Mooc With Lms Based To Improve English Teachers’ Teaching Competences
HIDAYAH, S. N. (2022) · IJET (Indonesian Journal of English Teaching) · doi:10.15642/ijet2.2022.11.1.30-45 · Cited by 3
“Kirkpatrick's 4-Level Evaluation Model is an evaluation model that allows researchers to make a series of training evaluations, both in simple and complex training, in 4 (four) stages of evaluation (Bates, 2004).”
Method
The Development of a 360-degree Evaluation Model of Medical Curriculum with the Kirkpatrick Hierarchy Approach
Kusmiati, M., Sanip, S., & Bahari, R. (2024) · Education in Medicine Journal · doi:10.21315/eimj2024.16.1.7 · Cited by 3
“Level 2 (learning) was measured through the learning programme of faculty from the stance of lecturers (17, 33).”
Method
SELF EFFICACY AS MEDIATOR BETWEEN LEARNING AND BEHAVIOUR AMONG IN-SERVICE SCIENCE TEACHERS TRAINING PROGRAMME OF HIGHER ORDER THINKING SKILLS
Mohamad, N., & Osman, K. (2017) · DergiPark (Istanbul University) · Cited by 3
Evaluation of the Effectiveness of In-Service Training Based on the Kirkpatrick Model: A Case Study of a Cardiopulmonary Resuscitation (CPR) Course for Nurses in Afzalipour Hospital, Kerman, Iran
Amiresmaili, M. R., Mirzaee, M., Aminizadeh, M., & Rahimisadegh, R. (2019) · Strides in development of medical education · doi:10.5812/sdme.89066 · Cited by 3
“Today, the most common method for the evaluation of training in organizations is the Kirkpatrick’s framework, consisting of four levels (13, 14): Reaction, learning, behavior, and results (15).”
Method
Supporting Clinicians to Use Technology to Deliver Highly Personalized and Measurement-Based Mental Health Care to Young People: Protocol for an Evaluation Study
Dohnt, H. C., Dowling, M. J., Davenport, T. A., Lee, G. Y., Cross, S. P. M., Scott, E. M., Song, Y. J. C., Hamilton, B. A., Hockey, S. J., Rohleder, C., et al. (2021) · JMIR Research Protocols · doi:10.2196/24697 · Cited by 3
“Last, the Kirkpatrick model is not without its flaws; for example, it has received criticism for being overly simplified and lacking an ability to provide information about how training can be improved [38].”
Method
Expanding the Kirkpatrick Evaluation Model-Towards More Efficient Training in the IT Sector
Agarwal, N., Pande, N., & Ahuja, V. (2019) · IGI Global eBooks · doi:10.4018/978-1-5225-8356-1.ch054 · Cited by 3
The New World Kirkpatrick Model (NWKM) pada Pelatihan Mandiri Implementasi Kurikulum Merdeka (IKM) Melalui Platform Merdeka Mengajar (PMM)
Widiastuti, S., Bachri, B. S., & Maureen, I. Y. (2023) · Jurnal Ilmiah Mandala Education · doi:10.58258/jime.v9i2.5083 · Cited by 3
“Kelebihan dan Kelemahan Model Evaluasi Kirk patric Versi Lama dan Versi Baru (The New World Kirkpatrick Model) No Kelebihan Kelemahan Model evaluasi Kirkpatrick versi lama 1 Sederhana, menyajikan informasi deskriptif dan evaluatif, serta merupakan pendekatan praktis (Bates, 2004).”
Background
Measuring transfer of Public Management Programmes: The Learning Transfer System Inventory in the Belgian federal administration
Broucker, B. (2007) · Lirias · Cited by 3
Integrating Web 2.0 learning technologies in higher education: the necessity, the barriers and the factors for success
Donaldson, L. (2014) · All Ireland Journal of Higher Education · doi:10.62707/aishej.v6i3.202 · Cited by 8
“Bates (2004) argues that its popularity and longevity as an evaluation model may be due to its simplicity but that this simplicity may actually be a limitation.”
Background
Communication and Relational Skills in Medicine
Loughland, C. M., Ditton-Phare, P., & Kissane, D. W. (2018) · Integrating psychiatry and primary care · doi:10.1007/978-3-319-74736-1_9 · Cited by 3
Improving undergraduate education in surgical paediatrics using near-peer assisted learning tutorials
Gracie, D. J., Winter, G., & Clarke, M. C. C. (2021) · Scottish Medical Journal · doi:10.1177/0036933021994256 · Cited by 3
“This divides training outcomes into four levels: level one is termed “reaction”, or the learners response to an intervention; level two is “learning”, where there is evidence of retention of knowledge; level three is “behaviour”, where there is evidence of impact on the practical application of knowledge gained; and l…”
Background
Simulation comme objet de recherche
LeBlanc, V. R., & Piquette, D. (2013) · Springer eBooks · doi:10.1007/978-2-8178-0469-9_36 · Cited by 3
Human Resource Training to Enhance Intellectual Capital in the Public Sector: A proposal of a Training Evaluation Model
Iannone, B. (2019) · International Journal of Business Administration · doi:10.5430/ijba.v10n5p10 · Cited by 3
“Uniquely, it will consider the limitations of Kirkpatrick’s training evaluation model (Bates, 2004) and attempt to go beyond these.”
Unraveling postgraduate communication learning: from transfer to transformative learning
van den Eertwegh, V. (2015) · Research Publications (Maastricht University) · doi:10.26481/dis.20151111ve · Cited by 3
How teacher educators learn to use data in a data team
Bolhuis, E. (2017) · UvA-DARE (University of Amsterdam) · Cited by 3
Ideas are Craftwork Development of an Innovation Training Course and its Evaluation with female and male Journeymen
Gumula, J. (2018) · doi:10.53846/goediss-6935 · Cited by 3
Evaluation of an e-learning course: coercion practices in psychiatric nursing
Lahti, M. (2014) · Doria (University of Helsinki) · Cited by 3
Implementation and insights from the MedXMentor structured mentorship program for undergraduate health science students at Mbarara University, Uganda
Tamale, E., Atuhairwe, I., Ssemwogerere, A., Muhimbura, B., Atimango, L., Malinga, P. D., Mulungi, J., Ssekitto, J. M., Naigaga, J., Kintu, T. M., et al. (2024) · Discover Education · doi:10.1007/s44217-024-00206-7 · Cited by 4
“The Kirkpatrick Model of Evaluation guided the assessment process, focusing on participants’ immediate reactions, knowledge acquisition, changes in behavior, and short-term outcomes [14, 15].”
Staff’s Knowledge and Self-Confidence in Difficult Communication: Evaluation of a Short Experiential-Based Training Program
Gonella, S., Brofferio, L., Stella, L., Sciarrotta, D., Giulio, P. D., & Dimonte, V. (2025) · Nursing Reports · doi:10.3390/nursrep15020060 · Cited by 2
“The educational impact of the course was evaluated according to the first two levels of the Kirkpatrick’s model, which is deemed an appropriate model for evaluating educational programs [27].”
E-Learning Modules Based on Bloom Taxonomy and the Miller Pyramid for First-Year Indian Medical Students: Randomized Controlled Study in Medical Education
Kumar, A. P., Padmavathi, R., Maheshkumar, K., Omprakash, A., Mani, P. K. C., Sathiyasekaran, B. W., & Maruthy, K. N. (2026) · JMIR Human Factors · doi:10.2196/84339 · Cited by 2
“There is a clear gap, and few studies have developed or tested e-modules created specifically for Indian medical students, especially those based on Bloom and Miller models [19].”
The gap between career management expectations and reality – empirical insights from the IT industry
Gubler, M., Coombs, C. R., & Arnold, J. (2018) · Gruppe Interaktion Organisation Zeitschrift für Angewandte Organisationspsychologie (GIO) · doi:10.1007/s11612-018-0402-1 · Cited by 2
“Lastly, as the degree to which employees ﬁnd training helpful is not necessarily related to their actual K learning outcomes (e.g., Bates 2004), the perceived usefulness of the OCM tools needs to be interpreted cautiously.”
Background
60 Years Later - Testing Kirkpatrick's 4-Level Evaluation Model on an Extra-Occupational Master Program
Bauer, M., & Goehlich, M. (2020) · Journal of Education and Human Development · doi:10.15640/jehd.v9n4a3 · Cited by 2
“…which the evaluation levels are related to each other or determine the subsequent evaluation levels has been widely discussed throughout the literature (e.g. Bates, 2004; Reio et al., 2017; Ritzmann, Hagemann, & Kluge, 2014; Salas and Cannon-Bowers, 2001) – however, without an unequivocal answer.”
BackgroundMethod
Education as Culture: The Amazing and Awesome Case Conference
Purdy, E. I., Roseby, R., Manuela Brinkmann, B., Blackmore, E., Meyer, C., & Cabrera, D. (2021) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-20-00407.1 · Cited by 2
Use of a 2-year continuing professional development programme to change Japanese physicians’ attitudes to learning primary care: a qualitative study
Seki, M., Fujinuma, Y., Matsushima, M., Joki, T., Okonogi, H., Miura, Y., Ohno, I., & Hiramoto, J. (2022) · BMJ Open · doi:10.1136/bmjopen-2021-059925 · Cited by 2
Changing Entrepreneurial Leadership Knowledge Competency in Higher Education: A Way to Move Forward
Rahman, A. A. A., Aziz, M. I., Uthamaputhran, S. A. L., Anuar, N. I. M., Yusuff, Y. Z., & Muhammad, N. M. N. (2022) · International Journal of Criminology and Sociology · doi:10.6000/1929-4409.2020.09.315 · Cited by 2
“Kirkpatrick (1976) model has been described as the most popular approach to the evaluation of training in organizations (Bates, 2004).”
Method
eLearning Courses for Tourism and Heritage during a Pandemic: The Case of ‘Tourism Management at UNESCO World Heritage Sites (Vol. 3)’
Rosani, I., Gravari-Barbas, M., Ascaniis, S. D., & Cantoni, L. (2023) · Academica Turistica · doi:10.26493/2335-4194.16.35-47 · Cited by 3
Training Effectiveness Evaluation: Frameworks and Considerations for Flightcrew Training Review & Approval
Sonnenfeld, N. A., Nguyen, B., Alonso, A., & Jentsch, F. G. (2023) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/21695067231192933 · Cited by 2
“…been shaped by an array of theories, methods, and technologies, yet in practice the empirical foundations of training evaluation may often be oversimplified, such that the decision of whether a training program is acceptable becomes a question of trainees' self-reported satisfaction (Bates, 2004).”
Background
Applying Scrum to Knowledge Transfer Among Software Developers
Ibarra-Torres, F., Urbieta, M., & Medina-Medina, N. (2023) · International Journal of Software Engineering and Knowledge Engineering · doi:10.1142/s0218194023430015 · Cited by 2
Facts to Snacks. Evaluating the Effectiveness of Bite-Sized Animations in Teaching Palliative Care to Medical Students
Chua, K. L. M., Chan, J. Q. V., Tan, L. L. C., & Low, J. A. (2024) · American Journal of Hospice and Palliative Medicine® · doi:10.1177/10499091241240053 · Cited by 2
“22 Similarly, interviewees de ﬁ ne effective learning as: “ the outcome of increased understanding, knowledge, and retention ” .”
Supporting healthcare professionals from ethnic minority backgrounds to ‘Step Into’ a clinical academic career
Bramley, L., Bond, C., Stacey, G., Dring, E., Cowley, A., Booth, V., Janiszewski, H., & Cooper, J. E. (2024) · Journal of research in nursing · doi:10.1177/17449871241232332 · Cited by 2
“Firstly, it provided a straightforward way to evaluate the programme based on the outcomes reported by participants (Bates, 2004).”
Acquisition of key clinical communication skills through simulation-based education: findings from a program for postgraduate psychiatry trainees (ComPsych)
Ditton-Phare, P., Sandhu, H., Kelly, B. J., & Loughland, C. M. (2024) · Discover Education · doi:10.1007/s44217-024-00141-7 · Cited by 2
“A well-established oncology evaluation framework in healthcare [18–21] was utilized in the evaluation of ComPsych and comprises four levels of evaluation [22].”
Evaluation of Technical and Vocational Education and Training (TVET) Programmes in Nigeria: The Kirkpatrick Model
Makinde, W. A., & Bamiro, T. O. (2024) · Journal of Pedagogy and Education Science · doi:10.56741/jpes.v3i02.522 · Cited by 2
“The model also focuses on the outcomes of the behaviors of the participants in the training [23],[24].”
Background
Surgical trainee education in benign anorectal disease: a scoping review
Watson, E. G. R., Zhang, T. Y., Ong, H. I., Proud, D. M., & Mohan, H. M. (2025) · Surgery Open Science · doi:10.1016/j.sopen.2025.05.001 · Cited by 2
“Limited assessments of learning were undertaken, with studies only addressing two of Kirkpatrick's Four Levels of Training Evaluation [63].”
Linguistic means to expose the human rights aspect of citizens’ surveillance
Danilova, E. S., Pupynina, E. V., Drygina, Y. A., Pugach, V. S., & Markelova, O. V. (2021) · Linguistics and Culture Review · doi:10.21744/lingcure.v5ns1.1317 · Cited by 2
Modelo de excelencia de programas formativos en línea (MEPFL)
María, O., de la Rosa, A., Miguel, L., & Angulo, V. (2006) · Revista Interuniversitaria de Formación del Profesorado Continuación de la antigua Revista de Escuelas Normales · Cited by 2
An Exploration of the Research/Teaching Trade‐off in the Perception of Business Students
Giangreco, A., Goethals, F., & Maes, J. (2013) · European Management Review · doi:10.1111/emre.12009 · Cited by 2
“Even if student reaction analysis is only partial and might be subjected to biases (Bates, 2004; Kuo and Ye, 2009), it has a certain value because it may prompt feedback on the way participants perceived the course (Mathieu et al.”
Monitoring and Evaluating
Haddock, P. (2015) · Cited by 2
The Effectiveness of Doctoral Program in Nursing in Iran Based on the Patrick Model
Mohammadi, F., Momennasab, M., Yektatalab, S., Kouchaki, Z., & Mozafari, F. (2016) · Nursing and Midwifery Studies · doi:10.17795/nmsjournal33726 · Cited by 2
“When, the outcomes are compared with expected results (7), the effectiveness of the program can be judged and decisions about continuing the program can be made (10, 11).”
BackgroundMethodResultInfluential
Finding the Critical Few
Donovan, P. (2016) · Advances in human resources management and organizational development book series · doi:10.4018/978-1-5225-1808-2.ch007 · Cited by 2
Regresando a Los Valores Básicos: Las Propuestas del Marketing Social y Humanista
Cavazos‐Arroyo, J., Puente‐Díaz, R., & Giuliani, A. C. (2017) · Revista organizações em contexto/Organizações em Contexto · doi:10.15603/1982-8756/roc.v13n25p279-298 · Cited by 2
“…o informaciones positivas, con el fin de ayudar o beneficiar a los otros, fomentando intereses legítimos y de bien común, por lo que se trata de un principio y deber moral que confiere y promueve, siempre que sea posible, el bienestar para los grupos de interés de la organización (BATES, 2004).”
Background
Evaluation of Process and Satisfaction for Selective Courses in a Medical School
Kim, D.-H., Choi, Y.-H., Han, S. Y., Shin, J., & Lee, S. H. (2017) · Korean Medical Education Review · doi:10.17496/kmer.2017.19.2.90 · Cited by 2
“물론 교육에 있어서 높은 만족도가 늘 학습성과의 향상을 보장하는 것은 아니나[14],”
The balancing act: the variation among deaneries across Great Britain regarding provision of focus on diabetes and endocrinology training
Agha, A., Singh, B. M., & Hanif, W. (2018) · British Journal of Diabetes · doi:10.15277/bjd.2018.158 · Cited by 2
Impact of educational leadership and interprofessional learning on vascular access training
Hulse, A. L., & Cochrane, J. (2018) · British Journal of Nursing · doi:10.12968/bjon.2018.27.19.s4 · Cited by 2
Evaluation of Training on Good Agronomic Practices for Seed Yam Production in Nigeria
Mignouna, D. B., Aighewi, B. A., Maroya, N., Akinribido, B., Balogun, M. O., Akintayo, O. T., Amah, D., Awotide, B. A., Nguezet, P. M. D., Abdoulaye, T., et al. (2023) · Seeds · doi:10.3390/seeds2010009 · Cited by 2
Successful implementation of Medical Education Faculty Development Project at Saint George University of Beirut in the immediate post triple blow to Beirut
Nehme, A. H., Btaiche, R., Jreij, M., Jahjah, J., Karam, G., & Belcher, A. E. (2023) · MedEdPublish · doi:10.12688/mep.19519.2 · Cited by 2
Evaluating the effectiveness of Uganda’s Supranational TB Reference Laboratory quality management system training program
Nakiwala, D., Niringiyimana, B., Wekiya, E., Guido, O., Kabugo, J., Isa, A., Katuramu, A., Beatrice, O., Korsah, C. N., Kyomugasho, L., et al. (2023) · Human Resources for Health · doi:10.1186/s12960-023-00876-8 · Cited by 2
“It has been documented that training evaluation is a critical component of analyzing, designing, developing, and implementing an effective training program, creating room to also identify training needs [4–10].”
BackgroundMethod
Effectiveness of Long-Distance Training using Kirkpatrick Evaluation
Rahmadani, R. (2022) · 12 Waiheru · doi:10.47655/12waiheru.v8i1.5 · Cited by 2
“Namun, seiring dengan banyaknya indikator yang harus dinilai dari tiap kategori pelatihan, (Bates, 2004) berpendapat bahwa dalam kasus tertentu kuesioner saja tidak cukup untuk menilai efektivitas suatu pelatihan.”
Background
Determining Return on Investment for Professional Development In Public Education: A Model
Kosloski, M. F., & Reed, P. A. (2009) · ODU Digital Commons (Old Dominion University) · Cited by 2
Logistics in Simulation-Based Interprofessional Education
Charles, S., & Koehn, M. L. (2020) · Comprehensive healthcare simulation · doi:10.1007/978-3-030-28845-7_10 · Cited by 2
EFEKTIVITAS PROGRAM PELATIHAN PROGRAM PENGENDALIAN INFEKSI (PPI) MELALUI EVALUASI PRE TEST DAN POS TEST DI BAGIAN DIKLAT RUMAH SAKIT PUSAT OTAK NASIONAL (RSP PON)
Dewi, N. F., & Hikmah, Y. (2018) · Jurnal Administrasi Bisnis Terapan · doi:10.7454/jabt.v1i1.23 · Cited by 2
“Tahap hasil atau dampak untuk mengevaluasi akibat dari perubahan perilaku alumni dilihat dalam meningkatkan kinerja organisasi (Kirkpatrick, 1998; Bates, 2004).”
Background
Teaching and Learning through the Net
Huang, T. Y., & Huang, C. H. (2020) · International Conference on Education and E-Learning (ICEEL) · doi:10.1145/3439147.3439182 · Cited by 2
Developmental Evaluation of the CHOICE+ Champion Training Program
Wu, S., Keller, H., Donnelly, R., Lambe, E., & Dunn-Ridgeway, H. (2021) · Journal of Long-Term Care · doi:10.31389/jltc.61 · Cited by 2
Protecting health care workers from COVID-19: implementing a training programme on personal protective equipment in Pakistan
Hafeez, A., Kumar, R., Ahmed, I., & Haq, Z. U. (2021) · Eastern Mediterranean Health Journal · doi:10.26719/emhj.21.064 · Cited by 2
“We could not develop a robust monitoring and evaluation component that could use frameworks such as the Kirkpatrick model (23) during the learning or practice stages.”
Method
The Introduction of Clinical Microsystems into an Emergency Department.
O’Dwyer, C. (2014) · Figshare · doi:10.25419/rcsi.10812497 · Cited by 2
ROI for Technology Projects: Measuring and Delivering Value—D. Brian Roulstone and Jack J. Phillips (Woburn, MA: Butterworth Heinemann, 2008, pp. 343, ISBN-10: 0750685883; ISBN-13: 978-0750685887). Reviewed by P. Andru and A. Botchkarev
Andru, P., & Botchkarev, A. (2012) · IEEE Transactions on Engineering Management · doi:10.1109/tem.2012.2201722 · Cited by 2
“However, certain criticisms of the framework are known [5], e.”
Background
Constructive Controversy in Innovation Processes – Application and EvaluationPreprint
Vollmer, A., & Seyr, S. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2084761 · Cited by 2
A program evaluation on the viability of a Foreign Corrupt Practices Act (FCPA) program implemented in a multinational organization in corporate America
White, L. T. (2013) · doi:10.17760/d20003010 · Cited by 2
Understanding the lived experiences and training of undergraduate admission officers in detecting fraudulent application materials of international applicants at highly selective institutions
Newcomb, J. T. (2017) · doi:10.17760/d20251627 · Cited by 2
Contribution de l'intérêt situationnel à une reconsidération de la satisfaction dans la formation pour adultes
Yennek, N. (2014) · theses.fr (ABES) · doi:10.70675/a1b828f0ze9c6z488azbe4ez10bbd199467e · Cited by 2
Higher education for employability : the development of a diagnostic maturity model
Wiele, P. V. (2017) · doi:10.70675/111f01c4z6fecz4348zbad0zc316958608c2 · Cited by 2
An Exploration of RPL (Recognition of Prior Learning) in Companies and Organisations in Ireland Valorisation, Return on Investment, and Emerging Trends
Collins, K. (2011) · Arrow - TU Dublin (Technological University Dublin) · doi:10.21427/d7rk5s · Cited by 2
Vertical teaching principles: pregnancy induced hypertension
Sharma, N., Parimala, A., Shrinivasan, J., & Sasireka, P. (2016) · International Journal of Reproduction Contraception Obstetrics and Gynecology · doi:10.18203/2320-1770.ijrcog20161655 · Cited by 1
Evaluación Kirkpatrick de un programa de simulación clínica para estudiantes de técnico en laboratorio clínico
Figueroa-Gómez, L. I., Bustos-Toledo, H. S., Plaza-Garrido, A., & Erpel-Norambuena, J. M. (2021) · Revista Latinoamericana de Simulación Clínica · doi:10.35366/101427 · Cited by 1
Evaluation of Foundation Course for First-Year Medical Undergraduates in a Medical College of Eastern India
Datta, M., Bhattacharya, S., & Mondal, S. (2022) · Journal of Medical Education · doi:10.5812/jme-122116 · Cited by 1
“was evaluated; however, the present study required learners to rate their skills before and after the course (Kirkpatrick level 2) (9).”
Method
Developing a Framework to Guide the Evaluation of Training in Research Skills for Health and Care Professionals
Sabey, A., Biddle, M., & Bray, I. (2023) · Education for Health · doi:10.4103/efh.efh_289_22 · Cited by 1
Aproximaciones al estudio de la transferencia y su evaluación en el campo de la formación docente
González, R. P. L., & Arroyo, G. C. (2024) · IE Revista de Investigación Educativa de la REDIECH · doi:10.33010/ie_rie_rediech.v15i0.1954 · Cited by 1
Enhancing law enforcement training: A gamified approach to detecting terrorism financing
Zola, F., Segurola-Gil, L., King, E., Mullins, M., & Orduna-Urrutia, R. (2024) · International Journal of Police Science & Management · doi:10.1177/14613557241237174 · Cited by 1
“This model comprises four criteria levels: reaction, learning, behaviour and results (Bates, 2004).”
Evaluation of an HIV-related Education Intervention Scale-up: A Hybrid Type 3 Effectiveness-implementation Study in the Dominican Republic
Stonbraker, S., Castro, Y. E., Caraballo, P. B., Mayorga, S., Rael, C. T., Dunn, M., Centi, S. M., McNair, B. K., Michel, J., Goggin-Kehm, M., et al. (2024) · AIDS and Behavior · doi:10.1007/s10461-024-04555-0 · Cited by 1
Programme Evaluation of Electives in the New CBME Curriculum in Indian Medical Education
Suneja, S., Khanna, G., & Kapoor, R. (2025) · Medical Science Educator · doi:10.1007/s40670-025-02314-x · Cited by 1
Evaluating the Impact of Learning and Development on Staff Motivation in International Non‐Governmental and International Non‐Profit Organisations
Amidkhonova, M., & Gander, M. (2025) · International Journal of Training and Development · doi:10.1111/ijtd.70004 · Cited by 1
Specialized Training in LCNC and AI: from the Pedagogical Concept to the Experience
O’Brien, S., Brandon, C., Busch, D., Krumrey, M., Mitwalli, D. S., Singh, A., Teumert, S., & Margaria, T. (2025) · IEEE Annual International Computer Software and Applications Conference (COMPSAC) · doi:10.1109/compsac65507.2025.00336 · Cited by 1
“Perhaps one of the most widely used evaluation models for training programmes is the Kirkpatrick model [21], which has in itself formed the basis for the development of many subsequent models [22].”
Curriculum Innovation: How Effective Is a Telementoring Virtual Epilepsy Curriculum in Postgraduate Medical Education?
AlQahtani, M., Jiwan, A., Strasser, L., Ratnapalan, S., & Donner, E. J. (2025) · Neurology: Education · doi:10.1212/ne9.0000000000200259
Assessing the effectiveness of AGRI UDAAN accelerator program on agri-startups in India: an integrated PCA and machine learning approach
Ponnaganti, N., Vinayagam, S. S., Sivaramane, N., Paul, N. C., Reddy, K. S., & Nangare, D. D. (2026) · Frontiers in Sustainable Food Systems · doi:10.3389/fsufs.2026.1705691 · Cited by 1
Implementation and Evaluation of a Pediatric Pain Assessment Educational Program ( PPAEP ) for Nurses in a Resource‐Limited Setting: A Pilot Study
Amponsah, A. K., Hammond, C. K., Bam, V. B., Gyamfi, D., Armah, J., Wilson, D., Annobil, F. A., Badengo, D. B., Danquah, C. B., Kyei‐Dompim, J., et al. (2026) · Paediatric and Neonatal Pain · doi:10.1002/pne2.70027 · Cited by 1
Project Change Dissertation Introduction of Video-Based Open Education Resources (OER) in a Third Level Educational Institution
Hashim, S. (2014) · doi:10.25419/rcsi.10812269 · Cited by 1
Impact Of Sustainable Development Education At Universiti Teknologi Malaysia (UTM)
Zolfagharian, S., Nourbakhsh, M., Irizarry, J., Gheisari, M., & Zakaria, R. B. (2011) · Jurnal Teknologi · doi:10.11113/jt.v56.53 · Cited by 1
The Relationship of Motivational Factors, Peer Support and Transfer of Finance Training in Nurse Managers Working in Acute Care Hospital Settings.
Thomas, C. D. (2011) · NCSU Libraries Repository (North Carolina State University Libraries) · Cited by 1
The Measurement of Transfer Using Return on Investment
Donovan, P. (2013) · Springer eBooks · doi:10.1007/978-3-319-02093-8_9 · Cited by 1
Le processus d'évaluation de formation à partir d’une étude de cas
de Almeida, V. S., & Agnoletti, M.-F. (2015) · Psychologie du Travail et des Organisations · doi:10.1016/s1420-2530(16)30017-6 · Cited by 1
Pratiques Psychologiques rubrique Psychologie du travail Revue des modèles en évaluation de formation: approches conceptuelles individuelles et sociales * Training evaluation models: Individualistic and social approaches
Gilibert, D., & Gillet, I. (2010) · Cited by 1
Building evaluation capacity within faculty development programs
Luhanga, U. (2015) · QSpace (Queen's University Library) · Cited by 1
Effectiveness of Training Strategies That Support Informatics Competency Development in Healthcare Professionals
Rhodes, B., Short, A., & Shaben, T. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-805362-1.00015-2 · Cited by 1
Healthcare Students on Placements: a Cyclical Quality Method for Satisfaction Assessments
Boutillier, C. K., Jeanrenaud, L., Gilles, J., Bouche, L., & Cotting, J. Q. (2020) · Medical Science Educator · doi:10.1007/s40670-020-01048-2 · Cited by 1
“This model has the advantage of summarising the complex process of training evaluation and offers a rational approach that is sufficiently broad (but concise) to be in line with the needs of training professionals [7].”
Background
IMPLEMENTATION OF AN IMMUNISATION PROJECT FOR THE REFUGEES USING THE LOGIC MODEL
Goh, L. G., Sow, C.-F., & Jaafar, S. (2020) · Malaysian Journal of Public Health Medicine · doi:10.37268/mjphm/vol.20/no.3/art.604 · Cited by 1
Assessing the Impact of an Online Training Program on Research Performance of Students and Faculty Members
Jadhav, H. T., & Bamane, P. D. (2021) · Journal of Engineering Education/Journal of engineering education transformations/Journal of engineering education transformation · doi:10.16920/jeet/2021/v34i0/157161 · Cited by 1
“This model has been in use from last thirty years (Bates 2004).”
Method
Using programme theory to identify the key elements of the Frontline programme
Maxwell, N. (2021) · Social Work Education · doi:10.1080/02615479.2021.1903415 · Cited by 1
“Step one: generating Frontline’s programme theory Programme theory design drew upon Kirkpatrick’s model (Kirkpatrick, 1994), which provides a systematic outcome-based method of evaluation which allows analysis of multiple measures of training effectiveness (Bates, 2004).”
Method
The Mediating Effect of Intention to Use on the Relationship between Mobile Learning Application and Knowledge and Skill Usage
Noor, A. M., Mahmood, N. H. N., & Zakaria, W. N. W. (2021) · Asian Social Science · doi:10.5539/ass.v17n12p31 · Cited by 2
“This model is the most preferred evaluation framework as it helps in understanding the training evaluation in a very systematic way and one of the best evaluation methods (Bates, 2004; Dorri et al., 2016).”
Method
Students’ Perceptions on Cataloging Course
Kyprianos, K., Efthymiou, F., & Kouis, D. (2021) · Libri · doi:10.1515/libri-2021-0054 · Cited by 1
The balancing act: the variation among deaneries across Great Britain regarding provision of focus on diabetes and endocrinology training
Agha, A., Singh, B. M., & Hanif, W. (2018) · British Journal of Diabetes · doi:10.15277/bjd.2017.158 · Cited by 1
Design Thinking Transfer Gap: Differences Between Knowledge and Application of Design Thinking in the Organizational Environment
Mayer, L., Mayer, S., Hölzle, K., Bönke, N., & Meinel, C. (2023) · Understanding innovation · doi:10.1007/978-3-031-36103-6_17 · Cited by 3

Authors: Bates, R.
Affiliations: Louisiana State University (US)
Corresponding author: Bates, Reid
Venue: Evaluation and Program Planning
Publisher: Elsevier BV
Published: 2004-08
Volume: 27
Issue: 3
Pages: 341-347
ISSN: 0149-7189 (ISSN-L)
DOI: 10.1016/j.evalprogplan.2004.04.011
OpenAlex: W2097592370
Cited by: 623
References: 44
Citations by year: 2026: 53 · 2025: 23 · 2024: 42 · 2023: 53 · 2022: 49 · 2021: 39 · 2020: 43 · 2019: 44 · 2018: 32 · 2017: 45 · 2016: 32 · 2015: 32 · 2014: 30 · 2013: 29 · 2012: 22
FWCI: 4.09
Type: journal article
Language: en
Open access: closed
Licence: www.elsevier.com/tdm/userlicense/1.0/ (tdm)
Locations: Evaluation and Program Planning (publishedVersion)
RePEc: Research Papers in Economics (submittedVersion)
Topics: Social Sciences › Psychology › Applied Psychology › Human Resource Development and Performance Evaluation
Social Sciences › Public Administration › Evaluation and Performance Assessment
Social Sciences › Education › Evaluation of Teaching Practices
Keywords: Kirkpatrick model, training evaluation, beneficence, moral obligation, formative assessment, summative assessment, training effectiveness, human resource development, evaluation limitations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

A critical analysis of evaluation practice: the Kirkpatrick model and the principle of beneficence

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks