Systematic review of measurement tools to assess surgeons' intraoperative cognitive workload
Open accessAbstract
Background: Surgeons in the operating theatre deal constantly with high-demand tasks that require simultaneous processing of a large amount of information. In certain situations, high cognitive load occurs, which may impact negatively on a surgeon's performance. This systematic review aims to provide a comprehensive understanding of the different methods used to assess surgeons' cognitive load, and a critique of the reliability and validity of current assessment metrics. Methods: A search strategy encompassing MEDLINE, Embase, Web of Science, PsycINFO, ACM Digital Library, IEEE Xplore, PROSPERO and the Cochrane database was developed to identify peer-reviewed articles published from inception to November 2016. Quality was assessed by using the Medical Education Research Study Quality Instrument (MERSQI). A summary table was created to describe study design, setting, specialty, participants, cognitive load measures and MERSQI score. Results: Of 391 articles retrieved, 84 met the inclusion criteria, totalling 2053 unique participants. Most studies were carried out in a simulated setting (59 studies, 70 per cent). Sixty studies (71 per cent) used self-reporting methods, of which the NASA Task Load Index (NASA-TLX) was the most commonly applied tool (44 studies, 52 per cent). Heart rate variability analysis was the most used real-time method (11 studies, 13 per cent). Conclusion: Self-report instruments are valuable when the aim is to assess the overall cognitive load in different surgical procedures and assess learning curves within competence-based surgical education. When the aim is to assess cognitive load related to specific operative stages, real-time tools should be used, as they allow capture of cognitive load fluctuation. A combination of both subjective and objective methods might provide optimal measurement of surgeons' cognition.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The NASA-TLX is a widely accepted and validated tool to measure subjective workload after completing a task.
“The NASA-TLX is a widely accepted and validated tool to measure subjective workload after completing a task (Dias et al., 2018; Hart, 2006; Hart & Staveland, 1988).”
From Perception of Physical Demand, Mental Demand, and Performance: A Comparison of Two Voice Interventions for Parkinson's Disease (2022) · cites this paper as Dias et al., 2018
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823 · see citing works
Harris, P. A., Taylor, R., Thielke, R., Payne, J., Gonzalez, N., & Conde, J. G. (2009) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2008.08.010 · Cited by 51,384 · see citing works
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859 · see citing works
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1956) · Psychological Review · doi:10.1037/h0043158 · Cited by 17,812 · see citing works
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,469 · see citing works
Shamseer, L., Moher, D., Clarke, M., Ghersi, D., Liberati, A., Petticrew, M., Shekelle, P., Stewart, L. A., & the PRISMA-P Group (2015) · BMJ · doi:10.1136/bmj.g7647 · Cited by 13,120 · see citing works
Cognitive Load During Problem Solving: Effects on Learning
Sweller, J. (1988) · Cognitive Science · doi:10.1016/0364-0213(88)90023-7 · Cited by 11,048 · see citing works
Ericsson (1993) · doi:10.1037/0033-295x.87.3.215 · Cited by 4,539 · see citing works
NASA-Task Load Index (NASA-TLX); 20 Years Later
Hart, S. G. (2006) · Proceedings of the Human Factors and Ergonomics Society Annual Meeting · doi:10.1177/154193120605000909 · Cited by 4,297 · see citing works
Porges, S. W. (2007) · Biological Psychology · doi:10.1016/j.biopsycho.2006.06.009 · Cited by 3,415 · see citing works
Thayer, J. F., & Lane, R. D. (2009) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2008.08.004 · Cited by 2,040 · see citing works
Thayer, J. F., Hansen, A. L., Saus-Rose, E., & Johnsen, B. H. (2009) · Annals of Behavioral Medicine · doi:10.1007/s12160-009-9101-z · Cited by 1,872 · see citing works
Cognitive load theory in health professional education: design principles and strategies
Van Merriënboer, J. J. G., & Sweller, J. (2010) · Medical Education · doi:10.1111/j.1365-2923.2009.03498.x · Cited by 1,511 · see citing works
Association Between Funding and Quality of Published Medical Education Research
Reed, D. A., Cook, D. A., Beckman, T. J., Levine, R. B., Kern, D. E., & Wright, S. M. (2007) · JAMA · doi:10.1001/jama.298.9.1002 · Cited by 961 · see citing works
Cognitive Load Theory: Implications for medical education: AMEE Guide No. 86
Young, J. Q., Van Merrienboer, J., Durning, S., & Ten Cate, O. (2014) · Medical Teacher · doi:10.3109/0142159x.2014.889290 · Cited by 935 · see citing works
EEG correlates of task engagement and mental workload in vigilance, learning, and memory tasks.
Berka, C., Levendowski, D. J., Lumicao, M. N., Yau, A., Davis, G., Zivkovic, V. T., Olmstead, R. E., Tremoulet, P. D., & Craven, P. L. (2007) · PubMed · Cited by 765 · see citing works
A prospective study of patient safety in the operating room
Christian, C. K., Gustafson, M. L., Roth, E. M., Sheridan, T. B., Gandhi, T. K., Dwyer, K., Zinner, M. J., & Dierks, M. (2006) · Surgery · doi:10.1016/j.surg.2005.07.037 · Cited by 514 · see citing works
Development and Validation of a Surgical Workload Measure: The Surgery Task Load Index (SURG‐TLX)
Wilson, M., Poolton, J., Malhotra, N., Ngo, K., Bright, E., & Masters, R. S. W. (2011) · World Journal of Surgery · doi:10.1007/s00268-011-1141-4 · Cited by 425 · see citing works
Yurko, Y. Y., Scerbo, M. W., Prabhu, A. S., Acker, C. E., & Stefanidis, D. (2010) · Simulation in Healthcare: The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0b013e3181e3f329 · Cited by 328 · see citing works
Gianaros, P. J., van der Veen, F. M., & Jennings, J. R. (2004) · Psychophysiology · doi:10.1111/1469-8986.2004.00179.x · Cited by 327 · see citing works
Performing laparoscopic surgery is significantly more stressful for the surgeon than open surgery
Berguer, R., Smith, W. D., & Chung, Y.-J. (2001) · Surgical Endoscopy · doi:10.1007/s004640080030 · Cited by 321 · see citing works
The Impact of Operating Room Distractions on Stress, Workload, and Teamwork
Wheelock, A., Suliman, A., Wharton, R. M. H., Babu, E. D., Hull, L., Vincent, C. A., Sevdalis, N., & Arora, S. (2015) · Annals of Surgery · doi:10.1097/sla.0000000000001051 · Cited by 254 · see citing works
Stefanidis, D., Wang, F., Korndorffer, J. R., Dunne, J. B., & Scott, D. J. (2009) · Surgical Endoscopy · doi:10.1007/s00464-009-0578-0 · Cited by 251 · see citing works
Physician Clinical Performance Assessment
Landon, B. E., Normand, S. T., Blumenthal, D., & Daley, J. (2003) · JAMA · doi:10.1001/jama.290.9.1183 · Cited by 238 · see citing works
Assessing Mental Workload During Laparoscopic Surgery
Carswell, C. M., Clarke, D., & Seales, W. B. (2005) · Surgical Innovation · doi:10.1177/155335060501200112 · Cited by 198 · see citing works
Eye Metrics as an Objective Assessment of Surgical Skill
Richstone, L., Schwartz, M. J., Seideman, C. A., Cadeddu, J. A., Marshall, S. P., & Kavoussi, L. R. (2010) · Annals of Surgery · doi:10.1097/sla.0b013e3181e464fb · Cited by 196 · see citing works
Lee, G. I., Lee, M. R., Clanton, T., Sutton, E. R. H., Park, A., & Marohn, M. R. (2013) · Surgical Endoscopy · doi:10.1007/s00464-013-3213-z · Cited by 196 · see citing works
Workload assessment of surgeons: correlation between NASA TLX and blinks
Zheng, B., Jiang, X., Tien, G., Meneghetti, A. T., Panton, O. N. M., & Atkins, M. S. (2012) · Surgical Endoscopy · doi:10.1007/s00464-012-2268-6 · Cited by 193 · see citing works
Fallahi, M., Motamedzade, M., Heidarimoghadam, R., Soltanian, A. R., & Miyake, S. (2015) · Applied Ergonomics · doi:10.1016/j.apergo.2015.07.009 · Cited by 174 · see citing works
Limitations of subjective cognitive load measures in simulation‐based procedural training
Naismith, L. M., Cheung, J. J. H., Ringsted, C. V., & Cavalcanti, R. B. (2015) · Medical Education · doi:10.1111/medu.12732 · Cited by 167 · see citing works
Validation of a Novel Virtual Reality Robotic Simulator
Sethi, A. S., Peine, W. J., Mohammadi, Y., & Sundaram, C. P. (2009) · Journal of Endourology · doi:10.1089/end.2008.0250 · Cited by 151 · see citing works
The Emotional and Cognitive Impact of Unexpected Simulated Patient Death
Fraser, K. L., Huffman, J., Ma, I. W. Y., Sobczak, M., McIlwrick, J., Wright, B. J., & McLaughlin, K. (2013) · CHEST Journal · doi:10.1378/chest.13-0987 · Cited by 148 · see citing works
Wadhera, R. K., Parker, S. H., Burkhart, H. M., Greason, K. L., Neal, J. R., Levenick, K. M., Wiegmann, D. A., & Sundt, T. M. (2010) · Journal of Thoracic and Cardiovascular Surgery · doi:10.1016/j.jtcvs.2009.10.048 · Cited by 147 · see citing works
Measuring cognitive load: performance, mental effort and simulation task complexity
Haji, F. A., Rojas, D., Childs, R. A., de Ribaupierre, S., & Dubrowski, A. (2015) · Medical Education · doi:10.1111/medu.12773 · Cited by 136 · see citing works
Li, L., Yang, J., Chu, Y., Wu, W., Xue, J., Liang, P., & Chen, L. (2016) · PLoS ONE · doi:10.1371/journal.pone.0146996 · Cited by 127 · see citing works
Leff, D. R., Elwell, C. E., Orihuela‐Espina, F., Atallah, L., Delpy, D. T., Darzi, A. W., & Yang, G. Z. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.09.032 · Cited by 121 · see citing works
Yu, D., Dural, A. C., Morrow, M. M. B., Yang, L., Collins, J. W., Hallbeck, M. S., Kjellman, M., & Forsman, M. (2016) · Surgical Endoscopy · doi:10.1007/s00464-016-5047-y · Cited by 121 · see citing works
Böhm, B. (2001) · Archives of Surgery · doi:10.1001/archsurg.136.3.305 · Cited by 119 · see citing works
Eversbusch, A., & Grantcharov, T. (2004) · Surgical Endoscopy · doi:10.1007/s00464-003-9264-9 · Cited by 116 · see citing works
Weigl, M., Antoniadis, S., Chiapponi, C., Bruns, C. J., & Sevdalis, N. (2014) · Surgical Endoscopy · doi:10.1007/s00464-014-3668-6 · Cited by 113 · see citing works
Using Data to Enhance Performance and Improve Quality and Safety in Surgery
Goldenberg, M. G., Jung, J. J., & Grantcharov, T. (2017) · JAMA Surgery · doi:10.1001/jamasurg.2017.2888 · Cited by 108 · see citing works
What Are the Principles That Guide Behaviors in the Operating Room?
Madani, A., Vassiliou, M. C., Watanabe, Y., Al‐Halabi, B., Al-Rowais, M. S., Deckelbaum, D., Fried, G. M., & Feldman, L. S. (2016) · Annals of Surgery · doi:10.1097/sla.0000000000001962 · Cited by 106 · see citing works
Wilhelm, D., Reiser, S. B., Kohn, N., Witte, M., Leiner, U., Mühlbach, L., Ruschin, D., Reiner, W., & Feußner, H. (2014) · Surgical Endoscopy · doi:10.1007/s00464-014-3487-9 · Cited by 106 · see citing works
Validity of Cognitive Load Measures in Simulation-Based Training
Naismith, L. M., & Cavalcanti, R. B. (2015) · Academic Medicine · doi:10.1097/acm.0000000000000893 · Cited by 106 · see citing works
Heart rate and heart rate variability as indirect markers of surgeons’ intraoperative stress
Rieger, A., Stoll, R., Kreuzfeld, S., Behrens, K., & Weippert, M. (2013) · International Archives of Occupational and Environmental Health · doi:10.1007/s00420-013-0847-z · Cited by 105 · see citing works
Measuring mental workload during the performance of advanced laparoscopic tasks
Zheng, B., Cassera, M. A., Martinec, D. V., Spaun, G. O., & Swanström, L. L. (2009) · Surgical Endoscopy · doi:10.1007/s00464-009-0522-3 · Cited by 105 · see citing works
Comparison of Postural Ergonomics Between Laparoscopic and Robotic Sacrocolpopexy: A Pilot Study
Tarr, M. E., Brancato, S. J., Cunkelman, J. A., Polcari, A., Nutter, B., & Kenton, K. S. (2014) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2014.10.004 · Cited by 96 · see citing works
Chowriappa, A. J., Raza, S. J., Fazili, A. A., Field, E. P., Malito, C., Samarasekera, D., Shi, Y. Y., Ahmed, K., Wilding, G. E., Kaouk, J. H., et al. (2014) · British Journal of Urology · doi:10.1111/bju.12704 · Cited by 96 · see citing works
Cognitive load in distributed and massed practice in virtual reality mastoidectomy simulation
Andersen, S. A. W., Mikkelsen, P. T., Konge, L., Cayé‐Thomasen, P., & Sørensen, M. S. (2015) · The Laryngoscope · doi:10.1002/lary.25449 · Cited by 95 · see citing works
Weigl, M., Stefan, P., Abhari, K., Wucherer, P., Fallavollita, P., Lazarovici, M., Weidert, S., Euler, E., & Catchpole, K. C. (2015) · Surgical Endoscopy · doi:10.1007/s00464-015-4239-1 · Cited by 95 · see citing works
Cognitive skills assessment during robot‐assisted surgery: separating the wheat from the chaff
Guru, K. A., Esfahani, E. T., Raza, S. J., Bhat, R., Wang, K., Hammond, Y., Wilding, G. E., Peabody, J. O., & Chowriappa, A. J. (2014) · British Journal of Urology · doi:10.1111/bju.12657 · Cited by 93 · see citing works
Ruiz-Rabelo, J. F., Navarro‐Rodríguez, E., Stasi, L. L. D., Jiménez, N. D., Cabrera-Bermon, J., Díaz-Iglesias, C., Gomez-Alvarez, M., & Briceño‐Delgado, J. (2015) · Obesity Surgery · doi:10.1007/s11695-015-1922-1 · Cited by 91 · see citing works
Gaze entropy reflects surgical task load
Stasi, L. L. D., Díaz-Piedra, C., Rieiro, H., Sanchez-Carrion, J. M., Berrido, M. M., Granados, G. O., & Catena, A. (2016) · Surgical Endoscopy · doi:10.1007/s00464-016-4851-8 · Cited by 87 · see citing works
Andersen, S. A. W., Mikkelsen, P. T., Konge, L., Cayé‐Thomasen, P., & Sørensen, M. S. (2015) · Journal of surgical education · doi:10.1016/j.jsurg.2015.09.010 · Cited by 85 · see citing works
Klein, M. I., Warm, J. S., Riley, M. A., Matthews, G., Doarn, C. R., Donovan, J. F., & Gaitonde, K. (2012) · Journal of Endourology · doi:10.1089/end.2011.0641 · Cited by 81 · see citing works
Quantifying Intraoperative Workloads Across the Surgical Team Roles: Room for Better Balance?
Yu, D., Lowndes, B. R., Thiels, C. A., Bingener, J., Abdelrahman, A. M., Lyons, R., & Hallbeck, M. S. (2016) · World Journal of Surgery · doi:10.1007/s00268-016-3449-6 · Cited by 81 · see citing works
Dixon, B. J., Daly, M. J., Chan, H. H. L., Vescan, A. D., Witterick, I., & Irish, J. C. (2013) · The Laryngoscope · doi:10.1002/lary.24385 · Cited by 72 · see citing works
Surgeon's vigilance in the operating room
Zheng, B., Tien, G., Atkins, M. S., Swindells, C., Tanin, H., Meneghetti, A. T., Qayumi, K. A., & Panton, O. N. M. (2011) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2011.01.016 · Cited by 70 · see citing works
Understanding Cognitive Performance During Robot-Assisted Surgery
Guru, K. A., Shafiei, S. B., Khan, A., Hussein, A. A., Sharif, M. A., & Esfahani, E. T. (2015) · Urology · doi:10.1016/j.urology.2015.07.028 · Cited by 70 · see citing works
Heemskerk, J., Zandbergen, H. R., Keet, S. W. M., Martijnse, I. S., Montfort, G. V., Peters, R. J. A., Svircevic, V., Bouwman, R. A., Baeten, C. G. M. I., & Bouvy, N. D. (2014) · Digestive Surgery · doi:10.1159/000365580 · Cited by 68 · see citing works
The Loud Surgeon Behind the Console: Understanding Team Activities During Robot-Assisted Surgery
Tiferes, J., Hussein, A. A., Bisantz, A. M., Kozlowski, J. D., Sharif, M. A., Winder, N. M., Ahmad, N., Allers, J. C., Cavuoto, L. A., & Guru, K. A. (2016) · Journal of surgical education · doi:10.1016/j.jsurg.2015.12.009 · Cited by 68 · see citing works
Evaluation of a Navigation System for ENT with Surgical Efficiency Criteria
Strau, G., Koulechov, K., ttger, S. R., Bahner, J. E., Trantakis, C., Hofer, M., Korb, W., Burgert, O., Meixensberger, J., Manzey, D., et al. (2006) · The Laryngoscope · doi:10.1097/01.mlg.0000202091.34295.05 · Cited by 66 · see citing works
Schuetz, M., Gockel, I., Beardi, J., Hakman, P., Dünschede, F., Mönk, S., Heinrichs, W., & Junginger, T. (2007) · Surgical Endoscopy · doi:10.1007/s00464-007-9605-1 · Cited by 64 · see citing works
Stress among surgical attending physicians and trainees
Joseph, B. A., Parvaneh, S., Swartz, T., Haider, A. A., Hassan, A. N., Kulvatunyou, N., Tang, A. L., Latifi, R., Najafi, B., & Rhee, P. (2016) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000001162 · Cited by 60 · see citing works
Improving pilot mental workload evaluation with combined measures
Wanyan, X., Zhuang, D., & Zhang, H. (2014) · Bio-Medical Materials and Engineering · doi:10.3233/bme-141041 · Cited by 60 · see citing works
Berg, R. J., Inaba, K., Sullivan, M. E., Okoye, O. T., Siboni, S., Minneti, M., Teixeira, P. G., & Δημητριάδης, Δ. (2014) · Surgery · doi:10.1016/j.surg.2014.06.012 · Cited by 58 · see citing works
Temporal Stress in the Operating Room
Modi, H., Singh, H., Orihuela‐Espina, F., Athanasiou, T., Fiorentino, F., Yang, G., Darzi, A. W., & Leff, D. R. (2017) · Annals of Surgery · doi:10.1097/sla.0000000000002289 · Cited by 57 · see citing works
Teaching operating room conflict management to surgeons: clarifying the optimal approach
Rogers, D. A., Lingard, L., Boehler, M. L., Espin, S., Klingensmith, M. E., Mellinger, J. D., & Schindler, N. (2011) · Medical Education · doi:10.1111/j.1365-2923.2011.04040.x · Cited by 56 · see citing works
Muresan, C., Lee, T. H., Seagull, F. J., & Park, A. (2010) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2009.12.018 · Cited by 53 · see citing works
Sleep deprivation increases cognitive workload during simulated surgical tasks
Tomasko, J. M., Pauli, E. M., Kunselman, A. R., & Haluck, R. S. (2011) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2011.08.009 · Cited by 53 · see citing works
Bharathan, R., Vali, S., Setchell, T. E., Miskry, T. S., Darzi, A. W., & Aggarwal, R. K. (2013) · European Journal of Obstetrics & Gynecology and Reproductive Biology · doi:10.1016/j.ejogrb.2013.03.017 · Cited by 51 · see citing works
Foo, J.-L., Martinez-Escobar, M., Juhnke, B., Cassidy, K., Hisley, K., Lobe, T. E., & Winer, E. H. (2012) · Journal of Laparoendoscopic & Advanced Surgical Techniques · doi:10.1089/lap.2012.0150 · Cited by 51 · see citing works
Youssef, Y., Lee, G., Godinez, C., Sutton, E. R. H., Klein, R. V., George, I., Seagull, F. J., & Park, A. (2011) · Surgical Endoscopy · doi:10.1007/s00464-010-1517-9 · Cited by 48 · see citing works
Song, M.-H., Tokuda, Y., Nakayama, T., Sato, M., & Hattori, K. (2009) · Interactive Cardiovascular and Thoracic Surgery · doi:10.1510/icvts.2008.195941 · Cited by 47 · see citing works
Plastic Surgeon???s Life: Marvelous for Mind, Exhausting for Body
Demirtaş, Y., Tulmaç, M., Yavuzer, R., Yalcin, R., Ayhan, S., Latıfoǧlu, O., & Atabay, K. (2004) · Plastic & Reconstructive Surgery · doi:10.1097/01.prs.0000133166.50279.7c · Cited by 46 · see citing works
Estimating a Mental Workload Redline in a Simulated Air-to-Ground Combat Mission
Colle, H. A., & Reid, G. B. (2005) · International Journal of Aviation Psychology · doi:10.1207/s15327108ijap1504_1 · Cited by 45 · see citing works
Physical and Mental Workload in Single-Incision Laparoscopic Surgery and Conventional Laparoscopy
Koca, D., Yıldız, S., Soyupek, F., Günyeli, İ., Erdemoğlu, E., Soyupek, S., & Erdemoğlu, E. (2014) · Surgical Innovation · doi:10.1177/1553350614556363 · Cited by 44 · see citing works
Dixon, B. J., Daly, M. J., Chan, H. H. L., Vescan, A. D., Witterick, I., & Irish, J. C. (2011) · The Laryngoscope · doi:10.1002/lary.22153 · Cited by 44 · see citing works
The surgeon's mental load during decision making at various stages of operations
Czyżewska, E., Kiczka, K., Czarnecki, A., & Pokinko, P. (1983) · European Journal of Applied Physiology · doi:10.1007/bf00429080 · Cited by 43 · see citing works
Training improves laparoscopic tasks performance and decreases operator workload
Hu, J., Lu, J., Tan, W. B., & Lomanto, D. (2015) · Surgical Endoscopy · doi:10.1007/s00464-015-4410-8 · Cited by 43 · see citing works
Retention of Mastoidectomy Skills After Virtual Reality Simulation Training
Andersen, S. A. W., Konge, L., Cayé‐Thomasen, P., & Sørensen, M. S. (2016) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2016.0454 · Cited by 43 · see citing works
Carswell, C. M., Lio, C. H., Grant, R. C., Klein, M. I., Clarke, D., Seales, W. B., & Strup, S. E. (2010) · Applied Ergonomics · doi:10.1016/j.apergo.2010.06.003 · Cited by 42 · see citing works
Haji, F. A., Khan, R., Regehr, G., Drake, J. M., de Ribaupierre, S., & Dubrowski, A. (2015) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9599-8 · Cited by 42 · see citing works
The effect of augmented real‐time image guidance on task workload during endoscopic sinus surgery
Dixon, B. J., Chan, H. H. L., Daly, M. J., Vescan, A. D., Witterick, I., & Irish, J. C. (2012) · International Forum of Allergy & Rhinology · doi:10.1002/alr.21049 · Cited by 42 · see citing works
Bertolaccini, L., Viti, A., & Terzi, A. C. (2014) · Surgical Endoscopy · doi:10.1007/s00464-014-4024-6 · Cited by 41 · see citing works
Andreu-Pérez, J., Leff, D. R., Shetty, K., Darzi, A. W., & Yang, G. (2016) · Brain Connectivity · doi:10.1089/brain.2015.0350 · Cited by 40 · see citing works
Zheng, B., Rieder, E., Cassera, M. A., Martinec, D. V., Lee, G., Panton, O. N. M., Park, A., & Swanström, L. L. (2011) · Surgical Endoscopy · doi:10.1007/s00464-011-2038-x · Cited by 39 · see citing works
Leff, D. R., James, D. R. C., Orihuela‐Espina, F., Kwok, K., Sun, L. W., Mylonas, G. P., Athanasiou, T., Darzi, A. W., & Yang, G. (2015) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2015.00526 · Cited by 38 · see citing works
Stelter, K., Ertl-Wagner, B. B., Luz, M., Muller, S., Ledderose, G., Siedek, V., Berghaus, A., Arpe, S., & Leunig, A. (2011) · Rhinology Journal · doi:10.4193/rhin11.035 · Cited by 36 · see citing works
Prichard, R. S., O’Neill, C. J., Oucharek, J. J., Colinda, Y. H., Delbridge, L., & Sywak, M. S. (2012) · Journal of surgical education · doi:10.1016/j.jsurg.2012.04.002 · Cited by 35 · see citing works
Improvement of design of a surgical interface using an eye tracking device
Barkana, D. E., & Açık, A. (2014) · Theoretical Biology and Medical Modelling · doi:10.1186/1742-4682-11-s1-s4 · Cited by 35 · see citing works
Psychophysical workload in the operating room: primary surgeon versus assistant
Rieger, A., Fenger, S., Neubert, S., Weippert, M., Kreuzfeld, S., & Stoll, R. (2014) · Surgical Endoscopy · doi:10.1007/s00464-014-3899-6 · Cited by 35 · see citing works
Visual working memory influences the performance in virtual image–guided surgical intervention
Hedman, L., Klingberg, T., Enochsson, L., Kjellin, A., & Felländer‐Tsai, L. (2007) · Surgical Endoscopy · doi:10.1007/s00464-007-9287-8 · Cited by 33 · see citing works
Kopac, D., Chen, J., Tang, R., Sawka, A., & Vaghadia, H. (2013) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2013.03.007 · Cited by 33 · see citing works
Theodoraki, M., Ledderose, G., Becker, S., Leunig, A., Arpe, S., Luz, M., & Stelter, K. (2014) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-014-3194-0 · Cited by 31 · see citing works
Technical skill training improves the ability to learn
Kurahashi, A. M., Harvey, A. M., MacRae, H., Moulton, C.-A. E., & Dubrowski, A. (2010) · Surgery · doi:10.1016/j.surg.2010.03.006 · Cited by 29 · see citing works
Where are we with transparency over performance of doctors and institutions?
Tavare, A. N. (2012) · BMJ · doi:10.1136/bmj.e4464 · Cited by 29 · see citing works
Reaction times and the decision-making process in endoscopic surgery
Zheng, B., Janmohamed, Z., & MacKenzie, C. L. (2003) · Surgical Endoscopy · doi:10.1007/s00464-002-8759-0 · Cited by 29 · see citing works
Technical mentorship during robot‐assisted surgery: a cognitive analysis
Hussein, A. A., Shafiei, S. B., Sharif, M. A., Esfahani, E. T., Ahmad, B., Kozlowski, J. D., Hashmi, Z., & Guru, K. A. (2016) · British Journal of Urology · doi:10.1111/bju.13445 · Cited by 29 · see citing works
Vertebroplasty Performance on Simulator for 19 Surgeons Using Hierarchical Task Analysis
Wucherer, P., Stefan, P., Abhari, K., Fallavollita, P., Weigl, M., Lazarovici, M., Winkler, A., Weidert, S., Peters, T. M., de Ribaupierre, S., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2389033 · Cited by 28 · see citing works
Gómez‐Gómez, E., Carrasco‐Valiente, J., Valero-Rosa, J., Campos-Hernández, J. P., Anglada-Curado, F. J., Carazo-Carazo, J. L., Font, P., & Requena-Tapia, M. J. (2014) · Actas Urológicas Españolas · doi:10.1016/j.acuro.2014.09.008 · Cited by 28 · see citing works
MOURAVIEV, V. B., Klein, M. I., Schommer, E., Thiel, D. D., Samavedi, S., Kumar, A., Leveillee, R. J., Thomas, R., Pow‐Sang, J. M., Su, L.-M., et al. (2016) · Journal of Robotic Surgery · doi:10.1007/s11701-015-0540-1 · Cited by 27 · see citing works
Systematic review of methodological quality of individual performance measurement in surgery
Maruthappu, M., El‐Harasis, M. A., Nagendran, M., Orgill, D. P., McCulloch, P. G., Duclos, A., & Carty, M. J. (2014) · British journal of surgery · doi:10.1002/bjs.9642 · Cited by 26 · see citing works
The Future of General Surgery Residency Education
Klingensmith, M. E. (2015) · JAMA Surgery · doi:10.1001/jamasurg.2015.4598 · Cited by 26 · see citing works
Britt, R. C., Scerbo, M. W., Montano, M. J., Kennedy, R., Prytz, E. G., & Stefanidis, D. (2015) · Surgery · doi:10.1016/j.surg.2015.03.032 · Cited by 24 · see citing works
Impact of 3D vision on mental workload and laparoscopic performance in inexperienced subjects
Gómez‐Gómez, E., Carrasco‐Valiente, J., Valero-Rosa, J., Campos-Hernández, J. P., Anglada-Curado, F. J., Carazo-Carazo, J. L., Font, P., & Requena-Tapia, M. J. (2015) · Actas Urológicas Españolas (English Edition) · doi:10.1016/j.acuroe.2015.03.006 · Cited by 24 · see citing works
Rieder, E., Martinec, D. V., Cassera, M. A., Goers, T. A., Dunst, C. M., & Swanström, L. L. (2010) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2010.10.009 · Cited by 24 · see citing works
Specific stressors in endonasal skull base surgery with and without navigation
Stelter, K., Theodoraki, M., Becker, S., Tsekmistrenko, V., Olzowy, B., & Ledderose, G. (2014) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-014-3154-8 · Cited by 23 · see citing works
Scerbo, M. W., Britt, R. C., & Stefanidis, D. (2016) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2016.09.056 · Cited by 22 · see citing works
Smith, W. D., Yi-Hung, C., & Berguer, R. (2000) · Studies in health technology and informatics · doi:10.3233/978-1-60750-914-1-309 · Cited by 21 · see citing works
Pupil Response to Precision in Surgical Task Execution
Xianta, J., Bin, Z., Tien, G., & Stella, A. M. (2013) · Studies in health technology and informatics · doi:10.3233/978-1-61499-209-7-210 · Cited by 21 · see citing works
Immersive training: breaking the bubble and measuring the heat
Pluyter, J. R., Rutkowski, A.-F., & Jakimowicz, J. J. (2014) · Surgical Endoscopy · doi:10.1007/s00464-013-3350-4 · Cited by 18 · see citing works
Clinical Work Intensity Among Physician Specialties: How Might We Assess It?
Horner, R. D., Szaflarski, J. P., Jacobson, C. J., Elder, N. C., Bolon, S. K., Matthews, G., Ying, J., Meganathan, K., & Raphaelson, M. I. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181f3801f · Cited by 16 · see citing works
Performance Measurement in Surgery Through the National Quality Forum
Hyder, J. A., Roy, N., Wakeam, E., Hernández, R. A., Kim, S. P., Bader, A. M., Cima, R. R., & Nguyen, L. L. (2014) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2014.06.018 · Cited by 14 · see citing works
David, R., Haji, F. A., Shewaga, R., Kapralos, B., & Dubrowski, A. (2014) · Studies in health technology and informatics · doi:10.3233/978-1-61499-375-9-353 · Cited by 14 · see citing works
Mastering Instruments Before Operating on a Patient
Zheng, B., Fu, B., Al-Tayeb, T. A., Hao, Y. F., & Qayumi, A. K. (2014) · Surgical Innovation · doi:10.1177/1553350614532533 · Cited by 12 · see citing works
Gardner, A. K., Clanton, J., Jabbour, I. I., Scott, L., Scott, D. J., & Russo, M. A. (2016) · Surgery · doi:10.1016/j.surg.2016.05.015 · Cited by 12 · see citing works
Rasmussen, S. B., Konge, L., Mikkelsen, P. T., Sørensen, M. S., & Andersen, S. A. W. (2015) · Evaluation & the Health Professions · doi:10.1177/0163278715597962 · Cited by 11 · see citing works
Bjerrum, F., Sørensen, J. L., Konge, L., Lindschou, J., Rosthøj, S., Ottesen, B., & Strandbygaard, J. J. S. (2014) · BMC Medical Education · doi:10.1186/1472-6920-14-215 · Cited by 6 · see citing works
Laser visual guidance versus two-dimensional vision in laparoscopy: a randomized trial
Sørensen, S. M. D., Mahmood, O., Konge, L., Thinggaard, E., & Bjerrum, F. (2016) · Surgical Endoscopy · doi:10.1007/s00464-016-4937-3 · Cited by 4 · see citing works
Flagged first, then by citations
1 of the 121 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- [51]Ericsson KA Simon HA Verbal Reports as Data Psychological Review 1980 87 3 215 251
Cited by
Sorted by citations
Talking With Readers: Metadiscourse As Rhetorical Act
Crismore, A. (1989) · Opus: Research & Creativity (Indiana University – Purdue University Fort Wayne) · Cited by 322 · see citing works
Said, S., Gozdzik, M., Roche, T. R., Braun, J., Rössler, J., Kaserer, A., Spahn, D. R., Nöthiger, C. B., & Tscholl, D. W. (2020) · Journal of Medical Internet Research · doi:10.2196/19472 · Cited by 173 · see citing works
Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training
Wu, C., Cha, J. S., Sulek, J. E., Zhou, T., Sundaram, C. P., Wachs, J. P., & Yu, D. (2019) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720819874544 · Cited by 140 · see citing works
Devos, H., Gustafson, K. M., Ahmadnezhad, P., Liao, K., Mahnken, J. D., Brooks, W. M., & Burns, J. M. (2020) · Brain Sciences · doi:10.3390/brainsci10120994 · Cited by 101 · see citing works
Cognitive Load Management: An Invaluable Tool for Safe and Effective Surgical Training
Howie, E. E., Dharanikota, H., Gunn, E., Ambler, O., DIAS, R. D., Wigmore, S. J., Skipworth, R. J. E., & Yule, S. (2023) · Journal of surgical education · doi:10.1016/j.jsurg.2022.12.010 · Cited by 83 · see citing works
Self-citationMeasuring cognitive load in augmented reality with physiological methods: A systematic review
Suzuki, Y., Wild, F., & Eileen Scanlon, A. (2023) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12882 · Cited by 74 · see citing works
Cardone, D., Perpetuini, D., Filippini, C., Mancini, L., Nocco, S., Tritto, M., Rinella, S., Giacobbe, A., Fallica, G., Ricci, F., et al. (2022) · Sensors · doi:10.3390/s22197300 · Cited by 63 · see citing works
Physiological synchronization and entropy as measures of team cognitive load
DIAS, R. D., Zenati, M. A., Stevens, R. H., Gabany, J. M., & Yule, S. (2019) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2019.103250 · Cited by 61 · see citing works
Self-citationHow Can Physiological Computing Benefit Human-Robot Interaction?
Roy, R. N., Drougard, N., Gateau, T., Dehais, F., & Chanel, C. P. C. (2020) · Robotics · doi:10.3390/robotics9040100 · Cited by 53 · see citing works
Morales, J. M., Ruiz-Rabelo, J. F., Díaz-Piedra, C., & Stasi, L. L. D. (2019) · Journal of surgical education · doi:10.1016/j.jsurg.2019.01.005 · Cited by 49 · see citing works
Cognitive ergonomics and robotic surgery
Wong, S. W., & Crowe, P. J. (2024) · Journal of Robotic Surgery · doi:10.1007/s11701-024-01852-7 · Cited by 48 · see citing works
Surgery Task Load Index in Cardiac Surgery: Measuring Cognitive Load Among Teams
Kennedy-Metz, L. R., Wolfe, H. L., DIAS, R. D., Yule, S., & Zenati, M. A. (2020) · Surgical Innovation · doi:10.1177/1553350620934931 · Cited by 47 · see citing works
Self-citationEye-Tracking Indicators of Workload in Surgery: A Systematic Review
Tolvanen, O., Elomaa, A.-P., Itkonen, M., Vrzáková, H., Bednarik, R., & Huotarinen, A. (2022) · Journal of Investigative Surgery · doi:10.1080/08941939.2021.2025282 · Cited by 46 · see citing works
Augmented Reality for Acetabular Component Placement in Direct Anterior Total Hip Arthroplasty
Alexander, C. P., Loeb, A. E., Fotouhi, J., Navab, N., Armand, M., & Khanuja, H. S. (2020) · The Journal of Arthroplasty · doi:10.1016/j.arth.2020.01.025 · Cited by 46 · see citing works
A comprehensive method to design and assess mixed reality simulations
Brunzini, A., Papetti, A., Messi, D., & Germani, M. (2022) · Virtual Reality · doi:10.1007/s10055-022-00632-8 · Cited by 46 · see citing works
Naik, R., Kogkas, A., Ashrafian, H., Mylonas, G. P., & Darzi, A. W. (2022) · Journal of Surgical Research · doi:10.1016/j.jss.2022.07.010 · Cited by 40 · see citing works
Objective Measures of Surgeon Non-Technical Skills in Surgery: A Scoping Review
Cha, J. S., & Yu, D. (2021) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720821995319 · Cited by 39 · see citing works
Burian, B. K., Harari, R. E., Robertson, J. M., Musson, D. M., Pozner, C. N., Doyle, T. E., Smink, D. S., Miccile, C., Paladugu, P., Atamna, B., et al. (2022) · Applied Ergonomics · doi:10.1016/j.apergo.2022.103902 · Cited by 39 · see citing works
Self-citationObjective Assessment of Cognitive Workload in Surgery
Almukhtar, A., Caddick, V., Naik, R., Goble, M., Mylonas, G. P., Darzi, A. W., Orihuela‐Espina, F., & Leff, D. R. (2024) · Annals of Surgery · doi:10.1097/sla.0000000000006370 · Cited by 42 · see citing works
Torkamani‐Azar, M., Lee, A., & Bednarik, R. (2022) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2022.3182869 · Cited by 38 · see citing works
Nguyen, J. H., Chen, J., Marshall, S. P., Ghodoussipour, S. B., Chen, A. W., Gill, I. S., & Hung, A. J. (2019) · World Journal of Urology · doi:10.1007/s00345-019-02881-w · Cited by 37 · see citing works
Cognitive Engineering to Improve Patient Safety and Outcomes in Cardiothoracic Surgery
Zenati, M. A., Kennedy-Metz, L. R., & DIAS, R. D. (2019) · Seminars in Thoracic and Cardiovascular Surgery · doi:10.1053/j.semtcvs.2019.10.011 · Cited by 37 · see citing works
Self-citationHead-Mounted Mixed-Reality Technology During Robotic-Assisted Transanal Total Mesorectal Excision
Huber, T., Hadzijusufoviç, E., Hansen, C., Paschold, M., Lang, H., & Kneist, W. (2019) · Diseases of the Colon & Rectum · doi:10.1097/dcr.0000000000001282 · Cited by 36 · see citing works
Hanway, P., Akehurst, L., Vernham, Z., & Hope, L. (2020) · Legal and Criminological Psychology · doi:10.1111/lcrp.12182 · Cited by 35 · see citing works
Artificial intelligence in cardiothoracic surgery
DIAS, R. D., Shah, J., & Zenati, M. A. (2020) · Minerva Cardioangiologica · doi:10.23736/s0026-4725.20.05235-4 · Cited by 35 · see citing works
Self-citationMeasurement and Management of Cognitive Load in Surgical Education: A Narrative Review
Tokuno, J., Carver, T. E., & Fried, G. M. (2022) · Journal of surgical education · doi:10.1016/j.jsurg.2022.10.001 · Cited by 34 · see citing works
First Reported Use of Team Cognitive Workload for Root Cause Analysis in Cardiac Surgery
Zenati, M. A., Leissner, K. B., Zorca, S. M., Kennedy-Metz, L. R., Yule, S., & DIAS, R. D. (2018) · Seminars in Thoracic and Cardiovascular Surgery · doi:10.1053/j.semtcvs.2018.12.003 · Cited by 34 · see citing works
Self-citationHigh density optical neuroimaging predicts surgeons’s subjective experience and skill levels
Keleş, H. O., Cengiz, C., Demiral, İ., Özmen, M. M., & Omurtag, A. (2021) · PLoS ONE · doi:10.1371/journal.pone.0247117 · Cited by 34 · see citing works
Factors associated with surgeon’s perception of distraction in the operating room
Jung, J. J., Elfassy, J., & Grantcharov, T. (2019) · Surgical Endoscopy · doi:10.1007/s00464-019-07088-z · Cited by 33 · see citing works
Cognitive task analysis and workload classification
Knisely, B. M., Joyner, J. S., & Vaughn-Cooke, M. (2021) · MethodsX · doi:10.1016/j.mex.2021.101235 · Cited by 33 · see citing works
Hsin, L., Chao, Y., Chuang, H., Kuo, T. B. J., Yang, C. C. H., Huang, C., Kang, C., Lin, W., Fang, T., Li, H., et al. (2022) · Virtual Reality · doi:10.1007/s10055-022-00688-6 · Cited by 32 · see citing works
Association Between Surgeon Stress and Major Surgical Complications
Awtry, J. A., Skinner, S. C., Polazzi, S., Lifante, J., Dey, T., Duclos, A., TopSurgeons Study Group, Badet, L., Bates, D. W., Bonin-Crepet, L., et al. (2025) · JAMA Surgery · doi:10.1001/jamasurg.2024.6072 · Cited by 32 · see citing works
Curtis, N. J., Conti, J., Dalton, R., Rockall, T., Allison, A. S., Ockrim, J. B., Jourdan, I. C., Torkington, J., Phillips, S. M., Allison, J., et al. (2019) · Surgical Endoscopy · doi:10.1007/s00464-018-06630-9 · Cited by 30 · see citing works
DIAS, R. D., Conboy, H. M., Gabany, J. M., Clarke, L. A., Osterwei, L. J., Avrunin, G. S., Arney, D. E., Goldman, J. M., Riccardi, G., Yule, S., et al. (2018) · IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA) · doi:10.1109/cogsima.2018.8423995 · Cited by 30 · see citing works
Self-citationHowie, E. E., Ambler, O., Gunn, E., DIAS, R. D., Wigmore, S. J., Skipworth, R. J. E., & Yule, S. (2024) · Annals of Surgery · doi:10.1097/sla.0000000000006211 · Cited by 29 · see citing works
Self-citationFavre-Félix, J., Dziadzko, M. A., Bauer, C., Duclos, A., Lehot, J.-J., Rimmele, T. R., & Lilot, M. (2022) · Türk anesteziyoloji ve reanimasyon derneği dergisi · doi:10.5152/tjar.2022.21234 · Cited by 25 · see citing works
Zamudio, J., Woodward, J., Kanji, F. F., Anger, J. T., Catchpole, K. C., & Cohen, T. (2023) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2023.06.010 · Cited by 26 · see citing works
Avellino, I., Nozari, S., Canlorbe, G., & Jansen, Y. (2021) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3449214 · Cited by 25 · see citing works
Kuo, L., Ngu, J. C., Lin, Y., Chen, C., & Tang, Y.-H. (2020) · Journal of Surgical Case Reports · doi:10.1093/jscr/rjaa005 · Cited by 23 · see citing works
Sensors for Continuous Monitoring of Surgeon’s Cognitive Workload in the Cardiac Operating Room
Kennedy-Metz, L. R., DIAS, R. D., Srey, R., Rance, G. C., Furlanello, C., & Zenati, M. A. (2020) · Sensors · doi:10.3390/s20226616 · Cited by 23 · see citing works
Self-citationWong, J. M. K., Moore, K. J., Lewis, P., Reid, M., Saul, K. R., & Carey, E. T. (2022) · Journal of Minimally Invasive Gynecology · doi:10.1016/j.jmig.2022.09.552 · Cited by 23 · see citing works
Ruberto, A. J., Rodenburg, D., Ross, K., Sarkar, P., Hungler, P. C., Etemad, A., Howes, D., Clarke, D., McLellan, J., Wilson, D., et al. (2021) · AEM Education and Training · doi:10.1002/aet2.10605 · Cited by 22 · see citing works
Combined Gaze Metrics as Stress-Sensitive Indicators of Microsurgical Proficiency
Koskinen, J., Bednarik, R., Vrzáková, H., & Elomaa, A.-P. (2020) · Surgical Innovation · doi:10.1177/1553350620942980 · Cited by 22 · see citing works
Shafiei, S. B., Elsayed, A. S., Hussein, A. A., Iqbal, U. H., & Guru, K. A. (2020) · IEEE Access · doi:10.1109/access.2020.3036751 · Cited by 21 · see citing works
Biosignals Monitoring of First Responders for Cognitive Load Estimation in Real-Time Operation
Gutiérrez, Á., Blanco-Hermo, P., Bejerano, V. R., Chatzigeorgiou, C., Oregui, X., Álvarez, M., Navarro, S., Feidakis, M., Azpiroz, I., Izquierdo, G., et al. (2023) · Applied Sciences · doi:10.3390/app13137368 · Cited by 21 · see citing works
Avrunin, G. S., Clarke, L. A., Conboy, H. M., Osterweil, L. J., DIAS, R. D., Yule, S., Goldman, J. M., & Zenati, M. A. (2018) · IEEE/ACM International Workshop on Software Engineering for Healthcare (SEH) · doi:10.1145/3194696.3194705 · Cited by 21 · see citing works
Self-citationMohan, A. T., Vyas, K. S., Asaad, M., & Khajuria, A. (2020) · Plastic & Reconstructive Surgery Global Open · doi:10.1097/gox.0000000000003064 · Cited by 20 · see citing works
Managing a team in the operating room: The science of teamwork and non-technical skills for surgeons
Sinyard, R. D., Rentas, C., Gunn, E., Etheridge, J. C., Robertson, J. M., Gleason, A. M., Riley, M. S., Yule, S., & Smink, D. S. (2022) · Current Problems in Surgery · doi:10.1016/j.cpsurg.2022.101172 · Cited by 20 · see citing works
Self-citationAnschuetz, L., Niederhauser, L., Wimmer, W., Yacoub, A., Weibel, D., Mast, F. W., & Caversaccio, M. D. (2019) · JAMA Otolaryngology–Head & Neck Surgery · doi:10.1001/jamaoto.2019.1765 · Cited by 20 · see citing works
A cognitive decomposition to empirically study human performance in control room environments
Knisely, B. M., Joyner, J. S., Rutkowski, A. M., Wong, M., Barksdale, S., Hotham, H., Kharod, K. C., & Vaughn-Cooke, M. (2020) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2020.102438 · Cited by 19 · see citing works
Analysis of Mirrored Psychophysiological Change of Cardiac Surgery Team Members During Open Surgery
Kennedy-Metz, L. R., DIAS, R. D., Stevens, R. H., Yule, S., & Zenati, M. A. (2020) · Journal of surgical education · doi:10.1016/j.jsurg.2020.08.012 · Cited by 19 · see citing works
Self-citationGomez, E., Husin, H. M., Dumon, K. R., Williams, N. N., & Kuchenbecker, K. J. (2024) · Surgical Endoscopy · doi:10.1007/s00464-024-11459-6 · Cited by 20 · see citing works
Keller, S., Yule, S., Smink, D. S., Zagarese, V., Safford, S. D., & Parker, S. H. (2020) · BMC Surgery · doi:10.1186/s12893-020-00937-y · Cited by 18 · see citing works
Self-citationSTUDY ON THE IMPACT OF COGNITIVE LOAD ON PERFORMANCE IN ENGINEERING DESIGN
Zimmerer, C., & Matthiesen, S. (2021) · Proceedings of the Design Society · doi:10.1017/pds.2021.537 · Cited by 22 · see citing works
Pilot Study Using Neurofeedback as a Tool to Reduce Surgical Resident Burnout
Kratzke, I. M., Campbell, A., Yefimov, M. N., Mosaly, P. R., Adapa, K., Meltzer-Brody, S. E., Farrell, T. M., & Mazur, L. M. (2020) · Journal of the American College of Surgeons · doi:10.1016/j.jamcollsurg.2020.08.762 · Cited by 18 · see citing works
Crew Autonomy During Simulated Medical Event Management on Long Duration Space Exploration Missions
Yule, S., Robertson, J. M., Mormann, B., Smink, D. S., Lipsitz, S. R., Abahuje, E. A. E., Kennedy-Metz, L. R., Park, S., Miccile, C., Pozner, C. N., et al. (2022) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/00187208211067575 · Cited by 17 · see citing works
Self-citationSimulated skill complexity and perceived cognitive load during preclinical dental training
Al‐Saud, L. M. (2022) · European Journal Of Dental Education · doi:10.1111/eje.12891 · Cited by 17 · see citing works
Gurung, P. M. S., Campbell, T., Wang, B., Joseph, J., & Ghazi, A. (2019) · World Journal of Urology · doi:10.1007/s00345-019-02858-9 · Cited by 17 · see citing works
Use of eye tracking in medical education
Specian, F. C., Litchfield, D., Sandars, J. E., & Cecílio‐Fernandes, D. (2024) · Medical Teacher · doi:10.1080/0142159x.2024.2316863 · Cited by 15 · see citing works
Chauhan, R., Ingersol, C. A., Wooden, W. A., Gordillo, G. M., Stefanidis, D., Hassanein, A. H., & Lester, M. E. (2022) · Journal of Reconstructive Microsurgery · doi:10.1055/a-2003-7425 · Cited by 15 · see citing works
Learning theories and principles in surgical education and technical learning
Tseng, J. (2020) · Journal of Surgical Oncology · doi:10.1002/jso.25936 · Cited by 15 · see citing works
DIAS, R. D., Conboy, H. M., Gabany, J. M., Clarke, L. A., Osterweil, L. J., Arney, D. E., Goldman, J. M., Riccardi, G., Avrunin, G. S., Yule, S., et al. (2018) · Lecture notes in computer science · doi:10.1007/978-3-030-01201-4_8 · Cited by 15 · see citing works
Self-citationImpact of surgical non-technical skills on clinical outcomes: systematic review
Norton, J., Janda, A. M., Howie, E. E., Pohl, N., Abahuje, E. A. E., Harrington, S. D., Popov, V., Bauer, T., Borges, P., Roca, G. Q., et al. (2025) · British journal of surgery · doi:10.1093/bjs/znaf271 · Cited by 14 · see citing works
Self-citationCognitive Ergonomics: A Review of Interventions for Outpatient Practice
Li-Wang, J., Townsley, A., & Katta, R. (2023) · Cureus · doi:10.7759/cureus.44258 · Cited by 14 · see citing works
Dynamic Cognitive Load Assessment in Virtual Reality
Elkin, R. L., Beaubien, J., Damaghi, N., Chang, T. P., & Kessler, D. O. (2024) · Simulation & Gaming · doi:10.1177/10468781241248821 · Cited by 14 · see citing works
Cognitive Load Assessment Scales in Simulation
Greer, S. K., Jeffe, D. B., Manga, A., Murray, D. J., & Emke, A. R. (2022) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000665 · Cited by 14 · see citing works
Roberts, S. I., Cen, S., Nguyen, J. H., Perez, L. C., Medina, L. G., Ma, R., Marshall, S. P., Kocielnik, R., Anandkumar, A., & Hung, A. J. (2021) · Journal of Endourology · doi:10.1089/end.2021.0790 · Cited by 13 · see citing works
Association Between Operating Room Noise and Team Cognitive Workload in Cardiac Surgery
Kennedy-Metz, L. R., Arshanskiy, M., Keller, S., Arney, D. E., DIAS, R. D., & Zenati, M. A. (2022) · IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA) · doi:10.1109/cogsima54611.2022.9830675 · Cited by 13 · see citing works
Self-citationPanwar, K. S., Huish, E. G., Law, J. L., Deans, J. T., Staples, J. R., Eisemon, E. O., & Lum, Z. C. (2024) · The Journal of Arthroplasty · doi:10.1016/j.arth.2024.01.002 · Cited by 13 · see citing works
Shafiei, S. B., Shadpour, S., & Shafqat, A. (2024) · Brain Research Bulletin · doi:10.1016/j.brainresbull.2024.110992 · Cited by 13 · see citing works
Howie, E. E., Harari, R., DIAS, R. D., Wigmore, S. J., Skipworth, R. J. E., & Yule, S. (2024) · Journal of Surgical Research · doi:10.1016/j.jss.2024.07.009 · Cited by 13 · see citing works
Self-citationSchmidt, F. A., Hussain, I., Boadi, B. I., Sommer, F. J., Thomé, C., & Härtl, R. (2024) · Operative Neurosurgery · doi:10.1227/ons.0000000000001317 · Cited by 13 · see citing works
Factors Predicting Operative Difficulty of Laparoscopic Total Mesorectal Excision
Curtis, N. J., Thomas, C., Dennison, G., Ockrim, J. B., Conti, J. A., Dalton, R., Allison, A. S., & Francis, N. K. (2019) · Diseases of the Colon & Rectum · doi:10.1097/dcr.0000000000001490 · Cited by 13 · see citing works
Operative teaching takes “GUTS”: Impact of Educational Time Out on trainee's cognitive load
Han, A., Naples, R. F., French, J. C., Dragomirescu, C., Tu, C., & Lipman, J. M. (2022) · The American Journal of Surgery · doi:10.1016/j.amjsurg.2022.03.037 · Cited by 12 · see citing works
Amirthanayagam, A., Zecca, M., Barber, S. R., Singh, B., & Moss, E. L. (2023) · BMJ Open · doi:10.1136/bmjopen-2022-066765 · Cited by 12 · see citing works
Pupil Response in Visual Tracking Tasks: The Impacts of Task Load, Familiarity, and Gaze Position
Wu, Y., Zhang, Z., Zhang, Y., Zheng, B., & Aghazadeh, F. (2024) · Sensors · doi:10.3390/s24082545 · Cited by 12 · see citing works
Filetti, M., Anselmi, E., Macrini, S., Rizzo, F., Iacono, D., Giusti, R., & Marchetti, P. (2018) · Seminars in Arthritis and Rheumatism · doi:10.1016/j.semarthrit.2017.12.013 · Cited by 12 · see citing works
A neurotechnological aid for semi-autonomous suction in robotic-assisted surgery
Barragan, J. A., Yang, J., Yu, D., & Wachs, J. P. (2022) · Scientific Reports · doi:10.1038/s41598-022-08063-w · Cited by 11 · see citing works
Augmented Cognition in the Operating Room
DIAS, R. D., Yule, S., & Zenati, M. A. (2020) · Springer eBooks · doi:10.1007/978-3-030-49100-0_19 · Cited by 11 · see citing works
Self-citationShafiei, S. B., Shadpour, S., Sasangohar, F., Mohler, J. L., Attwood, K. M., & Jing, Z. (2024) · npj Science of Learning · doi:10.1038/s41539-024-00216-y · Cited by 10 · see citing works
Négyesi, J., Négyesi, P., Hortobágyi, T., Sun, S., Kusuyama, J., Kiss, R. M., & Nagatomi, R. (2022) · Scientific Reports · doi:10.1038/s41598-022-21962-2 · Cited by 10 · see citing works
Keunecke, J. G., Gall, C. M., Birkholz, T., Moritz, A., Eiche, C., & Prottengeier, J. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4638-4 · Cited by 10 · see citing works
Kataife, E. D., Said, S., Braun, J., Roche, T. R., Rössler, J., Kaserer, A., Spahn, D. R., Mileo, F. G., & Tscholl, D. W. (2020) · Anaesthesia · doi:10.1111/anae.15314 · Cited by 9 · see citing works
Roitsch, C. M., Hagan, J. L., Patricia, K. E., Jain, S., Chen, X., Arnold, J. L., Devaraj, S., & Sundgren, N. C. (2020) · Simulation in Healthcare The Journal of the Society for Simulation in Healthcare · doi:10.1097/sih.0000000000000475 · Cited by 9 · see citing works
Park, S. H., Goldberg, S. A., Al-Ballaa, A., Tayeb, B. O., Basurrah, M. A., Abahuje, E. A. E., Miccile, C., Pozner, C. N., Yule, S., & DIAS, R. D. (2022) · Journal of Surgical Research · doi:10.1016/j.jss.2022.06.023 · Cited by 9 · see citing works
Self-citationZhang, J., Hua, Y., Gu, J., Chen, Y., & Yin, Z. (2022) · Chinese Control Conference (CCC) · doi:10.23919/ccc55666.2022.9902053 · Cited by 9 · see citing works
Training and proficiency level in endoscopic sinus surgery change residents’ eye movements
Niederhauser, L., Gunser, S., Waser, M., Mast, F. W., Caversaccio, M. D., & Anschuetz, L. (2023) · Scientific Reports · doi:10.1038/s41598-022-25518-2 · Cited by 9 · see citing works
Haney, C. M., Kowalewski, K., Schmidt, M. W., Lang, F., Bintintan, V. V., Fan, C., Wehrtmann, F. S., Studier‐Fischer, A., Felińska, E. A., Müller-Stich, B. P., et al. (2023) · Surgical Endoscopy · doi:10.1007/s00464-023-10044-7 · Cited by 9 · see citing works
Learning Intracorporeal Suture on Pelvitrainer Using a Robotized Versus Conventional Needle Holder
Siri, E., Crochet, P., Charavil, A., Netter, A., Resseguier, N., & Agostini, A. (2020) · Journal of Surgical Research · doi:10.1016/j.jss.2020.01.016 · Cited by 9 · see citing works
Tendencias y características de la realidad virtual
Vásquez‐Carbonell, M., & Ortega, J. I. S. (2020) · Computer and Electronic Sciences Theory and Applications · doi:10.17981/cesta.01.01.2020.04 · Cited by 9 · see citing works
Postprocedural Cognitive Load Measurement With Immediate Feedback to Guide Curriculum Development
Huckaby, L. V., Cyr, A. R., Handzel, R. M., Littleton, E. B., Crist, L. R., Luketich, J. D., Lee, K. K. W., & Dhupar, R. (2021) · The Annals of Thoracic Surgery · doi:10.1016/j.athoracsur.2021.05.086 · Cited by 9 · see citing works
Richardson, K., Huber, J. E., Kiefer, B., & Snyder, S. (2022) · American Journal of Speech-Language Pathology · doi:10.1044/2022_ajslp-22-00026 · Cited by 9 · see citing works
Granular estimation of user cognitive workload using multi-modal physiological sensors
Wang, J., Stevens, C., Bennett, W. R., & Yu, D. (2024) · Frontiers in Neuroergonomics · doi:10.3389/fnrgo.2024.1292627 · Cited by 8 · see citing works
DIAS, R. D., Kennedy-Metz, L. R., Srey, R., Rance, G. C., Harari, R. E., Arney, D. E., Gombolay, M., & Zenati, M. A. (2023) · Lecture notes in computer science · doi:10.1007/978-3-031-34953-9_35 · Cited by 8 · see citing works
Self-citationOsztrogonacz, P. J., Chinnadurai, P., & Lumsden, A. B. (2023) · Methodist DeBakey Cardiovascular Journal · doi:10.14797/mdcvj.1263 · Cited by 8 · see citing works
Kennedy-Metz, L. R., DIAS, R. D., Srey, R., Rance, G. C., Conboy, H. M., Haime, M. E., Quin, J. A., Yule, S., & Zenati, M. A. (2020) · Human Factors The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720820976297 · Cited by 8 · see citing works
Self-citationKelkar, A. S., Kelkar, J. A., Chougule, Y., Bolisetty, M., & Singhvi, P. (2021) · European Journal of Ophthalmology · doi:10.1177/11206721211062034 · Cited by 8 · see citing works
Rajaratnam, V., Ng, H. J. H., Rahman, N. A., & Dong, C. (2022) · ANZ Journal of Surgery · doi:10.1111/ans.17772 · Cited by 8 · see citing works
Nabeel, A., Al-Sabah, S. K., AlGhanim, K., Al-Roumi, D., Al-Basri, D., Ziyab, A. H., & Ashrafian, H. (2024) · International Journal of Surgery · doi:10.1097/js9.0000000000001958 · Cited by 7 · see citing works
Real-time cognitive workload assessment using non-intrusive methods: a systematic review
Basnet, N., & Zahabi, M. (2025) · Ergonomics · doi:10.1080/00140139.2025.2606779 · Cited by 7 · see citing works
- Authors
- Dias, R. D., Ngo-Howard, M. C., Boskovski, M. T., Zenati, M. A., & Yule, S. J.
- Affiliations
- Brigham and Women's Hospital (US)
- Boston University (US)
- Harvard University (US)
- Corresponding author
- Yule, S J
- Venue
- British Journal of Surgery
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-02-21
- Volume
- 105
- Issue
- 5
- Pages
- 491-501
- ISSN
- 0007-1323 (ISSN-L)
- 1365-2168
- PMC
- PMC5878696
- OpenAlex
- W2793138952
- Cited by
- 273
- References
- 121
- Citations by year
- 2026: 59 · 2025: 39 · 2024: 35 · 2023: 34 · 2022: 31 · 2021: 20 · 2020: 33 · 2019: 14 · 2018: 7
- FWCI
- 4.12
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- British journal of surgery (publishedVersion)
- Europe PMC (PubMed Central) (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Iris (University of Trento) (submittedVersion)
- Funders
- National Heart, Lung, and Blood Institute (R01HL126896-01A)
- Topics
- Health Sciences › Medicine › Surgery › Surgical Simulation and Training
- Social Sciences › Psychology › Social Psychology › Human-Automation Interaction and Safety
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Keywords
- mental workload, surgeons, NASA-TLX, heart rate variability, self-report measures, real-time physiological monitoring, surgical simulation, learning curve, surgical training, reliability and validity
- MeSH terms
- Clinical Competence, Cognition, Humans, Workload, Self Report, Surgeons
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review