Chart reviews in emergency medicine research: Where are the methods?
Abstract
Study objective Medical chart reviews are often used in emergency medicine research. However, the reliability of data abstracted by chart reviews is seldom examined critically. The objective of this investigation was to determine the proportion of emergency medicine research articles that use data from chart reviews and the proportions that report methods of case selection, abstractor training, monitoring and blinding, and interrater agreement. Methods Research articles published in three emergency medicine journals from January 1989 through December 1993 were identified. The articles that used chart reviews were analyzed. Results Of 986 original research articles that were identified, 244 (25%; 95% confidence interval [CI], 22% to 28%) relied on chart reviews. Inclusion criteria were described in 98% (95% CI, 96% to 99%), and 73% (95% CI, 67% to 79%) defined the variables being analyzed. Other methods were seldom mentioned: abstractor training, 18% (95% CI, 13% to 23%); standardized abstraction forms, 11% (95% CI, 7% to 15%); periodic abstractor monitoring, 4% (95% CI, 2% to 7%); and abstractor blinding to study hypotheses, 3% (95% CI, 1% to 6%). Interrater reliability was mentioned in 5% (95% CI, 3% to 9%) and tested statistically in .4% (95% CI, 0% to 2%). A 15% random sample of articles was reassessed by a second investigator; interrater agreement was high for all eight criteria. Conclusion Chart review is a common method of data collection in emergency medicine research.…
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Retrospective chart review methods have utility in identifying issues for further study, particularly when chart review protocols are standardized.
“Despite limitations inherent in retrospective chart review methods, their utility in identifying issues for further study has been noted, particularly when chart review protocols are standardized (Gilbert, Lowenstein, Koziol-McLain, Barta, & Steiner, 1996).”
From Drug-facilitated sexual assault, impaired trauma memory, and implications for mental health treatment (2022) · cites this paper as Gilbert, Lowenstein, Koziol-McLain, Barta, & Steiner, 1996
Cites
High agreement but low Kappa: I. the problems of two paradoxes
Feinstein, A. R., & Cicchetti, D. V. (1990) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(90)90158-l · Cited by 3,034 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Gaieski, D. F., Mikkelsen, M. E., Band, R. A., Pines, J. M., Massone, R., Furia, F. F., Shofer, F. S., & Goyal, M. (2010) · Critical Care Medicine · doi:10.1097/ccm.0b013e3181cc4824 · Cited by 970 · see citing works
The impact of adverse childhood experiences on an urban pediatric population
Burke, N. J., Hellman, J. L., Scott, B. G., Weems, C. F., & Carrion, V. G. (2011) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2011.02.006 · Cited by 594 · see citing works
Optimizing Emergency Department Front-End Operations
Wiler, J. L., Gentle, C., Halfpenny, J. M., Heins, A., Mehrotra, A., Mikhail, M. G., & Fite, D. (2010) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2009.05.021 · Cited by 339 · see citing works
Firearm Violence Among High-Risk Emergency Department Youth After an Assault Injury
Carter, P. M., Walton, M. A., Roehler, D. R., Goldstick, J., Zimmerman, M. A., Blow, F. C., & Cunningham, R. M. (2015) · Pediatrics · doi:10.1542/peds.2014-3572 · Cited by 174 · see citing works
Moore, C. L., Bomann, S., Daniels, B., Luty, S., Molinaro, A., Singh, D., & Gross, C. P. (2014) · BMJ · doi:10.1136/bmj.g2191 · Cited by 157 · see citing works
External validation of the San Francisco Syncope Rule in the Canadian setting
Thiruganasambandamoorthy, V., Hess, E. P., Alreesi, A., Perry, J. J., Wells, G. A., & Stiell, I. G. (2010) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2009.10.001 · Cited by 88 · see citing works
Parissis, J. T., Rafouli-Stergiou, P., Mebazaa, A., Ikonomidis, I., Bistola, V., Nikolaou, M., Meas, T., Delgado, J., Vilas-Boas, F., Paraskevaidis, I., et al. (2012) · International Journal of Cardiology · doi:10.1016/j.ijcard.2011.11.098 · Cited by 58 · see citing works
Outcomes in Canadian Emergency Department Syncope Patients – Are We Doing a Good Job?
Thiruganasambandamoorthy, V., Hess, E. P., Turko, E., Perry, J. J., Wells, G. A., & Stiell, I. G. (2013) · The Journal of Emergency Medicine · doi:10.1016/j.jemermed.2012.06.028 · Cited by 53 · see citing works
Scheuermeyer, F. X., Mackay, M., Christenson, J., Grafstein, E., Pourvali, R., Heslop, C., MacPhee, J., Ward, J., Heilbron, B., McGrath, L., et al. (2015) · Academic Emergency Medicine · doi:10.1111/acem.12750 · Cited by 48 · see citing works
Application of San Francisco Syncope Rule in elderly ED patients
Schladenhaufen, R., Feilinger, S., Pollack, M., Benenson, R., & Kusmiesz, A. L. (2008) · The American Journal of Emergency Medicine · doi:10.1016/j.ajem.2007.10.042 · Cited by 45 · see citing works
Cavicchiolo, M. E., Lanzoni, P., Wingi, M. O., Pizzol, D., Daverio, M., Da Dalt, L., Putoto, G., & Trevisanuto, D. (2016) · BMC Pregnancy and Childbirth · doi:10.1186/s12884-016-1170-y · Cited by 34 · see citing works
Dating Violence Among Male and Female Youth Seeking Emergency Department Care
Singh, V., Walton, M. A., Whiteside, L. K., Stoddard, S., Epstein-Ngo, Q., Chermack, S. T., & Cunningham, R. M. (2014) · Annals of Emergency Medicine · doi:10.1016/j.annemergmed.2014.05.027 · Cited by 23 · see citing works
Fields, L., Young, D. A., Patel, A. R., Munroe, C., Shumway, M., Bell, S., & Richer, L. A. (2022) · European Journal of Psychotraumatology · doi:10.1080/20008198.2022.2057165 · Cited by 22 · see citing works
Fu, S., Vassilaki, M., Ibrahim, O. A., Petersen, R. C., Pagali, S., St Sauver, J., Moon, S., Wang, L., Fan, J. W., Liu, H., et al. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.958539 · Cited by 15 · see citing works
Maddry, J. K., Sessions, D., Heard, K., Lappan, C., McManus, J., & Bebarta, V. S. (2014) · Journal of Medical Toxicology · doi:10.1007/s13181-014-0398-z · Cited by 16 · see citing works
- Authors
- Gilbert, E. H., Lowenstein, S. R., Koziol-McLain, J., Barta, D. C., & Steiner, J.
- Venue
- Annals of Emergency Medicine
- Publisher
- Elsevier BV
- Published
- 1996-03
- Volume
- 27
- Issue
- 3
- Pages
- 305-308
- ISSN
- 0196-0644
- Cited by
- 895
- References
- 1
- Language
- en
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review