The DOI matches its Crossref record.
Quality of evidence
Open accessAbstract
Verbeek and his co-authors (1) recently indicated that rapid searches of biomedical databases can provide useful support for clinical decisions in occupational health. Subsequent correspondence considered the complementary roles of evidence-based approaches and the traditional clinical craft skills based on experience and intuition (2, 3). While I would support both contentions in principle, I feel that further exploration is also needed to assess “fitness for purpose” when evidence-based techniques are used to underpin important clinical case management and policy decisions. The key issues to be addressed are “What is the real time taken from framing a question to providing an evidence-based appraisal (there is more to this than just the time to search a database)?”, “What quality and depth of appraisal is ‘fit for purpose’ in various situations faced by occupational health practitioners?”, and “How much of the relevant information is indexed with abstracts on the main biomedical databases?” I would contrast the approximately 25 hours spent and 1 month of elapsed time that it took me to prepare written appraisals on a series of policy topics (4) against the 30 minutes of search and elapsed time of Verbeek et al (1) to find supporting information for clinical decision making. I would also question the adequacy of a single round of searching and assessment based solely on available abstracts as distinct from search, collection and appraisal of full papers, supplemented by the study of selected material referenced in the first round of papers obtained. I agree that some incremental improvements in clinical decision making can follow a quick scan of abstracts. I would, however, be seriously concerned about the very real limitations of this approach in an area such as occupational health, where decisions are liable to be subjected to regulatory or legal challenge, as well as sometimes leading to actions that can be costly in both personal and financial terms. I would also worry if such limited searches are indexed as critical appraisals and used by others in contexts other than that in which the question was originally posed, especially if the authority of a source such as the International Commission on Occupational Health was then cited in defense of the subsequent decision. All this may seem rather negative, but, if a sound evidence base is to be secured to improve the current, rather limited validity of decision making in occupational health, we need a well-developed approach to its quality. This approach will need to take account of the particular social and political framework for occupational health practice when compared with other facets of the health care system. The teaching of evidence-based approaches and practice with their use should now form a normal part of courses in occupational health practice. It can be fun, and one of the important spin-offs is a valuable skepticism about the foundations of much current practice, within which lie the seeds for a better evidence base in the future. A consensus at an international level is desirable; let’s see if one can be achieved!
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
GRADE: an emerging consensus on rating quality of evidence and strength of recommendations
Guyatt, G. H., Oxman, A. D., Vist, G. E., Kunz, R., Falck-Ytter, Y., Alonso-Coello, P., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39489.470347.ad · Cited by 23,305
GRADE guidelines: 3. Rating the quality of evidence
Balshem, H., Helfand, M., Schünemann, H. J., Oxman, A. D., Kunz, R., Brozek, J., Vist, G. E., Falck-Ytter, Y., Meerpohl, J., & Norris, S. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.07.015 · Cited by 8,285
Barr, J., Fraser, G. L., Puntillo, K., Ely, E. W., Gélinas, C., Dasta, J. F., Davidson, J. E., Devlin, J. W., Kress, J. P., Joffe, A. M., et al. (2013) · Critical Care Medicine · doi:10.1097/ccm.0b013e3182783b72 · Cited by 3,765
What is ‘quality of evidence’ and why is it important to clinicians?
Guyatt, G. H., Oxman, A. D., Kunz, R., Vist, G. E., Falck-Ytter, Y., & Schünemann, H. J. (2008) · BMJ · doi:10.1136/bmj.39490.551019.be · Cited by 3,250
GRADE guidelines: a new series of articles in the Journal of Clinical Epidemiology
Guyatt, G. H., Oxman, A. D., Schünemann, H. J., Tugwell, P., & Knottnerus, A. (2011) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.09.011 · Cited by 3,094
Hochberg, M. C., Altman, R. D., April, K. T., Benkhalti, M., Guyatt, G., McGowan, J., Towheed, T., Welch, V., Wells, G., & Tugwell, P. (2012) · Arthritis Care & Research · doi:10.1002/acr.21596 · Cited by 3,068
Clinical Practice Guidelines We Can Trust
Committee on Standards for Developing Trustworthy Clinical Practice Guidelines, Board on Health Care Services, & Institute of Medicine (2011) · National Academies Press eBooks · doi:10.17226/13058 · Cited by 3,081
Stevens, D. L., Bisno, A. L., Chambers, H. F., Dellinger, E. P., Goldstein, E. J. C., Gorbach, S. L., Hirschmann, J. V., Kaplan, S. L., Montoya, J. G., & Wade, J. C. (2014) · Clinical Infectious Diseases · doi:10.1093/cid/ciu296 · Cited by 2,780
Prevention of VTE in Nonorthopedic Surgical Patients
Gould, M. K., Garcia, D. A., Wren, S. M., Karanicolas, P. J., Arcelus, J. I., Heit, J. A., & Samama, C. M. (2012) · Chest · doi:10.1378/chest.11-2297 · Cited by 2,131
Allergic Rhinitis and its Impact on Asthma (ARIA) guidelines: 2010 Revision
Brożek, J. L., Bousquet, J., Baena-Cagnani, C. E., Bonini, S., Canonica, G. W., Casale, T. B., van Wijk, R. G., Ohta, K., Zuberbier, T., & Schünemann, H. J. (2010) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2010.06.047 · Cited by 1,813
The Pediatric Guidelines Sub-Committee for the World Society of the Abdominal Compartment Syndrome, Kirkpatrick, A. W., Roberts, D. J., De Waele, J., Jaeschke, R., Malbrain, M. L. N. G., De Keulenaer, B., Duchesne, J., Bjorck, M., Leppaniemi, A., et al. (2013) · Intensive Care Medicine · doi:10.1007/s00134-013-2906-z · Cited by 1,624
Alhazzani, W., Møller, M. H., Arabi, Y. M., Loeb, M., Gong, M. N., Fan, E., Oczkowski, S., Levy, M. M., Derde, L., Dzierba, A., et al. (2020) · Critical Care Medicine · doi:10.1097/ccm.0000000000004363 · Cited by 1,565
Callaway, C. W., Soar, J., Aibiki, M., Böttiger, B. W., Brooks, S. C., Deakin, C. D., Donnino, M. W., Drajer, S., Kloeck, W., Morley, P. T., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000273 · Cited by 1,390
Caraceni, A., Hanks, G., Kaasa, S., Bennett, M. I., Brunelli, C., Cherny, N., Dale, O., De Conno, F., Fallon, M., Hanna, M., et al. (2012) · The Lancet Oncology · doi:10.1016/s1470-2045(12)70040-2 · Cited by 1,243
WHO guidelines for the programmatic management of drug-resistant tuberculosis: 2011 update
Falzon, D., Jaramillo, E., Schünemann, H. J., Arentz, M., Bauer, M., Bayona, J., Blanc, L., Caminero, J. A., Daley, C. L., Duncombe, C., et al. (2011) · European Respiratory Journal · doi:10.1183/09031936.00073611 · Cited by 1,100
Shulman, S. T., Bisno, A. L., Clegg, H. W., Gerber, M. A., Kaplan, E. L., Lee, G., Martin, J. M., & Van Beneden, C. (2012) · Clinical Infectious Diseases · doi:10.1093/cid/cis629 · Cited by 1,092
Stevens, D. L., Bisno, A. L., Chambers, H. F., Dellinger, E. P., Goldstein, E. J. C., Gorbach, S. L., Hirschmann, J. V., Kaplan, S. L., Montoya, J. G., & Wade, J. C. (2014) · Clinical Infectious Diseases · doi:10.1093/cid/ciu444 · Cited by 988
The speed-accuracy tradeoff: history, physiology, methodology, and behavior
Heitz, R. P. (2014) · Frontiers in Neuroscience · doi:10.3389/fnins.2014.00150 · Cited by 938
Thangaratinam, S., Rogozinska, E., Jolly, K., Glinkowski, S., Roseboom, T., Tomlinson, J. W., Kunz, R., Mol, B. W., Coomarasamy, A., & Khan, K. S. (2012) · BMJ · doi:10.1136/bmj.e2088 · Cited by 802
Kidney Disease: Improving Global Outcomes
Eckardt, K.-U., & Kasiske, B. L. (2009) · Nature Reviews Nephrology · doi:10.1038/nrneph.2009.153 · Cited by 740
Fast track surgery versus conventional recovery strategies for colorectal surgery
Spanjersberg, W. R., Reurings, J., Keus, F., & van Laarhoven, C. J. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007635.pub2 · Cited by 735
van Rheenen, P. F., Van de Vijver, E., & Fidler, V. (2010) · BMJ · doi:10.1136/bmj.c3369 · Cited by 714
Perlman, J. M., Wyllie, J., Kattwinkel, J., Wyckoff, M. H., Aziz, K., Guinsburg, R., Kim, H.-S., Liley, H. G., Mildenhall, L., Simon, W. M., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000276 · Cited by 697
Amsterdam, E. A., Kirk, J. D., Bluemke, D. A., Diercks, D., Farkouh, M. E., Garvey, J. L., Kontos, M. C., McCord, J., Miller, T. D., Morise, A., et al. (2010) · Circulation · doi:10.1161/cir.0b013e3181ec61df · Cited by 609
Watanabe, T., Itabashi, M., Shimada, Y., Tanaka, S., Ito, Y., Ajioka, Y., Hamaguchi, T., Hyodo, I., Igarashi, M., Ishida, H., et al. (2015) · International Journal of Clinical Oncology · doi:10.1007/s10147-015-0801-z · Cited by 590
Paravertebral block versus thoracic epidural for patients undergoing thoracotomy
Yeung, J. H., Gates, S., Naidu, B. V., Wilson, M. J., & Gao Smith, F. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009121.pub2 · Cited by 573
Nilsen, E. S., Myrhaug, H. T., Johansen, M., Oliver, S., & Oxman, A. D. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004563.pub2 · Cited by 565
Shulman, S. T., Bisno, A. L., Clegg, H. W., Gerber, M. A., Kaplan, E. L., Lee, G., Martin, J. M., & Van Beneden, C. (2012) · Clinical Infectious Diseases · doi:10.1093/cid/cis847 · Cited by 530
Owens, D. K., Lohr, K. N., Atkins, D., Treadwell, J. R., Reston, J. T., Bass, E. B., Chang, S., & Helfand, M. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.03.009 · Cited by 513
Chow, A. W., Benninger, M. S., Brook, I., Brozek, J. L., Goldstein, E. J. C., Hicks, L. A., Pankey, G. A., Seleznick, M., Volturo, G., Wald, E. R., et al. (2012) · Clinical Infectious Diseases · doi:10.1093/cid/cir1043 · Cited by 501
Aberg, J. A., Gallant, J. E., Ghanem, K. G., Emmanuel, P., Zingman, B. S., & Horberg, M. A. (2014) · Clinical Infectious Diseases · doi:10.1093/cid/cit665 · Cited by 496
Brown, C. E., Wickline, M. A., Ecoff, L., & Glaser, D. (2009) · Journal of Advanced Nursing · doi:10.1111/j.1365-2648.2008.04878.x · Cited by 470
Interventional management of neuropathic pain: NeuPSIG recommendations
Dworkin, R. H., O’Connor, A. B., Kent, J., Mackey, S. C., Raja, S. N., Stacey, B. R., Levy, R. M., Backonja, M., Baron, R., Harke, H., et al. (2013) · Pain · doi:10.1016/j.pain.2013.06.004 · Cited by 457
Holst, L. B., Petersen, M. W., Haase, N., Perner, A., & Wetterslev, J. (2015) · BMJ · doi:10.1136/bmj.h1354 · Cited by 426
Price, L. C., Wort, S. J., Finney, S. J., Marino, P. S., & Brett, S. J. (2010) · Critical Care · doi:10.1186/cc9264 · Cited by 389
Is Diabetes Mellitus an Independent Risk Factor for Colon Cancer and Rectal Cancer?
Yuhara, H., Steinmaus, C., Cohen, S. E., Corley, D. A., Tei, Y., & Buffler, P. A. (2011) · American Journal of Gastroenterology · doi:10.1038/ajg.2011.301 · Cited by 377
Recommendations on screening for breast cancer in average-risk women aged 40-74 years
The Canadian Task Force on Preventive Health Care (2011) · Canadian Medical Association Journal · doi:10.1503/cmaj.110334 · Cited by 348
Travers, A. H., Perkins, G. D., Berg, R. A., Castren, M., Considine, J., Escalante, R., Gazmuri, R. J., Koster, R. W., Lim, S. H., Nation, K. J., et al. (2015) · Circulation · doi:10.1161/cir.0000000000000272 · Cited by 342
Screening for prostate cancer: systematic review and meta-analysis of randomised controlled trials
Djulbegovic, M., Beyth, R. J., Neuberger, M. M., Stoffs, T. L., Vieweg, J., Djulbegovic, B., & Dahm, P. (2010) · BMJ · doi:10.1136/bmj.c4543 · Cited by 337
Blackwood, B., Alderdice, F., Burns, K., Cardwell, C., Lavery, G., & O'Halloran, P. (2011) · BMJ · doi:10.1136/bmj.c7237 · Cited by 336
Benefits and harms of adhesion barriers for abdominal surgery: a systematic review and meta-analysis
ten Broek, R. P. G., Stommel, M. W. J., Strik, C., van Laarhoven, C. J. H. M., Keus, F., & van Goor, H. (2014) · The Lancet · doi:10.1016/s0140-6736(13)61687-6 · Cited by 335
Micronutrient fortification of food and its impact on woman and child health: a systematic review
Das, J. K., Salam, R. A., Kumar, R., & Bhutta, Z. A. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-67 · Cited by 328
Nutritional supplementation for stable chronic obstructive pulmonary disease
Ferreira, I. M., Brooks, D., White, J., & Goldstein, R. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000998.pub3 · Cited by 326
Antenatal dietary education and supplementation to increase energy and protein intake
Ota, E., Hori, H., Mori, R., Tobe-Gai, R., & Farrar, D. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000032.pub3 · Cited by 320
Evidence‐based practice guidelines for plasma transfusion
Roback, J. D., Caldwell, S., Carson, J., Davenport, R., Drew, M. J., Eder, A., Fung, M., Hamilton, M., Hess, J. R., Luban, N., et al. (2010) · Transfusion · doi:10.1111/j.1537-2995.2010.02632.x · Cited by 316
Braces and orthoses for treating osteoarthritis of the knee
Duivenvoorden, T., Brouwer, R. W., van Raaij, T. M., Verhagen, A. P., Verhaar, J. A., & Bierma-Zeinstra, S. M. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004020.pub3 · Cited by 314
Lucas, G. M., Ross, M. J., Stock, P. G., Shlipak, M. G., Wyatt, C. M., Gupta, S. K., Atta, M. G., Wools-Kaloustian, K. K., Pham, P. A., Bruggeman, L. A., et al. (2014) · Clinical Infectious Diseases · doi:10.1093/cid/ciu617 · Cited by 310
Dignan, F. L., Wynn, R. F., Hadzic, N., Karani, J., Quaglia, A., Pagliuca, A., Veys, P., & Potter, M. N. (2013) · British Journal of Haematology · doi:10.1111/bjh.12558 · Cited by 295
Patel, A., Laffan, M. A., Waheed, U., & Brett, S. J. (2014) · BMJ · doi:10.1136/bmj.g4561 · Cited by 291
SUPPORT Tools for evidence-informed health Policymaking (STP)
Lavis, J. N., Oxman, A. D., Lewin, S., & Fretheim, A. (2009) · Health Research Policy and Systems · doi:10.1186/1478-4505-7-s1-i1 · Cited by 286
Artemisinin-based combination therapy for treating uncomplicated malaria
Sinclair, D., Zani, B., Donegan, S., Olliaro, P., & Garner, P. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd007483.pub2 · Cited by 286
Assessing and presenting summaries of evidence in Cochrane Reviews
Langendam, M. W., Akl, E. A., Dahm, P., Glasziou, P., Guyatt, G., & Schünemann, H. J. (2013) · Systematic Reviews · doi:10.1186/2046-4053-2-81 · Cited by 282
Grading the strength of a body of evidence when assessing health care interventions: an EPC update
Berkman, N. D., Lohr, K. N., Ansari, M. T., Balk, E. M., Kane, R., McDonagh, M., Morton, S. C., Viswanathan, M., Bass, E. B., Butler, M., et al. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.11.023 · Cited by 279
Aberg, J. A., Gallant, J. E., Ghanem, K. G., Emmanuel, P., Zingman, B. S., & Horberg, M. A. (2014) · Clinical Infectious Diseases · doi:10.1093/cid/cit757 · Cited by 268
The GRADE approach and Bradford Hill's criteria for causation
Schünemann, H., Hill, S., Guyatt, G., Akl, E. A., & Ahmed, F. (2011) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2010.119933 · Cited by 262
Diagnosis and Rationale for Action against Cow's Milk Allergy (DRACMA): A summary report
Fiocchi, A., Schünemann, H. J., Brozek, J., Restani, P., Beyer, K., Troncone, R., Martelli, A., Terracciano, L., Bahna, S. L., Rancé, F., et al. (2010) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2010.10.011 · Cited by 259
The ketamine effect on ICP in traumatic brain injury
Zeiler, F. A., Teitelbaum, J., West, M., & Gillman, L. M. (2014) · Neurocritical Care · doi:10.1007/s12028-013-9950-y · Cited by 257
Tannenbaum, C., Paquette, A., Hilmer, S., Holroyd-Leduc, J., & Carnahan, R. (2012) · Drugs & Aging · doi:10.1007/bf03262280 · Cited by 241
Du, S., Yuan, C., Xiao, X., Chu, J., Qiu, Y., & Qian, H. (2011) · Patient Education and Counseling · doi:10.1016/j.pec.2011.02.021 · Cited by 220
Jensen, J. F., Thomsen, T., Overgaard, D., Bestle, M. H., Christensen, D., & Egerod, I. (2015) · Intensive Care Medicine · doi:10.1007/s00134-015-3689-1 · Cited by 185
Uhlig, K., Leff, B., Kent, D., Dy, S., Brunnhuber, K., Burgers, J. S., Greenfield, S., Guyatt, G., High, K., Leipzig, R., et al. (2014) · Journal of General Internal Medicine · doi:10.1007/s11606-013-2659-y · Cited by 158
Cost Effectiveness of Childhood Obesity Interventions
Gortmaker, S. L., Long, M. W., Resch, S. C., Ward, Z. J., Cradock, A. L., Barrett, J. L., Wright, D. R., Sonneville, K. R., Giles, C. M., Carter, R. C., et al. (2015) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2015.03.032 · Cited by 144
Katikireddi, S. V., Egan, M., & Petticrew, M. (2015) · Journal of Epidemiology and Community Health · doi:10.1136/jech-2014-204711 · Cited by 126
Glick, S. B., Clarke, A. R., Blanchard, A., & Whitaker, A. K. (2012) · Journal of General Internal Medicine · doi:10.1007/s11606-012-2052-2 · Cited by 94
Prasad, V., Jorgenson, J., Ioannidis, J. P. A., & Cifu, A. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.11.005 · Cited by 90
How representative are clinical study patients with allergic rhinitis in primary care?
Costa, D. J., Amouyal, M., Lambert, P., Ryan, D., Schünemann, H. J., Daures, J. P., Bousquet, J., & Bousquet, P. J. (2011) · Journal of Allergy and Clinical Immunology · doi:10.1016/j.jaci.2010.10.058 · Cited by 63
An update on antidepressant use in bipolar depression
Sidor, M. M., & MacQueen, G. M. (2012) · Current Psychiatry Reports · doi:10.1007/s11920-012-0323-6 · Cited by 57
Discussing study limitations in reports of biomedical studies- the need for more transparency
Puhan, M. A., Akl, E. A., Bryant, D., Xie, F., Apolone, G., & Riet, G. (2012) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-10-23 · Cited by 54
Connolly, B., Denehy, L., Brett, S., Elliott, D., & Hart, N. (2012) · Critical Care · doi:10.1186/cc11219 · Cited by 49
Petti, S. (2010) · Journal of Dentistry · doi:10.1016/j.jdent.2010.09.002 · Cited by 47
Yavchitz, A., Ravaud, P., Hopewell, S., Baron, G., & Boutron, I. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-123 · Cited by 11
Metadata
- Authors
- Carter, T.
- Venue
- Scandinavian Journal of Work, Environment & Health
- Published
- 2003-02
- Volume
- 29
- Issue
- 1
- Pages
- 79-80
- ISSN
- 0355-3140 (ISSN-L)
- 1795-990X
- OpenAlex
- W2068403673
- Cited by
- 343
- References
- 0
- FWCI
- 2.04
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.