The Endocrine Society Guidelines: When the Confidence Cart Goes Before the Evidence Horse
The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
CONTEXT: In 2005, the Endocrine Society (TES) adopted the GRADE system of developing clinical practice guidelines. Grading of Recommendations, Assessment, Development, and Evaluation working group guidance suggests that strong recommendations based on low or very low (L/VL) confidence may often be inappropriate, and has offered a taxonomy of paradigmatic situations in which strong recommendations based on L/VL confidence estimates may be appropriate. OBJECTIVE: We sought to characterize strong recommendations of TES based on L/VL confidence evidence. DATA SOURCES AND EXTRACTION: We identified all strong recommendations based on L/VL confidence evidence published in TES guidelines between 2005 and 2011. We identified those consistent with one of the paradigmatic situations in the taxonomy. DATA SYNTHESIS: Two hundred six of 357 (58%) of the recommendations of TES were strong; of these, 121 (59%) were based on L/VL confidence evidence. Of these 121, 35 (29%) were consistent with one of the paradigmatic situations. The most common situation (13, 11%) was of a strong recommendation against the intervention because of low confidence evidence for benefit and high confidence evidence for harm. The remaining 86 (71%) comprised 43 (36%) "best practice" statements for which sensible alternatives do not exist; 5 (4%) in which recommendations were for "additional research"; 5 (4%) in which greater confidence in the estimates was warranted; and 33 (27%) for which we could not find a compelling explanation for the incongruence. CONCLUSIONS: Guideline panels should beware of formulating strong recommendations when confidence in estimates is low. Our taxonomy when such recommendations are appropriate may be helpful.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bhasin, S., Cunningham, G. R., Hayes, F. J., Matsumoto, A. M., Snyder, P. J., Swerdloff, R. S., & Montori, V. M. (2010) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2009-2354 · Cited by 1,954 · cited 3×
“High quality of evidence denotes equality in treatment of hyperthyroidism but low quality of evidence suggests harm in methimazole 2) We recommend against the use of GCs that traverse the placenta, such as dexamethasone, for treatment of pregnant patients with congenital adrenal hyperplasia (10) High quality of eviden…”
BackgroundSelf-citationFunder, J. W., Carey, R. M., Fardella, C., Gomez-Sanchez, C. E., Mantero, F., Stowasser, M., Young, W. F., & Montori, V. M. (2008) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2008-0104 · Cited by 1,554
Self-citationSpeiser, P. W., Azziz, R., Baskin, L. S., Ghizzoni, L., Hensle, T. W., Merke, D. P., Meyer-Bahlburg, H. F. L., Miller, W. L., Montori, V. M., Oberfield, S. E., et al. (2010) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2009-2631 · Cited by 1,468 · cited 5×
“Evidence RCT/SRR 10/7 (8) 11/2 (13) 21/9 (10) 18/11 (12) 4/1 (25) 22/12 (15) 43/21 (12) ORCT/SROR 7/1 (5) 14/5 (16) 21/6 (10) 8/2 (7) 4/1 (25) 12/3 (8) 33/9 (9) O/SRO 93/6 (77) 57/2 (67) 150/8 (72) 75/8 (55) 8/0 (50) 83/8 (55) 233/16 (65) NC 11 (9) 3 (4) 14 (7) 34 (25) 0 34 (22) 48 (14) Direction For 98 (81) 80 (94) 1…”
BackgroundInfluentialSelf-citationMolitch, M. E., Clemmons, D. R., Malozowski, S., Merriam, G. R., & Vance, M. L. (2011) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2011-0179 · Cited by 1,047
Scientific evidence underlying the ACC/AHA clinical practice guidelines.
Tricoci, P. (2009) · JAMA · doi:10.1001/jama.2009.205 · Cited by 908 · cited 3×
“al (6) studied the American College of Cardiology/Amer-”
BackgroundBrożek, J. L., Akl, E. A., Alonso‐Coello, P., Lang, D., Jaeschke, R., Williams, J. W., Phillips, B., Lelgemann, M., Lethaby, A., Bousquet, J., et al. (2009) · Allergy · doi:10.1111/j.1398-9995.2009.01973.x · Cited by 894
Self-citationAndrogen therapy in women: An Endocrine Society clinical practice guideline
Wierman, M. E., Basson, R., Davis, S. R., Khosla, S., Miller, K. K., Rosner, W., & Santoro, N. (2006) · The Journal of Clinical Endocrinology & Metabolism · doi:10.1210/jc.2006-1121 · Cited by 301 · cited 2×
“Graded as low quality when there is moderate quality evidence for benefits 8 Additional research We recommend additional investigation using rodents and primates to further define the specific targets of androgen action (16) 5 (4)”
Background
Cited by
Methodological quality and synthesis of case series and case reports
Murad, M. H., Sultan, S., Haffar, S., & Bazerbachi, F. (2018) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2017-110853 · Cited by 2,242
“GRADE literature also describes five paradigmatic situations in which a strong recommendation can be made based on low quality evidence.(30) One of which is when the condition is life threatening.”
BackgroundSelf-citationManagement of Sickle Cell Disease: Summary of the 2014 Evidence-Based Report by Expert Panel Members
Yawn, B. P., Buchanan, G. R., Afenyi-Annan, A. N., Ballas, S. K., Hassell, K. L., James, A. H., Jordan, L., Lanzkron, S. M., Lottenberg, R., Savage, W. J., et al. (2014) · JAMA · doi:10.1001/jama.2014.10517 · Cited by 1,599
Self-citationAmerican Thyroid Association Guidelines for Management of Patients with Anaplastic Thyroid Cancer
Smallridge, R. C., Ain, K. B., Asa, S. L., Bible, K. C., Brierley, J. D., Burman, K. D., Kebebew, E., Lee, N. Y., Nikiforov, Y. E., Rosenthal, M. S., et al. (2012) · Thyroid · doi:10.1089/thy.2012.0302 · Cited by 935
Keepers, G. A., Fochtmann, L. J., Anzia, J. M., Benjamin, S., Lyness, J. M., Mojtabai, R., Servis, M., Walaszek, A., Buckley, P., Lenzenweger, M. F., et al. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.177901 · Cited by 912
Bible, K. C., Kebebew, E., Brierley, J., Brito, J. P., Cabanillas, M. E., Clark, T. J., Di Cristofano, A., Foote, R., Giordano, T., Kasperbauer, J., et al. (2021) · Thyroid · doi:10.1089/thy.2020.0944 · Cited by 730
Self-citation
Metadata
- Authors
- Brito, J. P., Domecq, J. P., Murad, M. H., Guyatt, G. H., & Montori, V. M.
- Venue
- The Journal of Clinical Endocrinology & Metabolism
- Publisher
- The Endocrine Society
- Published
- 2013-08
- Volume
- 98
- Issue
- 8
- Pages
- 3246-3252
- ISSN
- 0021-972X (ISSN-L)
- 1945-7197
- OpenAlex
- W2108020394
- Cited by
- 73
- References
- 7
- FWCI
- 7.25
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: The Endocrine Society Guidelines: When the Confidence Cart Goes Before the Evidence Horse. https://app.cochat.ai/papers/10.1210/jc.2013-1814
- The paper
- Brito, J. P., Domecq, J. P., Murad, M. H., Guyatt, G. H., & Montori, V. M. (2013). The Endocrine Society Guidelines: When the Confidence Cart Goes Before the Evidence Horse. The Journal of Clinical Endocrinology & Metabolism. https://doi.org/10.1210/jc.2013-1814
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.