The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
No Surgical Innovation Without Evaluation: Evolution and Further Development of the IDEAL Framework and Recommendations
Open accessAbstract
Objective: To update, clarify, and extend IDEAL concepts and recommendations. Background: New surgical procedures, devices, and other complex interventions need robust evaluation for safety, efficacy, and effectiveness. Unlike new medicines, there is no internationally agreed evaluation pathway for generating and analyzing data throughout the life cycle of surgical innovations. The IDEAL Framework and Recommendations were designed to provide this pathway and they have been used increasingly since their introduction in 2009. Based on a Delphi survey, expert workshop and major discussions during IDEAL conferences held in Oxford (2016) and New York (2017), this article updates and extends the IDEAL Recommendations, identifies areas for future research, and discusses the ethical problems faced by investigators at each IDEAL stage. Methods: The IDEAL Framework describes 5 stages of evolution for new surgical therapeutic interventions—Idea, Development, Exploration, Assessment, and Long-term Study. This comprehensive update proposes several modifications. First, a “Pre-IDEAL” stage describing preclinical studies has been added. Second we discuss potential adaptations to expand the scope of IDEAL (originally designed for surgical procedures) to accommodate therapeutic devices, through an IDEAL-D variant. Third, we explicitly recognise the value of comprehensive data collection through registries at all stages in the Framework and fourth, we examine the ethical issues that arise at each stage of IDEAL and underpin the recommendations. The Recommendations for each stage are reviewed, clarified and additional detail added. Conclusions: The intention of this article is to widen the practical use of IDEAL by clarifying the rationale for and practical details of the Recommendations. Additional research based on the experience of implementing these Recommendations is needed to further improve them.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548 · cited 1×
“Recommended Reporting Guidelines for Protocols and Full Reports Several robust guidelines for reporting surgical RCTs are recommended including the updated 2010 CONSORT Statement,(37) its extension for NPT (non-pharmacological treatments)(38) and a template for intervention description and replication (TIDieR Statemen…”
BackgroundSelf-citationCONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
SPIRIT 2013 Statement: Defining Standard Protocol Items for Clinical Trials
Chan, A.-W., Tetzlaff, J. M., Altman, D. G., Laupacis, A., Gøtzsche, P. C., Krleža-Jerić, K., Hróbjartsson, A., Mann, H., Dickersin, K., Berlin, J. A., et al. (2013) · Annals of Internal Medicine · doi:10.7326/0003-4819-158-3-201302050-00583 · Cited by 7,363
CONSORT 2010 statement: extension to randomised pilot and feasibility trials
on behalf of the PAFS consensus group, Eldridge, S. M., Chan, C. L., Campbell, M. J., Bond, C. M., Hopewell, S., Thabane, L., & Lancaster, G. A. (2016) · Pilot and Feasibility Studies · doi:10.1186/s40814-016-0105-8 · Cited by 2,843
Self-citationThe COMET Handbook: version 1.0
Williamson, P. R., Altman, D. G., Bagley, H., Barnes, K. L., Blazeby, J. M., Brookes, S. T., Clarke, M., Gargon, E., Gorst, S., Harman, N., et al. (2017) · Trials · doi:10.1186/s13063-017-1978-4 · Cited by 2,011
Self-citationThe PRECIS-2 tool: designing trials that are fit for purpose
Loudon, K., Treweek, S., Sullivan, F., Donnan, P., Thorpe, K. E., & Zwarenstein, M. (2015) · BMJ · doi:10.1136/bmj.h2147 · Cited by 1,846
No surgical innovation without evaluation: the IDEAL recommendations
McCulloch, P., Altman, D. G., Campbell, W. B., Flum, D. R., Glasziou, P., Marshall, J. C., & Nicholl, J. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61116-8 · Cited by 1,820
Self-citationThe SCARE Statement: Consensus-based surgical case report guidelines
Agha, R. A., Fowler, A. J., Saeta, A., Barai, I., Rajmohan, S., Orgill, D. P., Afifi, R., Al-Ahmadi, R., Albrecht, J., Alsawadi, A., et al. (2016) · International Journal of Surgery · doi:10.1016/j.ijsu.2016.08.014 · Cited by 1,686
Self-citationCan Animal Models of Disease Reliably Inform Human Studies?
van der Worp, H. B., Howells, D. W., Sena, E. S., Porritt, M. J., Rewell, S., O'Collins, V., & Macleod, M. R. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000245 · Cited by 1,354
Challenges in evaluating surgical innovation
Ergina, P. L., Cook, J. A., Blazeby, J. M., Boutron, I., Clavien, P.-A., Reeves, B. C., & Seiler, C. M. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61086-2 · Cited by 653
Self-citation
Cited by
Global Vascular Guidelines on the management of chronic limb-threatening ischemia.
Conte, M. S., Bradbury, A. W., Kolh, P., White, J. V., Dick, F., Fitridge, R., Mills, J. L., Ricco, J.-B., Suresh, K. R., Murad, M. H., et al. (2019) · Journal of Vascular Surgery · doi:10.1016/j.jvs.2019.02.016 · Cited by 2,015
Global vascular guidelines on the management of chronic limb-threatening ischemia
Conte, M. S., Bradbury, A. W., Kolh, P., White, J. V., Dick, F., Fitridge, R., Mills, J. L., Ricco, J.-B., Suresh, K. R., Murad, M. H., et al. (2019) · European Journal of Vascular and Endovascular Surgery · doi:10.1016/j.ejvs.2019.05.006 · Cited by 1,582
Vasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · Nature Medicine · doi:10.1038/s41591-022-01772-9 · Cited by 1,039
Self-citationVasey, B., Nagendran, M., Campbell, B., Clifton, D. A., Collins, G. S., Denaxas, S., Denniston, A. K., Faes, L., Geerts, B., Ibrahim, M., et al. (2022) · BMJ · doi:10.1136/bmj-2022-070904 · Cited by 665
Self-citationThe DECIDE-AI Steering Group (2021) · Nature Medicine · doi:10.1038/s41591-021-01229-5 · Cited by 184
Metadata
- Authors
- Hirst, A., Philippou, Y., Blazeby, J., Campbell, B., Campbell, M., Feinberg, J., Rovers, M., Blencowe, N., Pennell, C., Quinn, T., Rogers, W., Cook, J., Kolias, A. G., Agha, R., Dahm, P., Sedrakyan, A., & McCulloch, P.
- Venue
- Annals of Surgery
- Published
- 2019-02
- Volume
- 269
- Issue
- 2
- Pages
- 211-220
- ISSN
- 0003-4932 (ISSN-L)
- 1528-1140
- OpenAlex
- W2802387694
- Cited by
- 393
- References
- 42
- FWCI
- 84.29
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: No Surgical Innovation Without Evaluation: Evolution and Further Development of the IDEAL Framework and Recommendations. https://app.cochat.ai/papers/10.1097/sla.0000000000002794
- The paper
- Hirst, A., Philippou, Y., Blazeby, J., Campbell, B., Campbell, M., Feinberg, J., Rovers, M., Blencowe, N., Pennell, C., Quinn, T., Rogers, W., Cook, J., Kolias, A. G., Agha, R., Dahm, P., Sedrakyan, A., & McCulloch, P. (2019). No Surgical Innovation Without Evaluation: Evolution and Further Development of the IDEAL Framework and Recommendations. Annals of Surgery. https://doi.org/10.1097/sla.0000000000002794
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.