When and how to assess fast-changing technologies: a comparative study of medical applications of four generic technologies.
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
OBJECTIVES. To try to identify the optimal time at which to start assessing new and fast-evolving health technologies. To provide insight into factors influencing the timing of assessments and the choice of methods for assessing new and fast-changing technologies. HOW THE RESEARCH WAS CONDUCTED. A series of literature reviews were undertaken covering the general principles involved in the timing of health technology assessments (HTAs). Additionally, the reported assessments of laparoscopic cholecystectomy, chorionic villus sampling (CVS), teleradiology, teledermatology, genetic screening for predisposition to breast cancer, and gene therapy for cystic fibrosis were reviewed to try to identify the factors that influenced the timing of these assessments. Key individuals in each field were also interviewed. The selected technologies allowed comparison between those that were new and evolving and those that were relatively well-established. A bibliometric study of publication trends was also undertaken to see whether these trends would suggest points in the development of a technology that could be used as indicators that assessment should be started. RESEARCH FINDINGS. TIMING. The precise point at which assessment should start was not identified but the bibliometric study suggested that extending this approach might give useful results. For all health technologies, more regular reporting of outcomes and side-effects should be encouraged during the period after initial assessment and, where the technology is fast-changing, reassessment should take place from time to time. The precise intervals were not identified and the problem remains of deciding when a technology has changed enough to warrant reassessment. FACTORS INFLUENCING TIMING. Published reports of assessments did not generally specify the reasons for their timing, but a number of factors appear to have influenced the timing of those assessments, directly or indirectly. Product champions and opinion leaders pioneer the introduction of new technologies into clinical practice, and their reports may lead to the rapid diffusion of such technologies before they have been adequately evaluated, as was the case with laparoscopic cholecystectomy; this diffusion may limit the methods of evaluation that can then be used. It is therefore important to assess new health technologies before diffusion takes place. The extent to which regulatory control is imposed on the introduction of new health technologies can also influence the timing of assessments. Such controls might have helped to restrict the diffusion of laparoscopic cholecystectomy, making a large and widely generalisable randomised controlled trial (RCT) feasible. The source and availability of funding for studies may influence the nature and timing of trials. Many telemedicine evaluations were funded by commercial telecommunications organisations and were thus restricted in their timing (and biased towards the technological aspects of the applications) by the availability of funds. Media coverage undoubtedly has an influence although this influence is not always predictable; it may generate 'favourable' publicity about new health technologies, which can lead to immediate demands for the new technique, as was the case with laparosocpic cholecystectomy with its apparent benefits. Thus assessments should be made before media coverage exerts popular pressure on purchasers to adopt the technology and dissuades patients from participating in RCTs (because of fear they may be randomised to the standard treatment as occurred in a US trial of CVS). Innovators should also be cautious in the claims that they make to the media.(ABSTRACT TRUNCATED)
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Improving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
Why we need observational studies to evaluate the effectiveness of health care
Black, N. (1996) · BMJ · doi:10.1136/bmj.312.7040.1215 · Cited by 1,598
Cited by
Clinical indications for cardiovascular magnetic resonance (CMR): Consensus Panel report?
PENNELL, D. (2004) · European Heart Journal · doi:10.1016/j.ehj.2004.06.040 · Cited by 747
Evaluation of diagnostic tests when there is no gold standard. A review of methods
Rutjes, A., Reitsma, J., Coomarasamy, A., Khan, K., & Bossuyt, P. (2007) · Health Technology Assessment · doi:10.3310/hta11500 · Cited by 524
Moher, D., Pham, B., Lawson, M., & Klassen, T. (2003) · Health Technology Assessment · doi:10.3310/hta7410 · Cited by 500
Ward, K., Hilton, P., & UK and Ireland TVT Trial Group (2008) · BJOG: An International Journal of Obstetrics & Gynaecology · doi:10.1111/j.1471-0528.2007.01548.x · Cited by 356
The challenges faced in the design, conduct and analysis of surgical randomised controlled trials
Cook, J. A. (2009) · Trials · doi:10.1186/1745-6215-10-9 · Cited by 351
Metadata
- Authors
- Mowatt, Bower, Brebner, Cairns, Grant, & McKee
- Venue
- Health Technology Assessment
- Published
- 1997
- Volume
- 1
- Issue
- 14
- Pages
- i-vi, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W200771743
- Cited by
- 112
- References
- 2
- FWCI
- 11.51
- Type
- journal article
- Language
- en
- Open access
- hybrid
- Funders
- Health Technology Assessment Programme (93/42/01)
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: When and how to assess fast-changing technologies: a comparative study of medical applications of four generic technologies. https://app.cochat.ai/papers/10.3310/hta1140
- The paper
- Mowatt, Bower, Brebner, Cairns, Grant, & McKee. (1997). When and how to assess fast-changing technologies: a comparative study of medical applications of four generic technologies. Health Technology Assessment. https://doi.org/10.3310/hta1140
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.