Literature searching for clinical and cost-effectiveness studies used in health technology assessment reports carried out for the National Institute for Clinical Excellence appraisal system
Open accessThe DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: To contribute to making searching for Technology Assessment Reports (TARs) more cost-effective by suggesting an optimum literature retrieval strategy. DATA SOURCES: A sample of 20 recent TARs. REVIEW METHODS: All sources used to search for clinical and cost-effectiveness studies were recorded. In addition, all studies that were included in the clinical and cost-effectiveness sections of the TARs were identified, and their characteristics recorded, including author, journal, year, study design, study size and quality score. Each was also classified by publication type, and then checked to see whether it was indexed in the following databases: MEDLINE, EMBASE, and then either the Cochrane Controlled Trials Register (CCTR) for clinical effectiveness studies or the NHS Economic Evaluation Database (NHS EED) for the cost-effectiveness studies. Any study not found in at least one of these databases was checked to see whether it was indexed in the Science Citation Index (SCI) and BIOSIS, and the American Society of Clinical Oncology (ASCO) Online if a cancer review. Any studies still not found were checked to see whether they were in a number of additional databases. RESULTS: The median number of sources searched per TAR was 20, and the range was from 13 to 33 sources. Six sources (CCTR, DARE, EMBASE, MEDLINE, NHS EED and sponsor/industry submissions to National Institute for Clinical Excellence) were used in all reviews. After searching the MEDLINE, EMBASE and NHS EED databases, 87.3% of the clinical effectiveness studies and 94.8% of the cost-effectiveness studies were found, rising to 98.2% when SCI, BIOSIS and ASCO Online and 97.9% when SCI and ASCO Online, respectively, were added. The median number of sources searched for the 14 TARs that included an economic model was 9.0 per TAR. A sensitive search filter for identifying non-randomised controlled trials (RCT), constructed for MEDLINE and using the search terms from the bibliographic records in the included studies, retrieved only 85% of the known sample. Therefore, it is recommended that when searching for non-RCT studies a search is done for the intervention alone, and records are then scanned manually for those that look relevant. CONCLUSIONS: Searching additional databases beyond the Cochrane Library (which includes CCTR, NHS EED and the HTA database), MEDLINE, EMBASE and SCI, plus BIOSIS limited to meeting abstracts only, was seldom found to be effective in retrieving additional studies for inclusion in the clinical and cost-effectiveness sections of TARs (apart from reviews of cancer therapies, where a search of the ASCO database is recommended). A more selective approach to database searching would suffice in most cases and would save resources, thereby making the TAR process more efficient. However, searching non-database sources (including submissions from manufacturers, recent meeting abstracts, contact with experts and checking reference lists) does appear to be a productive way of identifying further studies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Some researchers agree that when timeliness is of importance, hand searching of reference lists and contacting experts can be more effective than comprehensive bibliographic database searches [45, 46].”
From How to conduct systematic reviews more expeditiously? (2015) · cites this paper as [45]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Assessing the quality of reports of randomized clinical trials: Is blinding necessary?
Jadad, A. R., Moore, R. A., Carroll, D., Jenkinson, C., Reynolds, D. J. M., Gavaghan, D. J., & McQuay, H. J. (1996) · Controlled Clinical Trials · doi:10.1016/0197-2456(95)00134-4 · Cited by 17,582
Consensus development methods, and their use in clinical guideline development.
Murphy, Black, Lamping, McKee, Sanderson, Askham, & Marteau (1998) · Health Technology Assessment · doi:10.3310/hta2030 · Cited by 2,051
Guidelines for authors and peer reviewers of economic submissions to the BMJ
Drummond, M. F., & Jefferson, T. O. (1996) · BMJ · doi:10.1136/bmj.313.7052.275 · Cited by 1,827
Evaluating patient-based outcome measures for use in clinical trials.
Fitzpatrick, Davey, Buxton, & Jones (1998) · Health Technology Assessment · doi:10.3310/hta2140 · Cited by 1,715
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Full publication of results initially presented in abstracts.
Scherer, R. W., Langenberg, P., & von Elm, E. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000005.pub3 · Cited by 997
Direction and impact of language bias in meta-analyses of controlled trials: empirical study
Jüni, P., Holenstein, F., Sterne, J., Bartlett, C., & Egger, M. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.115 · Cited by 892
The Medical Review Article: State of the Science
MULROW, C. D. (1987) · Annals of Internal Medicine · doi:10.7326/0003-4819-106-3-485 · Cited by 856
Royle, P., & Milne, R. (2003) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462303000552 · Cited by 693
Self-citationJadad, A. R., Cook, D. J., Jones, A., Klassen, T. P., Tugwell, P., Moher, M., & Moher, D. (1998) · JAMA · doi:10.1001/jama.280.3.278 · Cited by 534
Research works printed but not linked: 7
- [16]16. Lee KP , Schotland M, Bacchetti P , Bero LA. Association of journal quality indicators with methodological quality of clinical research articles. JAMA 2002; 287 :2805-8.
- [18]18. Hopewell S, McDonald S, Clarke M, Egger M. Grey literature in meta-analyses of randomized trials of health care interventions (Cochrane Methodology Review). In The Cochrane Library (Issue 1). Oxford: Update Software; 2003.
- [22]22. Jefferson TO, Alderson P , Davidoff F, Wager E. Editorial peer-review for improving the quality of reports of biomedical studies (Cochrane Methodology Review). In The Cochrane Library (Issue 1). Oxford: Update Software; 2003.
- [36]36. Eady A. Secondary publications: economic analyses. In McKibbon A, editor. PDQ evidence-based principles and practice. Hamilton: Decker; 1999. pp. 173-86.
- [38]38. Clarke M, Oxman AD, editors. Locating and selecting studies. Cochrane Reviewers Handbook 4.1.6 (updated January 2003) Section 5. In The Cochrane Library (Issue 2). Oxford: Update Software; 2003.
- [40]40. Royle P . Literature searching for randomised controlled trials used in Cochrane reviews: rapid versus exhaustive searches [dissertation]. Southampton: University of Southampton; 2001.
- [41]41. Hopewell S, Clarke M, Stewart L, Tierney J. Time to publication for results of clinical trials (Cochrane Methodology Review). In The Cochrane Library (Issue 1). Oxford: Update Software; 2003.
Cited by
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Medical Decision Making · doi:10.1177/0272989x12454579 · Cited by 799
Expediting systematic reviews: methods and implications of rapid reviews
Ganann, R., Ciliska, D., & Thomas, H. (2010) · Implementation Science · doi:10.1186/1748-5908-5-56 · Cited by 752
Philips, Z., Ginnelly, L., Sculpher, M., Claxton, K., Golder, S., Riemsma, R., Woolacoot, N., & Glanville, J. (2004) · Health Technology Assessment · doi:10.3310/hta8360 · Cited by 697
Hobart, J., & Cano, S. (2009) · Health Technology Assessment · doi:10.3310/hta13120 · Cited by 621
Moher, D., Pham, B., Lawson, M., & Klassen, T. (2003) · Health Technology Assessment · doi:10.3310/hta7410 · Cited by 500
Eddy, D. M., Hollingworth, W., Caro, J. J., Tsevat, J., McDonald, K. M., & Wong, J. B. (2012) · Value in Health · doi:10.1016/j.jval.2012.04.012 · Cited by 466
Searching for studies: a guide to information retrieval for Campbell systematic reviews
Kugley, S., Wade, A., Thomas, J., Mahood, Q., Jørgensen, A. K., Hammerstrøm, K., & Sathe, N. (2017) · Campbell Systematic Reviews · doi:10.4073/cmg.2016.1 · Cited by 371
“For reviews concerning cost effectiveness specifically, authors may seek guidance on searching from chapter 7 in Evidence-Based Decisions and Economics (13) or methodologic reports (13-18).”
High and Rising Health Care Costs. Part 2: Technologic Innovation
Bodenheimer, T. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-142-11-200506070-00012 · Cited by 329
“The National Health Service of the United Kingdom has held per capita expenditures very low.”
BackgroundHartling, L., Featherstone, R., Nuspl, M., Shave, K., Dryden, D. M., & Vandermeer, B. (2017) · BMC Medical Research Methodology · doi:10.1186/s12874-017-0347-z · Cited by 324
“Comprehensive literature searching is widely recommended; however, searching additional sources is associated with diminishing returns, [21] and the effect of continuing to search new sources has an unknown impact on the final results and conclusions.”
BackgroundPapaioannou, D., Sutton, A., Carroll, C., Booth, A., & Wong, R. (2010) · Health Information & Libraries Journal · doi:10.1111/j.1471-1842.2009.00863.x · Cited by 318
Self-monitoring of blood glucose in type 2 diabetes: systematic review
Clar, C., Barnard, K., Cummins, E., Royle, P., & Waugh, N. (2010) · Health Technology Assessment · doi:10.3310/hta14120 · Cited by 274
Self-citationSystematic reviews need systematic searchers.
(2005) · Europe PMC (PubMed Central) · Cited by 257
Imamura, M., Abrams, P., Bain, C., Buckley, B., Cardozo, L., Cody, J., Cook, J., Eustice, S., Glazener, C., Grant, A., et al. (2010) · Health Technology Assessment · doi:10.3310/hta14400 · Cited by 254
Turner, D., Wailoo, A., Nicholson, K., Cooper, N., Sutton, A., & Abrams, K. (2003) · Health Technology Assessment · doi:10.3310/hta7350 · Cited by 246
Ismail, K., Maissi, E., Thomas, S., Chalder, T., Schmidt, U., Bartlett, J., Patel, A., Dickens, C., Creed, F., & Treasure, J. (2010) · Health Technology Assessment · doi:10.3310/hta14220 · Cited by 245
McDaid, C., Griffin, S., Weatherly, H., Durée, K., van der Burgt, M., van Hout, S., Akers, J., Davies, R., Sculpher, M., & Westwood, M. (2009) · Health Technology Assessment · doi:10.3310/hta13040 · Cited by 241
Lourenco, T., Armstrong, N., N'Dow, J., Nabi, G., Deverill, M., Pickard, R., Vale, L., MacLennan, G., Fraser, C., McClinton, S., et al. (2008) · Health Technology Assessment · doi:10.3310/hta12350 · Cited by 221
Jolly, K., Taylor, R., Lip, G., Greenfield, S., Raftery, J., Mant, J., Lane, D., Jones, M., Lee, K., & Stevens, A. (2007) · Health Technology Assessment · doi:10.3310/hta11350 · Cited by 216
Bouza, C., López, T., Magro, A., Navalpotro, L., & Amate, J. M. (2006) · European Spine Journal · doi:10.1007/s00586-005-0048-x · Cited by 209
“The present systematic review includes published and unpublished studies, and data from the FDA [5, 33, 45], and we believe it to be the largest such effort made to date.”
BackgroundManchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/35 · Cited by 190
Shaw, L., Rodgers, Price, C., van Wijck, F., Shackley, P., Steen, N., Barnes, M., Ford, G., & Graham, L. (2010) · Health Technology Assessment · doi:10.3310/hta14260 · Cited by 187
Mowatt, G., Zhu, S., Kilonzo, M., Boachie, C., Fraser, C., Griffiths, T., N'Dow, J., Nabi, G., Cook, J., & Vale, L. (2010) · Health Technology Assessment · doi:10.3310/hta14040 · Cited by 313
Blood glucose self-monitoring in type 2 diabetes: a randomised controlled trial
Farmer, A., Wade, A., French, D., Simon, J., Yudkin, P., Gray, A., Craven, A., Goyder, L., Holman, R., Mant, D., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13150 · Cited by 180
Morrell, C., Warner, R., Slade, P., Dixon, S., Walters, S., Paley, G., & Brugha, T. (2009) · Health Technology Assessment · doi:10.3310/hta13300 · Cited by 176
Wang, D., Cummins, C., Bayliss, S., Sandercock, J., & Burls, A. (2008) · Health Technology Assessment · doi:10.3310/hta12360 · Cited by 175
Manchikanti, L. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/819 · Cited by 168
Halladay, C. W., Trikalinos, T. A., Schmid, I. T., Schmid, C. H., & Dahabreh, I. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.12.017 · Cited by 166
Abubakar, I. I., Irvine, L., Aldus, C. F., Wyatt, G., Fordham, R. J., Schelenz, S., Shepstone, L., Howe, A., Peck, M. W., & Hunter, P. R. (2007) · Health Technology Assessment · doi:10.3310/hta11360 · Cited by 160
Manchikanti, L. (2008) · Pain Physician · doi:10.36076/ppj.2008/11/161 · Cited by 157
Bouza, C., López‐Cuadrado, T., Alcázar, R. A., Saz‐Parkinson, Z., & Amate, J. M. (2009) · BMC Gastroenterology · doi:10.1186/1471-230x-9-31 · Cited by 159
“Nevertheless, we feel that any such bias would necessarily have been minimised by the scope of and systematic strategy used in the search of the literature and we are confident that the majority of the research conducted in this field was successfully identified [15,43].”
BackgroundInfluentialChen, Y., Jowett, S., Barton, P., Malottki, K., Hyde, C., Gibbs, J., Pepke-Zaba, J., Fry-Smith, A., Roberts, J., & Moore, D. (2009) · Health Technology Assessment · doi:10.3310/hta13490 · Cited by 148
Errors in search strategies were identified by type and frequency
Sampson, M., & McGowan, J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.01.007 · Cited by 142
Social determinants of COVID-19 incidence and outcomes: A rapid review
Upshaw, T. L., Brown, C., Smith, R., Perri, M., Ziegler, C., & Pinto, A. D. (2021) · PLOS ONE · doi:10.1371/journal.pone.0248336 · Cited by 142
Andronis, L., Barton, P. M., & Bryan, S. (2009) · Health Technology Assessment · doi:10.3310/hta13290 · Cited by 175
The Inclusion of Informal Care in Applied Economic Evaluation: A Review
Goodrich, K., Kaambwa, B., & Al‐Janabi, H. (2012) · Value in Health · doi:10.1016/j.jval.2012.05.009 · Cited by 162
Little, P., Turner, S., Rumsby, K., Warner, G., Moore, M., Lowes, J., Smith, H., Hawke, C., Turner, D., Leydon, G., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13190 · Cited by 137
Penninga, L., Møller, C. H., Gustafsson, F., Steinbrüchel, D. A., & Gluud, C. N. (2010) · European Journal of Clinical Pharmacology · doi:10.1007/s00228-010-0902-6 · Cited by 144
Bouza, C., López‐Cuadrado, T., Magro, A., Fuster, L. N., & Amate, J. M. (2006) · BMC Urology · doi:10.1186/1471-2490-6-14 · Cited by 118
“Selection of studies: For inclusion, the studies were required to meet the following criteria [20-22]: a)”
The contribution of databases to the results of systematic reviews: a cross-sectional study
Hartling, L., Featherstone, R., Nuspl, M., Shave, K., Dryden, D. M., & Vandermeer, B. (2016) · BMC Medical Research Methodology · doi:10.1186/s12874-016-0232-1 · Cited by 118
“While methodological guidance for SRs encourages comprehensive searching, there are diminishing returns with each additional database searched [7] and the impact of searching each additional database in terms of the final results and conclusions is not known.”
BackgroundResultOxman, A. D., Schünemann, H. J., & Fretheim, A. (2006) · Health Research Policy and Systems · doi:10.1186/1478-4505-4-20 · Cited by 128
“Similarly, a third assessment of 20 Technology Assessment Reports by NICE found that a more selective approach to database searching would suffice in most cases and would save resources, whereas searching other sources, including contact with experts and checking reference lists, appeared to be a more productive way o…”
BackgroundA systematic review of presumed consent systems for deceased organ donation
Rithalia, A. D., McDaid, C., Suekarran, S., Norman, G., Myers, L., & Sowden, A. J. (2009) · Health Technology Assessment · doi:10.3310/hta13260 · Cited by 112
Tacrolimus versus cyclosporin as primary immunosuppression for lung transplant recipients
Penninga, L., Penninga, E. I., Møller, C. H., Iversen, M., Steinbrüchel, D. A., & Gluud, C. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008817.pub2 · Cited by 109
Gowers, S., Clark, A., Roberts, C., Byford, S., Barrett, B., Griffiths, A., Edwards, V, Bryan, C., Smethurst, N., Rowlands, L., et al. (2010) · Health Technology Assessment · doi:10.3310/hta14150 · Cited by 107
How to conduct systematic reviews more expeditiously?
Tsertsvadze, A., Chen, Y.-F., Moher, D., Sutcliffe, P., & McCarthy, N. (2015) · Systematic Reviews · doi:10.1186/s13643-015-0147-7 · Cited by 104
“Some researchers agree that when timeliness is of importance, hand searching of reference lists and contacting experts can be more effective than comprehensive bibliographic database searches [45, 46].”
BackgroundPerformance of screening tests for child physical abuse in accident and emergency departments
Woodman, J., Pitt, M., Wentz, R., Taylor, B., Hodes, D., & Gilbert, R. E. (2008) · Health Technology Assessment · doi:10.3310/hta12330 · Cited by 115
Lorenzetti, D. L., & Ghali, W. A. (2013) · BMC Medical Research Methodology · doi:10.1186/1471-2288-13-141 · Cited by 102
“Previous research has demonstrated that authors typically search multiple electronic databases to identify studies relevant for systematic reviews [11-14].”
BackgroundVenUS II: a randomised controlled trial of larval therapy in the management of leg ulcers
Dumville, J. C., Worthy, G., Soares, M. O., Bland, J., Cullum, N. A., Dowson, C. G., Iglesias, C., McCaughan, D., Mitchell, J., Nelson, E. A., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13550 · Cited by 105
Searching for studies: A guide to information retrieval for Campbell systematic reviews
MacDonald, H., Comer, C., Foster, M., Labelle, P. R., Marsalis, S., Nyhan, K., Premji, Z., Rogers, M., Splenda, R., Stansfield, C., et al. (2024) · Campbell Systematic Reviews · doi:10.1002/cl2.1433 · Cited by 98
“…reviews, authors may seek guidance on searching from Chapter 7 in Evidence ‐ Based Decisions and Economics (Glanville & Paisley, 2010) or methodologic reports (Alton et al., 2006; Glanville & Paisley, 2010; Glanville et al., 2009; McKinlay et al., 2006; Royle & Waugh, 2003; Sassi et al., 2002).”
BackgroundWhich resources should be used to identify RCT/CCTs for systematic reviews: a systematic review
Crumley, E. T., Wiebe, N., Cramer, K., Klassen, T. P., & Hartling, L. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-24 · Cited by 95
Mowatt, G., Houston, J. G., Hernández, R. A., de Verteuil, R., Fraser, C. M., Cuthbertson, B. H., & Vale, L. D. (2009) · Health Technology Assessment · doi:10.3310/hta13070 · Cited by 94
Cooke, M. R., Marsh, J. L., Clark, M., Nakash, R., Jarvis, R., Hutton, J. L., Szczepura, A. K., Wilson, S., & Lamb, S. E. (2009) · Health Technology Assessment · doi:10.3310/hta13130 · Cited by 113
Bond, M., Pitt, M., Akoh, J. A., Moxham, T., Hoyle, M., & Anderson, R. (2009) · Health Technology Assessment · doi:10.3310/hta13380 · Cited by 91
Vitamin K to prevent fractures in older women: systematic review and economic evaluation
Stevenson, M., Lloyd-Jones, M., & Papaioannou, D. (2009) · Health Technology Assessment · doi:10.3310/hta13450 · Cited by 90
Chase, D., Rosten, C., Turner, S., Hicks, N., & Milne, R. (2009) · Health Technology Assessment · doi:10.3310/hta13590 · Cited by 89
Hummel, S., Simpson, E., Hemingway, P., Stevenson, M., & Rees, A. (2010) · Health Technology Assessment · doi:10.3310/hta14470 · Cited by 97
Surveillance search techniques identified the need to update systematic reviews
Sampson, M., Shojania, K. G., McGowan, J., Daniel, R., Rader, T., Iansavitchene, A., Ji, J., Ansari, M. T., & Moher, D. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.10.003 · Cited by 86
Pilgrim, H., Lloyd-Jones, M., & Rees, A. (2009) · Health Technology Assessment · doi:10.3310/hta13100 · Cited by 102
Balloon kyphoplasty in malignant spinal fractures: a systematic review and meta-analysis
Bouza, C., López‐Cuadrado, T., Cediel, P., Saz‐Parkinson, Z., & Amate, J. M. (2009) · BMC Palliative Care · doi:10.1186/1472-684x-8-12 · Cited by 83
Colbourn, T., Asseburg, C., Bojke, L., Philips, Z., Claxton, K., Ades, A. E., & Gilbert, R. E. (2007) · Health Technology Assessment · doi:10.3310/hta11290 · Cited by 83
Clegg, A. J., Loveman, E., Gospodarevskaya, E., Harris, P. S., Bird, A., Bryant, J., Scott, D. A., Davidson, P., Little, P. S., & Coppin, R. (2010) · Health Technology Assessment · doi:10.3310/hta14280 · Cited by 82
Manchikanti, L., Singh, V., Helm, S., Trescot, A. M., & Hirsch, J. A. (2008) · Pain Physician · doi:10.36076/ppj.2008/11/291 · Cited by 78
Autoantibody testing in children with newly diagnosed type 1 diabetes mellitus
Dretzke, J., Cummins, C., Sandercock, J., Fry-Smith, A., Barrett, T., & Burls, A. (2004) · Health Technology Assessment · doi:10.3310/hta8220 · Cited by 77
Ruiz, J. S., García, J. B., Ruiloba, J. V., Ubago, J. G., & González, M. P. G.-P. (2008) · Actas Españolas de Psiquiatría · Cited by 94
Johnson, A. P., Sikich, N., Evans, G. A., Evans, W. K., Giacomini, M. K., Glendining, M., Krahn, M. D., Levin, L., OH, P. I., & Perera, C. (2009) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462309090199 · Cited by 70
“In the United Kingdom, the National Institute of Clinical Excellence conducts appraisals that are expected to be adopted throughout the National Health Service (22;23).”
BackgroundBankhead, C. R., Brett, J., Bukach, C., Webster, P., Stewart-Brown, S. L., Munafo, M. R., & Austoker, J. (2003) · Health Technology Assessment · doi:10.3310/hta7420 · Cited by 76
Williamson, I., Benge, S., Barton, S., Petrou, M., Letley, L., Fasey, N., Abangma, G., Dakin, H., & Little, P. (2009) · Health Technology Assessment · doi:10.3310/hta13370 · Cited by 69
Kai, J., Ulph, F., Cullinan, T., & Qureshi, N. (2009) · Health Technology Assessment · doi:10.3310/hta13570 · Cited by 72
Michaels, J., Campbell, W., King, B., MacIntyre, J., Palfreyman, S., Shackley, P., & Stevenson, M. (2009) · Health Technology Assessment · doi:10.3310/hta13560 · Cited by 66
Fleeman, N., McLeod, C., Bagust, A., Beale, S., Boland, A., Dundar, Y., Jorgensen, A., Payne, K., Pirmohamed, M., Pushpakom, S. P., et al. (2010) · Health Technology Assessment · doi:10.3310/hta14030 · Cited by 72
Hay, A. D., Redmond, N. M., Costelloe, C., Montgomery, A. A., Fletcher, M. E., Hollinghurst, S. P., & Peters, T. (2009) · Health Technology Assessment · doi:10.3310/hta13270 · Cited by 67
Shepherd, J., Rogers, G., Anderson, R., Main, C., Coon, J. T., Hartwell, D., Liu, Z., Loveman, E., Green, C., Pitt, M., et al. (2008) · Health Technology Assessment · doi:10.3310/hta12190 · Cited by 68
DANIELS, J. P., Gray, J. W., Pattison, H. M., Roberts, T. E., Edwards, E. A., Milner, P., Spicer, L., King, E., Hills, R. K., Gray, R. G., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13420 · Cited by 75
Robson, S., Kelly, T., Howel, Deverill, M., Hewison, J., Lie, M., Stamp, E., Armstrong, N., & May, C. (2009) · Health Technology Assessment · doi:10.3310/hta13530 · Cited by 62
Brown, T. J., Pilkington, G., Bagust, A., Boland, A., Oyee, J., Smith, C. T., Blundell, M., Lai, M., Saborido, C. M., Greenhalgh, J., et al. (2013) · Health Technology Assessment · doi:10.3310/hta17310 · Cited by 70
Comparison of case note review methods for evaluating quality and safety in health care
Lock, C. A., Wilson, J. A., Steen, N., Eccles, M., Mason, H., Carrie, S., Clarke, R. W., Kubba, H., Raine, C. H., Zarod, A., et al. (2010) · Health Technology Assessment · doi:10.3310/hta14130 · Cited by 63
Coleman, T., Agboola, S., Leonardi-Bee, J., Taylor, M., McEwen, A., & McNeill, A. (2010) · Health Technology Assessment · doi:10.3310/hta14490 · Cited by 62
How well do search filters perform in identifying economic evaluations in MEDLINE and EMBASE
Glanville, J., Kaunelis, D., & Mensinkai, S. (2009) · International Journal of Technology Assessment in Health Care · doi:10.1017/s0266462309990523 · Cited by 62
“(13), Royle and Waugh (15), Sassi et al.”
BackgroundMethodInfluentialNon-occupational postexposure prophylaxis for HIV: a systematic review
Bryant, J., Baxter, L., & Hird, S. (2009) · Health Technology Assessment · doi:10.3310/hta13140 · Cited by 62
Screening for hyperglycaemia in pregnancy: a rapid update for the National Screening Committee
Waugh, N., Royle, P., Clar, C., Henderson, R., Cummins, E., Hadden, D., Lindsay, R., & Pearson, D. (2010) · Health Technology Assessment · doi:10.3310/hta14450 · Cited by 60
Self-citationTaylor, R. S., & Elston, J. (2009) · Health Technology Assessment · doi:10.3310/hta13080 · Cited by 63
McKenna, C., McDaid, C., Suekarran, S., Hawkins, N., Claxton, K., Light, K., Chester, M., Cleland, J. G. F., Woolacott, N. F., & Sculpher, M. (2009) · Health Technology Assessment · doi:10.3310/hta13240 · Cited by 66
Cahill, J., Barkham, M., Hardy, G., Gilbody, S., Richards, D., Bower, P., Audin, K., & Connell, J. (2008) · Health Technology Assessment · doi:10.3310/hta12240 · Cited by 57
POTTER, J. F., Mistri, A. K., Brodie, F. G., Tchernova, J., Wilson, E., Jagger, C., James, M. A., Ford, G. A., & Robinson, T. G. (2009) · Health Technology Assessment · doi:10.3310/hta13090 · Cited by 58
Tyrer, P. J., Oliver, P., Romeo, R., Knapp, M. R. J., Huline‐Dickens, S., Bouras, N., Ahmed, M. Z., Cooray, S., Deb, S. S., Murphy, D., et al. (2009) · Health Technology Assessment · doi:10.3310/hta13210 · Cited by 56
Immunosuppressive T-cell antibody induction for heart transplant recipients
Penninga, L., Møller, C. H., Gustafsson, F., Gluud, C. N., & Steinbrüchel, D. A. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008842.pub2 · Cited by 61
Manchikanti, L., Derby, R., Wolfer, L., Singh, V., Datta, S., & Hirsch, J. A. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/929 · Cited by 64
Haby, M. M., Chapman, E., Clark, R., Barreto, J. O. M., Revéiz, L., & Lavis, J. N. (2015) · Implementation Science · doi:10.1186/s13012-016-0472-9 · Cited by 57
Obama Health Care for All Americans: Practical Implications
Manchikanti, L., & Hirsch, J. A. (2009) · Pain Physician · doi:10.36076/ppj.2009/12/289 · Cited by 53
Hemingway, H., Henriksson, M., Chen, R., Damant, J., Fitzpatrick, N. K., Abrams, K. R., Hingorani, A. D., Janzon, M., Shipley, M. J., Feder, G. S., et al. (2010) · Health Technology Assessment · doi:10.3310/hta14090 · Cited by 56
Systematic reviews of epidemiology in diabetes: finding the evidence
Royle, P., Bain, L., & Waugh, N. (2005) · BMC Medical Research Methodology · doi:10.1186/1471-2288-5-2 · Cited by 51
Self-citationMunk, C., Portnoy, A., Suharlim, C., Clarke‐Deelder, E., Brenzel, L., Resch, S., & Menzies, N. A. (2019) · BMC Health Services Research · doi:10.1186/s12913-019-4468-4 · Cited by 53
Lefebvre, C., Glanville, J., Beale, S., Boachie, C., Duffy, S., Fraser, C., Harbour, J., McCool, R., & Smith, L. (2017) · Health Technology Assessment · doi:10.3310/hta21690 · Cited by 49
Antibody induction therapy for lung transplant recipients
Penninga, L., Møller, C. H., Penninga, E. I., Iversen, M., Gluud, C. N., & Steinbrüchel, D. A. (2013) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd008927.pub2 · Cited by 54
Expert searching in public health.
Alpi, K. M. (2005) · PubMed Central · Cited by 47
Uthman, O. A., Popoola, T. A., Uthman, M. M. B., & Aremu, O. (2010) · PLoS ONE · doi:10.1371/journal.pone.0009628 · Cited by 55
“These keywords were combined with an economic study filter based on the Centre for Review Disseminations model [23,24].”
MethodSpeed, C., Heaven, B., Adamson, A., Bond, J., Corbett, S., Lake, A., May, C., Vanoli, A., McMeekin, P., Moynihan, P., et al. (2010) · Health Technology Assessment · doi:10.3310/hta14520 · Cited by 44
Huxley, N., Crathorne, L., Varley‐Campbell, J., Tikhonova, I. A., Snowsill, T., Briscoe, S., Peters, J., Bond, M. L., Napier, M., & Hoyle, M. (2017) · Health Technology Assessment · doi:10.3310/hta21380 · Cited by 48
“This was because we did not search the European Society of Medical Oncology (ESMO) conference database, instead checking the American Society of Clinical Oncology database, in line with published recommendations on searching for health technology assessment (HTA) reviews.(102) This study would have been excluded from…”
MethodYoung, I., Waddell, L. A., Sánchez, J., Wilhelm, B., McEwen, S. A., & Rajić, A. (2013) · Preventive Veterinary Medicine · doi:10.1016/j.prevetmed.2013.11.009 · Cited by 53
Deeming, S., Searles, A., Reeves, P., & Nilsson, M. (2017) · Health Research Policy and Systems · doi:10.1186/s12961-017-0180-1 · Cited by 47
“The review comprised a systematic search of a finite number of key publication databases, a rigorous review of the grey literature and extensive hand searching of cited references [23, 24] (Fig.”
BackgroundAra, R., Pandor, A., Stevens, J., Rees, A., & Rafia, R. (2009) · Health Technology Assessment · doi:10.3310/hta13340 · Cited by 54
Metadata
- Authors
- Royle, P., & Waugh, N.
- Affiliations
- University of Aberdeen (GB)
- ORCID
- Waugh, N
- Venue
- Health Technology Assessment
- Published
- 2003-11
- Volume
- 7
- Issue
- 34
- Pages
- iii, ix-x, 1
- ISSN
- 1366-5278 (ISSN-L)
- 2046-4924
- OpenAlex
- W2119297205
- Cited by
- 194
- References
- 37
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 1 · 2022: 4 · 2021: 6 · 2020: 4 · 2019: 3 · 2018: 4 · 2017: 8 · 2016: 12 · 2015: 9 · 2014: 3 · 2013: 13 · 2012: 5
- FWCI
- 13.24
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Health Technology Assessment (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Warwick Research Archive Portal (University of Warwick) (acceptedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- University of Warwick (cc-by)
- Funders
- Health Technology Assessment programme (02/30/01)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Keywords
- literature searching, National Institute for Clinical Excellence, database indexing, MEDLINE, Embase, search filters, economic models, bibliographic databases, BIOSIS
- MeSH terms
- Abstracting and Indexing, Cost-Benefit Analysis, United Kingdom, Medical Informatics, Research Design, Technology Assessment, Biomedical, Randomized Controlled Trials as Topic, Databases, Bibliographic, Information Storage and Retrieval
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.