The DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Automated subtyping of HIV-1 genetic sequences for clinical and surveillance purposes: Performance evaluation of the new REGA version 3 and seven other tools
Open accessAbstract
BACKGROUND: To investigate differences in pathogenesis, diagnosis and resistance pathways between HIV-1 subtypes, an accurate subtyping tool for large datasets is needed. We aimed to evaluate the performance of automated subtyping tools to classify the different subtypes and circulating recombinant forms using pol, the most sequenced region in clinical practice. We also present the upgraded version 3 of the Rega HIV subtyping tool (REGAv3). METHODOLOGY: HIV-1 pol sequences (PR+RT) for 4674 patients retrieved from the Portuguese HIV Drug Resistance Database, and 1872 pol sequences trimmed from full-length genomes retrieved from the Los Alamos database were classified with statistical-based tools such as COMET, jpHMM and STAR; similarity-based tools such as NCBI and Stanford; and phylogenetic-based tools such as REGA version 2 (REGAv2), REGAv3, and SCUEAL. The performance of these tools, for pol, and for PR and RT separately, was compared in terms of reproducibility, sensitivity and specificity with respect to the gold standard which was manual phylogenetic analysis of the pol region. RESULTS: The sensitivity and specificity for subtypes B and C was more than 96% for seven tools, but was variable for other subtypes such as A, D, F and G. With regard to the most common circulating recombinant forms (CRFs), the sensitivity and specificity for CRF01_AE was ~99% with statistical-based tools, with phylogenetic-based tools and with Stanford, one of the similarity based tools. CRF02_AG was correctly identified for more than 96% by COMET, REGAv3, Stanford and STAR. All the tools reached a specificity of more than 97% for most of the subtypes and the two main CRFs (CRF01_AE and CRF02_AG). Other CRFs were identified only by COMET, REGAv2, REGAv3, and SCUEAL and with variable sensitivity. When analyzing sequences for PR and RT separately, the performance for PR was generally lower and variable between the tools. Similarity and statistical-based tools were 100% reproducible, but this was lower for phylogenetic-based tools such as REGA (~99%) and SCUEAL (~96%). CONCLUSIONS: REGAv3 had an improved performance for subtype B and CRF02_AG compared to REGAv2 and is now able to also identify all epidemiologically relevant CRFs. In general the best performing tools, in alphabetical order, were COMET, jpHMM, REGAv3, and SCUEAL when analyzing pure subtypes in the pol region, and COMET and REGAv3 when analyzing most of the CRFs. Based on this study, we recommend to confirm subtyping with 2 well performing tools, and be cautious with the interpretation of short sequences.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Thompson, J. D., Higgins, D. G., & Gibson, T. J. (1994) · Nucleic Acids Research · doi:10.1093/nar/22.22.4673 · Cited by 64,617
Tamura, K., Peterson, D., Peterson, N., Stecher, G., Nei, M., & Kumar, S. (2011) · Molecular Biology and Evolution · doi:10.1093/molbev/msr121 · Cited by 39,969
Hall, T. A. (1999) · Nucleic Acids Symposium Series · doi:10.14601/phytopathol_mediterr-14998u1.29 · Cited by 38,297
Guindon, S., Dufayard, J.-F., Lefort, V., Anisimova, M., Hordijk, W., & Gascuel, O. (2010) · Systematic Biology · doi:10.1093/sysbio/syq010 · Cited by 18,376
RAxML-VI-HPC: maximum likelihood-based phylogenetic analyses with thousands of taxa and mixed models
Stamatakis, A. (2006) · Bioinformatics · doi:10.1093/bioinformatics/btl446 · Cited by 15,582
jModelTest: Phylogenetic Model Averaging
Posada, D. (2008) · Molecular Biology and Evolution · doi:10.1093/molbev/msn083 · Cited by 10,499
Gouy, M., Guindon, S., & Gascuel, O. (2010) · Molecular Biology and Evolution · doi:10.1093/molbev/msp259 · Cited by 5,782
An Empirical Test of Bootstrapping as a Method for Assessing Confidence in Phylogenetic Analysis
Hillis, D. M., & Bull, J. J. (1993) · Systematic Biology · doi:10.1093/sysbio/42.2.182 · Cited by 3,631
An Empirical Test of Bootstrapping as a Method for Assessing Confidence in Phylogenetic Analysis
Hillis, D. M., & Bull, J. J. (1993) · Systematic Biology · doi:10.2307/2992540 · Cited by 3,423
Lole, K. S., Bollinger, R. C., Paranjape, R. S., Gadkari, D., Kulkarni, S. S., Novak, N. G., Ingersoll, R., Sheppard, H. W., & Ray, S. C. (1999) · Journal of Virology · doi:10.1128/jvi.73.1.152-160.1999 · Cited by 2,695
TREE-PUZZLE: maximum likelihood phylogenetic analysis using quartets and parallel computing
Schmidt, H. A., Strimmer, K., Vingron, M., & von Haeseler, A. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.3.502 · Cited by 2,532
Thompson, M. A., Aberg, J. A., Hoy, J. F., Telenti, A., Benson, C., Cahn, P., Eron, J. J., Günthard, H. F., Hammer, S. M., Reiss, P., et al. (2012) · JAMA · doi:10.1001/jama.2012.7961 · Cited by 2,469
Mansky, L. M., & Temin, H. M. (1995) · Journal of Virology · doi:10.1128/jvi.69.8.5087-5094.1995 · Cited by 1,154
Robertson, D. L., Anderson, J. P., Bradac, J. A., Carr, J. K., Foley, B., Funkhouser, R. K., Gao, F., Hahn, B. H., Kalish, M. L., Kuiken, C., et al. (2000) · Science · doi:10.1126/science.288.5463.55d · Cited by 964
Likelihood-mapping: A simple method to visualize phylogenetic content of a sequence alignment
Strimmer, K., & von Haeseler, A. (1997) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.94.13.6815 · Cited by 941
Phylogenetic Signal, Evolutionary Process, and Rate
Revell, L. J., Harmon, L. J., & Collar, D. C. (2008) · Systematic Biology · doi:10.1080/10635150802302427 · Cited by 879 · cited 1×
“The philosophy of REGA is to avoid assigning sequences with low phylogenetic signal, with the aim to avoid false conclusions about evolutionary relationships (Revell et al., 2008; Strimmer and von Haeseler, 1997).”
BackgroundA simulation comparison of phylogeny algorithms under equal and unequal evolutionary rates.
(1994) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a040126 · Cited by 824
Global trends in molecular epidemiology of HIV-1 during 2000–2007
Hemelaar, J., Gouws, E., Ghys, P. D., & Osmanov, S. (2011) · AIDS · doi:10.1097/qad.0b013e328342ff93 · Cited by 692
Web Resources for HIV Type 1 Genotypic-Resistance Test Interpretation
Liu, T. F., & Shafer, R. W. (2006) · Clinical Infectious Diseases · doi:10.1086/503914 · Cited by 654
Evolutionary analysis of the dynamics of viral infectious disease
Pybus, O. G., & Rambaut, A. (2009) · Nature Reviews Genetics · doi:10.1038/nrg2583 · Cited by 620
The causes and consequences of HIV evolution
Rambaut, A., Posada, D., Crandall, K. A., & Holmes, E. C. (2004) · Nature Reviews Genetics · doi:10.1038/nrg1246 · Cited by 564
Evaluation of diagnostic tests for infectious diseases: general principles
Banoo, S., Bell, D., Bossuyt, P., Herring, A., Mabey, D., Poole, F., Smith, P. G., Sriram, N., Wongsrichanalai, C., Linke, R., et al. (2006) · Nature Reviews Microbiology · doi:10.1038/nrmicro1523 · Cited by 454
High Rate of Recombination throughout the Human Immunodeficiency Virus Type 1 Genome
Jetzt, A. E., Yu, H., Klarmann, G. J., Ron, Y., Preston, B. D., & Dougherty, J. P. (2000) · Journal of Virology · doi:10.1128/jvi.74.3.1234-1240.2000 · Cited by 379
Geno2pheno: estimating phenotypic drug resistance from HIV-1 genotypes
Beerenwinkel, N. (2003) · Nucleic Acids Research · doi:10.1093/nar/gkg575 · Cited by 266
Carr, J. K., Salminen, M. O., Koch, C., Gotte, D., Artenstein, A. W., Hegerich, P. A., St Louis, D., Burke, D. S., & McCutchan, F. E. (1996) · Journal of Virology · doi:10.1128/jvi.70.9.5935-5943.1996 · Cited by 251
Accurate reconstruction of a known HIV-1 transmission history by phylogenetic tree analysis.
Leitner, T., Escanilla, D., Franzén, C., Uhlén, M., & Albert, J. (1996) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.93.20.10864 · Cited by 250
HIV-1 subtype C viruses rapidly develop K65R resistance to tenofovir in cell culture
Brenner, B. G., Oliveira, M., Doualla-Bell, F., Moisi, D. D., Ntemgwa, M., Frankel, F., Essex, M., & Wainberg, M. A. (2006) · AIDS · doi:10.1097/01.aids.0000232228.88511.0b · Cited by 226
Kosakovsky Pond, S. L., Posada, D., Stawiski, E., Chappey, C., Poon, A. F. Y., Hughes, G., Fearnhill, E., Gravenor, M. B., Leigh Brown, A. J., & Frost, S. D. W. (2009) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000581 · Cited by 194
Alcantara, L. C. J., Cassol, S. A., Libin, P., Deforche, K., Pybus, O. G., Ranst, M. A. V., Galvão‐Castro, B., Vandamme, A., & de Oliveira, T. (2009) · Nucleic Acids Research · doi:10.1093/nar/gkp455 · Cited by 193
Self-citationPosada, D., & Crandall, K. A. (2001) · Molecular Biology and Evolution · doi:10.1093/oxfordjournals.molbev.a003890 · Cited by 170
European recommendations for the clinical use of HIV drug resistance testing: 2011 update.
Vandamme, A., Camacho, R. J., Ceccherini‐Silberstein, F., de Luca, A., Palmisano, L., Paraskevis, D. N., Paredes, R., Poljak, M., Schmit, J., Soriano, V., et al. (2011) · PubMed · Cited by 142
Self-citationThe role of recombination in the emergence of a complex and dynamic HIV epidemic
Zhang, M., Foley, B. T., Schultz, A.-K., Macke, J. P., Bulla, I., Stanke, M., Morgenstern, B., Korber, B., & Leitner, T. (2010) · Retrovirology · doi:10.1186/1742-4690-7-25 · Cited by 132
Evaluation of diagnostic tests for infectious diseases: general principles
Banoo, S., Bell, D., Bossuyt, P. M., Herring, A. J., Mabey, D. C. W., Poole, F., Smith, P. G., Sriram, N., Wongsrichanalai, C., Linke, R., et al. (2010) · Nature Reviews Microbiology · doi:10.1038/nrmicro1523z · Cited by 127
Rhee, S., Kantor, R., Katzenstein, D. A., Camacho, R. J., Morris, L., Sirivichayakul, S., Jorgensen, L., Brígido, L. F. D. M., Schapiro, J., & Shafer, R. W. (2006) · AIDS · doi:10.1097/01.aids.0000216363.36786.2b · Cited by 97
Self-citationAbecasis, A. B., Lemey, P., Vidal, N., de Oliveira, T., Peeters, M., Camacho, R. J., Shapiro, B., Rambaut, A., & Vandamme, A. (2007) · Journal of Virology · doi:10.1128/jvi.00463-07 · Cited by 92
Self-citationMartínez-Cajas, J., Pai, N. P., Klein, M. B., & Wainberg, M. A. (2008) · PubMed · Cited by 81
Phylodynamics of the HIV-1 CRF02_AG clade in Cameroon
Faria, N. R., Suchard, M. A., Abecasis, A. B., de Sousa, J. D., Ndembi, N., Bonfim, I., Camacho, R. J., Vandamme, A., & Lemey, P. (2011) · Infection Genetics and Evolution · doi:10.1016/j.meegid.2011.04.028 · Cited by 59
Self-citationA statistical model for HIV-1 sequence classification using the subtype analyser (STAR)
Myers, R. E., Gale, C. V., Harrison, A., Takeuchi, Y., & Kellam, P. (2005) · Computer applications in the biosciences · doi:10.1093/bioinformatics/bti569 · Cited by 43
Dunlop, D. (1965) · BMJ · doi:10.1136/bmj.1.5435.641-a · Cited by 16
Cited by
COMET: adaptive context-based modeling for ultrafast HIV-1 subtype identification
Struck, D., Lawyer, G., Ternes, A.-M., Schmit, J.-C., & Bercoff, D. P. (2014) · Nucleic Acids Research · doi:10.1093/nar/gku739 · Cited by 381
Lanz, C., Meier, J., Stöckle, M., Furrer, H., Calmy, A., Cavassini, M., Bernasconi, E., Schmid, P., Braun, D. L., Kouyos, R. D., et al. (2025) · Clinical Infectious Diseases · doi:10.1093/cid/ciae569 · Cited by 18
“HIV subtypes were determined using the COMET and REGA tools [18, 19]; if results differed, the subtype with higher support was assigned.”
Metadata
- Authors
- Pineda-Peña, A.-C., Faria, N. R., Imbrechts, S., Libin, P., Abecasis, A. B., Deforche, K., Gómez-López, A., Camacho, R. J., de Oliveira, T., & Vandamme, A.-M.
- Venue
- Infection, Genetics and Evolution
- Publisher
- Elsevier BV
- Published
- 2013-10
- Volume
- 19
- Pages
- 337-348
- ISSN
- 1567-1348 (ISSN-L)
- OpenAlex
- W1969028669
- Cited by
- 383
- References
- 39
- FWCI
- 8.31
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.