Nine quick tips for efficient bioinformatics curriculum development and training
Open accessThe DOI matches its Crossref record; 25 of the 25 references it cites were found in a registry or an index.
Abstract
Biomedical research is becoming increasingly data driven. New technologies that generate large-scale, complex data are continually emerging and evolving. As a result, there is a concurrent need for training researchers to use and understand new computational tools. Here we describe an efficient and effective approach to developing curriculum materials that can be deployed in a research environment to meet this need.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As McClatchy et al. (2020) highlight, similar workshops are often not sequential, causing content to be disjointed and removing learners from a clear trajectory for skills development, which impedes the overall effectiveness of these training sessions.”
From Student‐led workshops: Filling skills gaps in computational research for life scientists (2021) · cites this paper as McClatchy et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Introducing new concepts simultaneously with practical exercises can promote enhanced knowledge retention and are more likely to support future independent development of new skills (Hackathorn et al., 2011; McClatchy et al., 2020).”
From Student‐led workshops: Filling skills gaps in computational research for life scientists (2021) · cites this paper as McClatchy et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“This strategy creates a shared experience for all participants, and encourages peer learning by providing an opportunity for question and answer during guided activities (Brown & Wilson, 2018; McClatchy et al., 2020).”
From Student‐led workshops: Filling skills gaps in computational research for life scientists (2021) · cites this paper as McClatchy et al., 2020
Experimental — accuracy not yet measuredThe source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“Providing space for dual engagement takes advantage of learning being a social activity, which can facilitate improved content understanding (McClatchy et al., 2020) and motivation for further learning beyond the workshop (Tractenberg et al., 2019).”
From Student‐led workshops: Filling skills gaps in computational research for life scientists (2021) · cites this paper as McClatchy et al., 2020
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“Taking advantage of online resources that are already available eases the burden of developing technical content and can shift the focus toward increasing the effectiveness of the learning experience (McClatchy et al., 2020).”
From Student‐led workshops: Filling skills gaps in computational research for life scientists (2021) · cites this paper as McClatchy et al., 2020
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Scikit-learn: Machine Learning in Python
Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Müller, A., Nothman, J., Louppe, G., et al. (2012) · arXiv · doi:10.48550/arxiv.1201.0490 · Cited by 71,016 · cited 1×
“In our course on machine learning, we replaced housing price data in the scikit-learn tutorial [43] with protein expression data that are more Fig 2.”
Methodscikit-image: image processing in Python
van der Walt, S., Schönberger, J. L., Nunez-Iglesias, J., Boulogne, F., Warner, J. D., Yager, N., Gouillart, E., & Yu, T. (2014) · PeerJ · doi:10.7717/peerj.453 · Cited by 6,794
The Cambridge Handbook of Multimedia Learning
(2005) · doi:10.1017/cbo9780511816819 · Cited by 1,595
Schmidt, R. A., & Bjork, R. A. (1992) · Psychological Science · doi:10.1111/j.1467-9280.1992.tb00029.x · Cited by 1,582 · cited 1×
“When practical exercises resemble tasks that learners would use in their work, retention and transfer of skills to work are enhanced [45].”
BackgroundThe Science of Training and Development in Organizations: What Matters in Practice
Salas, E., Tannenbaum, S. I., Kraiger, K., & Smith-Jentsch, K. A. (2012) · Psychological Science in the Public Interest · doi:10.1177/1529100612436661 · Cited by 1,104 · cited 3×
“Training that promotes an organization’s competitiveness or differentiates it from others should be prioritized to meet organizational needs [6].”
BackgroundMethodInfluentialPython Data Science Handbook: Essential Tools for Working with Data
Vanderplas, J. (2016) · Cited by 686
R for Data Science: Import, Tidy, Transform, Visualize, and Model Data
Wickham, H., & Grolemund, G. (2016) · Cited by 524
100 years of training and development research: What we know and where we should go.
Bell, B. S., Tannenbaum, S. I., Ford, J. K., Noe, R. A., & Kraiger, K. (2017) · Journal of Applied Psychology · doi:10.1037/apl0000142 · Cited by 462 · cited 1×
“Real-time assessment enables on-the-fly decision-making [46,47].”
Broman, K. W., Gatti, D. M., Simecek, P., Furlotte, N. A., Prins, P., Sen, Ś., Yandell, B. S., & Churchill, G. A. (2019) · Genetics · doi:10.1534/genetics.118.301595 · Cited by 452
Self-citationLearning, Training, and Development in Organizations
(2009) · Routledge eBooks · doi:10.4324/9780203878385 · Cited by 403
How People Learn II: Learners, Contexts, and Cultures
Illas Limson, S. L. (2025) · Academy of Management Learning & Education · doi:10.5465/amle.2022.0312 · Cited by 367
Introductory Science and Mathematics Education for 21st-Century Biologists
Bialek, W., & Botstein, D. (2004) · Science · doi:10.1126/science.1095480 · Cited by 255
Methods of Rapid Evaluation, Assessment, and Appraisal
McNall, M., & Foster-Fishman, P. G. (2007) · American Journal of Evaluation · doi:10.1177/1098214007300895 · Cited by 251 · cited 1×
“Real-time assessment enables on-the-fly decision-making [46,47].”
Inferring on the intentions of others by hierarchical Bayesian learning
Diaconescu, A. O., Mathys, C., Weber, L. A. E., Daunizeau, J., Kasper, L., Lomakina, E. I., Fehr, E., & Stephan, K. E. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003810 · Cited by 219
A global perspective on evolving bioinformatics and data science training needs
Attwood, T. K., Blackford, S., Brazas, M. D., Davies, A., & Schneider, M. V. (2019) · Briefings in Bioinformatics · doi:10.1093/bib/bbx100 · Cited by 175
Learning by doing: An empirical study of active teaching techniques: (683152011-599)
Solomon, E. D., Hackathorn, J., Tennial, R. E., Blankmeyer, K., & Garczynski, A. M. (2011) · PsycEXTRA Dataset · doi:10.1037/e683152011-599 · Cited by 155 · cited 3×
“Practical skills are best learned in a hands-on setting, which requires guided practice and coaching [28,29].”
BackgroundBioinformatics curriculum guidelines: Toward a definition of core competencies
Welch, L., Lewitter, F., Schwartz, R., Brooksbank, C., Radivojac, P., Gaeta, B., & Schneider, M. V. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003496 · Cited by 137 · cited 1×
“It can be helpful to consider learner personae that personify the target audience [3,26].”
BackgroundTen simple rules for making training materials FAIR
Garcia, L., Batut, B., Burke, M. L., Kuzak, M., Psomopoulos, F. E., Arcila, R., Attwood, T. K., Beard, N., Carvalho‐Silva, D., Dimopoulos, A. C., et al. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007854 · Cited by 71 · cited 1×
“Openly accessible materials can be adapted and taught by others, which has a multiplier effect for the reach of the work [48].”
BackgroundIrizarry, R. A. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429341830 · Cited by 59 · cited 3×
“The Python Data Science Handbook [20], Hands-on Programming with R [21], Data Analysis for the Life Sciences [22], R for Data Science [23], and Introduction to Data Science [24] all have free versions available from the authors or publishers.”
Method(2014) · Nature Methods · doi:10.1038/nmeth.2837 · Cited by 28
Tractenberg, R. E., Lindvall, J. M., Attwood, T. K., & Via, A. (2019) · PLOS ONE · doi:10.1371/journal.pone.0225256 · Cited by 27
Training and Personal Development
Kraiger, K., & Cavanagh, T. M. (2014) · Wiley eBooks · doi:10.1002/9781118736982.ch13 · Cited by 17
Wilson, G. (2019) · Chapman & Hall/CRC eBooks · doi:10.1201/9780429330704 · Cited by 17
Data Analysis for the Life Sciences with R
Irizarry, R. A., & Love, M. I. (2016) · Chapman & Hall/CRC eBooks · doi:10.1201/9781315367002 · Cited by 13 · cited 4×
“We worked closely with a computer scientist who served as a nonexpert partner to help translate statistical concepts in Data Analysis for the Life Sciences [22], making them accessible to learners with little or no statistics background by rephrasing concepts with language that a nonstatistician might use [12].”
BackgroundMethodInfluentialSoftware Carpentry: R For Reproducible Scientific Analysis
Allen, J. D., Arnold, J., Bachant, P., Banaszkiewicz, P., Bekolay, T., Black, M., Blischak, J., Boughton, A., Broman, K. W., Cabunoc Mayes, A., et al. (2016) · Figshare · doi:10.5281/zenodo.57520 · Cited by 1 · cited 1×
“We regularly offer Software Carpentry’s introductory Python and R training [34,35] to bring learners up to speed in programming skills needed to successfully participate in more advanced topics such as Basic Image Analysis with Python and Quantitative Trait Mapping [13,17].”
Method
Research works printed but not linked: 11
- G Wiggins, 2005, Understanding By Design
- National Academies of Sciences, Engineering, and Medicine, Medicine, 2015, Reproducibility Issues in Research with Animals and Animal Models: Workshop in Brief
- Challenges in irreproducible research [Internet]. Nature. [cited 2020 Feb 23]. Available from: https://www.nature.com/collections/prbfkwmwvz/
- Statistics for Biologists [Internet]. [cited 2020 Mar 11]. Available from: https://www.nature.com/collections/qghhqm/content/practical-guides
- G Grolemund, 2014, Hands-on programming with R
- MTH Chi, 2005, Complex Declarative Learning. In: The Cambridge handbook of thinking and reasoning, 371
- National Research Council, 2009, A New Biology for the 21st Century
- A Lee, 2018, Software Carpentry: Plotting and Programming in Python
- MJ Nathan, Expert Blind Spot: When Content Knowledge Eclipses Pedagogical Content Knowledge., 6
- D Wiliam, 2008, The Future of Assessment
- G Wilson, 2016, Software Carpentry: Lesson Example
Cited by
Student‐led workshops: Filling skills gaps in computational research for life scientists
LaTourrette, K., Stengel, A., & Clarke, J. (2021) · Natural Sciences Education · doi:10.1002/nse2.20052 · Cited by 6
A data science practicum to introduce undergraduate students to bioinformatics for research
Bartlett, B. R., Stitt‐Bergh, M., Kantar, M. B., & Bingham, J. (2023) · Biochemistry and Molecular Biology Education · doi:10.1002/bmb.21762 · Cited by 6
“Efforts to increase the number of informatics/data science courses in undergraduate curricula often fail to emphasize general principles of data science or consider skills required to perform analysis of multi-format data.(3) To be sure, articulating clearly defined general principles is imperative for students to cho…”
BackgroundLi, Z., Li, Z., Heng, J., Jiang, S., & Chen, X. (2026) · BMC Public Health · doi:10.1186/s12889-026-26345-0 · Cited by 11
“Recent studies have emphasized the critical role of first aid knowledge in enhancing public preparedness, particularly in emergency situations [12, 13], Several investigations among university students have shown that, although attitudes toward first aid are generally positive, both knowledge and…”
Training biologists in Unix command-line skills: From curriculum to interactive online tutorials
Khamvongsa-Charbonnier, L., Aboukhalil, R., Chiapello, H., Denecker, T., Poulain, P., Puthier, D., Sand, O., Thomas‐Chollier, M., & Toffano‐Nioche, C. (2026) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1014133 · Cited by 1
“We used the tips described in [15] to develop a Unix command line curriculum for life scientists with little or no command line experience.”
An Brief Examination of Case Studies in Reproducibility for Bioinformatics Training
Alsafwani, Z. W., & Cooper, K. M. (2021) · IEEE International Conference on Bioinformatics and Biomedicine (BIBM) · doi:10.1109/bibm52615.2021.9669698
Metadata
- Authors
- McClatchy, S., Bass, K. M., Gatti, D. M., Moylan, A., & Churchill, G.
- Affiliations
- Jackson Laboratory (US)
- College of the Atlantic (US)
- Corresponding author
- McClatchy, Susan
- Venue
- PLOS Computational Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-07-23
- Volume
- 16
- Issue
- 7
- Pages
- e1008007
- ISSN
- 1553-734X (ISSN-L)
- 1553-7358
- PMC
- PMC7377369
- OpenAlex
- W3044595157
- Cited by
- 8
- References
- 24
- Citations by year
- 2026: 2 · 2025: 1 · 2024: 1 · 2023: 1 · 2022: 1 · 2021: 2
- FWCI
- 0.32
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Computational Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- The Mouseion at the JAXlibrary (Jackson Laboratory) (submittedVersion, cc-by)
- Funders
- National Institutes of Health
- National Institute of General Medical Sciences (R25GM123516)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genetics, Bioinformatics, and Biomedical Research
- Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
- Physical Sciences › Computer Science › Computer Science Applications › Teaching and Learning Programming
- Keywords
- bioinformatics education, curriculum development, research training, computational tools, training materials
- MeSH terms
- Algorithms, Computer Graphics, Curriculum, Feedback, Learning, Software, Reproducibility of Results, Program Development, Computational Biology, Internet, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.