The DOI matches its Crossref record.
Tidy Data
Open accessAbstract
A huge amount of effort is spent cleaning data to get it ready for analysis, but there has been little research on how to make data cleaning as easy and effective as possible. This paper tackles a small, but important, component of data cleaning: data tidying. Tidy datasets are easy to manipulate, model and visualize, and have a specific structure: each variable is a column, each observation is a row, and each type of observational unit is a table. This framework makes it easy to tidy messy datasets because only a small set of tools are needed to deal with a wide range of un-tidy datasets. This structure also makes it easier to develop tidy tools for data analysis, tools that both input and output tidy datasets. The advantages of a consistent data structure and matching tools are demonstrated with a case study free from mundane data manipulation chores.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Wickham, H., Averick, M., Bryan, J., Chang, W., McGowan, L., François, R., Grolemund, G., Hayes, A., Henry, L., Hester, J., et al. (2019) · Journal of Open Source Software · doi:10.21105/joss.01686 · Cited by 22,138
Self-citationWickham, H. (2016) · Use R! · doi:10.1007/978-3-319-24277-4_9 · Cited by 12,516
Self-citationseaborn: statistical data visualization
Waskom, M. (2021) · Journal of Open Source Software · doi:10.21105/joss.03021 · Cited by 7,310
Simple Features for R: Standardized Support for Spatial Vector Data
Pebesma, E. (2018) · The R Journal · doi:10.32614/rj-2018-009 · Cited by 4,701
landscapemetrics : an open‐source R tool to calculate landscape metrics
Hesselbarth, M. H. K., Sciaini, M., With, K. A., Wiegand, K., & Nowosad, J. (2019) · Ecography · doi:10.1111/ecog.04617 · Cited by 1,280
tidytext: Text Mining and Analysis Using Tidy Data Principles in R
Silge, J., & Robinson, D. (2016) · The Journal of Open Source Software · doi:10.21105/joss.00037 · Cited by 941
Rosenberg, J., Beymer, P., Anderson, D., van Lissa, C. J., & Schmidt, J. (2018) · Journal of Open Source Software · doi:10.21105/joss.00978 · Cited by 785
Mathematics for Machine Learning
Deisenroth, M. P., Faisal, A. A., & Ong, C. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108679930 · Cited by 573
PlotsOfData—A web app for visualizing data together with their summaries
Postma, M., & Goedhart, J. (2019) · PLOS Biology · doi:10.1371/journal.pbio.3000202 · Cited by 553
ggalluvial: Layered Grammar for Alluvial Plots
Brunson, J. (2020) · Journal of Open Source Software · doi:10.21105/joss.02017 · Cited by 522
anndata: Access and store annotated data matrices
Virshup, I., Rybakov, S., Theis, F. J., Angerer, P., & Wolf, F. A. (2024) · Journal of Open Source Software · doi:10.21105/joss.04371 · Cited by 485
nasapower: A NASA POWER Global Meteorology, Surface Solar Energy and Climatology Data Client for R
Sparks, A. (2018) · Journal of Open Source Software · doi:10.21105/joss.01035 · Cited by 414
Machine Learning in Enzyme Engineering
Mazurenko, S., Prokop, Z., & Damborsky, J. (2020) · ACS Catalysis · doi:10.1021/acscatal.9b04321 · Cited by 410
codyn: An r package of community dynamics metrics
Hallett, L. M., Jones, S. K., MacDonald, A. A. M., Jones, M. B., Flynn, D. F. B., Ripplinger, J., Slaughter, P., Gries, C., & Collins, S. L. (2016) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12569 · Cited by 304
Our path to better science in less time using open data science tools
Lowndes, J. S. S., Best, B. D., Scarborough, C., Afflerbach, J. C., Frazier, M. R., O’Hara, C. C., Jiang, N., & Halpern, B. S. (2017) · Nature Ecology & Evolution · doi:10.1038/s41559-017-0160 · Cited by 286
Welbers, K., Van Atteveldt, W., & Benoit, K. (2017) · Communication Methods and Measures · doi:10.1080/19312458.2017.1387238 · Cited by 276
Data-driven strategic planning of building energy retrofitting: the case of Stockholm
Pasichnyi, O., Levihn, F., Shahrokni, H., Wallin, J., & Kordas, O. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.05.373 · Cited by 92
Assessing taxonomic metagenome profilers with OPAL
Meyer, F., Bremges, A., Belmann, P., Janssen, S., McHardy, A. C., & Koslicki, D. (2019) · Genome Biology · doi:10.1186/s13059-019-1646-y · Cited by 80
Many bioinformatics programming tasks can be automated with ChatGPT
Piccolo, S. R., Denny, P., Luxton-Reilly, A., Payne, S., & Ridge, P. G. (2023) · arXiv · doi:10.48550/arxiv.2303.13528 · Cited by 69
The ISB Cancer Genomics Cloud: A Flexible Cloud-Based Platform for Cancer Genomics Research
Reynolds, S. M., Miller, M., Lee, P., Leinonen, K., Paquette, S. M., Rodebaugh, Z., Hahn, A., Gibbs, D. L., Slagel, J., Longabaugh, W. J., et al. (2017) · Cancer Research · doi:10.1158/0008-5472.can-17-0617 · Cited by 63
Fairness and Decision-making in Collaborative Shift Scheduling Systems
Uhde, A., Schlicker, N., Wallach, D. P., & Hassenzahl, M. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376656 · Cited by 64
Wrangling messy CSV files by detecting row and type patterns
van den Burg, G. J. J., Nazábal, A., & Sutton, C. (2019) · Data Mining and Knowledge Discovery · doi:10.1007/s10618-019-00646-y · Cited by 42
Parker, J., Simpson, G. D., & Miller, J. E. (2020) · Sustainability · doi:10.3390/su12187439 · Cited by 23
Arsiwala, A., Bhatt, R., van Niekerk, L., Quintero-Cadena, P., Ao, X., Rosenbaum, A., Bhatt, A., Smith, A., Yang, Y., Anderson, K., et al. (2025) · mAbs · doi:10.1080/19420862.2025.2593055 · Cited by 16
Data Services Librarians’ Responsibilities and Perspectives on Research Data Management
Bishop, B. W., Orehek, A. M., Eaker, C., & Smith, P. L. (2022) · Journal of eScience Librarianship · doi:10.7191/jeslib.2022.1226 · Cited by 11
Li, M., & Zhou, Q. (2017) · 2017 IEEE Trustcom/BigDataSE/ICESS · doi:10.1109/trustcom/bigdatase/icess.2017.322 · Cited by 9
Metadata
- Authors
- Wickham, H.
- Venue
- Journal of Statistical Software
- Publisher
- Foundation for Open Access Statistic
- Published
- 2014
- Volume
- 59
- Issue
- 10
- ISSN
- 1548-7660 (ISSN-L)
- OpenAlex
- W4235243453
- Cited by
- 901
- References
- 0
- FWCI
- 30.70
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.