Practical scrubbing: Getting to the bad sector at the right time
The DOI matches its Crossref record; 24 of the 28 references it cites were found in a registry or an index.
Abstract
Latent sector errors (LSEs) are a common hard disk failure mode, where disk sectors become inaccessible while the rest of the disk remains unaffected. To protect against LSEs, commercial storage systems use scrubbers: background processes verifying disk data. The efficiency of different scrubbing algorithms in detecting LSEs has been studied in depth; however, no attempts have been made to evaluate or mitigate the impact of scrubbing on application performance. We provide the first known evaluation of the performance impact of different scrubbing policies in implementation, including guidelines on implementing a scrubber. To lessen this impact, we present an approach giving conclusive answers to the questions: when should scrubbing requests be issued, and at what size, to minimize impact and maximize scrubbing throughput for a given workload. Our approach achieves six times more throughput, and up to three orders of magnitude less slowdown than the default Linux I/O scheduler.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Existing archival storage solutions, such as magnetic tapes and hard disk drives, suffer from limited media lifespans that render them unsuitable for long-term data retention1–3.”
From Laser writing in glass for dense, fast and efficient archival data storage (2026) · cites this paper as [1]
In the citing paper
“Most digital archive systems rely on media that degrade within a few years1–3.”
From Laser writing in glass for dense, fast and efficient archival data storage (2026) · cites this paper as [1]
Citations
Cites
A new look at the statistical model identification
Akaike, H. (1974) · IEEE Transactions on Automatic Control · doi:10.1109/tac.1974.1100705 · Cited by 51,879 · cited 1×
“We estimate the order p using Akaike’s Information Criterion [22], that optimizes the ratio between the number of parameters and the accuracy of the resulting model.”
MethodAutoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction Data
Engle, R. F., & Russell, J. R. (1998) · Econometrica · doi:10.2307/2999632 · Cited by 1,817
The World’s Technological Capacity to Store, Communicate, and Compute Information
Hilbert, M., & López, P. (2011) · Science · doi:10.1126/science.1200970 · Cited by 1,643
Ruemmler, C., & Wilkes, J. (1993) · USENIX Winter · Cited by 428
Autoregressive Conditional Duration: A New Model for Irregularly Spaced Transaction DataPreprint
Russell, J. R., & Engle, R. F. (1998) · SSRN Electronic Journal · Cited by 337
An analysis of latent sector errors in disk drives
Bairavasundaram, L. N., Goodson, G. R., Pasupathy, S., & Schindler, J. (2007) · Proceedings of the 2007 ACM SIGMETRICS international conference on Measurement and modeling of computer systems · doi:10.1145/1254882.1254917 · Cited by 296
Golding, R. A., Bösch, P., Staelin, C., Sullivan, T., & Wilkes, J. (1995) · USENIX Annual Technical Conference · Cited by 264
Argon: performance insulation for shared storage servers
Wachs, M., Abd-El-Malek, M., Thereska, E., & Ganger, G. R. (2007) · File and Storage Technologies · Cited by 243
Data Analysis and Graphics Using R: An Example-based Approach
Maindonald, J., & Braun, J. (2006) · Cambridge University Press eBooks · doi:10.1017/cbo9780511790935 · Cited by 169
Modelling Irregularly Spaced Financial Data
Hautsch, N. (2004) · Lecture notes in economics and mathematical systems · doi:10.1007/978-3-642-17015-7 · Cited by 152
Research works printed but not linked: 3
- axboe, 2004, Linux block IO - Present and future, Proc of the Ottawa Linux Symposium
- 0, I/O Traces Tools and Analysis Repository
- oprea, 2010, A clean-slate look at disk scrubbing, Proc of USENIX FAST
Cited by
Predicting Node Failures in an Ultra-Large-Scale Cloud Computing Platform: An AIOps Solution
Li, Y., Jiang, Z. M. (., Li, H., Hassan, A. E., He, C., Huang, R., Zeng, Z., Wang, M., & Chen, P. (2020) · ACM Transactions on Software Engineering and Methodology · doi:10.1145/3385187 · Cited by 82
SD Codes: Erasure Codes Designed for How Storage Systems Really Fail
Plank, J. S., Blaum, M., & Hafner, J. L. (n.d.) · Cited by 72
Sector-Disk (SD) Erasure Codes for Mixed Failure Modes in RAID Systems
Plank, J. S., & Blaum, M. (2014) · ACM Transactions on Storage · doi:10.1145/2560013 · Cited by 69
Design Tradeoffs for {SSD} Reliability
Kim, B. S. J., Choi, J., & Min, S. L. (2019) · Seoul National University Open Repository (Seoul National University) · Cited by 62
Project Silica: Towards Sustainable Cloud Archival Storage in Glass
Anderson, P., Aranas, E. B., Assaf, Y., Behrendt, R., Black, R., Caballero, M., Cameron, P., Canakci, B., Carvalho, T. D., Chatzieleftheriou, A., et al. (2023) · ACM SIGOPS Symposium on Operating Systems Principles (SOSP) · doi:10.1145/3600006.3613208 · Cited by 30
Laser writing in glass for dense, fast and efficient archival data storage
Microsoft Research Project Silica Team, Allison, J., Anderson, P., Aranas, E., Assaf, Y., Black, R., Caballero, M., Canakci, B., Chattaway, J. A., Chatzieleftheriou, A., et al. (2026) · Nature · doi:10.1038/s41586-025-10042-w · Cited by 25
Improving Storage System Reliability with Proactive Error Prediction
Mahdisoltani, F., Stefanovici, I. A., & Schroeder, B. (2017) · USENIX Annual Technical Conference · Cited by 25
Self-citationUnderstanding Real World Data Corruptions in Cloud Systems
Wang, P., Dean, D. J., & Gu, X. (2015) · IEEE International Conference on Cloud Engineering · doi:10.1109/ic2e.2015.41 · Cited by 17
Project Silica: Towards Sustainable Cloud Archival Storage in Glass
Anderson, P., Aranas, E., Assaf, Y., Behrendt, R., Black, R., Caballero, M., Cameron, P., Canakci, B., Chatzieleftheriou, A., Clarke, R., et al. (2025) · ACM Transactions on Storage · doi:10.1145/3708996 · Cited by 13
“Since bit rot occurs in both over time, storage systems use scrubbing [5, 48, 49] to guarantee data integrity.”
Scrub Unleveling: Achieving High Data Reliability at Low Scrubbing Cost
Jiang, T., Huang, P. S., & Zhou, K. (2019) · Design, Automation, and Test in Europe · doi:10.23919/date.2019.8715169 · Cited by 10
Meshram, A., & Shrawankar, U. N. (2013) · International Journal of Computer Applications · doi:10.5120/12833-9973 · Cited by 3
A page lifetime-aware scrubbing scheme for improving reliability of Flash-based SSD
Li, N., Xie, Q., Wang, Y., Liu, X., Liu, H., & Yi, W. (2017) · IEICE Electronics Express · doi:10.1587/elex.14.20170831 · Cited by 3
Evaluating the viability of remote renewable energy in datacentre computing
Akoush, S., Sohan, R., Rice, A. C., & Hopper, A. (2016) · CL Technical Reports · doi:10.48456/tr-889 · Cited by 3
Project Silica: sustainable cloud archival storage in glass
Stefanovici, I. A., Anderson, P., Aranas, E. B., Black, R., Cabellero, M., Canakci, B., Chatzieleftheriou, A., Clegg, J., Cletheroe, D., Cooper, B., et al. (2024) · Frontiers in Ultrafast Optics: Biomedical, Scientific, and Industrial Applications · doi:10.1117/12.3010515 · Cited by 2
Han, J., Zhu, G., Lee, E., & Son, Y. (2021) · Cluster Computing · doi:10.1007/s10586-021-03353-w · Cited by 2
Efficient online memory error assessment and circumvention for Linux with RAMpage
Schirmeier, H., Korb, I., Spinczyk, O., & Engel, M. (2013) · International Journal of Critical Computer-Based Systems · doi:10.1504/ijccbs.2013.058397 · Cited by 2
Protecting Single Shingled Write Drives Against Latent Sector Failures
Schwarz, T. (2018) · ACM International Systems and Storage Conference (SYSTOR) · doi:10.1145/3211890.3211893 · Cited by 2
Achieving high data reliability at low scrubbing cost via failure-aware scrubbing
Jiang, T., Huang, P. S., & Zhou, K. (2020) · Journal of Parallel and Distributed Computing · doi:10.1016/j.jpdc.2020.05.007 · Cited by 1
An Efficient and Parallel Bad Block Checker for Parallelism of Storage Devices
Han, J., Zhu, G., Lee, E., & Son, Y. (2020) · IEEE International Conference on Autonomic Computing and Self-Organizing Systems Companion (ACSOS-C) · doi:10.1109/acsos-c51401.2020.00022 · Cited by 1
Investigation and Simulation of Hardware Errors in Kernel Logs of Linux-based Server Systems
Georgoulopoulos, N., Hatzopoulos, A. A., Karamitsios, K., Tabakis, I.-M., Kotrotsios, K., & Metsai, A. I. (2021) · South-East Europe Design Automation, Computer Engineering, Computer Networks and Social Media Conference (SEEDA-CECNSM) · doi:10.1109/seeda-cecnsm53056.2021.9566232 · Cited by 1
RAID Organizations for Improved Reliability and Performance: A Not Entirely Unbiased TutorialPreprint
Thomasian, A. (2023) · arXiv (Cornell University) · doi:10.48550/arxiv.2306.08763 · Cited by 1
Thomasian, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2401.03235 · Cited by 1
Paired-replicas with constant repair time: Loss functions and memorylessness
Deolalikar, V. (2013) · IEEE International Conference on Big Data (BigData) · doi:10.1109/bigdata.2013.6691657
Data Management for Shingled Magnetic Recording Disks
Pitchumani, R. (2015) · eScholarship (California Digital Library)
Unobtrusive Storage Maintenance
Amvrosiadis, G. (2016) · TSpace (University of Toronto)
Self-citationThe Reliability and Error Mitigation of the Storage Stack
Hwang, A. A. (2023) · TSpace (University of Toronto)
Metadata
- Authors
- Amvrosiadis, G., Oprea, A., & Schroeder, B.
- Affiliations
- University of Toronto (CA)
- Venue
- IEEE/IFIP International Conference on Dependable Systems and Networks (DSN 2012)
- Publisher
- IEEE
- Published
- 2012-06
- Pages
- 1-12
- ISSN
- 1530-0889 (ISSN-L)
- OpenAlex
- W1998799629
- Cited by
- 20
- References
- 28
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 1 · 2021: 2 · 2020: 3 · 2019: 2 · 2018: 1 · 2017: 2 · 2015: 1 · 2014: 1 · 2013: 4
- FWCI
- 1.61
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- International Conference on Dependable Systems & Networks/Proceedings (publishedVersion)
- Funders
- Microsoft Research
- Topics
- Physical Sciences › Computer Science › Computer Networks and Communications › Advanced Data Storage Technologies
- Physical Sciences › Computer Science › Computer Networks and Communications › Software System Performance and Reliability
- Physical Sciences › Computer Science › Information Systems › Advanced Database Systems and Queries
- Keywords
- hard disk drives, I/O scheduling, storage reliability
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.