The DOI matches its Crossref record; 39 of the 40 references it cites were found in a registry or an index.
First audit of macroinvertebrate samples from an EU Water Framework Directive monitoring program: human error greatly lowers precision of assessment results
Open accessAbstract
Invertebrates are often used in biological monitoring of soil and water ecosystems. Because of the huge number of invertebrate species, sample processing (sorting and identification) is a labor-intensive and often difficult task that is prone to error. These errors can bias assessment results, which often are used by environmental managers to guide funding decisions for costly restoration measures. However, quality control of assessment results is not implemented in many freshwater monitoring programs. We conducted the first audit of an official European freshwater monitoring program based on 414 macroinvertebrate samples from streams and rivers in Germany. The samples were collected by personnel at 7 different commercial environmental laboratories using the European Union (EU) Water Framework Directive protocol. We audited 12% of all samples at 3 different levels: 1) a sorting audit, 2) an identification audit, and 3) a total audit based on both sorting and identification. The sorting audit revealed that 29% of the specimens and every 5th taxon (20.6%) had been overlooked by the primary analyst. Differences in sorting were correlated with taxon body size (r = 0.61, p < 0.001). The identification audit showed that >30% of taxa differed between the results of the primary analysts and auditors. Taxa considered difficult to identify were not more prone to error than were taxa considered easier to identify. Primary analysts and auditors assigned 34% of audited samples to different quality classes in ≥1 of 3 assessment modules (organic pollution, acidification, and general degradation). For 16% of the samples, these changes resulted in a different final ecological assessment. Such a high rate of differences between primary analysts and auditors could lead to ineffective allocation of several million Euros. Our results clearly illustrate the need for adequate quality control and auditing in freshwater monitoring.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“many benthic invertebrate larvae are difficult to identify at the species level, and thus the most practical taxonomic level for the identification of these organisms is often only the genus or family [10].”
In the citing paper
“frequent identification errors occur and many specimens are not detected in samples [10]”
In the citing paper
“these limitations have direct consequences for the inferred ecosystem assessment metrics [10,14] and thus management decisions.”
In the citing paper
“While this is already better than the error rates of several morphology-based studies (see [10] for a discussion)”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
A fuzzy coding approach for the analysis of long‐term ecological data
CHEVENE, F., DOLÉADEC, S., & Chessel, D. (1994) · Freshwater Biology · doi:10.1111/j.1365-2427.1994.tb01742.x · Cited by 1,025
The Patch Dynamics Concept of Stream Community Ecology
Townsend, C. R. (1989) · Journal of the North American Benthological Society · doi:10.2307/1467400 · Cited by 942
Patch Dynamics in Lotic Systems: The Stream as a Mosaic
Pringle, C. M., Naiman, R. J., Bretschko, G., Karr, J. R., Oswood, M. W., Webster, J. R., WELCOMME, R. L., & Winterbourn, M. J. (1988) · Journal of the North American Benthological Society · doi:10.2307/1467303 · Cited by 636
Wright, J. F., Moss, D., Armitage, P. D., & Furse, M. T. (1984) · Freshwater Biology · doi:10.1111/j.1365-2427.1984.tb00039.x · Cited by 566
Commission of the European Communities
Appleyard, R. K. (1985) · Springer eBooks · doi:10.1007/978-94-009-5452-6_3 · Cited by 535
Karr, J. R., & Chu, E. W. (2000) · Hydrobiologia · doi:10.1023/a:1017097611303 · Cited by 291
AusRivAS: using macroinvertebrates to assess ecological condition of rivers in Western Australia
Smith, M. J., Kay, W. R., Edward, D. H. D., Papas, P., Richardson, K. S. J., Simpson, J. C., PINDER, A. M., Cale, D. J., Horwitz, P., Davis, J. A., et al. (1999) · Freshwater Biology · doi:10.1046/j.1365-2427.1999.00430.x · Cited by 289
Downes, B. J., Lake, P. S., & Schreiber, E. S. G. (1993) · Freshwater Biology · doi:10.1111/j.1365-2427.1993.tb00793.x · Cited by 232
Wright, J., Sutcliffe, D. W., Furse, M. T., & Australia, A. E. (2000) · Freshwater Biological Association eBooks · Cited by 216
The STAR project: context, objectives and approaches
Furse, M. T., Hering, D., Moog, O., Verdonschot, P. F. M., Johnson, R. K., Brabec, K., Gritzalis, K., Buffagni, A., Pinto, P., Friberg, N. R., et al. (2006) · Hydrobiologia · doi:10.1007/s10750-006-0067-6 · Cited by 216
Self-citation
Research works printed but not linked: 7
- BAYERISCHES LANDESAMT FÜR WASSERWIRTSCHAFT, Qualitätssicherung in der biologischen Gewässeranalyse - Bestimmungsliteratur und Bestimmbarkeitskategorien. Materialien Nr. 112. Bayerisches Landesamt für Wasserwirtschaft
- BMU WELT, 2005, NATURSCHUTZ UND REAKTORSICHERHEIT)
- CHAPMAN A. D., Principles of data quality. Version 1.0. Report for the Global Biodiversity Information Facility (GBIF). Global Biodiversity Information Facility
- INTERWIES E., A., Handbook for the selection of cost-effective measures according to Art. 11 Water Framework Directive
- MEIER C., J., Weiterentwicklung und Anpassung des nationalen Bewertungssystems für Makrozoobenthos an neue internationale Vorgaben. Fliessgewaesserbewertung
- MURRAY-BLIGH J., J., 2005, Commission to the European Communities
- WRIGHT J. F., Assessing the biological quality of freshwaters: RIVPACS and similar techniques
Cited by
Sorted by citations
Elbrecht, V., & Leese, F. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130324 · Cited by 765
Environmental DNA reveals that rivers are conveyer belts of biodiversity information
Deiner, K., Fronhofer, E. A., Mächler, E., Walser, J., & Altermatt, F. (2016) · Nature Communications · doi:10.1038/ncomms12544 · Cited by 700
Weigand, H., Beermann, A. J., ČIAMPOR, F. J., Costa, F. O., Csabai, Z., Duarte, S., Geiger, M. F., Grabowski, M., Rimet, F., Rulik, B., et al. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.04.247 · Cited by 617
Elbrecht, V., & Leese, F. (2017) · Frontiers in Environmental Science · doi:10.3389/fenvs.2017.00011 · Cited by 495
Elbrecht, V., Vamos, E. E., Meissner, K., Aroviita, J., & Leese, F. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12789 · Cited by 385
Metadata
- Authors
- Haase, P., Pauls, S. U., Schindehütte, K., & Sundermann, A.
- Affiliations
- Senckenberg, Research Institute and Natural History Museum, Department of Limnology and Conservation, Clamecy Strasse 12, 63571 Gelnhausen, Germany
- University of Minnesota (US)
- Venue
- Journal of the North American Benthological Society
- Publisher
- University of Chicago Press
- Published
- 2010-12
- Volume
- 29
- Issue
- 4
- Pages
- 1279-1291
- ISSN
- 0887-3593 (ISSN-L)
- 1937-237X
- OpenAlex
- W2115439841
- Cited by
- 119
- References
- 40
- Citations by year
- 2026: 8 · 2025: 9 · 2024: 10 · 2023: 4 · 2022: 6 · 2021: 11 · 2020: 9 · 2019: 15 · 2018: 10 · 2017: 10 · 2016: 10 · 2015: 7 · 2014: 2 · 2013: 3 · 2012: 2
- FWCI
- 2.32
- Type
- journal article
- Language
- en
- Open access
- green
- www.bioone.org
- Locations
- Journal of the North American Benthological Society (publishedVersion)
- BioOne Complete (BioOne) (submittedVersion)
- Topics
- Physical Sciences › Environmental Science › Ecology › Freshwater macroinvertebrate diversity and ecology
- Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Invertebrate Taxonomy and Ecology
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Environmental Toxicology and Ecotoxicology
- Keywords
- macroinvertebrates, Water Framework Directive, freshwater monitoring, quality control, auditing, human error, taxonomic identification, ecological assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
