First audit of macroinvertebrate samples from an EU Water Framework Directive monitoring program: human error greatly lowers precision of assessment results
Open accessAbstract
Invertebrates are often used in biological monitoring of soil and water ecosystems. Because of the huge number of invertebrate species, sample processing (sorting and identification) is a labor-intensive and often difficult task that is prone to error. These errors can bias assessment results, which often are used by environmental managers to guide funding decisions for costly restoration measures. However, quality control of assessment results is not implemented in many freshwater monitoring programs. We conducted the first audit of an official European freshwater monitoring program based on 414 macroinvertebrate samples from streams and rivers in Germany. The samples were collected by personnel at 7 different commercial environmental laboratories using the European Union (EU) Water Framework Directive protocol. We audited 12% of all samples at 3 different levels: 1) a sorting audit, 2) an identification audit, and 3) a total audit based on both sorting and identification. The sorting audit revealed that 29% of the specimens and every 5th taxon (20.6%) had been overlooked by the primary analyst. Differences in sorting were correlated with taxon body size (r = 0.61, p < 0.001). The identification audit showed that >30% of taxa differed between the results of the primary analysts and auditors. Taxa considered difficult to identify were not more prone to error than were taxa considered easier to identify. Primary analysts and auditors assigned 34% of audited samples to different quality classes in ≥1 of 3 assessment modules (organic pollution, acidification, and general degradation). For 16% of the samples, these changes resulted in a different final ecological assessment. Such a high rate of differences between primary analysts and auditors could lead to ineffective allocation of several million Euros. Our results clearly illustrate the need for adequate quality control and auditing in freshwater monitoring.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Many benthic invertebrate larvae are difficult to identify at the species level, so the most practical taxonomic level for identification is often only genus or family.
“many benthic invertebrate larvae are difficult to identify at the species level, and thus the most practical taxonomic level for the identification of these organisms is often only the genus or family [10].”
Frequent identification errors occur and many specimens are not detected in samples.
“frequent identification errors occur and many specimens are not detected in samples [10]”
These limitations have direct consequences for inferred ecosystem assessment metrics and thus management decisions.
“these limitations have direct consequences for the inferred ecosystem assessment metrics [10,14] and thus management decisions.”
The 17% undetected rate is already better than the error rates of several morphology-based studies.
“While this is already better than the error rates of several morphology-based studies (see [10] for a discussion)”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A fuzzy coding approach for the analysis of long‐term ecological data
CHEVENE, F., DOLÉADEC, S., & Chessel, D. (1994) · Freshwater Biology · doi:10.1111/j.1365-2427.1994.tb01742.x · Cited by 1,025 · see citing works
The Patch Dynamics Concept of Stream Community Ecology
Townsend, C. R. (1989) · Journal of the North American Benthological Society · doi:10.2307/1467400 · Cited by 939 · see citing works
Patch Dynamics in Lotic Systems: The Stream as a Mosaic
Pringle, C. M., Naiman, R. J., Bretschko, G., Karr, J. R., Oswood, M. W., Webster, J. R., WELCOMME, R. L., & Winterbourn, M. J. (1988) · Journal of the North American Benthological Society · doi:10.2307/1467303 · Cited by 636 · see citing works
Wright, J. F., Moss, D., Armitage, P. D., & Furse, M. T. (1984) · Freshwater Biology · doi:10.1111/j.1365-2427.1984.tb00039.x · Cited by 566 · see citing works
Commission of the European Communities
Appleyard, R. K. (1985) · Springer eBooks · doi:10.1007/978-94-009-5452-6_3 · Cited by 535 · see citing works
Karr, J. R., & Chu, E. W. (2000) · Hydrobiologia · doi:10.1023/a:1017097611303 · Cited by 291 · see citing works
AusRivAS: using macroinvertebrates to assess ecological condition of rivers in Western Australia
Smith, M. J., Kay, W. R., Edward, D. H. D., Papas, P., Richardson, K. S. J., Simpson, J. C., PINDER, A. M., Cale, D. J., Horwitz, P., Davis, J. A., et al. (1999) · Freshwater Biology · doi:10.1046/j.1365-2427.1999.00430.x · Cited by 289 · see citing works
Downes, B. J., Lake, P. S., & Schreiber, E. S. G. (1993) · Freshwater Biology · doi:10.1111/j.1365-2427.1993.tb00793.x · Cited by 232 · see citing works
Wright, J., Sutcliffe, D. W., Furse, M. T., & Australia, A. E. (2000) · Freshwater Biological Association eBooks · Cited by 216 · see citing works
The STAR project: context, objectives and approaches
Furse, M. T., Hering, D., Moog, O., Verdonschot, P. F. M., Johnson, R. K., Brabec, K., Gritzalis, K., Buffagni, A., Pinto, P., Friberg, N. R., et al. (2006) · Hydrobiologia · doi:10.1007/s10750-006-0067-6 · Cited by 216 · see citing works
Self-citationVariability in stream macroinvertebrates at multiple spatial scales
Li, J. L., Herlihy, A. T., Gerth, W. J., Kaufmann, P. R., Gregory, S. V., Urquhart, S., & Larsen, D. P. (2001) · Freshwater Biology · doi:10.1111/j.1365-2427.2001.00628.x · Cited by 215 · see citing works
Haase, P., Lohse, S., Pauls, S. U., Schindehütte, K., Sundermann, A., Rolauffs, P., & Hering, D. (2004) · Limnologica · doi:10.1016/s0075-9511(04)80005-7 · Cited by 199 · see citing works
Self-citationBöhmer, J., Rawer-Jost, C., Zenker, A. K., Meier, C., Feld, C. K., Biss, R., & Hering, D. (2004) · Limnologica · doi:10.1016/s0075-9511(04)80010-0 · Cited by 134 · see citing works
Towards a multimetric index for the assessment of Dutch streams using benthic macroinvertebrates
Vlek, H. E., Verdonschot, P. F. M., & Nijboer, R. C. (2004) · Hydrobiologia · doi:10.1023/b:hydr.0000025265.36836.e1 · Cited by 113 · see citing works
Chessman, B. C., & Royal, M. J. (2004) · Journal of the North American Benthological Society · doi:10.1899/0887-3593(2004)023 · Cited by 112 · see citing works
Assessing the impact of errors in sorting and identifying macroinvertebrate samples
Haase, P., Murray‐Bligh, J., Lohse, S., Pauls, S. U., Sundermann, A., Gunn, R. J. M., & Clarke, R. T. (2006) · Hydrobiologia · doi:10.1007/s10750-006-0075-6 · Cited by 103 · see citing works
Self-citationData quality, performance, and uncertainty in taxonomic identification for biological assessments
Stribling, J. B., Pavlik, K. L., Holdsworth, S. M., & Leppo, E. W. (2008) · Journal of the North American Benthological Society · doi:10.1899/07-175.1 · Cited by 95 · see citing works
Clarke, R. T., & Hering, D. (2006) · Hydrobiologia · doi:10.1007/s10750-006-0079-2 · Cited by 93 · see citing works
Clarke, R. T., & Hering, D. (2006) · Springer eBooks · doi:10.1007/978-1-4020-5493-8_30 · Cited by 92 · see citing works
Comparison of macroinvertebrate sampling methods in Europe
Friberg, N. R., Sandin, L., Furse, M. T., Larsen, S., Clarke, R. T., & Haase, P. (2006) · Hydrobiologia · doi:10.1007/s10750-006-0083-6 · Cited by 72 · see citing works
Self-citationAssessing the impact of errors in sorting and identifying macroinvertebrate samples
Haase, P., Murray‐Bligh, J., Lohse, S., Pauls, S. U., Sundermann, A., Gunn, R. J. M., & Clarke, R. T. (2006) · Springer eBooks · doi:10.1007/978-1-4020-5493-8_34 · Cited by 70 · see citing works
Self-citationClarke, R. T., Lorenz, A. W., Sandin, L., Schmidt‐Kloiber, A., Strackbein, J., Kneebone, N. T., & Haase, P. (2006) · Springer eBooks · doi:10.1007/978-1-4020-5493-8_31 · Cited by 53 · see citing works
Self-citationClarke, R. T., & MURPHY, J. F. (2006) · Freshwater Biology · doi:10.1111/j.1365-2427.2006.01611.x · Cited by 51 · see citing works
Clarke, R. T., Lorenz, A. W., Sandin, L., Schmidt‐Kloiber, A., Strackbein, J., Kneebone, N. T., & Haase, P. (2006) · Hydrobiologia · doi:10.1007/s10750-006-0078-3 · Cited by 48 · see citing works
Self-citationBraukmann, U., & Biss, R. (2004) · Limnologica · doi:10.1016/s0075-9511(04)80011-2 · Cited by 45 · see citing works
Determining the quality of taxonomic data
Stribling, J. B., Moulton, S. R., & Lester, G. T. (2003) · Journal of the North American Benthological Society · doi:10.2307/1468357 · Cited by 45 · see citing works
Assessing Acid Stress in Swedish Boreal and Alpine Streams Using Benthic Macroinvertebrates
Sandin, L., Dahl, J., & Johnson, R. K. (2004) · Springer eBooks · doi:10.1007/978-94-007-0993-5_8 · Cited by 44 · see citing works
Assessing acid stress in Swedish boreal and alpine streams using benthic macroinvertebrates
Sandin, L., Dahl, J., & Johnson, R. K. (2004) · Hydrobiologia · doi:10.1023/b:hydr.0000025262.98511.46 · Cited by 44 · see citing works
Testing different sorting techniques in macroinvertebrate samples from running waters
Haase, P., Pauls, S. U., Sundermann, A., & Zenker, A. K. (2004) · Limnologica · doi:10.1016/s0075-9511(04)80006-9 · Cited by 37 · see citing works
Self-citationCao, Y., Hawkins, C. P., & Vinson, M. R. (2003) · Freshwater Biology · doi:10.1046/j.1365-2427.2003.01123.x · Cited by 27 · see citing works
Sample Variability Influences on the Precision of Predictive Bioassessment
Nichols, S. J., Robinson, W. A., & Norris, R. H. (2006) · Hydrobiologia · doi:10.1007/s10750-005-9003-4 · Cited by 25 · see citing works
Ranasinghe, J. A., Montagne, D. E., Weisberg, S. B., Bergen, M., & Velarde, R. G. (2003) · Springer eBooks · doi:10.1007/978-94-017-0299-7_18 · Cited by 18 · see citing works
Taxonomy and systematics: contributions to benthology andJ-NABS
Holzenthal, R. W., Robertson, D. R., Pauls, S. U., & Mendez, P. K. (2010) · Journal of the North American Benthological Society · doi:10.1899/08-065.1 · Cited by 17 · see citing works
Self-citationSundermann, A., Pauls, S. U., Clarke, R. T., & Haase, P. (2008) · Fundamental and Applied Limnology / Archiv für Hydrobiologie · doi:10.1127/1863-9135/2008/0173-0021 · Cited by 15 · see citing works
Self-citationOlsen, D. A., Matthaei, C. D., & Townsend, C. R. (2007) · Marine and Freshwater Research · doi:10.1071/mf06202 · Cited by 13 · see citing works
Quality assurance and RIVPACS.
Dines, R. A., & Murray‐Bligh, J. (2000) · Cited by 11 · see citing works
Ranasinghe, J. A., Montagne, D. E., Weisberg, S. B., Bergen, M., & Velarde, R. G. (2003) · Environmental Monitoring and Assessment · doi:10.1023/a:1021333209477 · Cited by 11 · see citing works
Haase, P., Pauls, S. U., Engelhardt, C., & Sundermann, A. (2007) · Limnologica · doi:10.1016/j.limno.2007.06.002 · Cited by 9 · see citing works
Self-citationData Quality Concepts and Techniques Applied to Taxonomic Databases
Dalcin, E. (2005) · ePrints Soton (University of Southampton) · doi:10.5281/zenodo.7310007 · Cited by 7 · see citing works
Flagged first, then by citations
1 of the 40 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- HOLZENTHAL, R. W., D. R. ROBERTSON, S. U. PAULS, AND P. K. MENDEZ. 2010. Taxonomy and systematics: contributions to benthology and future directions. Journal of the North American Benthological Society 29:147-169.
- MURRAY-BLIGH, J., J. VAN DER MOLEN, AND P. VERDONSCHOT. 2005. STAR deliverable No. 7: audit of performance incorporating results of the La Bresse sampling and analysis workshop. Unpublished report to the Stan- dardisation of River Classifications Project, Commis- sion to the European Communities, Brussels, Belg- ium. (Available from: http://www.eu-star.at/pdf/ Deliverable7.pdf)
- OSTERMILLER, J. D., AND C. P. HAWKINS. 2004. Effects of sampling error on bioassessments of stream ecosystems: application to RIVPACS-type models. Journal of the North American Benthological Society 23:363-382.
- USSEGLIO-POLATERA, P. 1991. Repre ´sentation graphique synthe ´tique de la signification e ´cologique d'un peuple- ment. Application aux macroinverte ´bre ´s du Rho ˆne a ` Lyon. Bulletin d'Ecologie 22:195-202.
Cited by
Sorted by citations
Elbrecht, V., & Leese, F. (2015) · PLOS ONE · doi:10.1371/journal.pone.0130324 · Cited by 765 · see citing works
Environmental DNA reveals that rivers are conveyer belts of biodiversity information
Deiner, K., Fronhofer, E. A., Mächler, E., Walser, J., & Altermatt, F. (2016) · Nature Communications · doi:10.1038/ncomms12544 · Cited by 664 · see citing works
Weigand, H., Beermann, A. J., ČIAMPOR, F. J., Costa, F. O., Csabai, Z., Duarte, S., Geiger, M. F., Grabowski, M., Rimet, F., Rulik, B., et al. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.04.247 · Cited by 580 · see citing works
Elbrecht, V., & Leese, F. (2017) · Frontiers in Environmental Science · doi:10.3389/fenvs.2017.00011 · Cited by 465 · see citing works
Elbrecht, V., Vamos, E. E., Meissner, K., Aroviita, J., & Leese, F. (2017) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.12789 · Cited by 385 · see citing works
Pawlowski, J. W., Bruce, K., Panksep, K., Aguirre, F. I., Amalfitano, S., Apothéloz‐Perret‐Gentil, L., Baussant, T., Bouchez, A., Carugati, L., Cermakova, K., et al. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.151783 · Cited by 232 · see citing works
Utility of environmental DNA for monitoring rare and indicator macroinvertebrate species
Mächler, E., Deiner, K., Steinmann, P., & Altermatt, F. (2014) · Freshwater Science · doi:10.1086/678128 · Cited by 214 · see citing works
Haase, P., Hering, D., Jähnig, S. C., Lorenz, A. W., & Sundermann, A. (2012) · Hydrobiologia · doi:10.1007/s10750-012-1255-1 · Cited by 192 · see citing works
Self-citationEnvironmental DNA filtration techniques affect recovered biodiversity
Majaneva, M., Diserud, O. H., Eagle, S. H. C., Boström, E., Hajibabaei, M., & Ekrem, T. (2018) · Scientific Reports · doi:10.1038/s41598-018-23052-8 · Cited by 181 · see citing works
Leese, F., Sander, M., Buchner, D., Elbrecht, V., Haase, P., & Zizka, V. M. A. (2020) · Environmental DNA · doi:10.1002/edn3.177 · Cited by 157 · see citing works
Self-citationLeese, F., Bouchez, A., Abarenkov, K., Altermatt, F., Borja, Á., Bruce, K., Ekrem, T., ČIAMPOR, F. J., Čiamporová‐Zaťovičová, Z., Costa, F. O., et al. (2018) · Advances in ecological research/Advances in Ecological Research · doi:10.1016/bs.aecr.2018.01.001 · Cited by 151 · see citing works
Studying Ecosystems With DNA Metabarcoding: Lessons From Biomonitoring of Aquatic Macroinvertebrates
Bush, A., Compson, Z. G., Monk, W. A., Porter, T. M., Steeves, R., Emilson, E. J. S., Gagné, N., Hajibabaei, M., Roy, M., & Baird, D. J. (2019) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2019.00434 · Cited by 139 · see citing works
Scaling up DNA metabarcoding for freshwater macrozoobenthos monitoring
Elbrecht, V., & Steinke, D. (2018) · Freshwater Biology · doi:10.1111/fwb.13220 · Cited by 115 · see citing works
Freeland, J. R. (2016) · Genome · doi:10.1139/gen-2016-0100 · Cited by 119 · see citing works
Seymour, M., Edwards, F., Cosby, B. J., Bista, I., Scarlett, P., Brailsford, F. L., Glanville, H. C., de Bruyn, M., Carvalho, G. R., & Creer, S. (2021) · Communications Biology · doi:10.1038/s42003-021-02031-2 · Cited by 116 · see citing works
Mauvisseau, Q., Davy‐Bowker, J., Bulling, M. T., Brys, R., Neyrinck, S., Troth, C. R., & Sweet, M. J. (2019) · Scientific Reports · doi:10.1038/s41598-019-50571-9 · Cited by 107 · see citing works
Macher, J., Salis, R. K., Blakemore, K. S., Tollrian, R., Matthaei, C. D., & Leese, F. (2015) · Ecological Indicators · doi:10.1016/j.ecolind.2015.08.024 · Cited by 102 · see citing works
Morinière, J., Hendrich, L., Balke, M., Beermann, A. J., König, T., Hess, M., Koch, S., Müller, R., Leese, F., Hebert, P. D. N., et al. (2017) · Molecular Ecology Resources · doi:10.1111/1755-0998.12683 · Cited by 99 · see citing works
Zizka, V. M. A., Leese, F., Peinert, B., & Geiger, M. F. (2018) · Genome · doi:10.1139/gen-2018-0048 · Cited by 92 · see citing works
Dafforn, K. A., Johnston, E. L., Ferguson, A. J. P., Humphrey, C. L., Monk, W. A., Nichols, S. J., Simpson, S. L., Tulbure, M. G., & Baird, D. J. (2015) · Marine and Freshwater Research · doi:10.1071/mf15108 · Cited by 93 · see citing works
Executing multi-taxa eDNA ecological assessment via traditional metrics and interactive networks.
Seymour, M., Edwards, F. K., Cosby, B., Kelly, M., de Bruyn, M., Carvalho, G., & Creer, S. (2020) · Science of the Total Environment · doi:10.1016/j.scitotenv.2020.138801 · Cited by 78 · see citing works
Hydromorphological restoration of running waters: effects on benthic invertebrate assemblages
Sundermann, A., Antons, C., Cron, N., Lorenz, A. W., Hering, D., & Haase, P. (2011) · Freshwater Biology · doi:10.1111/j.1365-2427.2011.02599.x · Cited by 84 · see citing works
Self-citationWeigand, A. M., & Macher, J.-N. (2018) · Metabarcoding and Metagenomics · doi:10.3897/mbmg.2.26869 · Cited by 78 · see citing works
Hatzenbuhler, C. I., Kelly, J. R., Martinson, J. W., Okum, S. L., & Pilgrim, E. M. (2017) · Scientific Reports · doi:10.1038/srep46393 · Cited by 79 · see citing works
How to learn to stop worrying and love environmental DNA monitoring
Darling, J. A. (2019) · Aquatic Ecosystem Health & Management · doi:10.1080/14634988.2019.1682912 · Cited by 70 · see citing works
da Conceicoa, L. P., Elbrecht, V., Hall, A. C., Briscoe, A. G., Barber‐James, H. M., & Price, B. W. (2020) · Environmental DNA · doi:10.1002/edn3.116 · Cited by 65 · see citing works
Currier, C. A., Morris, T. J., Wilson, C. C., & Freeland, J. R. (2018) · Aquatic Conservation Marine and Freshwater Ecosystems · doi:10.1002/aqc.2869 · Cited by 66 · see citing works
Integrating molecular tools into freshwater ecology: developments and opportunities
Pauls, S. U., Alp, M., Bálint, M., Bernabò, P., ČIAMPOR, F. J., Čiamporová‐Zaťovičová, Z., Finn, D. S., Kohout, J., Leese, F., Lencioni, V., et al. (2014) · Freshwater Biology · doi:10.1111/fwb.12381 · Cited by 65 · see citing works
Self-citationStream water quality assessment by metabarcoding of invertebrates
Kuntke, F., de Jonge, N., Hesselsøe, M., & Nielsen, J. L. (2019) · Ecological Indicators · doi:10.1016/j.ecolind.2019.105982 · Cited by 63 · see citing works
A novel bacterial community index to assess stream ecological health
Lau, K. E. M., Washington, V. J., Fan, V., Neale, M. W., Lear, G., Curran, J. M., & Lewis, G. D. (2015) · Freshwater Biology · doi:10.1111/fwb.12625 · Cited by 62 · see citing works
Increased performance of DNA metabarcoding of macroinvertebrates by taxonomic sorting
Beentjes, K. K., Speksnijder, A. G. C. L., Schilthuizen, M., Hoogeveen, M., Pastoor, R., & van der Hoorn, B. (2019) · PLoS ONE · doi:10.1371/journal.pone.0226527 · Cited by 59 · see citing works
Choice of DNA extraction method affects DNA metabarcoding of unsorted invertebrate bulk samples
Majaneva, M., Diserud, O. H., Eagle, S. H. C., Hajibabaei, M., & Ekrem, T. (2018) · Metabarcoding and Metagenomics · doi:10.3897/mbmg.2.26664 · Cited by 55 · see citing works
Sundberg, P., Kvist, S., & Strand, M. (2016) · PLoS ONE · doi:10.1371/journal.pone.0155541 · Cited by 58 · see citing works
Incorporation of DNA barcoding into a large-scale biomonitoring program: opportunities and pitfalls
Pilgrim, E. M., Jackson, S. A., Swenson, S. J., Turcsanyi, I., Friedman, E., Weigt, L. A., & Bagley, M. J. (2011) · Journal of the North American Benthological Society · doi:10.1899/10-012.1 · Cited by 57 · see citing works
High-throughput environmental DNA analysis informs a biological assessment of an urban stream
Bagley, M. J., Pilgrim, E. M., Knapp, M., Yoder, C. O., Domingo, J. W. S., & Banerji, A. (2019) · Ecological Indicators · doi:10.1016/j.ecolind.2019.04.088 · Cited by 51 · see citing works
Porter, T. M., & Hajibabaei, M. (2022) · PLoS ONE · doi:10.1371/journal.pone.0274260 · Cited by 46 · see citing works
Fernández, S., Rodriguez-Martinez, S., Martínez, J. L., García‐Vázquez, E., & Ardura, A. (2019) · Environmental DNA · doi:10.1002/edn3.40 · Cited by 47 · see citing works
Practical guidance for integrating data management into long‐term ecological monitoring projects
Sutter, R. D., Wainscott, S. B., Boetsch, J. R., Palmer, C. J., & Rugg, D. J. (2015) · Wildlife Society Bulletin · doi:10.1002/wsb.548 · Cited by 44 · see citing works
River doctors: Learning from medicine to improve ecosystem management
Elosegi, A., Gessner, M. O., & Young, R. G. (2017) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2017.03.188 · Cited by 43 · see citing works
Benchmark database for fine-grained image classification of benthic macroinvertebrates
Raitoharju, J., Riabchenko, E., Ahmad, I. A., Iosifidis, A., Gabbouj, M., Serkan Kiranyaz, B., Tirronen, V., Ärje, J., Kärkkäinen, S., & Meissner, K. K. (2018) · Image and Vision Computing · doi:10.1016/j.imavis.2018.06.005 · Cited by 43 · see citing works
Zizka, V. M. A., Geiger, M. F., & Leese, F. (2020) · Ecological Indicators · doi:10.1016/j.ecolind.2020.106383 · Cited by 39 · see citing works
Chapuis, S., Herder, F., & Geiger, M. F. (2021) · PLoS ONE · doi:10.1371/journal.pone.0244598 · Cited by 42 · see citing works
Macher, T., Beermann, A. J., Arle, J., Foerster, J., Greyer, M., Mora, D., Koschorreck, J., Rolauffs, P., Rother, A., Schüler, S., et al. (2024) · Water Research · doi:10.1016/j.watres.2024.122987 · Cited by 40 · see citing works
Sustainability performance measurement – a framework for context-specific applications
Damtoft, N. F., van Liempd, D., & Lueg, R. (2024) · Journal of Global Responsibility · doi:10.1108/jgr-05-2023-0082 · Cited by 50 · see citing works
A DNA barcode database of Australia’s freshwater macroinvertebrate fauna
Carew, M. E., Nichols, S. J., Batovska, J., Clair, R. S., Murphy, N. P., Blacket, M. J., & Shackleton, M. E. (2017) · Marine and Freshwater Research · doi:10.1071/mf16304 · Cited by 38 · see citing works
Buchner, D., Beermann, A. J., Laini, A., Rolauffs, P., Vitecek, S., Hering, D., & Leese, F. (2019) · PLoS ONE · doi:10.1371/journal.pone.0226547 · Cited by 33 · see citing works
Remmel, N., Buchner, D., Enß, J., Hartung, V., Leese, F., Welti, E. A. R., Sinclair, J. S., & Haase, P. (2024) · Insect Conservation and Diversity · doi:10.1111/icad.12710 · Cited by 33 · see citing works
Self-citationConceptual guidelines for the implementation of the ecosystem approach in biodiversity monitoring
Mueller, M., & Geist, J. P. (2016) · Ecosphere · doi:10.1002/ecs2.1305 · Cited by 33 · see citing works
Everall, N. C., Johnson, M. F., Wood, P. J., Farmer, A., Wilby, R. L., & Measham, N. (2017) · Ecological Indicators · doi:10.1016/j.ecolind.2017.03.040 · Cited by 33 · see citing works
Long-term abundance trends of insect taxa are only weakly correlated
van Klink, R., Bowler, D. E., Gongalsky, K. B., & Chase, J. M. (2022) · Biology Letters · doi:10.1098/rsbl.2021.0554 · Cited by 33 · see citing works
Guareschi, S., Laini, A., & Sánchez‐Montoya, M. D. M. (2016) · Journal of Limnology · doi:10.4081/jlimnol.2016.1516 · Cited by 31 · see citing works
Nichols, S. J., & Dyer, F. J. (2013) · Frontiers of Environmental Science & Engineering · doi:10.1007/s11783-013-0556-6 · Cited by 30 · see citing works
Sources of uncertainty in assessment of marine phytoplankton communities
Dromph, K. M., Agustı́, S., Basset, A., Franco, J., Henriksen, P., Icely, J. D., Lehtinen, S., Moncheva, S., Revilla, M., Roselli, L., et al. (2012) · Hydrobiologia · doi:10.1007/s10750-012-1353-0 · Cited by 29 · see citing works
Krol, L., van der Hoorn, B., Gorsich, E. E., Trimbos, K. B., van Bodegom, P. M., & Schrama, M. J. J. (2019) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2019.00260 · Cited by 28 · see citing works
Theißinger, K., Kästel, A., Elbrecht, V., Makkonen, J., Michiels, S., Schmidt, S. I., Allgeier, S., Leese, F., & Brühl, C. A. (2018) · Metabarcoding and Metagenomics · doi:10.3897/mbmg.2.21060 · Cited by 27 · see citing works
Carter, J. L., & Resh, V. H. (2013) · Antarctica A Keystone in a Changing World · doi:10.3133/ofr20131129 · Cited by 27 · see citing works
Harper, L. R., Handley, L. L., Sayer, C. D., Read, D. S., Benucci, M., Blackman, R. C., Hill, M. J., & Hänfling, B. (2020) · Molecular Ecology · doi:10.1111/mec.15670 · Cited by 26 · see citing works
Feeley, H. B., Woods, M., Baars, J., & Kelly‐Quinn, M. (2011) · Hydrobiologia · doi:10.1007/s10750-011-0940-9 · Cited by 25 · see citing works
Babitsch, D., Berger, E., & Sundermann, A. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.145498 · Cited by 24 · see citing works
Self-citationBeentjes, K. K., Speksnijder, A. G. C. L., Schilthuizen, M., Schaub, B. E. M., & van der Hoorn, B. (2018) · Metabarcoding and Metagenomics · doi:10.3897/mbmg.2.26744 · Cited by 24 · see citing works
Cherrill, A. J. (2015) · Journal of Environmental Planning and Management · doi:10.1080/09640568.2015.1090961 · Cited by 22 · see citing works
Vourka, A., Karaouzas, I., & Parmakelis, Α. (2023) · Biodiversity and Conservation · doi:10.1007/s10531-023-02710-y · Cited by 22 · see citing works
Long-term monitoring data meet freshwater species distribution models: Lessons from an LTER-site
Kuemmerlen, M., Stoll, S., Sundermann, A., & Haase, P. (2015) · Ecological Indicators · doi:10.1016/j.ecolind.2015.08.008 · Cited by 22 · see citing works
Self-citationBeentjes, K. K., Barmentlo, S. H., Cieraad, E., Schilthuizen, M., van der Hoorn, B., Speksnijder, A. G. C. L., & Trimbos, K. B. (2021) · Molecular Ecology · doi:10.1111/mec.16326 · Cited by 20 · see citing works
Nichols, S. J., Kefford, B. J., Campbell, C. D., Bylemans, J., Chandler, E., Bray, J. P., Shackleton, M., Robinson, K. L., Carew, M. E., & Furlan, E. M. (2019) · Freshwater Biology · doi:10.1111/fwb.13443 · Cited by 20 · see citing works
Wang, S., Zhang, P., Zhang, D., & Chang, J. (2022) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.118026 · Cited by 19 · see citing works
Data Enrichment in Fine-Grained Classification of Aquatic Macroinvertebrates
Raitoharju, J., Riabchenko, E., Meissner, K. K., Ahmad, I., Iosifidis, A., Gabbouj, M., & Serkan Kiranyaz, B. (2016) · ICPR Workshop on Computer Vision for Analysis of Underwater Imagery (CVAUI) · doi:10.1109/cvaui.2016.020 · Cited by 19 · see citing works
Emmons, S. C., Compson, Z. G., Malish, M. C., Busch, M. H., Saenz, V., Higgins, K. T., & Allen, D. C. (2023) · Environmental DNA · doi:10.1002/edn3.453 · Cited by 18 · see citing works
Simović, P. M., Milosavljević, A., Stojanović, K. Z., Radenković, M. D., Savić‐Zdravković, D., Predić, B., Petrović, A., Božanić, M. L. J., & Milošević, D. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.172877 · Cited by 20 · see citing works
Promoting a functional macroinvertebrate approach in the biomonitoring of Italian lotic systems
Merritt, R. W., Fenoglio, S., & Cummins, K. W. (2016) · Journal of Limnology · doi:10.4081/jlimnol.2016.1502 · Cited by 16 · see citing works
Turunen, J., Mykrä, H., Elbrecht, V., Steinke, D., Braukmann, T., & Aroviita, J. (2021) · Metabarcoding and Metagenomics · doi:10.3897/mbmg.5.68938 · Cited by 13 · see citing works
Ärje, J., Kärkkäinen, S., Turpeinen, T., & Meissner, K. K. (2013) · Environmetrics · doi:10.1002/env.2208 · Cited by 15 · see citing works
Hidden diversity: DNA metabarcoding reveals hyper-diverse benthic invertebrate communities
Gleason, J. E., Hanner, R., & Cottenie, K. (2023) · BMC Ecology and Evolution · doi:10.1186/s12862-023-02118-w · Cited by 14 · see citing works
Learned vs. engineered features for fine-grained classification of aquatic macroinvertebrates
Riabchenko, E., Meissner, K. K., Ahmad, I. A., Iosifidis, A., Tirronen, V., Gabbouj, M., & Serkan Kiranyaz, B. (2016) · Proceedings - International Conference on Pattern Recognition/Proceedings/International Conference on Pattern Recognition · doi:10.1109/icpr.2016.7899975 · Cited by 14 · see citing works
On Confidences and Their Use in (Semi-)Automatic Multi-Image Taxa Identification
Raitoharju, J., & Meissner, K. K. (2019) · IEEE Symposium Series on Computational Intelligence (SSCI) · doi:10.1109/ssci44817.2019.9002975 · Cited by 14 · see citing works
Ntislidou, C., Bozatzidou, M., Argyriou, A.-K., Karaouzas, I., Skoulikidis, N., & Lazaridou, M. A. (2019) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2019.135496 · Cited by 13 · see citing works
Stream drying bioindication in Central Europe: A Biodrought Index accuracy assessment
Straka, M., Polášek, M., Csabai, Z., Zweidick, O., Graf, W., Meyer, E. I., Elexová, E. M., Lešťáková, M., & Pařil, P. (2021) · Ecological Indicators · doi:10.1016/j.ecolind.2021.108045 · Cited by 13 · see citing works
Chen, X., Wei, Q., Niu, Y., & Jiang, X. (2024) · Journal of Plankton Research · doi:10.1093/plankt/fbae052 · Cited by 12 · see citing works
Feio, M. J., Garcia‐Raventós, A., Ardura, A., Calapez, A. R., Pujante, A. M., Mortágua, A., Múrria, C., Diaz‐de‐Quijano, D., & Filipe, A. F. (2020) · Limnetica · doi:10.23818/limn.39.27 · Cited by 12 · see citing works
Keck, F., Hürlemann, S., Locher, N., Stamm, C., Deiner, K., & Altermatt, F. (2022) · Metabarcoding and Metagenomics · doi:10.3897/mbmg.6.79351 · Cited by 12 · see citing works
Riley, A. C., Wright, M., Porter, T. M., Maitland, V. C., Baird, D. J., & Hajibabaei, M. (2025) · BMC Biology · doi:10.1186/s12915-025-02284-x · Cited by 12 · see citing works
Human experts vs. machines in taxa recognition
Ärje, J., Raitoharju, J., Iosifidis, A., Tirronen, V., Meissner, K. K., Gabbouj, M., Serkan Kiranyaz, B., & Kärkkäinen, S. (2020) · Signal Processing Image Communication · doi:10.1016/j.image.2020.115917 · Cited by 27 · see citing works
Dusabe, M. C., Neubauer, T. A., Muvundja, F. A., Hyangya, B. L., & Albrecht, C. (2022) · Frontiers in Environmental Science · doi:10.3389/fenvs.2022.902246 · Cited by 9 · see citing works
The effect of automated taxa identification errors on biological indices
Ärje, J., Kärkkäinen, S., Meissner, K. K., Iosifidis, A., İnce, T., Gabbouj, M., & Serkan Kiranyaz, B. (2016) · Expert Systems with Applications · doi:10.1016/j.eswa.2016.12.015 · Cited by 9 · see citing works
DNA barcoding of Sialis sp. (Megaloptera) in Portugal: the missing tool to species identification
Ferreira, S., Paupério, J., Grosso-Silva, J. M., & Beja, P. R. (2019) · Aquatic Insects · doi:10.1080/01650424.2019.1571612 · Cited by 8 · see citing works
Gourgues, S., Goñi‐Urriza, M., Milhe-Poutingon, M., Baldoni-Andrey, P., Gurieff, N. B., Gelber, C., & Faucheur, S. L. (2024) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2024.175713 · Cited by 7 · see citing works
Chen, J., Zang, H., Ning, Y., Han, L., Deng, Z., Xie, Y., & Wang, B. (2025) · Ecological Indicators · doi:10.1016/j.ecolind.2025.114254 · Cited by 6 · see citing works
Metabarcoding for use in Nordic routine aquatic biomonitoring - a validation study
Meissner, K. K., Aroviita, J., Baattrup‐Pedersen, A., Buchner, D., Ekrem, T., Friberg, N. R., Johnson, R. K., Leese, F., Majaneva, M., Ólafsson, J. S., et al. (2021) · TemaNord · doi:10.6027/temanord2020-538 · Cited by 6 · see citing works
Simović, P. M., Milosavljević, A., Stojanović, K. Z., Savić‐Zdravković, D., Petrović, A. S., Predić, B., & Milošević, D. (2024) · Water · doi:10.3390/w17010021 · Cited by 5 · see citing works
The global role of bioassessment in policy delivery and decision-making for inland waters
KELLY, M. G., Free, G., Simaika, J. P., Warner, S., Bruder, A., Correa-Bedoya, A., Roque, F. D. O., Eriksen, T. E., Lento, J., Macadam, C. R., et al. (2025) · Journal of Environmental Management · doi:10.1016/j.jenvman.2025.127099 · Cited by 5 · see citing works
Šamulková, M., Čiamporová‐Zaťovičová, Z., ČIAMPOR, F. J., Tuhrinová, K., & Macko, P. (2025) · Biologia · doi:10.1007/s11756-025-01999-0 · Cited by 5 · see citing works
Fueyo, Á., Sánchez, O., Carleos, C. E., Granero‐Castro, J., & Borrell, Y. J. (2025) · Ecological Solutions and Evidence · doi:10.1002/2688-8319.70125 · Cited by 3 · see citing works
Cortez, T., Torres, A., Guimarães, M., Pinheiro, H. B., Cabral, M., Zielinsky, G., Pereira, C. M., de Castro, G. M., Guerreiro, L. T., Americo, J. A., et al. (2025) · PLoS ONE · doi:10.1371/journal.pone.0314210 · Cited by 3 · see citing works
Mauvisseau, Q., Davy‐Bowker, J., Bulling, M. T., Brys, R., Neyrinck, S., Troth, C. R., & Sweet, M. J. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/661447 · Cited by 3 · see citing works
Hidden diversity – DNA metabarcoding reveals hyper-diverse benthic invertebrate communitiesPreprint
Gleason, J. E., Hanner, R., & Cottenie, K. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.02.28.481642 · Cited by 2 · see citing works
Cross-comparing different protocols for DNA metabarcoding of freshwater macroinvertebrates
van der Lee, G. H., Polling, M., Laros, I., & Verdonschot, R. C. M. (2025) · Hydrobiologia · doi:10.1007/s10750-025-05993-0 · Cited by 1 · see citing works
Theißinger, K., Kästel, A., Elbrecht, V., Makkonen, J., Michiels, S., Schmidt, S. I., Allgeier, S., Leese, F., & Brühl, C. A. (2017) · Metabarcoding and Metagenomics · doi:10.3897/mbmg.1.21060 · Cited by 1 · see citing works
Quality Assurance for Freshwater Quality Monitoring - Technical Guidance Document
United Nations Environment Programme (2023) · United Nations Environment Programme eBooks · doi:10.59117/20.500.11822/42666 · Cited by 1 · see citing works
Mendez, P. K. (2025) · ZooKeys · doi:10.3897/zookeys.1263.150420 · Cited by 1 · see citing works
Ärje, J. (2016) · Jyväskylä University Digital Archive (University of Jyväskylä) · Cited by 1 · see citing works
- Authors
- Haase, P., Pauls, S. U., Schindehütte, K., & Sundermann, A.
- Affiliations
- Senckenberg, Research Institute and Natural History Museum, Department of Limnology and Conservation, Clamecy Strasse 12, 63571 Gelnhausen, Germany
- University of Minnesota (US)
- Venue
- Journal of the North American Benthological Society
- Publisher
- University of Chicago Press
- Published
- 2010-12
- Volume
- 29
- Issue
- 4
- Pages
- 1279-1291
- ISSN
- 0887-3593 (ISSN-L)
- 1937-237X
- OpenAlex
- W2115439841
- Cited by
- 119
- References
- 40
- Citations by year
- 2026: 8 · 2025: 9 · 2024: 10 · 2023: 4 · 2022: 6 · 2021: 11 · 2020: 9 · 2019: 15 · 2018: 10 · 2017: 10 · 2016: 10 · 2015: 7 · 2014: 2 · 2013: 3 · 2012: 2
- FWCI
- 2.32
- Type
- journal article
- Language
- en
- Open access
- green
- www.bioone.org
- Locations
- Journal of the North American Benthological Society (publishedVersion)
- BioOne Complete (BioOne) (submittedVersion)
- Topics
- Physical Sciences › Environmental Science › Ecology › Freshwater macroinvertebrate diversity and ecology
- Life Sciences › Agricultural and Biological Sciences › Ecology, Evolution, Behavior and Systematics › Invertebrate Taxonomy and Ecology
- Physical Sciences › Environmental Science › Health, Toxicology and Mutagenesis › Environmental Toxicology and Ecotoxicology
- Keywords
- macroinvertebrates, Water Framework Directive, freshwater monitoring, quality control, auditing, human error, taxonomic identification, ecological assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review