The DOI matches its Crossref record; 20 of the 22 references it cites were found in a registry or an index; none of the 7 sources its claims cite is checked for support yet.
Hydrostats: A Python Package for Characterizing Errors between Observed and Predicted Time Series
Open accessAbstract
Hydrologists use a number of tools to compare model results to observed flows. These include tools to pre-process the data, data frames to store and access data, visualization and plotting routines, error metrics for single realizations, and ensemble metrics for stochastic realizations to calibrate and evaluate hydrologic models. We present an open-source Python package to help characterize predicted and observed hydrologic time series data called hydrostats which has three main capabilities: Data storage and retrieval based on the Python Data Analysis Library (pandas), visualization and plotting routines using Matplotlib, and a metrics library that currently contains routines to compute over 70 different error metrics and routines for ensemble forecast skill scores. Hydrostats data storage and retrieval functions allow hydrologists to easily compare all, or portions of, a time series. For example, it makes it easy to compare observed and modeled data only during April over a 30-year period. The package includes literature references, explanations, examples, and source code. In this note, we introduce the hydrostats package, provide short examples of the various capabilities, and provide some background on programming issues and practices. The hydrostats package provides a range of tools to make characterizing and analyzing model data easy and efficient. The electronic supplement provides working hydrostats examples.
Overview
CoChat Summary
TL;DR
Hydrostats is an open-source Python package that helps hydrologists store, subset, visualize, and quantify errors between observed and predicted time series, bundling a metrics library (HydroErr) with over 70 error metrics plus ensemble forecast skill scores. The paper is a software note introducing the package's modules and demonstrating its capabilities and code-optimization choices.
Key findings
- Hydrostats provides three main capabilities: data storage/retrieval built on pandas, visualization/plotting routines using Matplotlib, and a metrics library containing routines for over 70 error metrics plus ensemble forecast skill scores.
- The package comprises five modules: analyze, data, ens_metrics, metrics, and visual; the metrics module wraps the separately available HydroErr library.
- In a worked example, a single KGE(2012) call returned 0.8767535070958952, and a table of six metrics (MAE, r², ACC, NSE, KGE(2012), SA) over the full record and four seasons showed similar but seasonally varying values (e.g., full-record MAE 1157.67, r² 0.91, ACC 0.95, NSE 0.87, KGE 0.87, SA 0.15).
- Benchmarking the Mielke-Berry R metric (which requires a double summation) on a vector of length 1000 gave average times of 181 × 10⁻³ ± 9.13 × 10⁻³ s (Python), 120 × 10⁻³ ± 8.86 × 10⁻³ s (numpy), and 254 × 10⁻⁶ ± 7.03 × 10⁻⁶ s (numba) — speedups of ~1.5× and ~700× respectively; at length 10,000, times were 16.6, 11.3, and 24.7 × 10⁻³ s (~1.5× and ~675×).
Methods
- Design: a software package description with example code and figures, not an empirical model-evaluation study; the authors state it is "not a discussion of model calibration, error metrics, or analysis methods."
- Data/sample: illustrative examples use two .csv files of predicted and observed flow merged into a pandas DataFrame, with a seasonal subset (1 April–31 July, 1 January 1986–31 December 1992) and daily averages/standard deviations; ensemble examples use a synthetic forecast of 52 realizations over 15 time steps.
- Main analysis: demonstration of module functions (merge_data, seasonal_period, daily_average, daily_std_error, make_table, ens_crps) and a runtime benchmark of three implementations (Python double loop, numpy vectorization, numba compilation) of the Mielke-Berry R metric using timeit, benchmarked on 7.7 GB RAM and an Intel Core i5-4590 CPU @ 3.30 GHz × 4.
Limitations
- Stated: the authors chose not to implement numba versions in the library because the large speedup only occurs for double loops (only a few metrics require them), and requiring numba would add a dependency; documentation instead gives directions for users to modify code to use numba.
- Stated: for shorter vectors (less than 1000) the time difference between implementations may not be significant.
- Evident from the text: the paper is a software note with illustrative examples rather than a validation study — the reported metric values (e.g., KGE 0.8767, the seasonal metric table) come from example data and are not presented as substantive hydrologic findings; the ensemble CRPS example uses synthetic random data.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures


Verification
Claims the paper makes
0 Valid · 4 Not valid · 4 Not checked · 34 Own results and interpretations
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“We present an open-source Python package to help characterize predicted and observed hydrologic time series data called hydrostats which has three main capabilities”
- Also stated in: § 1. Introduction · plain
“Hydrostats is an open-source software package designed to support hydrologic model evaluation.”
§ Hydrostats: A Python Package for Characterizing Errors between Observed and Predicted Time Series > Abstract
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Rests on an assumption not shown here.
- Also stated in: § 1. Introduction · plain
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“As the vector length increases, the numpy version performs faster than the Python version, about 2× to 5× as the vector length increases.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This level of speed up only occurs for double loops and only a few of the error metrics require double loops for implementation.”
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper states — it cites no source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“Single loops optimize well with numpy implementations.”
boostedstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“This level of speed up only occurs for double loops and only a few of the error metrics require double loops for implementation.”
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
2 more claims
Create a free account to see all 42 claims and to verify the 7 references still open.
- Probably not a substantial claim. 24
- It may state two separate claims as one. 20
- The quote only partly states this claim. 2
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Calculating the Kling-Gupta efficiency (KGE2012) metric hs.kge_2012(Pred,Obs) # separate vectors from data frame This returns 0.8767535070958952 # Calculating a table of different metrics for different periods hs.make_table(merged_dataframe=m.dat,metrics=['MAE', 'r2′, 'ACC', 'NSE', 'KGE (2012)', 'SA'], seasonal_periods=[['01-01′,'03-31′],['04-01′,'06-30′],['07-01′,'09-30′],['10-01′,'12-31′]], remove_neg=True, remove_zero=True, location='Magdalena') This returns Location MAE r2 ACC NSE KGE(2012) SA Full Time Series Magdalena 1157.67 0.91 0.95 0.87 0.87 0.15 Jan-01:Mar-31 Magdalena 631.98 0.89 0.94 0.86 0.86 0.16 April-01:June-30 Magdalena 1394.64 0.88 0.94 0.81 0.88 0.15 July-01:Sept-30 Magdalena 1188.54 0.88 0.94 0.83 0.83 0.15 Oct-01:Dec-31 Magdalena 1410.85 0.86 0.93 0.79 0.79 0.14 Figure 4. Presents a code example and results of calling a single error metric (top portion) and creating a table with six different error metrics over four different seasons or time periods.This shows that while the metric values are similar, the different seasons behave differently. > 2.8. Code Optimization
“then extracts the data from April 1 to July 31 from the period January 1, 1986 through December 31, 1994.”
§ Hydrostat dependencies import pandas as pd import numpy as np import matplotlib.pyplotas plt # Hydrostat modules import hydrostats as hs import hydrostats.dataas hd import hydrostats.visualas hv > 2.4. Pre-Processing (hydrostats.data)
“time_range=['1986-01-01′,'1992-12-31′]”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Hydrostat dependencies import pandas as pd import numpy as np import matplotlib.pyplotas plt # Hydrostat modules import hydrostats as hs import hydrostats.dataas hd import hydrostats.visualas hv > 2.5. Visualization (hydrostats.visualization)
“Figure 3 shows a code snippet that plots the predicted and observed seasonal values from 1980 to 2015 that were loaded in Figure 2”
§ Hydrostat dependencies import pandas as pd import numpy as np import matplotlib.pyplotas plt # Hydrostat modules import hydrostats as hs import hydrostats.dataas hd import hydrostats.visualas hv > 2.4. Pre-Processing (hydrostats.data)
“that only includes data for 1 April through 31 July for the period 1 January 1986 to 31 December 1992.”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Hydrostat dependencies import pandas as pd import numpy as np import matplotlib.pyplotas plt # Hydrostat modules import hydrostats as hs import hydrostats.dataas hd import hydrostats.visualas hv > 2.6. Error Metrics (hydrostats.metrics)
“The Python error functions have four flags: replace_nan, replace_inf, remove_neg, and remove_zero.”
§ Hydrostat dependencies import pandas as pd import numpy as np import matplotlib.pyplotas plt # Hydrostat modules import hydrostats as hs import hydrostats.dataas hd import hydrostats.visualas hv > 2.6. Error Metrics (hydrostats.metrics)
“The replace_neg and replace_inf flags provide values used to replace any instances of these entries”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Hydrostat dependencies import pandas as pd import numpy as np import matplotlib.pyplotas plt # Hydrostat modules import hydrostats as hs import hydrostats.dataas hd import hydrostats.visualas hv > 2.4. Pre-Processing (hydrostats.data)
“any of the 60 error metrics included in the hydrostats package”
§ Hydrostat dependencies import pandas as pd import numpy as np import matplotlib.pyplotas plt # Hydrostat modules import hydrostats as hs import hydrostats.dataas hd import hydrostats.visualas hv > 2.6. Error Metrics (hydrostats.metrics)
“The hydrostats.metrics module is a wrapper module for the Python HydroErr package, which is available separately.This module gives users access to over 70 error metrics from the hydrologic literature.”
Citations
Cites
Matplotlib: a 2D graphics environment
Hunter, J. D. (2007) · Computing in Science & Engineering · doi:10.1109/mcse.2007.55 · Cited by 39,249
DeLong, E. R., DeLong, D. M., & Clarke-Pearson, D. L. (1988) · Biometrics · doi:10.2307/2531595 · Cited by 22,649
Data Structures for Statistical Computing in Python
McKinney, W. (2010) · Proceedings of the Python in Science Conference · doi:10.25080/majora-92bf1922-00a · Cited by 11,032
The NumPy Array: A Structure for Efficient Numerical Computation
van der Walt, S., Colbert, S. C., & Varoquaux, G. (2011) · Computing in Science & Engineering · doi:10.1109/mcse.2011.37 · Cited by 9,381
Willmott, C., & Matsuura, K. (2005) · Climate Research · doi:10.3354/cr030079 · Cited by 7,958 · cited 1×
“…these speed ups we will use the Mielke–Berry R error metric [28] as this error metric requires a double summation as shown in Equation (1). where MAE (mean absolute error) [29] is: In Equations (1) and (2), n is the number of data points, x is the observed flow, and y is the predicted flow.”
MethodStrictly Proper Scoring Rules, Prediction, and Estimation
Gneiting, T., & Raftery, A. E. (2007) · Journal of the American Statistical Association · doi:10.1198/016214506000001437 · Cited by 5,793
Jupyter Notebooks – a publishing format for reproducible computational workflows
Thomas, K., Benjamin, R.-K., Fernando, P., Brian, G., Matthias, B., Jonathan, F., Kyle, K., Jessica, H., Jason, G., Sylvain, C., et al. (2016) · Positioning and Power in Academic Publishing: Players, Agents and Agendas · doi:10.3233/978-1-61499-649-1-87 · Cited by 3,063
Comparison of different efficiency criteria for hydrological model assessment
Krause, P., Boyle, D. P., & Bäse, F. (2005) · Advances in Geosciences · doi:10.5194/adgeo-5-89-2005 · Cited by 2,809
Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios
Kling, H., Fuchs, M., & Paulin, M. (2012) · Journal of Hydrology · doi:10.1016/j.jhydrol.2012.01.011 · Cited by 1,676
Numba: a LLVM-based Python JIT compiler
Lam, S. K., Pitrou, A., & Seibert, S. (2015) · Proceedings of the Second Workshop on the LLVM Compiler Infrastructure in HPC · doi:10.1145/2833157.2833162 · Cited by 1,514
Cited by
Jackson, E. K., Roberts, W., Nelsen, B., Williams, G. P., Nelson, E. J., & Ames, D. P. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.05.001 · Cited by 213
Self-citationDesigning Deep-Based Learning Flood Forecast Model With ConvLSTM Hybrid Algorithm
Moishin, M., Deo, R. C., Prasad, R., Raj, N., & Abdulla, S. (2021) · IEEE Access · doi:10.1109/access.2021.3065939 · Cited by 199
Apaydın, H., Sattari, M. T., Falsafian, K., & Prasad, R. (2021) · Journal of Hydrology · doi:10.1016/j.jhydrol.2021.126506 · Cited by 165
When best is the enemy of good – critical evaluation of performance criteria in hydrological models
Cinkus, G., Mazzilli, N., Jourde, H., Wünsch, A., Liesch, T., Ravbar, N., Chen, Z., & Goldscheider, N. (2023) · Hydrology and earth system sciences · doi:10.5194/hess-27-2397-2023 · Cited by 116
Long-Term Groundwater Level Prediction Model Based on Hybrid KNN-RF Technique
Kombo, O. H., Kumaran, S., Sheikh, Y. H., Bovim, A., & Jayavel, K. (2020) · Hydrology · doi:10.3390/hydrology7030059 · Cited by 112
Pastas: Open Source Software for the Analysis of Groundwater Time Series
Collenteur, R., Bakker, M., Caljé, R., Klop, S., & Schaars, F. (2019) · Ground Water · doi:10.1111/gwat.12925 · Cited by 109
Predicting the Trend of Dissolved Oxygen Based on the kPCA-RNN Model
Zhang, Y., Fitch, P., & Thorburn, P. J. (2020) · Water · doi:10.3390/w12020585 · Cited by 107
Collenteur, R., Bakker, M., Klammler, G., & Birk, S. (2021) · Hydrology and earth system sciences · doi:10.5194/hess-25-2931-2021 · Cited by 71
Evans, S. W., Jones, N. L., Williams, G. P., Ames, D. P., & Nelson, E. J. (2020) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2020.104782 · Cited by 65
Self-citationThe eWaterCycle platform for open and FAIR hydrological collaboration
Hut, R., Drost, N., van de Giesen, N., van Werkhoven, B., Abdollahi, B., Aerts, J., Albers, T., Alidoost, F., Andela, B., Camphuijsen, J., et al. (2022) · Geoscientific model development · doi:10.5194/gmd-15-5371-2022 · Cited by 52
Qiao, X., Nelson, E. J., Ames, D. P., Li, Z., David, C. H., Williams, G. P., Roberts, W., Lozano, J. L. S., Edwards, C., Souffront, M., et al. (2019) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2019.104501 · Cited by 46
Self-citationSanchez Lozano, J., Romero Bustamante, G., Hales, R. C., Nelson, E. J., Williams, G. P., Ames, D. P., & Jones, N. L. (2021) · Hydrology · doi:10.3390/hydrology8020071 · Cited by 46
Self-citationEvans, S., Williams, G. P., Jones, N. L., Ames, D. P., & Nelson, E. J. (2020) · Remote Sensing · doi:10.3390/rs12122044 · Cited by 40
Self-citationSong, T., Ding, W., Liu, H., Wu, J., Zhou, H., & Chu, J. (2020) · Water · doi:10.3390/w12030912 · Cited by 37
Riahi-Madvar, H., Dehghani, M., Memarzadeh, R., Salwana, E., Mosavi, A. H., & Shahab, S. (2020) · IEEE Access · doi:10.1109/access.2020.3019362 · Cited by 36
Ramirez, S. G., Hales, R. C., Williams, G. P., & Jones, N. L. (2022) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2022.105475 · Cited by 36
Self-citationGRACE Downscaler: A Framework to Develop and Evaluate Downscaling Models for GRACE
Pulla, S. T., Yasarer, H., & Yarbrough, L. D. (2023) · Remote Sensing · doi:10.3390/rs15092247 · Cited by 28
Bias correcting discharge simulations from the GEOGloWS global hydrologic model
Hales, R. C., Williams, G. P., James Nelson, E., Sowby, R. B., Ames, D. P., & Lozano, J. L. S. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130279 · Cited by 26
Self-citationOwusu, C., Snigdha, N. J., Martin, M. T., & Kalyanapu, A. (2022) · Sustainability · doi:10.3390/su14052557 · Cited by 25
Sahoo, D. P., Sahoo, B., Tiwari, M. K., & Behera, G. K. (2022) · Journal of Environmental Management · doi:10.1016/j.jenvman.2022.116121 · Cited by 25
Khattar, R., Hales, R. C., Ames, D. P., Nelson, E. J., Jones, N. L., & Williams, G. P. (2021) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2021.105227 · Cited by 20
Self-citationSABER: A Model-Agnostic Postprocessor for Bias Correcting Discharge from Large Hydrologic Models
Hales, R. C., Sowby, R. B., Williams, G. P., Nelson, E. J., Ames, D. P., Dundas, J. B., & Ogden, J. (2022) · Hydrology · doi:10.3390/hydrology9070113 · Cited by 19
Self-citationBridging Hydrological Ensemble Simulation and Learning Using Deep Neural Operators
Sun, A. Y., Jiang, P., Shuai, P., & Chen, X. (2024) · Water Resources Research · doi:10.1029/2024wr037555 · Cited by 17
Bezerra, U. A., Cunha, J., Valente, F., Nóbrega, R., Andrade, J., de Moura, M. S. B., Verhoef, A., Pérez-Marin, A. M., & Galvão, C. D. O. (2023) · Agricultural and Forest Meteorology · doi:10.1016/j.agrformet.2023.109408 · Cited by 16
Hybrid CNN–GRU model for hourly flood forecasting index: case studies from the Fiji islands
Deo, R. C., Deo, R. C., Ghimire, S., Nguyen‐Huy, T., & Ali, M. (2025) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-025-02964-8 · Cited by 15
Schutte, C. F., van der Laan, M., & van der Merwe, B. (2024) · Journal of Hydroinformatics · doi:10.2166/hydro.2024.268 · Cited by 14
Real-time flood forecasting based on a general dynamic neural network framework
Wan, X., Wu, Q., Cao, Z., & Wu, Y. (2022) · Stochastic Environmental Research and Risk Assessment · doi:10.1007/s00477-022-02271-6 · Cited by 13
Enhancing Flood Early Warning System in the HKH Region
Tsering, K., Shakya, K., Matin, M. A., Nelson, J., & Bajracharya, B. (2021) · Springer eBooks · doi:10.1007/978-3-030-73569-2_9 · Cited by 12
Rojas-Lesmes, D., Sanchez-Lozano, J., Nelson, E. J., Chancay-Sanchez, J., Rodriguez-Chaves, J., Larco-Erazo, K., Romero, E. G., Trujillo-Vela, M., Hales, R. C., Ames, D. P., et al. (2025) · Information Geography · doi:10.1016/j.infgeo.2025.100008 · Cited by 6
Self-citationStevens, M. D., Ramirez, S. G., Martin, E., Jones, N. L., Williams, G. P., Adams, K. H., Ames, D. P., & Pulla, S. T. (2025) · Environmental Modelling & Software · doi:10.1016/j.envsoft.2025.106368 · Cited by 9
Self-citationErgete, E. T., Ergete, E. T., & Geremew, G. B. (2024) · Journal of Water and Climate Change · doi:10.2166/wcc.2024.320 · Cited by 9
Liu, D., & Chongju, S. (2023) · Journal of Hydrology · doi:10.1016/j.jhydrol.2023.130094 · Cited by 8
Palmquist, E. C., Deemer, B. R., Metcalfe, A. N., Kennedy, T. A., Bair, L. S., Fairley, H. C., Grams, P. E., Sankey, J. B., & Yackulic, C. B. (2024) · River Research and Applications · doi:10.1002/rra.4360 · Cited by 8
Escuela Profesional de Ingeniería Agrícola, U. N. D. A., Lujano, R., Lujano, R., Ingeniería de Sistemas, U. N. D. A., Huamani, J. C., Servicio Nacional de Meteorología e Hidrología (SENAMHI), L., Lujano, A., & Autoridad Nacional del Agua (ANA), L. (2022) · Tecnología y Ciencias del Agua · doi:10.24850/j-tyca-14-02-05 · Cited by 8
Katipoğlu, O. M., Pekin, M. A., & Sercan, A. K. I. L. (2023) · Indonesian Journal of Earth Sciences · doi:10.52562/injoes.2023.821 · Cited by 7
Guzey, G. E., & Önöz, B. (2023) · Sustainability · doi:10.3390/su151310657 · Cited by 7
Source Attribution of Atmospheric Dust Deposition to Utah Lake
Telfer, J. T., Brown, M. M., Williams, G. P., Tanner, K. B., Miller, A. W., Sowby, R. B., & Miller, T. G. (2023) · Hydrology · doi:10.3390/hydrology10110210 · Cited by 6
Self-citationThe Second Generation Geoglows River Forecast SystemPreprint
Hales, R. C., Nelson, E. J., Kopp, S., Levin, H. K., Morris, A. L., Souffront, M., Gutierrez, A. L., Magoffin, R. H., Rosas, L. R., & Baaniya, Y. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5257837 · Cited by 6
Self-citationImplementing a GRU Neural Network for Flood Prediction in Ashland City, TennesseePreprint
Fordjour, G. K., & Kalyanapu, A. (2024) · arXiv (Cornell University) · doi:10.48550/arxiv.2405.10375 · Cited by 5
Chapagain, A. R., Maghami, I., & Ames, D. P. (2025) · Journal of Hydrology Regional Studies · doi:10.1016/j.ejrh.2025.102826 · Cited by 4
Self-citationReservoir Time-Series Filling From Remote Sensing Data in the Central Valley, Chile
Aguirre, I., Lozano‐Parra, J., & Velarde, J. G. (2022) · Practice, progress, and proficiency in sustainability · doi:10.4018/978-1-6684-4548-8.ch007 · Cited by 4
Fordjour, G. K., Nur, F., Kalyanapu, A., & Cervone, G. (2024) · Modeling Earth Systems and Environment · doi:10.1007/s40808-024-02211-z · Cited by 4
Holdsworth, A. M., Shao, A. E., & Christian, J. R. (2025) · Geophysical Research Letters · doi:10.1029/2024gl112591 · Cited by 4
Momm, H. G., Elkadiri, R., Bingner, R. L., Moore, K., & Wells, R. R. (2024) · Journal of Environmental Management · doi:10.1016/j.jenvman.2024.123278 · Cited by 3
Miller, A. W., Williams, G. P., Magoffin, R. H., Li, X., Miskin, T. J., Aghababaei, A., Wagle, P., Chapagain, A. R., Baaniya, Y., Oldham, P. D., et al. (2025) · Water · doi:10.3390/w17111627 · Cited by 3
Self-citationRequiz, B. J. C., Silva, J. D. T., Silva, C. E. T., Hurtado, C., & Orbegoso, F. A. C. (2023) · Revista del Instituto de investigación de la Facultad de minas metalurgia y ciencias geográficas · doi:10.15381/iigeo.v26i51.24493 · Cited by 3
A Geochemical Study of Near-Shore Sediment Cores from Utah Lake, UT, USA
Taggart, J. B., Woodland, L. M., Tanner, K. B., & Williams, G. P. (2025) · Geosciences · doi:10.3390/geosciences15090363 · Cited by 2
Self-citationAghababaei, A., Jones, N. L., Williams, G. P., Webster-Esho, E., van der Heijden, R., Li, X., Clement, T. P., & Rizzo, D. M. (2025) · Water · doi:10.3390/w17213083 · Cited by 2
Self-citationOverview of software for analysis and visualization of hydrological data
Baturinets, A., & Антоненко, С. В. (2019) · Actual problems of automation and information technology · doi:10.15421/431901 · Cited by 2
Vadose zone water and contaminant transport
Reck, A. (2021) · DepositOnce · doi:10.14279/depositonce-12051 · Cited by 2
Chandran, D., & Chithra, N. R. (2026) · Water Resources Management · doi:10.1007/s11269-026-04585-4 · Cited by 1
Terra, C., Thompson, J. H., Moore, H., Hess, R. J., Pesonen, D., Shekhar, H., Slater, L. D., & Ntarlagiannis, D. (2026) · Computers & Geosciences · doi:10.1016/j.cageo.2026.106298 · Cited by 1
Lujano, E., Lujano, R., Huamani, J. C., & Lujano, A. (2025) · doi:10.3390/eesp2025032020 · Cited by 1
Analysis of glacier hydrological model components with applications to Chile's Maipo BasinPreprint
Ahmad, M., & Rahman, M. (2023) · Preprints.org · doi:10.20944/preprints202306.1979.v1 · Cited by 1
Equifinality Contaminates the Sensitivity Analysis of Process-Based Snow ModelsPreprint
Kshetri, T., Khatibi, A., Mok, Y., Alam, S., Liu, H., & Clark, M. (2024) · doi:10.5194/egusphere-2023-3049 · Cited by 1
Holdsworth, A. M., Shao, A. E., & Christian, J. R. (2024) · doi:10.22541/essoar.172407921.18212147/v1 · Cited by 1
Streefland, L. B. (2020) · Utrecht University Repository (Utrecht University)
Qiao, X. (2020) · ScholarsArchive (Brigham Young University)
Hut, R., Drost, N., van de Giesen, N., et al. (2021) · Geoscientific model development · doi:10.5194/gmd-2021-344-rc1
Hut, R. (2021) · Geoscientific model development · doi:10.5194/gmd-2021-344-ac1
Hut, R., Drost, N., van de Giesen, N., et al. (2021) · Geoscientific model development · doi:10.5194/gmd-2021-344-cec1
Hut, R., Drost, N., van de Giesen, N., et al. (2022) · Geoscientific model development · doi:10.5194/gmd-2021-344-rc2
Reply to reviewers for gmd-2021-344
Hut, R. (2022) · Geoscientific model development · doi:10.5194/gmd-2021-344-ac2
Ergete, E. T., & Ayele, E. G. (2022) · Research Square · doi:10.21203/rs.3.rs-1746769/v1
(2022) · Hydrology and earth system sciences · doi:10.5194/hess-2022-380-cc2
(2022) · Hydrology and earth system sciences · doi:10.5194/hess-2022-380-cc1
Cinkus, G. (2023) · Hydrology and earth system sciences · doi:10.5194/hess-2022-380-ac1
Cinkus, G. (2023) · Hydrology and earth system sciences · doi:10.5194/hess-2022-380-ac2
(2023) · Hydrology and earth system sciences · doi:10.5194/hess-2022-380-rc1
(2023) · Hydrology and earth system sciences · doi:10.5194/hess-2022-380-rc2
Cinkus, G. (2023) · Hydrology and earth system sciences · doi:10.5194/hess-2022-380-ac3
Cinkus, G. (2023) · Hydrology and earth system sciences · doi:10.5194/hess-2022-380-ac4
Comment on egusphere-2023-3049
Kshetri, T., Khatibi, A., Mok, Y., et al. (2024) · doi:10.5194/egusphere-2023-3049-rc1
Comment on egusphere-2023-3049
Kshetri, T., Khatibi, A., Mok, Y., et al. (2024) · doi:10.5194/egusphere-2023-3049-rc2
Kshetri, T. (2024) · doi:10.5194/egusphere-2023-3049-ac2
SeqMetrics: a unified library for performance metrics calculation in Python
Rubab, F., Iftikhar, S., & Abbas, A. (2024) · The Journal of Open Source Software · doi:10.21105/joss.06450
Skromulis, A., Breidaks, J., Aņiskeviča, S., Klints, L., & Hudjakova, D. (2025) · Environment Technology Resources Proceedings of the International Scientific and Practical Conference · doi:10.17770/etr2025vol1.8705
Bezerra, U. A. (2023) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas)
Valencia, J., Jacobs, S., Breuer, L., Weeser, B., Francesconi, W., & Silva, M. D. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.6580180
Follum, M. L., Gutenson, J. L., Wahl, M. D., & Hales, R. C. (2026) · Sustainability · doi:10.3390/su18104937
Momm, H. G., ElKadiri, R., Bingner, R. L., Moore, K., Wells, R. J., & Duriancik, L. F. (2026) · CATENA · doi:10.1016/j.catena.2026.110339
Li, X., Jones, N. L., Williams, G. P., Aghababaei, A., Webster-Esho, E., van der Heijden, R., Clement, T. P., & Rizzo, D. M. (2026) · Water · doi:10.3390/w18172135
Self-citationChapagain, A. R., Maghami, I., Ames, D. P., Mondol, S. C., Swain, N., & Williams, G. P. (2026) · Water · doi:10.3390/w18192476
Self-citationAmes, D. P., Cohen, S., Beckage, B., Demir, İ., Halgren, J., Horsburgh, J. S., Nelson, J., Patel, A. M., Read, J. S., Swain, N., et al. (2026) · JAWRA Journal of the American Water Resources Association · doi:10.1111/1752-1688.70161
Self-citation
Metadata
- Authors
- Roberts, W., Williams, G. P., Jackson, E., Nelson, E. J., & Ames, D. P.
- Affiliations
- Brigham Young University (US)
- Corresponding author
- Williams, Gustavious P.
- Venue
- Hydrology
- Publisher
- MDPI AG
- Published
- 2018-12-02
- Volume
- 5
- Issue
- 4
- Pages
- 66
- ISSN
- 2306-5338 (ISSN-L)
- OpenAlex
- W2902790723
- Cited by
- 85
- References
- 22
- Citations by year
- 2026: 8 · 2025: 11 · 2024: 13 · 2023: 18 · 2022: 13 · 2021: 10 · 2020: 8 · 2019: 4
- Type
- software paper
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Hydrology (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
- Funders
- SERVIR, NASA Applied Sciences Program (NNX16AN45G)
- Topics
- Physical Sciences › Environmental Science › Water Science and Technology › Hydrology and Watershed Management Studies
- Physical Sciences › Environmental Science › Management, Monitoring, Policy and Law › Environmental Monitoring and Data Management
- Physical Sciences › Computer Science › Software › Computational Physics and Python Applications
- Keywords
- Python library, hydrologic model evaluation, error metrics, hydrological model calibration, open source software, river discharge
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
A language model drew the claims from the paper on 2026-11-18, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-11-18 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.