Using Artificial Intelligence to Improve Real-Time Decision-Making for High-Impact Weather
The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
High-impact weather events, such as severe thunderstorms, tornadoes, and hurricanes, cause significant disruptions to infrastructure, property loss, and even fatalities. High-impact events can also positively impact society, such as the impact on savings through renewable energy. Prediction of these events has improved substantially with greater observational capabilities, increased computing power, and better model physics, but there is still significant room for improvement. Artificial intelligence (AI) and data science technologies, specifically machine learning and data mining, bridge the gap between numerical model prediction and real-time guidance by improving accuracy. AI techniques also extract otherwise unavailable information from forecast models by fusing model output with observations to provide additional decision support for forecasters and users. In this work, we demonstrate that applying AI techniques along with a physical understanding of the environment can significantly improve the prediction skill for multiple types of high-impact weather. The AI approach is also a contribution to the growing field of computational sustainability. The authors specifically discuss the prediction of storm duration, severe wind, severe hail, precipitation classification, forecasting for renewable energy, and aviation turbulence. They also discuss how AI techniques can process “big data,” provide insights into high-impact weather phenomena, and improve our understanding of high-impact weather.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Breiman, L. (2001) · Machine Learning · doi:10.1023/a:1010933404324 · Cited by 133,538
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
(1992) · Cited by 23,431
Quinlan, J. R. (1986) · Machine Learning · doi:10.1007/bf00116251 · Cited by 21,439
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
A decision-theoretic generalization of on-line learning and an application to boosting
Freund, Y., & Schapire, R. E. (1997) · Journal of Computer and System Sciences · doi:10.1006/jcss.1997.1504 · Cited by 20,466
Friedman, J. H. (2002) · Computational Statistics & Data Analysis · doi:10.1016/s0167-9473(01)00065-2 · Cited by 7,067
Basic principles of ROC analysis
Metz, C. E. (1978) · Seminars in Nuclear Medicine · doi:10.1016/s0001-2998(78)80014-2 · Cited by 6,026
The Boosting Approach to Machine Learning: An Overview
Schapire, R. E. (2003) · Lecture Notes in Statistics · doi:10.1007/978-0-387-21579-2_9 · Cited by 2,003
Improved Use of Continuous Attributes in C4.5
Quinlan, J. R. (1996) · Journal of Artificial Intelligence Research · doi:10.1613/jair.279 · Cited by 1,846
Encyclopedia of Statistical Sciences.
Tanur, J. M., Casella, G., Dykstra, R., Finster, M. P., Gaver, D. P., Greenhouse, J., Iversen, G. R., Jasso, G., Kmenta, J., Press, S. J., et al. (1989) · Journal of the American Statistical Association · doi:10.2307/2289675 · Cited by 719
Does automation bias decision-making?
SKITKA, L. J., MOSIER, K. L., & BURDICK, M. (1999) · International Journal of Human-Computer Studies · doi:10.1006/ijhc.1999.0252 · Cited by 694 · cited 2×
“…etsoc.org/doi/pdf/10.1175/BAM S-D -16-0123.1 by guest on 03 Septem ber 2020 automated approach is that forecasters may become disengaged from the forecast process (Pliske et al. 2004) and struggle to take appropriate corrective action when automation fails (Skitka et al. 1999; Pagano et al. 2016).”
BackgroundInfluentialAn Hourly Assimilation–Forecast Cycle: The RUC
Benjamin, S. G., Dévényi, D., Weygandt, S. S., Brundage, K. J., Brown, J. M., Grell, G. A., Kim, D., Schwartz, B. E., Smirnova, T. G., Smith, T. L., et al. (2004) · Monthly Weather Review · doi:10.1175/1520-0493(2004)132<0495:ahactr>2.0.co;2 · Cited by 634
Self-citationVisualizing Multiple Measures of Forecast Quality
Roebber, P. J. (2009) · Weather and Forecasting · doi:10.1175/2008waf2222159.1 · Cited by 574
Statewide Monitoring of the Mesoscale Environment: A Technical Update on the Oklahoma Mesonet
McPherson, R. A., Fiebrich, C. A., Crawford, K. C., Kilby, J. R., Grimsley, D. L., Martinez, J. E., Basara, J. B., Illston, B. G., Morris, D. A., Kloesel, K. A., et al. (2007) · Journal of Atmospheric and Oceanic Technology · doi:10.1175/jtech1976.1 · Cited by 530
Predicting solar generation from weather forecasts using machine learning
Sharma, N., Sharma, P., Irwin, D., & Shenoy, P. (2011) · 2011 IEEE International Conference on Smart Grid Communications (SmartGridComm) · doi:10.1109/smartgridcomm.2011.6102379 · Cited by 467
How Can Decision Making Be Improved?
Milkman, K. L., Chugh, D., & Bazerman, M. H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01142.x · Cited by 425
An analog ensemble for short-term probabilistic solar power forecast
Alessandrini, S., Delle Monache, L., Sperati, S., & Cervone, G. (2015) · Applied Energy · doi:10.1016/j.apenergy.2015.08.011 · Cited by 362
Probabilistic Weather Prediction with an Analog Ensemble
Delle Monache, L., Eckel, F. A., Rife, D. L., Nagarajan, B., & Searight, K. (2013) · Monthly Weather Review · doi:10.1175/mwr-d-12-00281.1 · Cited by 339
Marquez, R., & Coimbra, C. F. M. (2011) · Solar Energy · doi:10.1016/j.solener.2011.01.007 · Cited by 325
An Enhanced Hail Detection Algorithm for the WSR-88D
Witt, A., Eilts, M. D., Stumpf, G. J., Johnson, J. T., Mitchell, E. D. W., & Thomas, K. W. (1998) · Weather and Forecasting · doi:10.1175/1520-0434(1998)013<0286:aehdaf>2.0.co;2 · Cited by 321
Wang, F., Mi, Z., Su, S., & Zhao, H. (2012) · Energies · doi:10.3390/en5051355 · Cited by 317
An Integrated Approach to Mid- and Upper-Level Turbulence Forecasting
Sharman, R., Tebaldi, C., Wiener, G., & Wolff, J. (2006) · Weather and Forecasting · doi:10.1175/waf924.1 · Cited by 268
Hourly solar irradiance time series forecasting using cloud cover index
Yang, D., Jirutitijaroen, P., & Walsh, W. (2012) · Solar Energy · doi:10.1016/j.solener.2012.07.029 · Cited by 261
Multi-Radar Multi-Sensor (MRMS) Severe Weather and Aviation Products: Initial Operating Capabilities
Smith, T. M., Lakshmanan, V., Stumpf, G. J., Ortega, K. L., Hondl, K., Cooper, K., Calhoun, K. M., Kingfield, D. M., Manross, K. L., Toomey, R., et al. (2016) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-14-00173.1 · Cited by 248
Self-citationSolar Forecasting: Methods, Challenges, and Performance
Tuohy, A., Zack, J. W., Haupt, S. E., Sharp, J., Ahlstrom, M. L., Dise, S., Grimit, E. P., Möhrlen, C., Lange, M., Casado, M. G., et al. (2015) · IEEE Power and Energy Magazine · doi:10.1109/mpe.2015.2461351 · Cited by 235
Self-citationOBJECTIVE PREDICTION OF FIVE-DAY MEAN TEMPERATURES DURING WINTER
Klein, W. H., Lewis, B. M., & Enger, I. (1959) · Journal of Meteorology · doi:10.1175/1520-0469(1959)016<0672:opofdm>2.0.co;2 · Cited by 202
Muller, M. P., Tomlinson, G., Marrie, T. J., Tang, P., McGeer, A., Low, D. E., Detsky, A. S., & Gold, W. L. (2005) · Clinical Infectious Diseases · doi:10.1086/428577 · Cited by 195
The attributes diagram A geometrical framework for assessing the quality of probability forecasts
Hsu, W.-R., & Murphy, A. H. (1986) · International Journal of Forecasting · doi:10.1016/0169-2070(86)90048-8 · Cited by 190
Artificial Intelligence technique for modelling and forecasting of solar radiation data: a review
Mellit, A. (2008) · International Journal of Artificial Intelligence and Soft Computing · doi:10.1504/ijaisc.2008.021264 · Cited by 189
Obtaining Calibrated Probabilities from BoostingPreprint
Niculescu-Mizil, A., & Caruana, R. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1207.1403 · Cited by 183
Hybrid intra-hour DNI forecasts with sky image processing enhanced by stochastic learning
Chu, Y., Pedro, H. T. C., & Coimbra, C. F. M. (2013) · Solar Energy · doi:10.1016/j.solener.2013.10.020 · Cited by 180
A Neural Network for Tornado Prediction Based on Doppler Radar-Derived Attributes
Marzban, C., & Stumpf, G. J. (1996) · Journal of Applied Meteorology · doi:10.1175/1520-0450(1996)035<0617:annftp>2.0.co;2 · Cited by 175
An Automated Technique to Quality Control Radar Reflectivity Data
Lakshmanan, V., Fritz, A., Smith, T., Hondl, K., & Stumpf, G. (2007) · Journal of Applied Meteorology and Climatology · doi:10.1175/jam2460.1 · Cited by 166
Self-citationArtificial Intelligence Methods in the Environmental Sciences
(2009) · Springer eBooks · doi:10.1007/978-1-4020-9119-3 · Cited by 163
MPING: Crowd-Sourcing Weather Reports for Research
Elmore, K. L., Flamig, Z. L., Lakshmanan, V., Kaney, B. T., Farmer, V., Reeves, H. D., & Rothfusz, L. P. (2014) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-13-00014.1 · Cited by 159
Self-citationForecasting Hail Using a One-Dimensional Hail Growth Model within WRF
Adams-Selin, R. D., & Ziegler, C. L. (2016) · Monthly Weather Review · doi:10.1175/mwr-d-16-0027.1 · Cited by 136
Using random forests to diagnose aviation turbulence
Williams, J. K. (2014) · Machine Learning · doi:10.1007/s10994-013-5346-7 · Cited by 124
Self-citationA Bayesian Neural Network for Severe-Hail Size Prediction
Marzban, C., & Witt, A. (2001) · Weather and Forecasting · doi:10.1175/1520-0434(2001)016<0600:abnnfs>2.0.co;2 · Cited by 116
Mecikalski, J. R., Williams, J. K., Jewett, C. P., Ahijevych, D., LeRoy, A., & Walker, J. R. (2015) · Journal of Applied Meteorology and Climatology · doi:10.1175/jamc-d-14-0129.1 · Cited by 115
Self-citationClassification of merged AVHRR and SMMR Arctic data with neural networks
Key, J., Maslanik, J. A., & Schweiger, A. J. (1989) · Photogrammetric Engineering & Remote Sensing · Cited by 114
Ahijevych, D. A., Pinto, J. O., Williams, J. K. Y., & Steiner, M. (2016) · Weather and Forecasting · doi:10.1175/waf-d-15-0113.1 · Cited by 99
Self-citationPrecipitation and Temperature Forecast Performance at the Weather Prediction Center
Novak, D. R., Bailey, C. M., Brill, K. F., Burke, P., Hogsett, W. A., Rausch, R., & Schichtel, M. (2013) · Weather and Forecasting · doi:10.1175/waf-d-13-00066.1 · Cited by 83
A regime-dependent artificial neural network technique for short-range solar irradiance forecasting
McCandless, T. C., Haupt, S. E., & Young, G. S. (2015) · Renewable Energy · doi:10.1016/j.renene.2015.12.030 · Cited by 83
Self-citationAn Empirical Model for Assessing the Severe Weather Potential of Developing Convection
Cintineo, J. L., Pavolonis, M. J., Sieglaff, J. M., & Lindsey, D. T. (2014) · Weather and Forecasting · doi:10.1175/waf-d-13-00113.1 · Cited by 82
Severe Weather Prediction Using Storm Surrogates from an Ensemble Forecasting System
Sobash, R., Schwartz, C., Romine, G., Fossell, K. R., & Weisman, M. (2016) · Weather and Forecasting · doi:10.1175/waf-d-15-0138.1 · Cited by 82
Next Generation Earth System Prediction
Board on Atmospheric Sciences and Climate, Ocean Studies Board, Studies, D. O. E. A. L., & National Academies of Sciences, E. (2016) · National Academies Press eBooks · doi:10.17226/21873 · Cited by 71
Karstens, C. D., Stumpf, G. J., Ling, C., Hua, L., Kingfield, D. M., Smith, T. M., Correia, J., Calhoun, K. M., Ortega, K. L., Melick, C. J., et al. (2015) · Weather and Forecasting · doi:10.1175/waf-d-14-00163.1 · Cited by 66
Self-citationQuality Control of Weather Radar Data Using Polarimetric Variables
Lakshmanan, V., Karstens, C. D., Krause, J. M., & Tang, L. (2014) · Journal of Atmospheric and Oceanic Technology · doi:10.1175/jtech-d-13-00073.1 · Cited by 62
Self-citationClassification of Convective Areas Using Decision Trees
Gagne, D. J., McGovern, A., & Brotzge, J. (2009) · Journal of Atmospheric and Oceanic Technology · doi:10.1175/2008jtecha1205.1 · Cited by 58
Self-citationMcGovern, A., Gagne, D. J., Williams, J. K., Brown, R. A., & Basara, J. B. (2014) · Machine Learning · doi:10.1007/s10994-013-5343-x · Cited by 55
Self-citationA Neural Network for Damaging Wind Prediction
Marzban, C., & Stumpf, G. J. (1998) · Weather and Forecasting · Cited by 55
Luna‐Herrera, J., Martínez-Cabrera, G., Parra-Maldonado, R., Enciso‐Moreno, J. A., Torres-López, J., Quesada-Pascual, F., Delgadillo-Polanco, R., & Franzblau, S. G. (2003) · European Journal of Clinical Microbiology & Infectious Diseases · doi:10.1007/s10096-002-0855-5 · Cited by 54
Knowledge Is Power: Efficiently Integrating Wind Energy and Wind Forecasts
Ahlstrom, M. L., Möhrlen, C., O’Sullivan, J., et al. (2013) · IEEE Power and Energy Magazine · doi:10.1109/mpe.2013.2277999 · Cited by 52
Automation and human expertise in operational river forecasting
Pagano, T. C., Pappenberger, F., Wood, A. W., Ramos, M., Persson, A., & Anderson, B. (2016) · Wiley Interdisciplinary Reviews Water · doi:10.1002/wat2.1163 · Cited by 50
Synoptic-Scale Features Common to Heavy Snowstorms in the Southeast United States
Mote, T. L., Gamble, D. W., Underwood, S. J., & Bentley, M. L. (1997) · Weather and Forecasting · doi:10.1175/1520-0434(1997)012<0154:uorttp>2.0.co;2 · Cited by 47
Kernel Smoothing For ROC Curve And Estimation For Thyroid Stimulating Hormone
Tazhibi, M., Bashardoost, N., & Ahmadi, M. (2011) · Cited by 44
Hail in Northeast Italy: A Neural Network Ensemble Forecast Using Sounding-Derived Indices
Manzato, A. (2012) · Weather and Forecasting · doi:10.1175/waf-d-12-00034.1 · Cited by 39
Tornado Detection with Support Vector Machines
Trafali̇s, T. B., İnce, H., & Richman, M. B. (2003) · Lecture notes in computer science · doi:10.1007/3-540-44864-0_30 · Cited by 37
A consensus forecasting approach for improved turbine hub height wind speed predictions
Myers, W. N., Wiener, G. M., Linden, S., & Haupt, S. E. (2011) · Cited by 35
Self-citationMcGovern, A., Gagne, D. J., Basara, J. B., Hamill, T. M., & Margolin, D. (2015) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-14-00006.1 · Cited by 34
Self-citationRegime-Dependent Short-Range Solar Irradiance Forecasting
McCandless, T. C., Young, G. S., Haupt, S. E., & Hinkelman, L. M. (2016) · Journal of Applied Meteorology and Climatology · doi:10.1175/jamc-d-15-0354.1 · Cited by 32
Self-citationSharman, R. D. (2016) · Springer eBooks · doi:10.1007/978-3-319-23630-8_1 · Cited by 31
APPLICATION OF STATISTICAL METHODS IN WEATHER PREDICTION
Malone, T. F. (1955) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.41.11.806 · Cited by 26
A Method for Extracting Postevent Storm Tracks
Lakshmanan, V., Herzog, B. S., & Kingfield, D. M. (2014) · Journal of Applied Meteorology and Climatology · doi:10.1175/jamc-d-14-0132.1 · Cited by 22
Combining observations and model data for short-term storm forecasting
Williams, J. K. Y., Ahijevych, D. A., Dettling, S., & Steiner, M. (2008) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.795737 · Cited by 21
Self-citationRemote detection and diagnosis of thunderstorm turbulence
Williams, J. K. Y., Sharman, R. D., Craig, J., & Blackburn, G. (2008) · Proceedings of SPIE, the International Society for Optical Engineering/Proceedings of SPIE · doi:10.1117/12.795570 · Cited by 20
Self-citationAdaptable Regression Method for Ensemble Consensus Forecasting
Williams, J. K. Y., Neilley, P. P., Koval, J. P., & McDonald, J. (2016) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v30i1.9913 · Cited by 14
Self-citationGagne, D. J. (2016) · SHAREOK (University of Oklahoma; Oklahoma State University; Central Oklahoma University) · Cited by 9
Self-citationThe Use of Model Output Statistics (MOS) in Objective Weather Forecasting
(1972) · doi:10.1175/1520-0450(1972)011<1203:tuomos>2.0.co;2
Cited by
Deep learning and process understanding for data-driven Earth system science
Reichstein, M., Camps-Valls, G., Stevens, B., Jung, M., Denzler, J., Carvalhais, N., & Prabhat (2019) · Nature · doi:10.1038/s41586-019-0912-1 · Cited by 5,673
Integrating Scientific Knowledge with Machine Learning for Engineering and Environmental Systems
Willard, J., Jia, X., Xu, S., Steinbach, M., & Kumar, V. (2023) · ACM Computing Surveys · doi:10.1145/3514228 · Cited by 878
A review of machine learning applications in wildfire science and management
Jain, P., Coogan, S. C. P., Subramanian, S. G., Crowley, M., Taylor, S., & Flannigan, M. D. (2020) · Environmental Reviews · doi:10.1139/er-2020-0019 · Cited by 765
WeatherBench: A Benchmark Data Set for Data‐Driven Weather Forecasting
Rasp, S., Dueben, P. D., Scher, S., Weyn, J. A., Mouatadid, S., & Thuerey, N. (2020) · Journal of Advances in Modeling Earth Systems · doi:10.1029/2020ms002203 · Cited by 663
Making the Black Box More Transparent: Understanding the Physical Implications of Machine Learning
McGovern, A., Lagerquist, R., John Gagne, D., Jergensen, G. E., Elmore, K. L., Homeyer, C. R., & Smith, T. (2019) · Bulletin of the American Meteorological Society · doi:10.1175/bams-d-18-0195.1 · Cited by 558
Self-citation
Metadata
- Authors
- McGovern, A., Elmore, K. L., Gagne, D. J., Haupt, S. E., Karstens, C. D., Lagerquist, R., Smith, T., & Williams, J. K.
- Venue
- Bulletin of the American Meteorological Society
- Publisher
- American Meteorological Society
- Published
- 2017-10
- Volume
- 98
- Issue
- 10
- Pages
- 2073-2090
- ISSN
- 0003-0007 (ISSN-L)
- 1520-0477
- OpenAlex
- W2601923741
- Cited by
- 443
- References
- 70
- FWCI
- 17.97
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.