CoChat
Sign Up
Cited by 4Environmental Monitoring and Data ManagementClimate variability and modelsPrecipitation Measurement and Analysis

Exploratory analysis of meteorological data

Open access
Sousa, Joel Agostinho Nunes Pinto de·2019·Universidade do Porto
DOI 10.34626/vyj3-hs51
Open this paper in CoChat — free accountOpen PDF

Abstract

The meteorological data recorded by the Escola Médico-Cirúrgica do Porto (EMCP) between December 1860 and March 1898 were stored in files.This data remained raw, consisting only of records that had not yet been analyzed.Through the Instituto Geofísico da Universidade do Porto (IGUP), we had access to these files which provided us with the opportunity to perform an exploratory analysis of these meteorological data.This analysis allowed us to identify missing values, suspect values, and values with format errors.Through the development of a web app, it became possible to analyze the evolution of the meteorological parameters trend in the period presented in the records and to analyze the evolution of the meteorological parameters in specific time intervals, such as months, years and seasons.It was also possible to study specific temperature and precipitation indices, such as heatwaves and maximum consecutive days of precipitation, as well as to observe the relationships between meteorological parameters.The developed web app allows the graphical visualization and interpretation of the exploratory analysis of the data in a dynamic and interactive way, a relevant contribution to this study, as well as for future analysis by experts in the field.i Resumo O conjunto dos dados meteorológicos registados pela Escola Médico-Cirúrgica do Porto (EMCP) entre dezembro de 1860 e março de 1898 estavam guardados em ficheiros.Estes dados permaneciam em bruto, consistindo apenas em registos que ainda não tinham sido analisados.Através do Instituto Geofísico da Universidade do Porto (IGUP), tivemos acesso a esses ficheiros que nos proporcionaram a oportunidade de realizar uma análise exploratória desses dados meteorológicos.Esta análise permitiu-nos identificar valores ausentes, valores suspeitos e valores com erros de formato.Através do desenvolvimento de uma web app, tornou-se possível analisar a evolução da tendência dos parâmetros meteorológicos no período apresentado nos registos e analisar a evolução de parâmetros meteorológicos em intervalos de tempo específicos, tais como meses, anos e estações do ano.Tornou-se ainda possível, estudar índices específicos de temperatura e precipitação, como ondas de calor e máximo de dias consecutivos de precipitação, assim como observar as relações entre os parâmetros meteorológicos.A web app desenvolvida permite a visualização gráfica e a interpretação da análise exploratória dos dados de forma dinâmica e interativa, um contributo relevante para este estudo, bem como para futuras análises de especialistas da área.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.34626/vyj3-hs51

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Meteorological data collection faces challenges from missing, aberrant, or erroneous data, which often arise due to equipment malfunctions, human errors in data recording, or lack of calibration and standardization across measurement instruments.

    “The challenges associated with meteorological data collection are multifaceted, primarily concerning the presence of missing, aberrant, or erroneous data. Such inconsistencies often arise due to equipment malfunctions, human errors in data recording, or the lack of calibration and standardization across measurement instruments [1, 2].”

    From Exploratory data analysis of Burkina Faso’s Raw daily meteorological records (1981–2021): data quality insights and potential outlier screening (2026) · cites this paper as [2]

    Split into 2 atoms — 1 confirmed, 1 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

No references could be resolved yet.

Research works printed but not linked: 55

  1. Jeremy Adler and Ingela Parmryd. Quantifying colocalization by correlation: the pearson correlation coefficient is superior to the mander's overlap coefficient. Cytometry Part A, 77 (8):733-742, 2010.
  2. Y Nazeer Ahammed, RR Reddy, K Rama Gopal, K Narasimhulu, D Baba Basha, L Siva Sankara Reddy, and TVR Rao. Seasonal variation of the surface ozone and its precursor gases during 2001-2003, measured at anantapur (14.62 n), a semi-arid site in india. Atmospheric Research, 80(2-3):151-164, 2006.
  3. Peter C Austin and Ewout W Steyerberg. Graphical assessment of internal and external calibration of logistic regression models by using loess smoothers. Statistics in medicine, 33 (3):517-535, 2014.
  4. Sven Bachthaler and Daniel Weiskopf. Continuous scatterplots. IEEE transactions on visualization and computer graphics, 14(6):1428-1435, 2008.
  5. Le Bao, Tilmann Gneiting, Eric P Grimit, Peter Guttorp, and Adrian E Raftery. Bias correction and bayesian model averaging for ensemble forecasts of surface wind direction. Monthly Weather Review, 138(5):1811-1821, 2010.
  6. Christoph Bergmeir, Rob J Hyndman, and José M Benítez. Bagging exponential smoothing methods using stl decomposition and box-cox transformation. International journal of forecasting, 32(2):303-312, 2016.
  7. Fitzgerald Booker, Russell Muntifering, Margaret McGrath, Kent Burkey, Dennis Decoteau, Edwin Fiscus, William Manning, Sagar Krupa, Arthur Chappelka, and David Grantz. The ozone component of global change: potential effects on agricultural and horticultural plant yield, product quality and interactions with invasive species. Journal of Integrative Plant Biology, 51(4):337-351, 2009.
  8. CH Brühl and Paul J Crutzen. On the disproportionate role of tropospheric ozone as a filter against solar uv-b radiation. Geophysical Research Letters, 16(7):703-706, 1989.
  9. Chris Chatfield. Exploratory data analysis. European journal of operational research, 23(1): 5-13, 1986.
  10. Andrew C Comrie. Comparing neural networks and regression models for ozone forecasting. Journal of the Air & Waste Management Association, 47(6):653-663, 1997.
  11. Victoria Cox. Exploratory data analysis. In Translating Statistics to Make Decisions, pages 47-74. Springer, 2017.
  12. M Isabel P de Lima, Fátima Espírito Santo, Alexandre M Ramos, and Ricardo M Trigo. Trends and correlations in annual extreme precipitation indices for mainland portugal, 1941-2007. Theoretical and applied climatology, 119(1-2):55-75, 2015.
  13. C Dueñas, MC Fernández, S Cañete, J Carretero, and E Liger. Assessment of ozone variations and meteorological effects in an urban area in the mediterranean coast. Science of the Total Environment, 299(1-3):97-113, 2002.
  14. William D Dupont and Walton D Plummer Jr. Power and sample size calculations for studies involving linear regression. Controlled clinical trials, 19(6):589-601, 1998.
  15. Stephen HC DuToit, A Gert W Steyn, and Rolf H Stumpf. Graphical exploratory data analysis. Springer Science & Business Media, 2012.
  16. Fátima Espírito Santo, M Isabel P de Lima, Alexandre M Ramos, and Ricardo M Trigo. Trends in seasonal surface air temperature in mainland portugal, since 1941. International Journal of Climatology, 34(6):1814-1837, 2014.
  17. Y Fang, Vaishali Naik, LW Horowitz, and Denise Leonore Mauzerall. Air pollution and associated human mortality: the role of air pollutant emissions, climate change and methane concentration increases from the preindustrial period to present. Atmospheric Chemistry and Physics, 13(3):1377-1394, 2013.
  18. John Fox. Nonparametric simple regression : smoothing scatterplots. Quantitative applications in the social sciences no. 07-130. Sage Publications, Thousand Oaks, CA, 2000.
  19. JI Freijer, JCH Van Eijkeren, and L Van Bree. A model for the effect on health of repeated exposure to ozone. Environmental Modelling & Software, 17(6):553-562, 2002.
  20. MW Gardner and SR Dorling. Statistical surface ozone models: an improved methodology to account for non-linear behaviour. Atmospheric Environment, 34(1):21-34, 2000.
  21. Martin T Hagan and Suzanne M Behr. The time series approach to short term load forecasting. IEEE Transactions on Power Systems, 2(3):785-791, 1987.
  22. Giles Harrison. Meteorological measurements and instrumentation. John Wiley & Sons, 2014.
  23. Ronald C Henry, Yu-Shuo Chang, and Clifford H Spiegelman. Locating nearby sources of air pollution by nonparametric regression of atmospheric concentrations on wind direction. Atmospheric Environment, 36(13):2237-2244, 2002.
  24. David C Hoaglin. Exploratory data analysis. Wiley StatsRef: Statistics Reference Online, pages 1-6, 2014.
  25. Dennis Howitt and Duncan Cramer. Introduction to statistics in psychology. Pearson education, 2007.
  26. Mia Hubert and Ellen Vandervieren. An adjusted boxplot for skewed distributions. Compu- tational Statistics Data Analysis, 52:5186-5201, 08 2008. doi:10.1016/j.csda.2007.11.008. · DOI · Paper page
  27. George J Huffman, Robert F Adler, Philip Arkin, Alfred Chang, Ralph Ferraro, Arnold Gruber, John Janowiak, Alan McNab, Bruno Rudolf, and Udo Schneider. The global precipitation climatology project (gpcp) combined precipitation dataset. Bulletin of the American Meteorological Society, 78(1):5-20, 1997.
  28. Daniel J Jacob and Darrell A Winner. Effect of climate change on air quality. Atmospheric environment, 43(1):51-63, 2009.
  29. William G Jacoby. Loess:: a nonparametric, graphical tool for depicting relationships between variables. Electoral Studies, 19(4):577-613, 2000.
  30. Jennifer J Kaplan, John G Gabrosek, Phyllis Curtiss, and Chris Malone. Investigating student understanding of histograms. Journal of Statistics Education, 22(2), 2014.
  31. Daniel A Keim, Ming C Hao, Umesh Dayal, and Meichun Hsu. Pixel bar charts: a visualization technique for very large multi-attribute data sets. Information Visualization, 1 (1):20-34, 2002.
  32. Daniel A Keim, Ming C Hao, and Umeshwar Dayal. Hierarchical pixel bar charts. IEEE Transactions on Visualization and Computer Graphics, 8(3):255-269, 2002.
  33. P Miranda, FES Coelho, António Rodrigues Tomé, Maria Antónia Valente, Anabela Carvalho, Carlos Pires, Henrique Oliveira Pires, Vanda Cabrinha Pires, and Carlos Ramalho. 20th century portuguese climate and climate scenarios. Climate Change in Portugal. Scenarios, Impacts and Adaptation Measures-SIAM Project (Santos FD, Forbes K, Moita R, eds). Lisbon: Gradiva Publishers, pages 23-83, 2002.
  34. SJ Oltmans, AS Lefohn, JM Harris, I Galbally, HE Scheel, G Bodeker, E Brunke, H Claude, D Tarasick, BJ Johnson, et al. Long-term changes in tropospheric ozone. Atmospheric Environment, 40(17):3156-3173, 2006.
  35. Noelia Otero, Jana Sillmann, Jordan L Schnell, Henning W Rust, and Tim Butler. Synoptic and meteorological drivers of extreme ozone concentrations over europe. Environmental Research Letters, 11(2):024005, 2016.
  36. Alexandre M Ramos, Ricardo M Trigo, and Fátima E Santo. Evolution of extreme temperatures over portugal: recent changes and future scenarios. Climate Research, 48(2-3): 177-192, 2011.
  37. Fátima Espírito Santo, Alexandre M Ramos, M Isabel P de Lima, and Ricardo M Trigo. Seasonal changes in daily precipitation extremes in mainland portugal from 1941 to 2007. Regional environmental change, 14(5):1765-1788, 2014.
  38. George AF Seber and Alan J Lee. Linear regression analysis, volume 329. John Wiley & Sons, 2012.
  39. Philip Sedgwick. Pearson's correlation coefficient. Bmj, 345:4483, 2012.
  40. A Sfetsos. A novel approach for the forecasting of mean hourly wind speed time series. Renewable energy, 27(2):163-174, 2002.
  41. Robert H. Shumway and David S. Stoffer. Time Series Analysis and Its Applications. Springer, 2016.
  42. Chiawa H Sim, Francis F Gan, and Tang C Chang. Outlier labeling with boxplot procedures. Journal of the American Statistical Association, 100(470):642-652, 2005.
  43. Simon Stisen, Inge Sandholt, Anette Nørgaard, Rasmus Fensholt, and Lars Eklundh. Estimation of diurnal air temperature using msg seviri data in west africa. Remote Sensing of Environment, 110(2):262-274, 2007.
  44. Kevin E Trenberth. Changes in precipitation with climate change. Climate Research, 47 (1-2):123-138, 2011.
  45. John W Tukey and Paul A Tukey. Computer graphics and exploratory data analysis: An introduction. The Collected Works of John W. Tukey: Graphics: 1965-1985, 5:419, 1988.
  46. Marcel Urban, Jonas Eberle, Christian Hüttich, Christiane Schmullius, and Martin Herold. Comparison of satellite-derived land surface temperature and air temperature from meteorological stations on the pan-arctic scale. Remote Sensing, 5(5):2348-2367, 2013.
  47. Christelle Vancutsem, Pietro Ceccato, Tufa Dinku, and Stephen J Connor. Evaluation of modis land surface temperature data to estimate air temperature in different ecosystems over africa. Remote Sensing of Environment, 114(2):449-465, 2010.
  48. William WS Wei. Time series analysis. In The Oxford Handbook of Quantitative Methods in Psychology: Vol. 2. 2006.
  49. William W.S. Wei. The Oxford Handbook of Quantitative Methods in Psychology: Vol. 2: Statistical Analysis. Oxford University Press, 2013.
  50. Sanford Weisberg. Applied linear regression, volume 528. John Wiley & Sons, 2005.
  51. Hadley Wickham. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag New York, 2016. ISBN: 978-3-319-24277-4.
  52. Pingping Xie and Phillip A Arkin. Global precipitation: A 17-year monthly analysis based on gauge observations, satellite estimates, and numerical model outputs. Bulletin of the American Meteorological Society, 78(11):2539-2558, 1997.
  53. Jialiu Xu and Yixiu Zhu. Some characteristics of ozone concentrations and their relations with meteorological factors in shanghai. Atmospheric Environment, 28(20):3387-3392, 1994.
  54. Yuan Yang, Wen Cai, and Jian Yang. Evaluation of modis land surface temperature data to estimate near-surface air temperature in northeast china. Remote Sensing, 9(5):410, 2017.
  55. Achim Zeileis and Gabor Grothendieck. zoo: S3 infrastructure for regular and irregular time series. arXiv preprint math/0505527, 2005. · arXiv

Cited by

Sorted by citations

Authors
Sousa, J. A. N. P. D.
Corresponding author
Sousa, Joel Agostinho Nunes Pinto de
Venue
Universidade do Porto
Publisher
Universidade do Porto
Published
2019-12-02
DOI
10.34626/vyj3-hs51
OpenAlex
W3011451665
Cited by
4
References
0
Citations by year
2024: 4
Type
dissertation
Language
en
Open access
Licence
other-oa
Locations
  • Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, other-oa)
  • Universidade do Porto
Topics
  • Physical Sciences › Earth and Planetary Sciences › Geology › Environmental Monitoring and Data Management
  • Physical Sciences › Environmental Science › Global and Planetary Change › Climate variability and models
  • Physical Sciences › Earth and Planetary Sciences › Atmospheric Science › Precipitation Measurement and Analysis
Keywords
historical meteorological records, Porto, data quality assessment, missing data, heat waves, temperature trends, precipitation trends, web application, interactive data visualization, 19th century climate, seasonal climate variability, climate indices

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review