Abstract
The weather forecast in cities as Quito is highly complicated due to its proximity to Latitude 0° and because it is located in the Andes mountains range. A statistical post-processing is compulsory in order to improve the output from the physical model and to improve the weather forecast in the city. A neural network can be applied in order to carry out this task but it is necessary first to reduce its uncertainty. The Bayesian Neural Networks (BNN) have been studied deeply thanks to its probability analysis, the uncertainty can be approximated. In this paper an analysis founded on the adjustment of the posterior predictive distribution based on estimators is carried out in order to reduce the prediction error variation (implicitly the uncertainty) in a Short-Term Weather Forecast for the Andean city of Quito. From the analysis it is obtained a maximum error forecast of 12% and it is proven that for Long Short Term Memory (LSTM) structures, the variation of the error reduces almost to the half with weight-decays of \( 2.04 \times 10^{ - 7} \) and \( 2.23 \times 10^{ - 7} \).
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Rasp, S.: Statistical Methods and Machine Learning in Weather and Climate Modelling. Ludwig Maximilians Universität München (2018)
Serrano, S., Ruiz, J., Bersosa, F.: Heavy rainfall and temperature proyections in a climate change scenario over Quito. Ecuador La Granja Revista de Ciencias de la Vida (Universidad Politécnica Salesiana) 25, 16–32 (2017)
Gal, Y., Ghahramani, Z.: Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. University of Cambridge (2016)
SRTM data, National Geospatial-Intelligence Agency (NGA) and the National Aeronautics and Space Administration (NASA), USA (2010). https://www2.jpl.nasa.gov/srtm/
Luca Cardelli L., Kwiatkowska M., Laurenti L., Paoletti N., Patane A., Wicker M.: Statistical guarantees for the robustness of bayesian neural networks. In : Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (2019)
Vladimirova, M., Verbeek, J., Mesejo,, P., Arbel, J.: Understanding priors in bayesian neural networks at the unit level. In: ICML 2019 - 36th International Conference on Machine Learning (2019)
Sun, S., Zhang, G., Shi, J., Grossey, R.: Functional variational bayesian neural networks. In: International Conference on Learning Representations (2019)
Yao, J., Pan, W., Ghosh, S., Velez, D.: Quality of uncertainty quantification for bayesian neural network inference. In: ICML Workshop on Uncertainty and Robustness in Deep Learning (2019)
Neal, R.: Bayesian Learning for Neural Networks. Lecture Notes in Statistics. Springer (1996)
Willink, R., White, R.: Disentangling Classical and Bayesian Approaches to Uncertainty Analysis. Technical Report No. CCT/12-08. BIPM: Sevres. France (2012)
Jordan, M., Ghahramani, Z., Jaakkola, T., Saul, L.: An introduction to variational methods for graphical models. Mach. Learn. 37(2), 183–233 (1999)
Dotlic, D., Ipekci, B., Dulin, J.: Uncertainty in Profit Scoring (Bayesian Deep Learning). Seminar Information Systems (WS18/19). Humboldt-Universität zu Berlin (2019)
Ladyzynski, P., Zbikowski, Z., Grzegorzewski, P.: Stock Trading with Random Forests, Trend Detection Tests and Force Index Volume Indicators. Artificial Intelligence and Soft Computing. In: International Conference on Artificial Intelligence and Soft Computing ICAISC, pp. 441–452 (2013)
Narayanaa, F., Turhan, L.: Preserving Order of Data When Validating Defect Prediction Models. California Polytechnic State University (2018)
Guide to Meteorological Instruments and Methods of Observation, WMO, vol. 8 (2008)
Kamal, I., Bae, H., Sunghyun, S., Yun, H.: DERN: Deep ensemble learning model for short and long-term prediction of baltic dry index. Appl. Sci. 10(4), 1504 (2020)
Hewage, Pradeep., Behera, Ardhendu., Trovati, Marcello, Pereira, Ella: Long-short term memory for an effective short-term weather forecasting model using surface weather data. In: MacIntyre, John, Maglogiannis, Ilias, Iliadis, Lazaros, Pimenidis, Elias (eds.) AIAI 2019. IAICT, vol. 559, pp. 382–390. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-19823-7_32
Alzahrani, A., Shamsia, P., Daglib, C., Ferdowsi, M.: Solar Irradiance Forecasting Using Deep Neural Networks. Complex Adaptive Systems Conference with Theme: Engineering Cyber Physical Systems. Elsevier (2017)
El Yacoubi, S., Fargette, M., Faye, A., de Carvalho, W., Libourel, T., Loireau, T.: A multilayer perceptron model for the correlation between satellite data and soil vulnerability in the Ferlo, Senegal. Int. J. Parallel. Emergent and Distrib. Syst. 34(1) (2018)
Krogh, A., Herts, J.: A simple Weight Decay Can Improve Generalization. Advances in Neural Information Processing Systems 4 (1991)
Acknowledgment
The authors would like to thank the French Ministry for Europe and Foreign Affairs, and the French Embassy in Ecuador for the support in the present work through the Solidarity Fund for Innovative Projects (FSPI).
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Llugsi, R., Fontaine, A., Lupera, P., Bechet, J., El Yacoubi, S. (2020). Uncertainty Reduction in the Neural Network’s Weather Forecast for the Andean City of Quito Through the Adjustment of the Posterior Predictive Distribution Based on Estimators. In: Rodriguez Morales, G., Fonseca C., E.R., Salgado, J.P., Pérez-Gosende, P., Orellana Cordero, M., Berrezueta, S. (eds) Information and Communication Technologies. TICEC 2020. Communications in Computer and Information Science, vol 1307. Springer, Cham. https://doi.org/10.1007/978-3-030-62833-8_39
Download citation
DOI: https://doi.org/10.1007/978-3-030-62833-8_39
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-62832-1
Online ISBN: 978-3-030-62833-8
eBook Packages: Computer ScienceComputer Science (R0)