Skip to main content

Uncertainty Reduction in the Neural Network’s Weather Forecast for the Andean City of Quito Through the Adjustment of the Posterior Predictive Distribution Based on Estimators

  • Conference paper
  • First Online:

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1307))

Abstract

The weather forecast in cities as Quito is highly complicated due to its proximity to Latitude 0° and because it is located in the Andes mountains range. A statistical post-processing is compulsory in order to improve the output from the physical model and to improve the weather forecast in the city. A neural network can be applied in order to carry out this task but it is necessary first to reduce its uncertainty. The Bayesian Neural Networks (BNN) have been studied deeply thanks to its probability analysis, the uncertainty can be approximated. In this paper an analysis founded on the adjustment of the posterior predictive distribution based on estimators is carried out in order to reduce the prediction error variation (implicitly the uncertainty) in a Short-Term Weather Forecast for the Andean city of Quito. From the analysis it is obtained a maximum error forecast of 12% and it is proven that for Long Short Term Memory (LSTM) structures, the variation of the error reduces almost to the half with weight-decays of \( 2.04 \times 10^{ - 7} \) and \( 2.23 \times 10^{ - 7} \).

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

References

  1. Rasp, S.: Statistical Methods and Machine Learning in Weather and Climate Modelling. Ludwig Maximilians Universität München (2018)

    Google Scholar 

  2. Serrano, S., Ruiz, J., Bersosa, F.: Heavy rainfall and temperature proyections in a climate change scenario over Quito. Ecuador La Granja Revista de Ciencias de la Vida (Universidad Politécnica Salesiana) 25, 16–32 (2017)

    Google Scholar 

  3. Gal, Y., Ghahramani, Z.: Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning. University of Cambridge (2016)

    Google Scholar 

  4. SRTM data, National Geospatial-Intelligence Agency (NGA) and the National Aeronautics and Space Administration (NASA), USA (2010). https://www2.jpl.nasa.gov/srtm/

  5. Luca Cardelli L., Kwiatkowska M., Laurenti L., Paoletti N., Patane A., Wicker M.: Statistical guarantees for the robustness of bayesian neural networks. In : Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence (2019)

    Google Scholar 

  6. Vladimirova, M., Verbeek, J., Mesejo,, P., Arbel, J.: Understanding priors in bayesian neural networks at the unit level. In: ICML 2019 - 36th International Conference on Machine Learning (2019)

    Google Scholar 

  7. Sun, S., Zhang, G., Shi, J., Grossey, R.: Functional variational bayesian neural networks. In: International Conference on Learning Representations (2019)

    Google Scholar 

  8. Yao, J., Pan, W., Ghosh, S., Velez, D.: Quality of uncertainty quantification for bayesian neural network inference. In: ICML Workshop on Uncertainty and Robustness in Deep Learning (2019)

    Google Scholar 

  9. Neal, R.: Bayesian Learning for Neural Networks. Lecture Notes in Statistics. Springer (1996)

    Google Scholar 

  10. Willink, R., White, R.: Disentangling Classical and Bayesian Approaches to Uncertainty Analysis. Technical Report No. CCT/12-08. BIPM: Sevres. France (2012)

    Google Scholar 

  11. Jordan, M., Ghahramani, Z., Jaakkola, T., Saul, L.: An introduction to variational methods for graphical models. Mach. Learn. 37(2), 183–233 (1999)

    Article  Google Scholar 

  12. Dotlic, D., Ipekci, B., Dulin, J.: Uncertainty in Profit Scoring (Bayesian Deep Learning). Seminar Information Systems (WS18/19). Humboldt-Universität zu Berlin (2019)

    Google Scholar 

  13. Ladyzynski, P., Zbikowski, Z., Grzegorzewski, P.: Stock Trading with Random Forests, Trend Detection Tests and Force Index Volume Indicators. Artificial Intelligence and Soft Computing. In: International Conference on Artificial Intelligence and Soft Computing ICAISC, pp. 441–452 (2013)

    Google Scholar 

  14. Narayanaa, F., Turhan, L.: Preserving Order of Data When Validating Defect Prediction Models. California Polytechnic State University (2018)

    Google Scholar 

  15. Guide to Meteorological Instruments and Methods of Observation, WMO, vol. 8 (2008)

    Google Scholar 

  16. Kamal, I., Bae, H., Sunghyun, S., Yun, H.: DERN: Deep ensemble learning model for short and long-term prediction of baltic dry index. Appl. Sci. 10(4), 1504 (2020)

    Google Scholar 

  17. Hewage, Pradeep., Behera, Ardhendu., Trovati, Marcello, Pereira, Ella: Long-short term memory for an effective short-term weather forecasting model using surface weather data. In: MacIntyre, John, Maglogiannis, Ilias, Iliadis, Lazaros, Pimenidis, Elias (eds.) AIAI 2019. IAICT, vol. 559, pp. 382–390. Springer, Cham (2019). https://doi.org/10.1007/978-3-030-19823-7_32

    Chapter  Google Scholar 

  18. Alzahrani, A., Shamsia, P., Daglib, C., Ferdowsi, M.: Solar Irradiance Forecasting Using Deep Neural Networks. Complex Adaptive Systems Conference with Theme: Engineering Cyber Physical Systems. Elsevier (2017)

    Google Scholar 

  19. El Yacoubi, S., Fargette, M., Faye, A., de Carvalho, W., Libourel, T., Loireau, T.: A multilayer perceptron model for the correlation between satellite data and soil vulnerability in the Ferlo, Senegal. Int. J. Parallel. Emergent and Distrib. Syst. 34(1) (2018)

    Google Scholar 

  20. Krogh, A., Herts, J.: A simple Weight Decay Can Improve Generalization. Advances in Neural Information Processing Systems 4 (1991)

    Google Scholar 

Download references

Acknowledgment

The authors would like to thank the French Ministry for Europe and Foreign Affairs, and the French Embassy in Ecuador for the support in the present work through the Solidarity Fund for Innovative Projects (FSPI).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ricardo Llugsi .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Llugsi, R., Fontaine, A., Lupera, P., Bechet, J., El Yacoubi, S. (2020). Uncertainty Reduction in the Neural Network’s Weather Forecast for the Andean City of Quito Through the Adjustment of the Posterior Predictive Distribution Based on Estimators. In: Rodriguez Morales, G., Fonseca C., E.R., Salgado, J.P., Pérez-Gosende, P., Orellana Cordero, M., Berrezueta, S. (eds) Information and Communication Technologies. TICEC 2020. Communications in Computer and Information Science, vol 1307. Springer, Cham. https://doi.org/10.1007/978-3-030-62833-8_39

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-62833-8_39

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-62832-1

  • Online ISBN: 978-3-030-62833-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics