Skip to main content
SpringerLink
Log in

Regression-based weight generation algorithm in neural network for solution of initial and boundary value problems

  • Original Article
  • Published:
Neural Computing and Applications Aims and scope Submit manuscript

Abstract

This paper introduces a new algorithm for solving ordinary differential equations (ODEs) with initial or boundary conditions. In our proposed method, the trial solution of differential equation has been used in the regression-based neural network (RBNN) model for single input and single output system. The artificial neural network (ANN) trial solution of ODE is written as sum of two terms, first one satisfies initial/boundary conditions and contains no adjustable parameters. The second part involves a RBNN model containing adjustable parameters. Network has been trained using the initial weights generated by the coefficients of regression fitting. We have used feed-forward neural network and error back propagation algorithm for minimizing error function. Proposed model has been tested for first, second and fourth-order ODEs. We also compare the results of proposed algorithm with the traditional ANN algorithm. The idea may very well be extended to other complicated differential equations.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14

Similar content being viewed by others

References

  1. Ricardo HJ (2009) A modern introduction to differential equations, 2nd edn. Elsevier, Amsterdam

    MATH  Google Scholar 

  2. Sneddon IN (2006) Elements of partial differential equations. Dover, New York

    MATH  Google Scholar 

  3. Douglas J, Jones BF (1963) Predictor–corrector methods for nonlinear parabolic differential equations. J Ind Appl Math 11:195–204

    Article  MATH  MathSciNet  Google Scholar 

  4. Reddy JN (1993) An introduction to the finite element method. McGraw-Hill, New York

    Google Scholar 

  5. Meade AJ Jr, Fernandez AA (1994) The numerical solution of linear ordinary differential equations by feed forward neural networks. Math Comput Model 19:1–25

    Article  MATH  MathSciNet  Google Scholar 

  6. Meade AJ Jr, Fernandez AA (1994) Solution of nonlinear ordinary differential equations by feed forward neural networks. Math Comput Model 20:19–44

    Article  MATH  MathSciNet  Google Scholar 

  7. Lagaris IE, Likas AC, Fotiadis DI (1998) Artificial neural networks for solving ordinary and partial differential equations. IEEE Trans Neural Netw 9:987–1000

    Article  Google Scholar 

  8. Lagaris IE, Likas AC, Papageorgiou DG (2000) Neural network methods for boundary value problems with irregular boundaries. IEEE Trans Neural Netw 11:1041–1049

    Article  Google Scholar 

  9. Malek A, Beidokhti SR (2006) Numerical solution for high order deferential equations, using a hybrid neural network—optimization method. Appl Math Comput 183:260–271

    Article  MATH  MathSciNet  Google Scholar 

  10. Yazid HS, Pakdaman M, Modaghegh H (2011) Unsupervised kernel least mean square algorithm for solving ordinary differential equations. Neurocomputing 74:2062–2071

    Article  Google Scholar 

  11. Selvaraju N, Abdul Samant J (2010) Solution of matrix Riccati differential equation for nonlinear singular system using neural networks. Int J Comput Appl 29:48–54

    Google Scholar 

  12. Shirvany Y, Hayati M, Moradian R (2009) Multilayer perceptron neural networks with novel unsupervised training method for numerical solution of the partial differential equations. Appl Soft Comput 9:20–29

    Article  Google Scholar 

  13. Aartt LP, Van der veer P (2001) Neural network method for solving partial differential equations. Neural Process Lett 14:261–271

    Article  Google Scholar 

  14. He S, Reif K, Unbehauen R (2000) Multilayer neural networks for solving a class of partial differential equations. Neural Netw 13:385–396

    Article  Google Scholar 

  15. Hoda SA, Nagla HA (2011) Neural network methods for mixed boundary value problems. Int J Nonlinear Sci 11:312–316

    MathSciNet  Google Scholar 

  16. McFall KS, Mahan JR (2009) Artificial neural network for solution of boundary value problems with exact satisfaction of arbitrary boundary conditions. IEEE Trans Neural Netw 20:1221–1233

    Article  Google Scholar 

  17. Manevitz L, Bitar A, Givoli D (2005) Neural network time series forecasting of finite-element mesh adaptation. Neurocomputing 63:447–463

    Article  Google Scholar 

  18. Leephakpreeda T (2002) Novel determination of differential-equation solutions: universal approximation method. J Comput Appl Math 146:443–457

    Article  MATH  MathSciNet  Google Scholar 

  19. Mai-Duy N, Tran-Cong T (2001) Numerical solution of differential equations using multi quadric radial basis function networks. Neural Netw 14:185–199

    Article  Google Scholar 

  20. Jianyu L, Siwei L, Yingjian Q, Yaping H (2003) Numerical solution of elliptic partial differential equation using radial basis function neural networks. Neural Netw 16:729–734

    Article  Google Scholar 

  21. Jckiewiez Z, Rahaman M, Welfent BD (2008) Numerical solution of a fredholm integra-differential equation modelling θ-neural networks. Appl Math Comput 195:2523–5363

    Google Scholar 

  22. Tsoulos IG, Lagaris IE (2006) Solving differential equations with genetic programming. Genet Program Evolvable Mach 7:33–54

    Article  Google Scholar 

  23. Parisi DR, Mariani MC, Laborde MA (2003) Solving differential equations with unsupervised neural networks. Chem Eng Process 42:715–721

    Article  Google Scholar 

  24. Mall S, Chakraverty S (2013) Regression based neural network training for the solution of ordinary differential equations. Int J Math Model Numer Optim 4:136–149

    MATH  Google Scholar 

  25. Tsoulos IG, Gavrilis D, Glavas E (2009) Solving differential equations with constructed neural networks. Neurocomputing 72:2385–2391

    Article  Google Scholar 

  26. Smaoui N, Al-Enezi S (2004) Modelling the dynamics of nonlinear partial differential equations using neural networks. J Comput Appl Math 170:27–58

    Article  MATH  MathSciNet  Google Scholar 

  27. Chakraverty S, Singh VP, Sharma RK (2006) Regression based weight generation algorithm in neural network for estimation of frequencies of vibrating plates. J Comput Methods Appl Mech Eng 195:4194–4202

    Article  MATH  Google Scholar 

  28. Chakraverty S, Singh VP, Sharma RK, Sharma GK (2009) Modelling vibration frequencies of annular plates by regression based neural network. Appl Soft Comput 9:439–447

    Article  Google Scholar 

  29. Zurada JM (1994) Introduction to artificial neural network. West, Eagan

    Google Scholar 

  30. Haykin S (1999) Neural networks a comprehensive foundation. Prentice Hall, Upper Saddle River

    MATH  Google Scholar 

Download references

Acknowledgments

The authors are thankful to Department of Science and Technology (DST), Government of India for financial support under Women Scientist Scheme-A.

Author information

Authors and Affiliations

  1. Department of Mathematics, National Institute of Technology, Rourkela, 769008, Odisha, India

    S. Chakraverty & Susmita Mall

Authors
  1. S. Chakraverty
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Susmita Mall
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to S. Chakraverty.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chakraverty, S., Mall, S. Regression-based weight generation algorithm in neural network for solution of initial and boundary value problems. Neural Comput & Applic 25, 585–594 (2014). https://doi.org/10.1007/s00521-013-1526-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00521-013-1526-4

Keywords

Search

Navigation