Skip to main content
Log in

Asset pricing with dynamic programming

Computational Economics Aims and scope Submit manuscript

Abstract

The study of asset price characteristics of stochastic growth models such as the risk-free interest rate, equity premium, and the Sharpe-ratio has been limited by the lack of global and accurate methods to solve dynamic optimization models. In this paper, a stochastic version of a dynamic programming method with adaptive grid scheme is applied to compute the asset price characteristics of a stochastic growth model. The stochastic growth model is of the type as developed by [Brock and Mirman (1972), Journal of Economic Theory, 4, 479–513 and Brock (1979), Part I: The growth model (pp. 165–190). New York: Academic Press; The economies of information and uncertainty (pp. 165–192). Chicago: University of Chicago Press. (1982). It has become the baseline model in the stochastic dynamic general equilibrium literature. In a first step, in order to test our procedure, it is applied to this basic stochastic growth model for which the optimal consumption and asset prices can analytically be computed. Since, as shown, our method produces only negligible errors, as compared to the analytical solution, in a second step, we apply it to more elaborate stochastic growth models with adjustment costs and habit formation. In the latter model preferences are not time separable and past consumption acts as a constraint on current consumption. This model gives rise to an additional state variable. We here too apply our stochastic version of a dynamic programming method with adaptive grid scheme to compute the above mentioned asset price characteristics. We show that our method is very suitable to be used as solution technique for such models with more complicated decision structure.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  • Abel A. (1990). Asset prices under habit formation and catching up with the Joneses. American Economic Review 40(2): 38–42

    Google Scholar 

  • Abel A. (1999). Risk premia and term premia in general equilibrium. Journal of Monetary Economics 43(1): 3–33

    Article  Google Scholar 

  • Akdeniz L., Dechert W.D. (1997). Do CAPM results hold in a dynamic economy?. Journal of Economic Dynamics and Control 21, 981–1003

    Article  Google Scholar 

  • Alvarez-Cuadradoo F., Monteiro G., Turnovsky S.J. (2004). Habit formation, catching up with the Joneses, and economic growth. Journal of Economic Growth 9, 47–80

    Article  Google Scholar 

  • Bauer F., Grüne L., Semmler W. (2006). Adaptive spline interpolation for Hamilton–Jacobi–Bellman equations. Applied Numerical Mathematics 56, 1196–1210

    Article  Google Scholar 

  • Becker, S., Grüne, L., & Semmler, W. (2006). Comparing second-order approximation with dynamic programming, Working paper, New School, New York, http://www.newschool.edu/gf/cem.

  • Breeden D.T. (1979). An intertemporal asset pricing model with stochastic consumption and investment opportunities. Journal of Financial Economics 7, 231–262

    Article  Google Scholar 

  • Boldrin M., Christiano L.J., Fisher J.D.M. (2001). Habit persistence, asset returns and the business cycle. American Economic Review 91(1): 149–166

    Article  Google Scholar 

  • Brock W. (1979). An integration of stochastic growth theory and theory of finance. In Green J., Schenkman J.(eds) Part I: The growth model. New York, Academic Press, pp. 165–190

    Google Scholar 

  • Brock W. (1982). Asset pricing in a production economy. In McCall J.J., (ed) The economies of information and uncertainty. Chicgo, University of Chicago Press, pp. 165–192

    Google Scholar 

  • Brock W., Mirman L. (1972). Optimal economic growth and uncertainty: The discounted case. Journal of Economic Theory 4, 479–513

    Article  Google Scholar 

  • Burnside C. (2001). Discrete state–space methods for the study of dynamic economies. In Marimon R., Scott A.(eds) Computational methods for the study of dynamic economies. Oxford, Oxford University Press, pp. 95–113

    Chapter  Google Scholar 

  • Candler G.V. (2001). Finite–difference methods for continuous–time dynamic programming. In Marimon R., Scott A. (eds) Computational methods for the study of dynamics economies. Oxford, Oxford University Press, pp. 172–194

    Chapter  Google Scholar 

  • Campbell J.Y., Cochrane J.H. (1999). Explaining the poor performance of consumption-based asset pricing models. Working paper, Harvard University

  • Chow C.-S., Tsitsiklis J.N. (1991). An optimal one–way multigrid algorithm for discrete–time stochastic control. IEEE Transaction Automation Control 36, 898–914

    Article  Google Scholar 

  • Christiano L., Fisher J. (2000). Algorithms for solving dynamic models with occasionally binding constraints. Journal of Economic Dynamics and Control 24, 1179–1232

    Article  Google Scholar 

  • Cochrane J. (2001). Asset pricing. Princeton, Princeton University Press

    Google Scholar 

  • Collard F., Juillard M. (2001). Accuracy of stochastic pertubation methods: The case of asset pricing models. Journal of Economic Dynamics and Control 25, 979–999

    Article  Google Scholar 

  • Constantinides G.M. (1990). Habit formation: A resolution of the equity premium puzzle. Journal of Political Economy 98, 519–543

    Article  Google Scholar 

  • Constantinides G.M., Duffie D. (1996). Asset pricing with heterogeneous consumers. Journal of Political Economy 104, 519–240

    Article  Google Scholar 

  • Daniel J.W. (1976). Splines and efficiency in dynamic programming. Journal of Mathematical Analysis and Applications 54, 402–407

    Article  Google Scholar 

  • Falcone M. (1987). A numerical approach to the infinite horizon problem of deterministic control theory. Applied Mathematics and Optimization 15, 1–13

    Article  Google Scholar 

  • Falcone M., Ferretti R. (1998). Convergence analysis for a class of high-order semi-Lagrangian advection schemes. SIAM Journal of Numerical Analysis 35, 909–940

    Article  Google Scholar 

  • Fuhrer J.C. (2000). Habit formation in consumption and its implications for monetary-policy models. American Economic Review 90, 367–390

    Article  Google Scholar 

  • Grüne L. (1997). An adaptive grid scheme for the discrete Hamilton–Jacobi–Bellman equation. Numerical Mathematics 75, 1288–1314

    Google Scholar 

  • Grüne L., Semmler W. (2004a). Using dynamic programming with adaptive grid scheme for optimal control problems in economics. Journal of Economic Dynamics and Control 28, 2427–2436

    Article  Google Scholar 

  • Grüne, L., & Semmler, W. (2004b). Solving asset pricing models with stochastic dynamic programming. CEM working paper no. 54, Bielefeld University.

  • Grüne, L., & Semmler, W. (2005). Asset pricing with loss aversion. Working paper, New School, http://www.newschool.edu/gf/cem.

  • Hansen L.P., Sargent T. (2002). Robust control. Book manuscript, Stanford Unversity

    Google Scholar 

  • Jerman U.J. (1998). Asset pricing in production economies. Journal of Monetary Economies 41, 257–275

    Article  Google Scholar 

  • Johnson S.A., Stedinger J.R., Shoemaker C.A., Li Y., Tejada–Guibert J.A. (1993). Numerical solution of continuous–state dynamic programs using linear and spline interpolation. Operational Research 41, 484–500

    Google Scholar 

  • Judd K.L. (1996). Approximation, perturbation, and projection methods in economic analysis. In: Amman H.M., Kendrick D.A., Rust J. (eds) Handbook of computational economics (ch.12). Amsterdam, Elsevier, pp. 511–585

    Google Scholar 

  • Judd K.L., Guu S.-M. (1997). Asymptotic methods for aggregate growth models. Journal of Economic Dynamics and Control 21, 1025–1042

    Article  Google Scholar 

  • Keane M.P., Wolpin K.I. (1994). The Solution and estimation of discrete choice dynamic programming models by simulation and interpolation: Monte–Carlo evidence. The Review of Economics and Statistics 76, 648–672

    Article  Google Scholar 

  • Kim, J. (2002). Indeterminacy and investment adjustment costs: An analytical result. University of Virginia. Mimeo: Dept. of Economics.

  • Lettau, M., & Uhlig, H. (1999). Volatility bounds and preferences: An analytical approach. revised from CEPR Discussion Paper No. 1678.

  • Lettau M., Uhlig H. (2000). Can habit formation be reconciled with business cycle facts?. Review of Economic Dynamics 3, 79–99

    Article  Google Scholar 

  • Lettau M., Gong G., Semmler W. (2001). Statistical estimation and moment evaluation of a stochastic growth model with asset market restrictions. Journal of Economic Organization and Behavior 44, 85–103

    Article  Google Scholar 

  • Lucas R., Jr. (1978). Asset prices in an exchange economy. Econometrica 46, 1429–1446

    Article  Google Scholar 

  • Marcet A. (1994). Simulation analysis of stochastic dynamic models: applications to theory and estimation. In: Sims C.A.(ed) Advances in econometrics, sixth world congress of the econometric society. Cambridge, Cambridge University Press, pp. 81–118

    Google Scholar 

  • McGrattan, E. R., & Prescott, E. C. (2001). Taxes, regulation and asset prices. Working paper, Federal Reserve Bank of Minneapolis.

  • Munos R., Moore A. (2002). Variable resolution discretization in optimal control. Machine Learning 49, 291–323

    Article  Google Scholar 

  • Reiter M. (1999). Solving higher–dimensional continuous–time stochastic control problems by value function regression. Journal of Economic Dynamics and Control 23, 1329–1353

    Article  Google Scholar 

  • Rouwenhorst K.G. (1995). Asset pricing implications of equilibrium business cycle models. In: Cooley T. (ed) Frontiers of business cycle research. Princeton, Princeton University Press, pp. 295–330

    Google Scholar 

  • Rust J. (1996). Numerical dynamic programming in economics. In: Amman H.M., Kendrick D.A., Rust J.(eds) Handbook of computational economics. Amsterdam, Elsevier, pp. 620–729

    Google Scholar 

  • Rust J. (1997). Using randomization to break the curse of dimensionality. Econometrica 65, 478–516

    Google Scholar 

  • Ryder H., Jr., Heal G. (1973). Optimal growth with intertemporally dependent preferences. Review of Economic Studies 40, 1–31

    Article  Google Scholar 

  • Santos M.S., Vigo–Aguiar J. (1998). Analysis of a numerical dynamic programming algorithm applied to economic models. Econometrica 66, 409–426

    Article  Google Scholar 

  • Schmitt-Grohe S., Uribe M. (2004). Solving dynamic general equilibrium models using a second-order approximation to the policy function. Journal of Economic Dynamics and Control 28, 755–775

    Article  Google Scholar 

  • Semmler W. (2006). Asset prices, booms and recessions - financial economics from a dynamic perspective (2nd ed.). Heidelberg and New York, Springer Publishing House

    Google Scholar 

  • Tauchen G., Hussey R. (1991). Quadrature–based methods for obtaining approximate solutions to nonlinear asset–price models. Econometrica 59, 371–396

    Article  Google Scholar 

  • Taylor J.B., Uhlig H. (1990). Solving non-linear stochastic growth models: A comparison of alternative solution methods. Journal of Business and Economic Studies 8, 1–18

    Article  Google Scholar 

  • Trick, M. A., & Zin, S. E. (1993).A linear programming approach to solving stochastic dynamic programs. Working Paper, Carnegie–Mellon University.

  • Trick M.A., Zin S.E. (1997). Spline approximations to value functions: A linear programming approach. Macroeconomic Dynamics 1, 255–277

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Lars Grüne.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Grüne, L., Semmler, W. Asset pricing with dynamic programming. Comput Econ 29, 233–265 (2007). https://doi.org/10.1007/s10614-006-9063-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10614-006-9063-1

Keywords

JEL classification

Navigation