phone +7 (3412) 91 60 92

Archive of Issues


Russia Yekaterinburg
Year
2012
Issue
1
Pages
77-95
<<
>>
Section Mathematics
Title Asymptotic properties of optimal solutions and value functions in optimal control problems with infinite time horizon
Author(-s) Usova A.A.a
Affiliations Institute of Mathematics and Mechanics, Ural Branch of the Russian Academy of Sciencesa
Abstract The research is devoted to the investigation of the behavior of optimal solutions and value functions in optimal control problems on infinite horizon, which arise in the economic growth models when an elasticity parameter of the Cobb-Douglas production function grows up to its limit value which is equal to unity. The solution is constructed within the framework of the Pontryagin maximum principle for problems on infinite time horizon. In the limit case the problem becomes linear and has a constant optimal control depending on model parameters only. Qualitative analysis of Hamiltonian systems outlines significant changes in solution behavior, namely, the absence of steady states in the limit case. Nevertheless, both the Hamiltonian function and the maximized Hamiltonian function save their properties of smoothness with respect to all variables, and strict concavity with respect to phase variables. Value functions are constructed for both linear and nonlinear optimal control problems. Numerical experiments are implemented for illustrating results of the sensitivity analysis.
Keywords optimal control, Hamiltonian systems, value function, Pontryagin maximum principle
UDC 517.977
MSC 34H05, 49L20
DOI 10.20537/vm120108
Received 3 November 2011
Language Russian
Citation Usova A.A. Asymptotic properties of optimal solutions and value functions in optimal control problems with infinite time horizon, Vestnik Udmurtskogo Universiteta. Matematika. Mekhanika. Komp'yuternye Nauki, 2012, issue 1, pp. 77-95.
References
  1. Aseev S.M., Kryazhimskii A.V. The Pontryagin maximum principle and optimal economic growth problems, Proceedings of the Steklov Institute of Mathematics, 2007, vol. 257, no. 1, pp. 1–255.
  2. Krasovskii N.N., Subbotin A.I. Game–Theoretical Control Problems, New York: Springer–Verlag, 1988, 518 p.
  3. Pontryagin L.S., Boltyanskii V.G., Gamkrelidze R.V., Mishchenko E.F. The Mathematical Theory of Optimal Processes, New York: Interscience, 1962, 360 p.
  4. Arrow K.J. Application of control theory to economic growth, Mathematics of the Decision Sciences, 1968, no. 2, pp. 89–119.
  5. Solow R.M. Growth Theory: An Exposition, New York: Oxford University Press, 1970, 109 p.
  6. Shell K. Applications of Pontryagin’s maximum principle to economics, Mathematical Systems Theory and Economics, 1969, vol. 1, pp. 241–292.
  7. Krasovskii A.N., Krasovskii N.N. Control under Lack of Information, Boston: Birkhauser, 1995, 324 p.
  8. Adiatulina R.A., Taras’ev A.M. Differential game with infinite time horizon, Prikl. Mat. Mekh., 1987, vol. 51, pp. 531–537.
  9. Capuzzo Dolcetta I. On a discrete approximation of the Hamilton–Jacobi of dynamic programming, Applied Mathematics and Optimization, 1983, vol. 4, pp. 367–377.
  10. Feichtinger G., Veliov V.M. On a distributed control problem arising in dynamic optimization of a fixed–size population, SIAM J. Optim., 2007, vol. 18 (3), pp. 980–1003.
  11. Nikol’skii M.S. On the local Lipschitz property of the Bellman function in an optimization problem, Tr. Inst. Mat. Mekh. Ural. Otd. Ross. Akad. Nauk, 2004, vol. 10, no. 2, pp. 106–115.
  12. Subbotin A.I. Generalized solutions of first–order PDEs: The dynamical optimization perspective, Boston: Birkhauser, 1995, 312 p.
  13. Falcone M. A numerical approach to the infinite horizon problem of deterministic control theory, Applied Mathematics and Optimization, 1987, vol. 15, pp. 1–13.
  14. Falcone M. Corrigenda: A numerical approach to the infinite horizon problem of deterministic control theory, Applied Mathematics and Optimization, 1991, vol. 23, pp. 213–214.
  15. Subbotina N.N. Singular approximations of minimax and viscosity solutions to Hamilton–Jacobi equations, Proceedings of the Institute of Mathematics and Mechanics, Ural Branch of the Russian Academy of Sciences, 2000, vol. 6, no. 1, pp. 190–208.
  16. Ushakov V.N., Latushkin Ya.A. The stability defect of sets in game control problems, Proceedings of the Institute of Mathematics and Mechanics, Ural Branch of the Russian Academy of Sciences, 2006, vol. 12, no. 2, pp. 178–194.
  17. Taras’ev A.M., Uspenskii A.A., Ushakov V.N. Approximate schemes and finite-difference operators for construction of the generalized solutions of Hamilton–Jacobi equations, Izv. Akad. Nauk Teor. Sist. Upr., 1994, no. 3, pp. 173–185.
  18. Ushakov V.N., Matviichuk A.R., Lebedev P.D. Defect of stability in game-pursuit problem, Vestn. Udmurt. Univ. Mat. Mekh. Komp. Nauki, 2010, no. 3, pp. 87–103.
  19. Krasovskii A.A. Assessment of the impact of aggregated economic factors on optimal consumption in models of economic growth, IIASA Interim Report IR-06-050, 2006, 46 p.
  20. Krasovskii A.A., Tarasyev A.M. Conjugation of Hamiltonian systems in optimal control problems, Preprints of the 17th world congress of IFAC, 2008, pp. 7784–7789.
  21. Zaitsev V.A., Popova S.N., Tonkov E.L. Exponential stabilization of nonlinear control systems, Vestn. Udmurt. Univ. Mat. Mekh. Komp. Nauki, 2010, no. 3, pp. 25–29.
  22. Balder E.J. An existence result for optimal economic growth problems, J. Math. Anal. Appl., 1983, vol. 95, pp. 195–213.
  23. Hartman Ph. Ordinary differential equations, New York–London–Sydney: John Wiley and Sons, 1964, 720 p. Translated under the title Obyknovennye differentsialnye uravneniya, Moscow: Mir, 1970, 720 p.
  24. Isaacs R. Differential games, New York–London–Sydney: JohnWiley and Sons, 1965, 480 p. Translated under the title Differentsialnye igry, Moscow: Mir, 1967, 480 p.
Full text
<< Previous article
Next article >>