Abstract
We introduce a trust region algorithm for minimization of nonsmooth functions with linear constraints. At each iteration, the objective function is approximated by a model function that satisfies a set of assumptions stated recently by Qi and Sun in the context of unconstrained nonsmooth optimization. The trust region iteration begins with the resolution of an “easy problem”, as in recent works of Martínez and Santos and Friedlander, Martínez and Santos, for smooth constrained optimization. In practical implementations we use the infinity norm for defining the trust region, which fits well with the domain of the problem. We prove global convergence and report numerical experiments related to a parameter estimation problem.
Similar content being viewed by others
References
I.E. Chambouleyron, J.M. Martínez, A.C. Moretti and M. Mulato. Estimation of optical constants of thin films by means of a pointwise constrained optimization approach. Technical Report. Institute of Mathematics, University of Campinas (1995).
A.R. Conn, N.I.M. Gould and Ph.L. Toint, Global convergence of a class of trust region algorithms for optimization with simple bounds,SIAM Journal on Numerical Analysis 25 (1988) 433–460; see alsoSIAM Journal on Numerical Analysis 26 (1989) 764–767.
A.R. Conn, N.I.M. Gould, A. Sartenaer and Ph.L. Toint, Global convergence of a class of trust region algorithms for optimization using inexact projections on convex constraints,SIAM Journal on Optimization 3 (1993) 164–221.
J.E. Dennis, S.B. Li and R.A. Tapia, A unified approach to global convergence of trust-region methods for nonsmooth optimization,Mathematical Programming 68 (1995) 319–346.
M. El Hallabi and R.A. Tapia, A global convergent theory for arbitrary norm trust region methods for nonlinear equations. Technical Report TR 87-25. Mathematical Sciences Department. Rice University (1987).
R. Fletcher,Practical Methods of Optimization (Wiley, New York, 1987).
A. Friedlander, J.M. Martínez and S.A. Santos, A new trust region algorithm for bound constrained minimization,Journal of Applied Mathematics and Optimization 30 (1994) 235–266.
A. Friedlander, J.M. Martínez and S.A. Santos, On the resolution of large scale linearly constrained convex minimization problems,SIAM Journal on Optimization 4 (1994) 331–339.
IBM Research Center,Optimization Subroutine Library, Guide and Reference, IBM Report, Yorktown Heights, New York (1994).
J.M. Martínez and S.A. Santos, A trust region strategy for minimization on arbitrary domains,Mathematical Programming 68 (1995) 267–302.
J.J. Moré, Recent developments in algorithms and software for trust region methods, in: A. Bachem, M. Grötschel and B. Korte, eds.,Mathematical Programming Bonn 1982 — The State of Art (Springer, Berlin, 1983) 256–287.
J.J. Moré, Trust regions and projected gradients, in: M. Iri and K. Yajima, eds.,Systems Modelling and Optimization Lecture Notes in Control and Information Sciences, Vol. 113 (Springer, Berlin. 1988) 1–13.
J.-S. Pang, S.P. Han and N. Rangaraj, Minimization of locally Lipschitz functions,SIAM Journal on Optimization 1 (1991) 57–82.
R. Poliquin and L. Qi, Iteration functions in nonsmooth optimization,Mathematics of Operations Research 20 (1995) 479–496.
M.J.D. Powell, On the global convergence of trust region algorithms for unconstrained minization,Mathematical Programming 29 (1984) 297–303.
L. Qi and J. Sun, A trust region algorithm for minimization of locally Lipschitzian functions,Mathematical Programming 66 (1994) 25–43.
R.T. Rockafellar, Monotone operators and the preximal point algorithm,SIAM Journal on Control and Optimization 14 (1976) 877–898.
R.T. Rockafellar,Convex Analysis (Princeton University Press, Princeton, NJ, 1970).
R. Swanepoel, Determination of the thickness and optical constants of amorphous silicon,Journal of Physics E (Scientific Instruments) 16 (1983) 1214–1222.
Y. Yuan, Conditions for convergence of trust region algorithms for nonsmooth optimization,Mathematical Programming 31 (1985) 220–228.
Author information
Authors and Affiliations
Additional information
Supported by FAPESP (Grant 90/3724-6), FINEP and FAEP-UNICAMP.
Supported by FAPESP (Grant 90/3724-6 and grant 93/1515-9).
Rights and permissions
About this article
Cite this article
Martínez, J.M., Moretti, A.C. A trust region method for minimization of nonsmooth functions with linear constraints. Mathematical Programming 76, 431–449 (1997). https://doi.org/10.1007/BF02614392
Received:
Revised:
Issue Date:
DOI: https://doi.org/10.1007/BF02614392