Abstract

A filled function method for nonlinear systems of equalities and inequalities^* * #CAM-410/11. This work was supported by the Natural Science Foundation of China (No.71171150). ** Corresponding author.

Zhongping Wan^** * #CAM-410/11. This work was supported by the Natural Science Foundation of China (No.71171150). ** Corresponding author. ; Liuyang Yuan; Jiawei Chen

School of Mathematics and Statistics, Wuhan University, Wuhan, Hubei, 430072, P.R. China. E-mails: mathwanzhp@whu.edu.cn / yangly0601@126.com

ABSTRACT

In this paper a filled function method is suggested for solving nonlinear systems of equalities and inequalities. Firstly, the original problem is reformulated into an equivalent constrained global optimization problem. Subsequently, a new filled function with one parameter is constructed based on the special characteristics of the reformulated optimization problem. Some properties of the filled function are studied and discussed. Finally, an algorithm based on the proposed filled function for solving nonlinear systems of equalities and inequalities is presented. The objective function value can be reduced by half in each iteration of our filled function algorithm. The implementation of the algorithm on several test problems is reported with numerical results.

Mathematical subject classification: 65K05, 90C30.

Key words: nonlinear systems of equalities and inequalities, constrained global optimization, filled function method.

1 Introduction

In this paper, we consider the following systems of nonlinear equalities and inequalities (for short, (SNEI)) defined by

where the functions c_i :Rⁿ → R are continuously differentiable, I ∪ E = { 1,..., m} and I ∩ E = ∅. The systems of nonlinear equalities and inequalities have found myriad applications in various industrial and economic areas.

If n = m and I = ∅, the system (SNEI) reduces into a system of nonlinear equations, one classical problem in mathematics, for which there are many well-known methods, such as Newton-type methods, secant methods, and trust-region methods (see [3, 4, 5, 11] etc.). Similarly, in recent years these methods are also proposed to solve the system (SNEI) (see [6, 7, 15, 16, 17, 18, 19, 22, 26] etc.).

A typical way of solving the system (SNEI) is to reformulate it into the following constrained optimization problem (for short, (COP))

Some well-developed optimization methods are used to solve problem (COP). It is clear that global optimal solutions of problem (COP) with the zero objective function value correspond to the solutions of the system (SNEI). Therefore, efficient global optimization methods are crucial for successfully solving the system (SNEI).

As one of the main global optimization methods to solve general unconstrained global optimization problems without special structural property, the filled function method has attracted much attention. The filled function algorithm is an efficient deterministic global optimization algorithm, and it has been used to solve plenty of optimization problems, such as unconstrained global optimization problems [9, 10], constrained global optimization problems [25], nonlinear equations [13, 14, 24], constrained nonlinear equations [1], nonlinear complementarity problems [27] and so on. The main idea of filled function method is to construct an auxiliary function called filled function via the current local minimizer of the original optimization problem, with the property that the current local minimizer is a local maximizer of the constructed filled function and a better initial point of the primal optimization problem can be obtained by searching the constructed filled function locally. From both the theoretical and the algorithmic points of view, the filled function method is competitive with the other existing global optimization methods, such as tunneling function methods [2, 12] and stochastic methods [20, 21]. Bai [1] proposed a filled function with three parameters for solving constrained nonlinear equations. However, in [1], ∇ p_{r, c, q, x*} (x) = depends on x - x*, which is not desirable. Motivated by these considerations, a novel filled function only with one parameter is constructed by employing the idea of penalty function in constrained optimization problem which is reformulated from the system (SNEI). Moreover, the gradient of the new filled function is not affected by || x - x* ||. The obtained numerical experiments show that the novel filled function method is of superiority over that in [1].

Outline. The rest of the paper is organized as follows. In section 2, a filledfunction is constructed for the reformulated constrained global optimization problem (COP). The corresponding filled function algorithm is presented in Section 3. Several numerical examples are reported in Section 4. and finally, some concluding remarks are made in section 5.

2 Filled function for problem (COP)

In this section, The following problem (COP) is considered

Let

Note that Sº is not necessarily identical to the interior of S.

Throughout the rest of the paper, we always assume that the following assumptions for problem (COP) hold.

Assumption 2.1I ≠ ∅.

Assumption 2.2 The system of nonlinear equalities and inequalities has at least one solution.

Assumption 2.3Sº ≠ ∅ and clSº = S, where clA denotes the closure ofset A.

By Assumption 2.3, we can see that for any x₀∈ S, there exists a sequence {x_k} ⊂ Sº, such that lim_{k→ ∞} x_k = x₀.

It is easy to see that x* is a solution of the system (SNEI) if and only if it isa global minimizer of problem (COP) and satisfies that f(x*) = 0.

For a given x* ∈ S with f(x*) > 0, the definition of the filled function is given as follows.

Definition 2.4A continuously differentiable function p(x, x*) is called a filled function of problem (COP) at x* with f(x*) > 0, if it satisfies the following conditions

Remark 2.5. With the definition above, we know that if p(x, x*) is a filled function of problem (COP) at x* with f(x*) > 0, i.e. x* is not a solution to the system (SNEI), any local minimizer of p(x, x*) on Rⁿ satisfies the inequality f() < and ∈ Sº.

In the following, a one-parameter filled function satisfying Definition 2 is introduced. To begin with, we design a continuously differentiable function H_{r, a}(t) with the following properties: it equals to a positive constant a when t > 0, and it equals to 0 when t < - r.

More specifically, for any given r > 0 and a > 0, we construct H_{r, a}(t) as follows

Note that the requirement for continuous differentiability of H_{r, a}(t) justifies the use of log function and cubic polynomial. The function H_{r, a}(t) differs from h_{r, a}(t) in [1], which we can get information from the figures below.

From the figures above, it can be seen that when r > 1, H_{r, a}(t) increases faster than h_{r, a}(t) from - r to 0, while when 0 < r < 1, the function H_{r, a}(t) is increasingly close to h_{r, a}(t) as r is getting smaller and smaller.

It is not difficult to check that H_{r, a}(t) is continuously differentiable andincreasing on R. Obviously, we have

Given an x* ∈ S with f(x*) > 0, the following filled function with one parameter is constructed

where the only parameter q > 0 and x* is the current local minimizer of problem (COP). Clearly, F(x, x*, q) is continuously differentiable on Rⁿ.

Remark 2.6 Note that F(x, x*, q) includes as a penalty term to penalize unfeasible points.

The following theorems show that F(x, x*, q) satisfies Definition 2.4 when the positive parameter q is sufficiently large.

Theorem 1 Let f(x*) > 0, q > 0. Then x* is a strict local maximizer of F(x, x*, q) on Rⁿ.

Proof. Since x* is a local minimizer of f(x), there exists a neighborhood N(x*, σ) of x* with σ > 0 such that f(x) > f(x*) for all x ∈ N(x*, σ) = {x| || x - x* || < σ}. Then for any x ∈ N(x*, σ), x ≠ x*, q > 0, and 0 < H_{r, a}(t) < a, we have

Theorem 2.7 reveals that the proposed new filled function satisfies condition (1) of Definition 2.4.

Theorem 2.8Let f(x*) > 0, q > 0. Then any point ∈ S\{x*} with ∇ F(, x*, q) = 0 implies f() < .

Proof. Assume that f() > . Then for any point ∈ S\{x*}, we have

∈

Theorem 2.8 reveals that the proposed new filled function satisfies condition (2) of Definition 2.4.

Theorem 2.9 Let f(x*) > 0, q > 0. Then any local minimizer of F(x, x*, q) on Rⁿ satisfies f() < and ∈ Sº.

Proof. Let be a local minimizer of F(x, x*, q) on Rⁿ, then ∇ F(, x*, q) = 0 and ≠ x* (since x* is a strict local maximizer of F(x, x*, q) on Rⁿ). By contradiction, suppose that is neither a point satisfying f() < nor ∈ Sº. Then

This is a contradiction. Therefore, if is a local minimizer of F(x, x*, q) on Rⁿ, we have f() < and ∈ Sº. Theorem 2 reveals that the proposed new filled function satisfies condition (3) of Definition 2.4.

Theorem 2.10Let f(x*) > 0, q > 0. Suppose that (SNEI) satisfies Assumption 2.2. Then there exists q₀ > 0 such that when q > q₀, any local minimizer of problem (COP) with f() < and ∈ Sº is a local minimizer of F(x, x* ,q) on Rⁿ. Furthermore, the number of point ∈ Sº with f() < is infinite.

Proof. Let be a local minimizer of problem (COP) on Sº with f() < . Then c_i() < 0, i∈ I and there exists a small enough number σ > 0 such that f(x) < and f(x) > f() for all x∈ S ∩ N(, σ), where N(, σ) = {x∈ Rⁿ| || x - || < σ}. Thus, there exists q₀ > 0 such that c_i () < , i∈ I. It follows that F(, x*, q) = - || - x* || when q > q₀. Since F(x, x*, q) > - || - x* || for any x∈ Rⁿ, is a global minimizer of F(x, x*, q) on Rⁿ. Therefore, is a local minimizer of F(x, x*, q) on Rⁿ. Let be a solution of (SNEI). Then we have that ≠ x*. By clSº = S, there exists a sequence {x_k} ⊂ S such that x_i≠ x_j for i≠ j and = . Hence, there exists a positive integer number k₀ such that when k > k₀, f(x_k) < . Therefore the number of point ∈ Sº with f() < is infinite.

Theorems 2.10 show that, for all q > q₀, F(x, x*, q) satisfies condition (4) of Definition 2.4. The following theorem shows that function F(x, x*, q) hasan interesting property.

Theorem 2.11Let x₁, x₂∈ S and the following conditions hold:

Then, the inequality F(x₁, x*, q) > F(x₂, x*, q) holds for all q > 0.

3 Filled function algorithm

In this section, a global optimization method for solving problem (COP) ispresented based on the constructed filled function (3), which leads to a solution or an approximate solution to (SNEI).

Suppose that (SNEI) has at least one solution. The general idea of the global optimization method is as follows.

Let x₀∈ S be a given initial point. Starting from this initial point, a local minimizer of problem (COP) is obtained with a local minimization method. The main task is to find deeper local minimizers of problem (COP) if is not a global minimizer.

Consider the following filled function problem (for short, (FFP))

where F(x, , q) is given by (3).

Let be a obtained local minimizer of problem (FFP) on Rⁿ, then by Theorem 2.9, we have f() < and ∈ Sº. Starting from this initial point , we can obtain a local minimizer of problem (COP). If is a global minimizer (namely f() = 0), is the solution of the system (SNEI); otherwise locally solve problem (FFP). Let be the obtained local minimizer, then we have that f() < and ∈ Sº. Repeating this process, we can finally obtain a solution of the system (SNEI) or a sequence {} ⊂ Sº with f() < , k = 1, 2,.... For such a sequence {}, k = 1, 2, ..., when k is sufficiently large, can be regarded as an approximate solution of the system (SNEI).

Let x* ∈ S and ε > 0, x* is called a ε-approximate solution of the system (SNEI) if x* ∈ S and f(x*) < ε.

The corresponding filled function algorithm for the global optimization problem (COP) is described as follows. The algorithm is referred as FFCOP (the filled function method for problem (COP)).

Algorithm FFCOP

From Theorems 2.7-2.10, it can be seen that if λ is small enough, q^U is large enough, and the direction set {e₁,..., e_K} is large enough, x_s can be obtained from Algorithm FFCOP within finite steps.

4 Numerical experiment

In this section, several sets of numerical experiments are presented to illustratethe efficiency of Algorithm FFCOP. All the numerical experiments are implemented in Matlab2010b. In our programs, the local minimizers of problem (FFP) and problem (COP) are respectively obtained by the Quasi-Newton method and the SQP method. || ∇ f(x) || < 10^{- 8} is used as the terminate condition.

The data of the problems is shown in Table 1. The number of the problem is shown in column 1, the source of the problem in column 2 and the number of the set of equalities (m_E), the set of inequalities (m_I) and variables (n) in the last column.

Initial points are the same as in the cited references.

The number of problems (column 1), the number of iterations (Iter, column 2), the approximation solution to (SNEI) (x_end, column 4) and the final functional values obtained (f(x_end), column 5) are shown in Table 2-4.

The first three problems are nonlinear inequalities, Problem 4 is square inequalities and the last six problems are linear inequalities. From Table 2-3, it can be seen that the number of iterations of problem 1, 2, 3 is respectively 1, 1, 3, while the number of iterations of the same problems are 4, 11, 8 in [1]. Moreover, from Table 4, it can be see that our filled function method is also effective to solve those problems which have square inequalities and linear inequalities.

5 Conclusions

In this paper, the filled function F(x, x*, q) with one parameter is constructed for solving nonlinear systems of equalities and inequalities and it has been proved that it satisfies the basic characteristics of the filled function definition. Promising computation results have been observed from our numerical experiments. In the future, the filled function method can be used to solve other problems such as nonlinear feasibility problems with expensive functions and so on.

Acknowledgments. We are greatly indebted to the anonymous referees and Professor J.M. Martínez as the Editor of our paper for their very careful and valuable comments that helped improve this manuscript.

Received: 10/IX/11.

Accepted:03/X/11.

Publication Dates

History