• No results found

Strong convergence of projection methods for a countable family of nonexpansive mappings and applications to constrained convex minimization problems

N/A
N/A
Protected

Academic year: 2020

Share "Strong convergence of projection methods for a countable family of nonexpansive mappings and applications to constrained convex minimization problems"

Copied!
30
0
0

Loading.... (view fulltext now)

Full text

(1)

R E S E A R C H

Open Access

Strong convergence of projection methods

for a countable family of nonexpansive

mappings and applications to constrained

convex minimization problems

Eskandar Naraghirad

*

*Correspondence: [email protected] Department of Mathematics, Yasouj University, Yasouj, 75918, Iran

Abstract

In this paper, we introduce a general algorithm to approximate common fixed points for a countable family of nonexpansive mappings in a real Hilbert space, which solves a corresponding variational inequality. Furthermore, we propose explicit iterative schemes for finding the approximate minimizer of a constrained convex minimization problem and prove that the sequences generated by our schemes converge strongly to a solution of the constrained convex minimization problem. Our results improve and generalize some known results in the current literature.

MSC: 47H10; 37C25

Keywords: countable family of nonexpansive mappings; fixed point; strong convergence; constrained convex minimization problem; projection method

1 Introduction

A viscosity approximation method for finding fixed points of nonexpansive mappings was first proposed by Moudafi in  []. He proved the convergence of the sequence gen-erated by the proposed method. In , Xu [] proved the strong convergence of the sequence generated by the viscosity approximation method to a unique solution of a cer-tain variational inequality problem defined on the set of fixed points of a nonexpansive map.

It is well known that the iterative methods for finding fixed points of nonexpansive map-pings can also be used to solve a convex minimization problem; see, for example, [–] and the references therein. In , Xu [] introduced an iterative method for computing the approximate solutions of a quadratic minimization problem over the set of fixed points of a nonexpansive mapping defined on a real Hilbert space. He proved that the sequence gen-erated by the proposed method converges strongly to the unique solution of the quadratic minimization problem. By combining the iterative schemes proposed by Moudafi [] and Xu [], Marino and Xu [] considered a general iterative method and proved that the se-quence generated by the method converges strongly to a unique solution of a certain varia-tional inequality problem, which is the optimality condition for a particular minimization problem. Liu [] and Qinet al.[] also studied some applications of the iterative method considered in []. Yamada [] introduced the so-called hybrid steepest-descent method

(2)

for solving the variational inequality problem and also studied the convergence of the se-quence generated by the proposed method. Very recently, Tian [] combined the iterative methods of [, ] in order to propose implicit and explicit schemes for constructing a fixed point of a nonexpansive mappingT defined on a real Hilbert space. He also proved the strong convergence of these two schemes to a fixed point ofTunder appropriate condi-tions. Related iterative methods for solving fixed point problems, variational inequalities and optimization problems can be found in [–] and the references therein.

On the other hand, the gradient-projection method for finding the approximate solu-tions of the constrained convex minimization problem is well known; see, for example, [] and the references therein. The convergence of the sequence generated by this method depends on the behavior of the gradient of the objective function. If the gradient fails to be strongly monotone, then the strong convergence of the sequence generated by the gradient-projection method may fail. Very recently, Xu [] gave an operator-oriented ap-proach as an alternative to the projection method and to the relaxed gradient-projection algorithm, namely, an averaged mapping approach. Moreover, he constructed a counterexample which shows that the sequence generated by the gradient-projection method does not converge strongly in the setting of an infinite-dimensional space. He also presented two modifications of gradient-projection algorithms which are shown to have strong convergence. Further, he regularized the minimization problem to derive an iterative scheme that generates a sequence converging in norm to the minimum-norm so-lution of the constrained convex minimization problem in the consistent case. The related methods and results can be found in [–] and the references therein. By virtue of pro-jections, the authors in [] extended the implicit and explicit iterative schemes proposed in [].

The purpose of this paper is to introduce a general algorithm to approximate com-mon fixed points for a countable family of nonexpansive mappings in a real Hilbert space. We prove the strong convergence theorems for the sequences produced by the methods to a common fixed point of a countable family of nonexpansive mappings which is the unique solution of a corresponding variational inequality. We also propose explicit itera-tive schemes for finding the approximate minimizer of a constrained convex minimization problem and prove that the sequences generated by our schemes converge strongly to a solution of the constrained convex minimization problem. Our results improve and gen-eralize some known results in the current literature, see, for example, [, ].

2 Preliminaries

Throughout this paper, we denote the set of real numbers and the set of positive integers byRandN, respectively. LetHbe a real Hilbert space, and letCbe a nonempty subset ofH. LetT:CCbe a mapping. We denote byF(T) the set of fixed points ofT,i.e., F(T) ={xC:Tx=x}.

Definition . (i) A mappingT:CCis said to benonexpansiveifTxTyxy for allx,yinC.Tis said to bequasi-nonexpansiveifF(T)=∅andTxyxyfor allxinCandyinF(T).

(ii) A mappingT:HHis said to be anaveraged mapping[] if it can be written as the average of the identityIand a nonexpansive mapping; that is,

(3)

whereαis a number in (, ), andS:HHis nonexpansive. More precisely, when (.), holds, we say thatT isα-averaged.

(iii) A mappingB:CHis said to beL-LipschitzianifBxByLxy,∀x,yC, whereL≥ is a constant. In particular, ifL∈[, ), thenBis called acontractiononC; if L= , thenBis nonexpansive.

(iv) A mappingV:D(V)HHis calledfirmly nonexpansive[] if

xy,VxVyVxVy, ∀x,yD(V),

whereD(V) is the domain ofV.

Clearly, a firmly nonexpansive mapping is a -averaged map.

Proposition .[, ] Let H be a real Hilbert space,and let S,T,B:HH be map-pings.

(a) IfT= ( –α)S+αBfor someαin(, ),and ifSis averaged,andBis nonexpansive,

thenT is averaged.

(b) Tis firmly nonexpansive if and only if the complement(I–T)is firmly nonexpansive. (c) IfT= ( –α)S+αBfor someαin(, ),and ifSis firmly nonexpansive,andBis

nonexpansive,thenT is averaged.

Recall that themetric (ornearest point) projectionfrom H onto C is the mapping PC:

HC,which assigns to each point x in H the unique point PCx in C satisfying the property

xPCx=d(x,C) :=inf yCxy.

Lemma .[] Let H be a real Hilbert space.For given x in H: (a) z=PCxif and only if

zx,zy ≤, ∀yC.

(b) z=PCxif and only if

xz≤ xy–yz, ∀yC.

(c)

PCxPCy,xyPCxPCy, ∀x,yH.

Consequently,PCis nonexpansive and monotone.

In general, a projection mapping is firmly nonexpansive, and, thus, a /-averaged map.

Lemma . The following inequality holds in an inner product space X:

(4)

Lemma .[] In a Hilbert space H,we have

λx+ ( –λ)y=λx+ ( –λ)y–λ( –λ)xy, ∀x,yH andλ∈[, ].

Lemma .(Demiclosedness principle []) Let T:CC be a nonexpansive mapping with F(T)=∅.If{xn} is a sequence in C that converges weakly to x,and if{(I–T)xn} converges strongly to y,then(I–T)x=y;in particular,if y= ,then xF(T).

Definition . Let H be a real Hilbert space. A nonlinear operatorT, whose domain D(T)Hand rangeR(T)His said to be:

(a) monotoneif

xy,TxTy ≥, ∀x,yD(T),

(b) η-strongly monotoneif there existsη> such that

xy,TxTyηxy, ∀x,yD(T),

(c) α-inverse strongly monotone(for short,α-ism) if there existsα> such that

xy,TxTyαTxTy, ∀x,yD(T).

It can be easily seen that (i) ifT is nonexpansive, thenIT is monotone; (ii) the pro-jection mapPCis a -ism. The inverse strongly monotone (also referred to as co-coercive)

operators have been widely used to solve practical problems in various fields, for instance, in traffic assignment problems; see, for example, [, ] and the references therein.

Proposition .[] Let T:HH be an operator.

(a) Tis nonexpansive if and only if the complementITis-ism. (b) IfTisv-ism,thenγTis v

γ-ism forv> .

(b) Tis averaged if and only if the complementITisv-ism for somev>.Indeed,for

αin(, ),Tisα-averaged if and only ifIT isα-ism.

Lemma .[] Let B:CH be an L-Lipschitzian mapping with constant L≥,and let A:CH be aκ-Lipschitzian andη-strongly monotone operator with constantsκ,η> . Then for≤γL<μη,we have

xy, (μAγB)x– (μAγB)y≥(μηγL)xy, ∀x,yC.

That is,μAγB is strongly monotone with coefficientμηγL.

The following lemma plays a key role in proving strong convergence of our iterative schemes.

(5)

mapping T:CC,define the mapping Tλ:CH by

x:=TxλμA(Tx), xC.

Then Tλis a contraction providedμ<η

κ,that is,

TλxTλy≤( –λτ)xy, ∀xC,

whereτ =  – –μ(ημκ)(, ].

LetA:CH be aκ-Lipschitzian andη-strongly monotone operator with constants κ,η> . LetB:CEbe anL-Lipschitzian mapping with constantL≥. Assume that T :CC is a nonexpansive mapping withF(T)=∅. Let  <μ< κη and ≤γL<τ,

whereτ= – –μ(ημκ). Let the net{xt}t

(,)be generated by the following implicit

scheme:

xt=PC

tγBxt+ (I–tμA)Txt

. (.)

Then {xt}t∈(,) converges strongly to a fixed pointx˜ ofT, which solves the variational

inequality

(γBμA)x,˜ x˜–z≤, ∀zF(T). (.)

Let the sequence{xn}n∈Nbe generated by the following explicit scheme:

xn+=PC

αnγBxn+ (I–αnμA)Txn

. (.)

Then {xn}n∈N converges strongly to a fixed pointx˜ ofT, which is also a solution of the variational inequality (.), see, for more details, [].

Consider a self-mappingStonCdefined by

Stx=PC

tγBxt+ (I–tμA)Tx

, ∀xC. (.)

Then,Stis a contraction, and it has a unique fixed point inC, which uniquely solves the

fixed point equation (.), see [] for more details.

Proposition . [, Proposition .] Let H be a real Hilbert space, and let C be a nonempty,closed and convex subset of H.Let A:CH be aκ-Lipschitzian andη-strongly accretive operator with constantsκ,η> .Let B:CH be an L-Lipschitzian mapping with constant L≥.Assume that T:CC is a nonexpansive mapping with F(T)=∅. Let <μ<κηand≤γL<τ,whereτ=  –

 –μ(ημκ).For each t in(, ),let x t

denote a unique solution of the fixed point equation(.).Then,the following properties hold for the net{xt}t∈(,):

() {xt}t∈(,)is bounded;

() limt→xtTxt= ;

(6)

Theorem .[, Theorem .] Let H be a real Hilbert space,and let C be a nonempty, closed and convex subset of H.Let A:CH be anκ-Lipschitzian andη-strongly accretive operator with constantsκ,η> .Let B:CH be an L-Lipschitzian mapping with con-stant L≥.Assume T:CC is a nonexpansive mapping with F(T)= ∅.Let <μ<κη

and≤γL<τ,whereτ =  – –μ(ημκ).For each t in(, ),let{xt}denote the

unique solution of the fixed point equation(.).Then the net{xt}converges strongly,as

t→,to a fixed pointx of T,˜ which solves the variational inequality(.),or equivalently, PF(T)(I–μA+γB)x˜=x.˜

Lemma .[] Let{sn},{γn} be sequences of nonnegative real numbers satisfying the inequality:

sn+≤( –γn)sn+γnδn, ∀n≥.

Suppose that{γn}and{δn}satisfy the conditions:

(i) {γn} ⊂[, ]andn=γn=∞,or equivalently, ∞n=( –γn) = ;

(ii) lim supn→∞δn≤,or

(ii) ∞n=γnδn<∞.

Thenlimn→∞sn= .

Lemma .[] Let{βn}be a sequence of real numbers with  <lim inf

n→∞ βn≤lim supn→∞ βn< .

Let{xn}and{zn}be two sequences in a Banach space E such that

xn+= ( –βn)xn+βnzn, n≥.

If

lim sup n→∞

xn+znxn+xn

≤,

thenlimn→∞xnzn= .

LetCbe a subset of a real Banach spaceE, and let{Tn}n=be a family of mappings of Csuch that∞n=F(Tn)=∅. Then{Tn}n=is said to satisfy theAKTT-condition[] if for

each bounded subsetDofC, we have

n=

supTn+zTnz:zD

<∞.

Lemma .[] Let C be a nonempty subset of a real Banach space E,and let{Tn}n=be a family of mappings of C into itself,which satisfies the AKTT -condition.Then for each x in C,we have that{Tnx}∞n=converges strongly to a point in C.Moreover,let the mapping T

be defined by

Tx= lim

(7)

Then for each bounded subset D of C,we have

lim sup n→∞

TnzTz:zD

= .

In the sequel,we will write that({Tn}n=,T)satisfies the AKKT-condition if{Tn}n=satisfies the AKKT-condition,and T is defined by Lemma..

We end this section with the following simple examples of mappings satisfying the AKTT-condition (see also Lemma .).

Example . (i) LetEbe any Banach space. For anyn∈N, let a mappingTn:EEbe

defined by

Tn(x) =

x

n (x∈E).

Then,Tnis a nonexpansive mapping for eachn∈N. It could easily be seen that ({Tn}n=,T)

satisfies theAKKT-condition, whereT(x) =  for allxE. (ii) LetE=l, where

l=

σ= (σ,σ, . . . ,σn, . . .) : ∞

n=

σn<∞

, σ=

n= σn

 

,∀σl,

σ,η=

n=

σnηn, ∀δ= (σ,σ, . . . ,σn, . . .),η= (η,η, . . . ,ηn, . . .)∈l.

Let{xn}n∈N∪{}⊂Ebe a sequence defined by

x= (, , , , . . .),

x= (, , , , , . . .),

x= (, , , , , , . . .),

x= (, , , , , , , . . .),

· · ·,

xn= (σn,,σn,, . . . ,σn,k, . . .),

· · ·,

where

σn,k=

⎧ ⎨ ⎩

 ifk= ,n+ ,

 ifk= ,k=n+ ,

for alln∈N. It is clear that the sequence{xn}n∈Nconverges weakly tox. Indeed, for any

= (λ,λ, . . . ,λn, . . .)∈l= (l)∗, we have

(xnx) =xnx,= ∞

k=

(8)

asn→ ∞. It is also obvious that xnxm= √

 for anyn=mwith n,msufficiently large. Thus,{xn}n∈Nis not a Cauchy sequence. We define a countable family of mappings Tj:EEby

Tj(x) =

⎧ ⎨ ⎩

n

n+x, ifx=xn; –j

j+x, ifx=xn,

for allj≥ andn≥. It is clear thatF(Tj) ={}for allj≥. It is obvious thatTj is a

quasi-nonexpansive mapping for eachj∈N. Thus,{Tj}j∈Nis a countable family of quasi-nonexpansive mappings.

LetTx=limj→∞Tjxfor allxE. It is easy to see that

T(x) = ⎧ ⎨ ⎩

n

n+x, ifx=xn;

–x, ifx=xn.

Then, we obtain thatTis a quasi-nonexpansive mapping withF(T) ={}=F(T). Let˜ Dbe a bounded subset ofE. Then there existsr>  such thatDBr={zE:z<r}. On the

other hand, for anyj∈N, we have

j=

supTj+zTjz:zD

=

j=

sup–j– 

j+  z– –j j+ z

:zD

=

j=

(j+ )(j+ )sup

z:zD<∞.

Furthermore, we have

lim sup j→∞

TjzTz:zD

= .

Therefore, ({Tn}n=,T) satisfies theAKKT-condition.

3 Fixed point and convergence theorems

LetCbe a nonempty, closed and convex subset of a real Hilbert spaceH, and letPCbe the

metric (or nearest point) projection fromHontoC.

Theorem . Let C be a nonempty,closed and convex subset of a real Hilbert space H. Assume {Tn}n= is a sequence of nonexpansive mappings from C into itself such that

n=F(Tn)=∅.Suppose,in addition,that T :CC is a nonexpansive mapping such

that({Tn}n=,T)satisfies the AKTT -condition,and S:CC is a nonexpansive mapping with F:=∞n=F(Tn)∩F(S)= ∅.Let A:CE be aκ-Lipschitzian andη-strongly

mono-tone operator with constantsκ,η> .Let B:CE be an L-Lipschitzian mapping with constant L≥.Let <μ<κηand≤γL<τ,whereτ=  –

 –μ(ημκ).

For arbitrarily given xin C,let the sequence{xn}be generated iteratively by

⎧ ⎨ ⎩

yn=PC[αnγBxn+ (I–αnμA)xn],

xn+= ( –βn)xn+βnTnSyn, n∈N,

(9)

where{αn},{βn}are two real sequences in(, )satisfying the following control conditions:

(a) lim

n→∞αn=  and

n=

αn=∞;

(b)  <lim inf

n→∞ βn≤lim supn→∞ βn< .

(.)

Then the sequence{xn}converges strongly to x∗∈F(TS),which solves the variational in-equality

(μAγB)x∗,x∗–z≤, zF(TS). (.)

Proof We divide the proof into several steps.

Step I. We claim that the sequence {xn} is bounded. Letpin F be fixed. In view of Lemma . we conclude that

(I–αnμA)xn– (I–αnμA)p≤( –αnτ)xnp, ∀n∈N.

This together with (.)-(.) implies that

ynp=PC

αnγBxn+ (I–αnμA)xn

PCpαnγBxn+ (I–αnμA)xnp

=αn

γBxnμA(p)

+ (I–αnμA)xn– (I–αnμA)pαnγLxnp+αn(γBμA)p+ ( –αnτ)xnp

= –αn(τγL)

xnp+αn(γBμA)p

≤max

xnp,

(γBμA)p τγL

. (.)

SinceTnis nonexpansive, for allninN, it follows from (.) and (.) that

xn+p=( –βn)(xnp) +βn(TnSynp) ≤( –βn)xnp+βnTnSynp ≤( –βn)xnp+βnynp

≤( –βn)xnp+βnmax

xnp,

(γBμA)p τγL

≤max

xnp,

(γBμA)p τγL

. (.)

By induction, we have that{xn}is bounded. This implies that the sequences{Axn},{Bxn},

{yn},{Syn}and{TnSyn}are bounded too. Let

M=supxn,Axn,Bxn,yn,Syn,TnSyn:n∈N

(10)

and set

D=zE:zM.

Then we haveDis a bounded subset ofEand{xn},{Axn},{Bxn},{yn},{TnSyn} ⊂D.

Step II. We claim thatlimn→∞ynTSyn= . In view of (.), we obtain

ynxn=PC

αnγBxn+ (I–αnμA)xn

PC[xn] ≤αnγBxn+ (I–αnμA)xnxn

=αnγBxn+xnαnμAxnxn

=αn(γBμA)xn. (.)

Sincelimn→∞αn= , it follows from (.) that

lim

n→∞ynxn= . (.)

In view of Lemma ., we conclude that

(I–αn+μA)xn+– (I–αn+μA)xn≤( –αn+τ)xn+xn, ∀n∈N.

This implies that

yn+yn=PC

αn+γBxn++ (I–αn+μA)xn+

PC

αnγBxn+ (I–αnμA)xnαn+γBxn++ (I–αn+μA)xn+αnγBxn+ (I–αnμA)xn

αn+γ(Bxn+Bxn) +γ(αn+αn)Bxn

+ (I–αn+μA)xn+– (I–αn+μA)xnαn+μAxnαn+γLxn+xn+ ( –αn+τ)xn+xn

+γ|αn+αn|Bxn+αn+μAxn

≤ –αn+(τγL)

xn+xn+γM|αn+αn|+μMαn+

xn+xn+γM|αn+αn|+μMαn+. (.)

Next, we show thatlimn→∞xn+xn= . For this purpose, we denote a sequence{zn}

byzn=TnSyn. It follows from (.) that

zn+zn=Tn+Syn+TnSyn

Tn+Syn+Tn+Syn+Tn+SynTnSynyn+yn+Tn+SynTnSyn

xn+xn+γM|αn+αn|+μMαn+

+supTn+zTnz:zD

(11)

This implies that

zn+znxn+xn ≤M|αn+αn|+sup

Tn+zTnz:zD

. (.)

Sincelimn→∞αn= , in view of theAKTT-condition and (.)(a), we conclude that

lim sup n→∞

zn+znxn+xn

≤.

Utilizing Lemma ., we deduce that

lim

n→∞znxn= .

It follows from (.) and (.)(b) that

lim

n→∞xn+xn=nlim→∞βnznxn= . (.)

On the other hand, we have

ynTnSyn ≤ ynxn+xnxn++xn+TnSynynxn+xnxn++ ( –βn)xnTnSynynxn+xnxn++ ( –βn)

xnyn+ynTnSyn

.

This implies that

ynTnSyn ≤

βn

ynxn+xnxn+

. (.)

In view of (.) and (.)-(.), we obtain

lim

n→∞ynTnSyn= . (.)

By the triangle inequality, we obtain

ynTSyn ≤ ynTnSyn+TnSynTSynynTnSyn+sup

TnzTz:zD

. (.)

In view of theAKTT-condition and (.)-(.), we deduce that

lim

n→∞ynTSyn= .

Step III. We prove that there existsx∗inF(TS) such that

lim sup n→∞

(μAγB)x∗,x∗–yn

≤.

For eachtin (, ), we define the mappingSt:CCby

St(x) =PC

(12)

SinceS,TandItμAare nonexpansive mappings for eachtin (, ), in view of (.), we conclude thatStis a contraction for eachtin (, ), and hence by the Banach contraction

principle, there exists a unique fixed pointxtinCsuch thatSt(xt) =xt. Thus, we have

xt=PC

tγBxt+ (I–tμA)TSxt

. (.)

Next, we show thatlimt→xt:=x∗exists. We first show that{xt}is bounded. To this end,

letpinFbe fixed. In view of Lemma ., we obtain

xtp=PC

tγBxt+ (I–tμA)TSxt

PCptγBxt+ (I–tμA)TSxtptγBxtμA(p)

+ (I–tμA)TSxt– (I–tμA)p

= –t(τγL)xtp+t(γBμA)p.

This implies that

xtp

(γBμA)p (τγL) .

Thus, we have that{xt}t∈(,)is bounded and so are{ATSxt}t∈(,)and{(γBμA)xt}t∈(,).

In view of (.), we obtain

xtTSxt=PC

tγBxt+ (I–tμA)TSxt

PC(TSxt) ≤tγBxt+ (I–tμA)TSxtTSxt

t(γBμA)xt.

This implies that

lim

t→+xtTSxt= . (.)

Using the techniques in the proof of Theorem ., we see that the variational inequality (.) has a unique solutionx˜∈F(TS). We show thatxt→ ˜xast→. To this end, set

yt=tγBxt+ (I–tμA)TSxt, ∀t∈(, ).

Then we havext=PCyt, and for any givenzinF(TS),

xtz=PCytyt+ytz

=PCytyt+t(γBxtμAz) + (ItμA)TSxt– (I–tμA)TSz. (.)

SincePCis the metric projection fromEontoC, for eachzinF(TS), we have

(13)

Exploiting Lemma . and (.), we obtain

xtz

=xtz,xtz

=PCytyt,PCytz+

(I–tμA)TSxt– (I–tμA)z,xtz

+tγBxtμAz,xtz

≤( –)xtz+tγBxtμAz,xtz. (.)

It follows from (.) that

xtz≤

τγBxtμAz,xtz

≤ 

τ

γBxtγBz,xtz+γBzμAz,xtz

≤ 

τ

γLxtz+γBzμAz,xtz

.

This implies that

xtz≤

τγLγBzμAz,xtz. (.)

Let{tn} ⊂(, ) be such thattn→+asn→ ∞. Letxn:=xtn. It follows from (.) that limn→∞xnTSxn= . The boundedness of{xt}implies that there existsx∗inCsuch

thatxnx∗, i.e., converges weakly, asn→ ∞. In view of Lemma ., we deduce that x∗∈F(TS). Sincexnx∗asn→ ∞, it follows from (.) thatlimn→∞xn–x∗= . Thus,

we have thatlimt→+xt=x∗is well defined. Next, we show thatx∗ solves the variational

inequality (.). Observe that

xt=PCyt=PCytyt+tγBxt+ (I–tμA)TSxt.

Thus, we have

(μAγB)xt=

t(PCytyt) – 

t(I–TS)xt+μ(AxtATSxt).

SinceTSis nonexpansive, we conclude thatITSis monotone. The property of metric projection implies that

(γBμA)xt,xtz

=

tPCytyt,xtz–  t

(I–TS)xt– (I–TS)z,xtz

+μAxtATSxt,xtz

μAxtATSxt,xtz

μLxtTSxtxtz. (.)

Replacingtbytnin (.), lettingn→ ∞, and noticing that{xtz}t∈(,)is bounded forz

inF(TS), with (.), we have

(14)

Thus, we have that x∗ inF(TS) is a solution of the variational inequality (.). Conse-quently,x∗=x˜by uniqueness. Therefore,xt→ ˜xast→. The variational inequality (.)

can be written as

(I–μA+γB)x˜–x,˜ x˜–z≥, ∀zF(TS).

So, in terms of Lemma ., it is equivalent to the following fixed point equation:

PF(TS)(I–μA+γB)x˜=x.˜

Since{yn}is bounded, for any subsequence of{yn}, there exists a further subsequence{yni} such thatyniuinC. In view of Lemma . and Step II, we conclude thatuF(TS). This

together with (.) implies that

lim sup n→∞

μAx∗–γBx∗,x∗–yn

= lim

i→∞

μAx∗–γBx∗,x∗–yni

=μAx∗–γBx∗,x∗–u

≤.

Step IV. We claim thatlimn→∞xnx∗= .

For eachninN∪ {}, we set

vn=αnγBxn+ (I–αnμA)TSxn

and observe thatyn=PCvn. Then, by Lemmas . and ., we obtain

ynx∗ =

ynx∗,ynx

=PCvnvn,PCvnx

+vnx∗,ynx

vnx∗,ynx

=αn

γBxnμA

x∗,ynx

+(I–αnμA)TSxn– (I–αnμA)TSx∗,ynx

=αnγ

BxnBx∗,ynx

+αn

(γBμA)x∗,ynx

+(I–αnμA)TSxn– (I–αnμA)TSx∗,ynx

αnγLxnxynx∗+αn

(γBμA)x∗,ynx

+ ( –αnτ)xnxynx

= –αn(τγL)xnxynx

+αn

(γBμA)x∗,ynx

≤ –αn(τγL)

xnx

∗

+ynx∗ 

+αn

(γBμA)x∗,ynx

(15)

This implies that

ynx∗ 

≤( –αn(τγL))

( +αn(τγL))

xnx∗ 

+ αn  +αn(τγL)

(γBμA)x∗,ynx

≤ –αn(τγL)xnx∗ 

+ αn  +αn(τγL)

(γBμA)x∗,ynx

= –αn(τγL)xnx∗ 

+αnθnξn, (.)

where

θn=τγL and ξn=

( +αn(τγL))(τγL)

(γBμA)x∗,ynx

.

In view of (.) and (.), we conclude that

xn+x∗ 

=( –βn)xn+βnTnSynx∗ 

≤( –βn)xnx∗+βnTnSynx∗ ≤( –βn)xnx

+βnynx∗ 

≤( –βn)xnx∗ 

+βn

 –αn(τγL)xnx∗ 

+αnθnξn

≤ –βnαn(τγL)xnx∗+βnαnθnξn

= –βnαn(τγL)xnx∗ 

+βnαn(τγL)

τγLθnξn, (.)

where γn =βnαn(τγL). It is easy to show that limn→∞γn= ,

n=γn=∞ and lim supn→∞ξn≤. Hence, in view of Lemma . and (.), we conclude that the sequence

{xn}converges strongly tox∗inF(TS).

Remark . Theorem . improves and extends [, Theorems . and .] in the follow-ing aspects.

(i) The identity mappingIis extended to the case ofIA:CE, whereA:CEis ak-Lipschitzian andη-strongly monotone (possibly nonself-) mapping.

(ii) In order to find a common fixed point of a countable family of nonexpansive self-mappingsTn:CC, the Mann-type iterations in [, Theorem .] are

extended to develop the new Mann-type iteration (.).

(iii) The new technique of an argument is applied in deriving Theorem .. For instance, the characteristic properties (Lemma .) of metric projectionPCplay an important

role in proving the strong convergence of the net{xt}t∈(,)in Theorem ..

(iv) Whenever we haveC=E,B= ,A=I, the identity mapping onCandμ= , then Theorem . reduces to [, Theorem .]. Thus, Theorem . covers [, Theorems . and .] as special cases.

(16)

and due to the well-known relations between fixed points of nonexpansive mappings and variational inequalities, the solution of (.) can be seen as a fixed point set of some non-expansive mappingV, and then this mapping could be added to countable family of non-expansive mappingsTn. In addition, the feasible set of the variational inequality problem

(.) isFix(TS), withTandSbeing nonexpansive mappings. For several sub-sets of nonex-pansive mapping,Fix(TS) =Fix(T)∩Fix(S) hold (see,e.g., [, ] for averaged mappings).

4 Constrained convex minimization problems

LetHbe a real Hilbert space, and letCbe a nonempty, closed and convex subset ofH. Consider the following constrained convex minimization problem:

minimizef(x) :xC, (.)

wheref :C→Ris a real-valued convex function. Iff is Fréchet differentiable, then the gradient-projection method (for short, GPM) generates a sequence{xn}using the follow-ing recursive formula:

xn+=PC

xnλf(xn)

, ∀n≥, (.)

or more generally,

xn+=PC

xnλn∇f(xn)

, ∀n≥, (.)

where in both (.) and (.), the initial guessxis taken fromCarbitrary, and the

param-eters,λorλn, are positive real numbers. The convergence of algorithms (.) and (.)

depends on the behavior of the gradient∇f. As a matter of fact, it is known that if∇f is α-strongly monotone andL-Lipschitzian with constantsα,L> , then the operator

T:=PC(I–λf) (.)

is a contraction; hence, the sequence{xn}defined by algorithm (.) converges in norm to the unique solution of the minimization problem (.). More generally, if the sequence

{λn}is chosen to satisfy the property

 <lim inf

n→∞ λn≤lim supn→∞ λn<

α

L, (.)

then the sequence{xn}defined by algorithm (.) converges in norm to the unique mini-mizer of (.).

However, if the gradient∇f fails to be strongly monotone, the operatorT defined by (.) would fail to be contractive; consequently, the sequence{xn}generated by algorithm (.) may fail to converge strongly (see [, Section ]). If∇f is Lipschitzian, then algo-rithms (.) and (.) can still converge in the weak topology under certain conditions.

(17)

gradient-projection algorithms, which are shown to have strong convergence. Further, he regularized the minimization problem (.) to devise an iterative scheme that generates a sequence converging in norm to the minimum-norm solution of (.) in the consistent case.

LetA:CH be aκ-Lipschitzian andη-strongly monotone operator with constants κ,η> , and letB:CHbe anl-Lipschitzian mapping with constantl≥. Suppose that  <μ<κη and ≤γl<τ, whereτ =

 –μ(ημκ). Suppose that the minimization

problem (.) is consistent, and let denote its solution set. Assume that the gradient

f isL-Lipschitzian with constantL> . Motivated by the work of Xu [], the authors of [] introduced the following implicit scheme that generates a net{}λ∈(,

L)in an implicit

way:

=PC

sγBxλ+ (I–sμA)Tλxλ

, (.)

whereandssatisfy the following conditions:

(i) s:=s(λ) =–λLfor eachλ∈(,L);

(ii) PC(I–λf) =sI+ ( –s)Tλfor eachλ∈(,L).

They proved that {}λ∈(,L) converges strongly to a minimizer x∗ in of (.), which

solves the variational inequality (.).

For a given arbitrary initial guessxinCand a sequence{λn} ⊂(,L) withλnL, they

also proposed the following explicit scheme that generates a sequence{xn}in an explicit way:

xn+=PC

snγBxn+ (I–snμA)Tnxn

, ∀n≥, (.)

wherern=–λnLandPC(I–λn∇f) =snI+ ( –sn)Tnfor eachn≥. It is proven in [] that

the sequence{xn}strongly converges to a minimizerx∗inof (.).

On the other hand, we know thatx∗inCsolves the minimization problem (.) if and only ifx∗solves the fixed point equation

x∗=PC(I–λf)x∗,

whereλ>  is any fixed positive number. Note that∇f being Lipschitzian implies that the gradient∇f isL-ism [], which then implies thatλf isλL-ism. So by Proposition .(c), Iλf isλL-averaged. Now since the projectionPCis-averaged, we know from

Propo-sition .(c) thatIλf is+λL-averaged for eachλ∈(,L). Hence, we can write

PC(I–λf) =

 –λLI+

 +λL

=sI+ ( –s)Tλ,

whereis nonexpansive, ands:=s(λ) =–λL∈(,) for eachλ∈(,L). It is easy to see

that

λ→ 

L ⇐⇒ s→

+.

For each fixedλ∈(,L), we now consider the self-mapping

Qλx=PC

sγBxλ+ (I–sμA)Tλx

(18)

It is easy to see thatis a contraction, see [] for more details. Thus, there exists a

unique fixed pointinC, which uniquely solves the fixed point equation (.).

The following two results, which summarize the properties of the net{}λ∈(,L) have

been proved in [].

Proposition . Let C be a nonempty,closed and convex subset of a real Hilbert space H. Let A:CH be aκ-Lipschitzian and η-strongly monotone operator with constants κ,η> ,and let B:CH be an l-Lipschitzian mapping with constant l≥.Suppose that <μ<κηand≤γl<τ,whereτ =

 –μ(ημκ).Suppose that the

minimiza-tion problem(.)is consistent,and letdenote its solution set.Assume that the gradient

f is L-Lipschitzian with constant L> .For eachλin(,L),let xλdenote a unique solution

of the fixed point equation(.),where Tλand s satisfy the following conditions:

(i) s:=s(λ) =–λL

for eachλin(,  L);

(ii) PC(I–λf) =sI+ ( –s)Tλfor eachλin(,L).

Then,the following properties for the net{}λ∈(,

L)hold:

(a) {}λ∈(,

L)is bounded;

(b) limλ→

LxλTλxλ= ;

(c) xλdefines a continuous curve from(,L)intoC.

Theorem . Let C be a nonempty,closed and convex subset of a real Hilbert space H. Let A:CH be aκ-Lipschitzian and η-strongly monotone operator with constants κ,η> ,and let B:CH be an l-Lipschitzian mapping with constant l≥.Suppose that <μ<κηand≤γl<τ,whereτ =

 –μ(ημκ).Suppose that the

minimiza-tion problem(.)is consistent,and letdenote its solution set.Assume that the gradient

f is L-Lipschitzian with constant L> .For eachλin(,

L),let xλdenote a unique solution

of the fixed point equation(.),where Tλand r satisfy the following conditions:

(i) s:=s(λ) =–λLfor eachλin(,L);

(ii) PC(I–λf) =sI+ ( –s)Tλfor eachλin(,L).

Then the net{}λ∈(,L)converges strongly,asλ→L,to a minimizer xof(.),which solves

the variational inequality(.);equivalently,we have PC(I–μA+γB)x∗=x∗.

Now, we are ready to propose explicit iterative schemes for finding the approximate minimizer of a constrained convex minimization problem and prove that the sequences generated by our schemes converge strongly to a solution of the constrained convex min-imization problem.

Theorem . Let C be a nonempty,closed and convex subset of a real Hilbert space H. Assume that{Sn}n=is a sequence of nonexpansive mappings from C into itself such that

n=F(Sn)=∅.Suppose,in addition,that S:CC is a nonexpansive mapping such that

({Sn}n=,S)satisfies the AKTT -condition.Let A:CH be aκ-Lipschitzian andη-strongly monotone operator with constantsκ,η> ,and let B:CH be an l-Lipschitzian mapping with constant l≥.Suppose that <μ<κηand≤γl<τ,whereτ =

 –μ(ημκ).

Suppose that the minimization problem(.)is consistent,and letdenote its solution set. Assume that the gradientf is L-Lipschitzian with constant L> .Let{λn}be a sequence in the interval(,L)such that{Tn}and{sn}satisfy the following conditions:

(i) sn=–λnLfor eachn≥;

(19)

(iii) sn→;

(iv) ∞n=sn=∞;

(v) ∞n=|λn+λn|<∞.

Suppose that{αn},{βn}are two sequences of real numbers in(, )satisfying the following control conditions:

(a) lim

n→∞αn=  and

n=

αn=∞;

(b)  <lim inf

n→∞ βn≤lim supn→∞ βn< . (.)

For given xin C arbitrarily,let the sequence{xn}be generated by

⎧ ⎨ ⎩

yn=PC[αnγBxn+ (I–αnμA)xn],

xn+= ( –βn)xn+βnTnSnyn, n∈N.

(.)

Iflimn→∞yn–Syn= and

n=F(Tn)∩F(S)=∅,then there exists a nonexpansive

map-ping T :CC such that({Tn}n=∞ ,T)satisfies the AKTT -condition,and{xn} converges strongly to a common element xin F(TS),which solves the variational inequality

(μAγB)x∗,x∗–z≤, zF(TS). (.)

Proof We divide the proof into several steps. First, we note that

() x˜inCsolves the minimization problem (.) if and only if for each fixedλ> ,x˜ solves the fixed point equation

˜

x=PC(I–λf)x;˜

() PC(I–λf)is+λL-averaged for eachλin(,L); in particular, the following relation

holds:

PC(I–λn∇f) =

 –λnL

I+  +λnL

Tn=snI+ ( –sn)Tn, ∀n≥.

Step I. We claim that the sequence{Tn}satisfies theAKTT-condition.

From the proof of Theorem .,{xn}is bounded and so are{Bxn}and{Tnxn}. LetDbe a

bounded subset ofCsuch that{Bxn,Tnxn:n∈N} ⊂D. Sincef isL-ism,PC(I–λn∇f) is

nonexpansive. It follows that for any givenzinDandvin, PC(I–λn∇f)z≤PC(I–λn∇f)z–v+v

PC(I–λn∇f)z–PC(I–λn∇f)v+vzv+v

z+ v.

This implies that

supPC(I–λn∇f)z:n∈N,zD

(20)

On the other hand, we have for anyzinDanduinthat

ATnzATnuAz+AuκTnzTnv+Avκzv+Av

z+ Av.

Therefore,

supATnz:n∈N,zD

<∞.

This shows that{ATnz:n∈N,zD}is bounded. We also obtain, for anyzinD, that

Tn+zTnz

=PC(I–λn+∇f) – ( –λn+L)I  +λn+L

z–PC(I–λn∇f) – ( –λnL)I  +λnL

z

≤PC(I–λn+∇f)

 +λn+L

z–PC(I–λn∇f)  +λnL

z+( –λnL)I  +λnL

z–( –λn+L)I  +λn+L

z

=( +λnL)PC(I–λn+∇f)z– ( +λn+L)PC(I–λn∇f)z ( +λn+L)( +λnL)

+ L|λn+λn| ( +λnL)( +λn+L)

z

≤L(λn+λn)PC(I–λn+∇f)z

( +λn+L)( +λnL)

+( +λn+L)PC(I–λn+∇f)z– ( +λn+L)PC(I–λn∇f)z ( +λn+L)( +λnL)

+ L|λn+λn| ( +λnL)( +λn+L)

z

≤L|(λn+λn)|PC(I–λn+∇f)z

( +λn+L)( +λnL)

+( +λn+L)PC(I–λn+∇f)z–PC(I–λn∇f)z ( +λn+L)( +λnL)

+ L|λn+λn| ( +λnL)( +λn+L)

z

≤ |λn+λn|

LPC(I–λn+∇f)z+ ∇f(z)+Lz

M|λn+λn|,

for some appropriate constantM>  such that

LPC(I–λn+∇f)z+ ∇f(z)+LzM,n≥.

Thus, we get

n=

supTn+zTnz:zD

M

n=

(21)

Now, define a mappingT:CCby

Tx= lim

n→∞Tnx,xC.

ThenT is a nonexpansive mapping. Since the minimization problem (.) is consistent, we conclude that∞n=F(Tn)=∅. Consequently, the sequence ({Tn}n=,T) satisfies the

AKTT-condition.

Step II. We claim thatlimn→∞ynTSyn= . In view of (.), we obtain

ynxn=QC

αnγBxn+ (I–αnμA)xn

QC[xn] ≤αnγBxn+ (I–αnμA)xnxn

=αnγBxn+xnαnμAxnxn

=αnγBxn+xnαnμAxnxn

=αn(γBμA)xn. (.)

Sincelimn→∞αn= , it follows from (.) that

lim

n→∞ynxn= . (.)

In view of Lemma ., we conclude that

(I–αn+μA)xn+– (I–αn+μA)xn≤( –αn+τ)xn+xn, ∀n∈N.

This implies that

yn+yn=PC

αn+γBxn++ (I–αn+μA)xn+

PC

αnγBxn+ (I–αnμA)xnαn+γBxn++ (I–αn+μA)xn+αnγBxn+ (I–αnμA)xn

αn+γ(Bxn+Bxn) +γ(αn+αn)Bxn

+ (I–αn+μA)xn+– (I–αn+μA)xnαn+μAxnαn+γLxn+xn+ ( –αn+τ)xn+xn

+γ|αn+αn|Bxn+αn+μAxn

≤ –αn+(τγL)

xn+xn+γM|αn+αn|+μMαn+

xn+xn+γM|αn+αn|+μMαn+. (.)

Next, we show thatlimn→∞xn+xn= . To this end, denote a sequence{zn}byzn=

TnSnyn. It follows from (.) that

zn+zn=Tn+Sn+yn+TnSnynTn+Sn+yn+Tn+Sn+yn

(22)

yn+yn

+Tn+Sn+ynTn+Snyn+Tn+SnynTnSnyn

yn+yn

+Sn+ynSnyn+Tn+SnynTnSnyn

yn+yn

+supSn+zSnz:zD

+supTn+zTnz:zD

xn+xn+γM|αn+αn|+μMαn+

+supSn+zSnz:zD

+supTn+zTnz:zD

.

This implies that

zn+znxn+xn ≤γM|αn+αn|+μMαn+

+supSn+zSnz:zD

+supTn+zTnz:zD

. (.)

Sincelimn→∞αn= , in view of Lemma . and (.), we conclude that

lim sup n→∞

zn+znxn+xn

≤.

Using Lemma ., we deduce that

lim

n→∞znxn= .

Thus, we have

lim

n→∞xn+xn=nlim→∞βnznxn= . (.)

On the other hand, we have

ynTnSnyn ≤ ynxn+xnxn++xn+TnSnynynxn+xnxn++xn+TnSnynynxn+xnxn++ ( –βn)xnTnSnynynxn+xnxn+

+ ( –βn)

xnyn+ynTnSnyn

. (.)

It follows from (.) that

ynTnSnyn ≤

βn

ynxn+xnxn+

. (.)

In view of (.) and (.), we obtain

lim

(23)

By the triangle inequality, we obtain

ynTnSyn ≤ ynTnSnyn+TnSnynTnSynynTnSnyn+SnynSynynTnSnyn+sup

SnzSz:zD

. (.)

In view of Lemma ., (.) and (.), we deduce that

lim

n→∞ynTnSyn= . (.)

By the triangle inequality, we obtain

ynTSyn ≤ ynTnSyn+TnSynTSynynTnSyn+sup

TnzTz:zD

. (.)

In view of theAKTT-condition and (.)-(.), we deduce that

lim

n→∞ynTSyn= .

Step III. We prove that

lim sup n→∞

(μAγB)x∗,x∗–yn

≤,

wherex∗∈F(TS) is the same as in Theorem . and satisfies

(γBμA)x∗,x∗–z≤, zF(TS). (.)

Let{ynk}be such that

lim sup n→∞

(μAγB)x∗,x∗–yn

= lim

k→∞

(μAγB)x∗,x∗–ynk

. (.)

By the same manner as in the proof of Theorem . Step II, we can finduF(TS) such thatynkuask→ ∞. In view of (ii), we have that

PC(I–λn∇f)ynyn=snyn+ ( –sn)Tnynyn

+ ( –sn)Tnynyn

Tnynyn

TnynTnSyn+TnSynyn

ynSyn+TnSynyn, (.)

wheresn=–λnLfor eachn≥. In view of (.) and taking into accountynSyn →,

we conclude that

lim

(24)

Hence we have

PC

I–

Lf

ynyn

PC

I–

Lf

ynPC(I–λn∇f)yn

+PC(I–λn∇f)ynxn

I–

Lf

yn– (I–λn∇f)yn

+PC(I–λn∇f)ynyn

=

Lλn

fyn+Tnynyn.

Thus, from the boundedness of{xn},sn→ (⇐⇒λnL) andTnynyn →, we

conclude that lim n→∞ PC I–

Lf

ynyn

= . (.)

Note that the gradient∇f is L-ism. Hence, it is known thatPC(I–Lf) is a

nonexpan-sive self-mapping onC. As a matter of fact, we have for eachx,yinC(see the proof of Theorem .)

PC

I–

Lf

xPC

I–

Lf

y

xy.

Sinceynku, by Lemma ., we obtain

u=PC

I–

Lf

u.

This shows thatu. Consequently, from (.) and (.), it follows that

lim sup n→∞

(γBμA)x∗,ynx

=(γBμA)x∗,ux∗≤.

As in the last part of the proof of Theorem ., we obtain thatxnx∗, which completes

the proof.

Corollary . Let C be a nonempty,closed and convex subset of a real Hilbert space H. Let A:CH be aκ-Lipschitzian and η-strongly monotone operator with constants κ,η> ,and let B:CH be an l-Lipschitzian mapping with constant l≥.Suppose that <μ<κηand≤γl<τ,whereτ =

 –μ(ημκ).Suppose that the

minimiza-tion problem(.)is consistent,and letdenote its solution set.Assume that the gradient

f is L-Lipschitzian with constant L> .Let{λn}be a sequence in the interval(,L)such that{Tn}and{sn}satisfy the following conditions:

(i) sn=–λnLfor eachn≥;

(ii) PC(I–λn∇f) =snI+ ( –sn)Tnfor eachn≥;

(iii) sn→;

(iv) ∞n=sn=∞;

(25)

Suppose that{αn},{βn}are two real sequences in(, )satisfying the following control con-ditions:

(a) lim

n→∞αn=  and

n=

αn=∞;

(b)  <lim inf

n→∞ βn≤lim supn→∞ βn< .

For given xin C arbitrarily,let the sequence{xn}be generated by

⎧ ⎨ ⎩

yn=PC[αnγBxn+ (I–αnμA)xn],

xn+= ( –βn)xn+βnTnyn, n∈N.

Then,there exists a nonexpansive mapping T:CC such that({Tn}n=,T)satisfies the AKTT -condition,and{xn}converges strongly to a common element x∗∈F(T)∩,which solves the variational inequality

(μAγB)x∗,x∗–z≤, zF(T).

We end this section by considering simple examples of sequences that fulfill the desired conditions of our results.

Example . Let{αn}n=be a sequence defined by

αn=

n+ , ∀n∈N.

LetL>  be any arbitrary real number, and letn∈Nbe such thatn>L. We define the

sequence{λn}n=as follows: ⎧

⎨ ⎩

λ=λ=· · ·=λn=

L, ifnn,

λn=(n+)Ln , ifn>n.

Then the sequences{αn}n= and{λn}n= satisfy all the aspects of the hypotheses of our results.

5 Applications

LetHbe a real Hilbert space, and letQ:H→Hbe a mapping. The effective domain of

Qis denoted bydom(Q), that is,dom(Q) ={xH:Qx=∅}. The range ofQis denoted by R(Q). A multi-valued mappingQis said to be monotone if for allx,yH,fQxandg inQy,

xy,fg ≥.

A monotone mappingQ:H→His said to be maximal if its graphG(Q) :{(x,f) :f Q(x)}

References

Related documents