Journal of Mathematics

Volume 2014 (2014), Article ID 965097, 9 pages

http://dx.doi.org/10.1155/2014/965097

Research Article

Newton Type Iteration for Tikhonov Regularization of Nonlinear Ill-Posed Problems in Hilbert Scales

Monnanda Erappa Shobha and Santhosh George

Department of Mathematical and Computational Sciences, National Institute of Technology Karnataka, Mangalore 575 025, India

Received 13 February 2014; Accepted 11 June 2014; Published 1 July 2014

Academic Editor: Beny Neta

Copyright © 2014 Monnanda Erappa Shobha and Santhosh George. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

Recently, Vasin and George (2013) considered an iterative scheme for approximately solving an ill-posed operator equation . In order to improve the error estimate available by Vasin and George (2013), in the present paper we extend the iterative method considered by Vasin and George (2013), in the setting of Hilbert scales. The error estimates obtained under a general source condition on ( is the initial guess and is the actual solution), using the adaptive scheme proposed by Pereverzev and Schock (2005), are of optimal order. The algorithm is applied to numerical solution of an integral equation in Numerical Example section.

1. Introduction

In this study, we are interested in approximately solving a nonlinear ill-posed operator equation:

where is a nonlinear operator. Here is the domain of , and  is the inner product with corresponding norm on the Hilbert spaces and . Throughout this paper we denote by the ball of radius centered at denotes the Fréchet derivative of at , and denotes the adjoint of . We assume that are the available noisy data satisfying

where is the noise level. Equation (1) is, in general, ill-posed, in the sense that a unique solution that depends continuously on the data does not exist. Since the available data is , one has to solve (approximately) the perturbed equation

instead of (1).

To solve the ill-posed operator equations, various regularization methods are used, for example, Tikhonov regularization, Landweber iterative regularization, Levenberg-Marquardt method, Lavrentiev regularization, Newton type iterative method, and so forth (see, e.g., [1–16]).

In [16], Vasin and George considered the iteration (which is a modified form of the method considered in [8])

where , is the initial guess, is the regularization parameter, and . Iteration (4) was used to obtain an approximation for the zero of and proved that is an approximate solution of (1). The regularization parameter in [16] was chosen appropriately from the finite set depending on the inexact data and the error level satisfying (2) using the adaptive parameter selection procedure suggested by Pereverzev and Schock [17].

In order to improve the rate of convergence many authors have considered the Hilbert scale variant of the regularization methods for solving ill-posed operator equations, for example, [18–26]. In this study, we present the Hilbert scale variant of (4).

We consider the Hilbert scale (see [14, 18, 23, 26–29]) generated by a strictly positive self-adjoint operator , with the domain dense in satisfying , for all . Recall [19, 28] that the space is the completion of with respect to the norm , induced by the inner product

In this paper, we consider the sequence defined iteratively by

where , , is the initial guess, , for obtaining an approximation for zero of (cf. [21, 30])

As in [16], we use the following center-type Lipschitz condition for the convergence of the iterative scheme.

Assumption 1. Let be fixed. There exists a constant such that, for every and , there exists an element satisfying

The error estimates in this work are obtained using the source condition on . In addition to the advantages listed in [16, see page 3], the method considered in this paper gives optimal order for a range of values of smoothness assumptions on . The regularization parameter is chosen from some finite set using the balancing principle considered by Pereverzev and Schock in [17].

The paper is organized as follows. In Section 2, we give the analysis of the method for regularization of (6) in the setting of Hilbert scales. The error analysis and adaptive scheme of parameter are given in Section 3. In Section 4, implementation of the method along with a numerical example is presented to validate the efficiency of the proposed method and we conclude the paper in Section 5.

2. The Method

First we will prove that the sequence defined by (6) converges to the zero of (7) and then we show that is an approximation to the solution of (1).

Let . We make use of the relation

which follows from the spectral properties of the positive self-adjoint operator , . Usually, for the analysis of regularization methods in Hilbert scales, an assumption of the form (cf. [18, 24])

on the degree of ill-posedness is used. In this paper instead of (10) we require only a weaker assumption:

for some positive reals , , and .

Note that (11) is simpler than that of (10). Now we define and by

The following proposition is used for further analysis.

Proposition 2 (cf. see [29, Proposition 2.1]). For and ,

Let us define a few parameters essential for the convergence analysis. Let

with

Further let , and

For , let

Then .

Lemma 3. Let Proposition 2 hold. Then for all , the following hold:

(a), (b).

Proof. Observe that, by Proposition 2,

This completes the proof of the lemma.

Theorem 4. Let and be as in (14) and (17), respectively; let be as defined in (6) with . Then under Assumption 1 and Lemma 3, the following estimates hold for all :

(a);(b).

Proof. If , then by Assumption 1,

where

and , and hence by Assumption 1 and Lemma 3(a), we have

and by Lemma 3(b),

Hence, by (19), (21), and (22), we have

Next we show that , using Assumption 1 and Lemma 3. Observe that

Hence, (a) follows from (23) and (24).

To prove (b), note that . Suppose for some ; then

Thus, by induction for all . This proves (b).

Next we go to the main result of this section.

Theorem 5. Let be as in (6), , and assumptions of Theorem 4 hold. Then is a Cauchy sequence in and converges, say, to . Further and

where .

Proof. Using relation (a) of Theorem 4, we obtain

Thus, is a Cauchy sequence in and hence it converges, say, to .

Now letting in (6), we obtain

This completes the proof.

The following assumption on source function and source condition is required to obtain the error estimates.

Assumption 6. There exists a continuous, strictly monotonically increasing function such that the following conditions hold:

(i),(ii) for all , and(iii)there exists with , such that

Remark 7. If , for example, , for some positive constant and , then, we have , where , , and .

Theorem 8. Let be the solution of (7) and suppose Assumptions 1 and 6 hold; then

Proof. Let . Then

Since , one can see that

where

Note that by Assumption 1 and Lemma 3,

by Proposition 2,

and by Assumption 6,

Hence, by (34)–(36) and (32), we have

This completes the proof of the theorem.

2.1. Error Bounds under Source Conditions

Theorem 9. Let be as in (6). If assumptions in Theorems 5 and 8 hold, then

where is as in Theorem 5. Further if , then

where .

2.2. A Priori Choice of the Parameter

The error estimate in Theorem 9 attains minimum for the choice which satisfies . Clearly , where

Thus, we have the following theorem.

Theorem 10. Suppose that all assumptions of Theorems 5 and 8 are fulfilled. For , let , and let be as in Theorem 9. Then

2.3. Adaptive Scheme and Stopping Rule

In this subsection, we consider the adaptive scheme suggested by Pereverzev and Schock in [17], modified suitably for choosing the parameter which does not involve even the regularization method in an explicit manner.

Let and , where , , and . Let , and let be as defined in (6) with and . Then, from Theorem 9, we have

Further, let

where is as in Theorem 9. The proof of the following theorem is analogous to the proof of Theorem 4.4 in [31], so we omit the details.

Theorem 11. Let be as in (6) with and , and assumptions in Theorem 9 hold. Let and be as defined in (43) and (44), respectively. Then and

3. Implementation of the Method

Finally, the balancing algorithm associated with the choice of the parameter specified in Theorem 11 involves the following steps:

(i)choose such that and ;(ii)choose big enough but not too large and , , where ;(iii)choose   .

Algorithm 1.

(1)set ;(2)choose ;(3)solve by using the iteration (6);(4)if , then take ;(5)else set and return to Step .

4. Numerical Example

Example 1. In this example, we consider a nonlinear integral operator, , defined by

with

The Fréchet derivative of is given by

In our computation, we take and , where is a random vector with and is a constant [26]. Then the exact solution

We take as

as our initial guess, so that the function satisfies the source condition (see [20, Proposition 5.3]). Thus, we expect to have an accuracy of order at least .

As in [26], we use the matrix

as a discrete approximation of the first-order differential operator (50).

We choose , , , and . The results of the computation are presented in Tables 1 and 2. The plots of the exact and the approximate solution obtained with are given in Figures 1 and 2.

The last column of Tables 1 and 2 shows that the error is of .

Table 1: Iterations and corresponding error estimates with , .

8
7
21
1.0606
0.9249
2.9244

16
2
9
0.2857
1.0033
3.1724

32
2
9
0.1431
1.0417
3.2940

64
2
9
0.1429
1.0608
3.3543

128
2
9
0.1428
1.0704
3.3847

256
2
9
0.1428
1.0754
3.4005

512
2
9
0.1428
1.0784
3.4098

1024
2
9
0.1428
1.0807
3.4172

Table 2: Iterations and corresponding error estimates with , .

8
7
21
1.0605
0.9249
2.9246

16
2
9
0.2856
1.0033
3.1726

32
2
9
0.1431
1.0417
3.2942

64
2
9
0.1429
1.0608
3.3546

128
2
9
0.1428
1.0704
3.3850

256
2
9
0.1428
1.0754
3.4008

512
2
9
0.1428
1.0784
3.4101

1024
2
9
0.1428
1.0807
3.4175

Figure 1: Curves of the exact and approximate solutions for .

Figure 2: Curves of the exact and approximate solutions for .

5. Conclusion

In this paper, we present an iterative regularization method for obtaining an approximate solution of a nonlinear ill-posed operator equation in the Hilbert scale setting. Here is a nonlinear operator and we assume that the available data is in place of exact data . The convergence analysis was based on the center-type Lipschitz condition. We considered a Hilbert scale, , generated by , where is a linear, unbounded, self-adjoint, densely defined, and strictly positive operator on . For choosing the regularization parameter , the adaptive scheme considered by Pereverzev and Schock in [17] was used. Finally, a numerical example is presented in support of our method which is found to be efficient.

Conflict of Interests

The authors declare that there is no conflict of interests regarding the publication of this paper.

Acknowledgment

Ms. Monnanda Erappa Shobha thanks NBHM, DAE, Government of India, for the financial support.

References

I. K. Argyros and S. Hilout, “A convergence analysis for directional two-step Newton methods,” Numerical Algorithms, vol. 55, no. 4, pp. 503–528, 2010.

I. K. Argyros and S. Hilout, “Weaker conditions for the convergence of Newton's method,” Journal of Complexity, vol. 28, no. 3, pp. 364–387, 2012.

I. K. Argyros, Y. J. Cho, and S. Hilout, Numerical Methods for Equations and its Applications, CRC Press, Taylor and Francis, New York, NY, USA, 2012.

A. B. Bakushinsky and M. Y. Kokurin, Iterative Methods for Approximate Solution of Inverse Problems, Springer, Dordrecht, The Netherlands, 2004.

H. W. Engl, K. Kunisch, and A. Neubauer, Regularization of Inverse Problems, Kluwer Academic Publishers, Dordrecht, The Netherlands, 1996.

H. W. Engl, “Regularization methods for the stable solution of inverse problems,” Surveys on Mathematics for Industry, vol. 3, no. 2, pp. 71–143, 1993.

H. W. Engl, K. Kunisch, and A. Neubauer, “Convergence rates for Tikhonov regularisation of nonlinear ill-posed problems,” Inverse Problems, vol. 5, no. 4, pp. 523–540, 1989.

S. George, “Newton-type iteration for Tikhonov regularization of nonlinear ill-posed problems,” Journal of Mathematics, vol. 2013, Article ID 439316, 9 pages, 2013.

M. Hanke, “A regularizing Levenberg-Marquardt scheme, with applications to inverse groundwater filtration problems,” Inverse Problems, vol. 13, no. 1, pp. 79–95, 1997.

B. Kaltenbacher, “A note on logarithmic convergence rates for nonlinear Tikhonov regularization,” Journal of Inverse and Ill-Posed Problems, vol. 16, no. 1, pp. 79–88, 2008.

B. Kaltenbacher, A. Neubauer, and O. Scherzer, Iterative Regularization Methods for Nonlinear Ill-Posed Porblems, de Gruyter, Berlin, Germany, 2008.

C. T. Kelley, Iterative Methods for Linear and Nonlinear Equations, SIAM, Philadelphia, Pa, USA, 1995.

Q. Jin, “On a regularized Levenberg-Marquardt method for solving nonlinear inverse problems,” Numerische Mathematik, vol. 115, no. 2, pp. 229–259, 2010.

U. Tautenhahn, “On the method of Lavrentiev regularization for nonlinear ill-posed problems,” Inverse Problems, vol. 18, no. 1, pp. 191–207, 2002.

V. Vasin, “Irregular nonlinear operator equations: Tikhonov's regularization and iterative approximation,” Journal of Inverse and Ill-Posed Problems, vol. 21, no. 1, pp. 109–123, 2013.

V. Vasin and S. George, “Expanding the applicability of Tikhonov's regularization and iterative approximation for ill-posed problems,” Journal of Inverse and Ill-Posed Problems, 2013.

S. Pereverzev and E. Schock, “On the adaptive selection of the parameter in regularization of ill-posed problems,” SIAM Journal on Numerical Analysis, vol. 43, no. 5, pp. 2060–2076, 2005.

H. Egger and A. Neubauer, “Preconditioning Landweber iteration in Hilbert scales,” Numerische Mathematik, vol. 101, no. 4, pp. 643–662, 2005.

Q. Jin, “Error estimates of some Newton-type methods for solving nonlinear inverse problems in Hilbert scales,” Inverse Problems, vol. 16, no. 1, pp. 187–197, 2000.

S. Lu, S. V. Pereverzev, Y. Shao, and U. Tautenhahn, “On the generalized discrepancy principle for Tikhonov regularization in Hilbert scales,” Journal of Integral Equations and Applications, vol. 22, no. 3, pp. 483–517, 2010.

P. Mahale and M. T. Nair, “A simplified generalized Gauss-Newton method for nonlinear ill-posed problems,” Mathematics of Computation, vol. 78, no. 265, pp. 171–184, 2009.

P. Mathe and U. Tautenhahn, “Error bounds for regularization methods in Hilbert scales by using operator monotonicity,” Far East Journal of Mathematical Sciences, vol. 24, no. 1, pp. 1–21, 2007.

F. Natterer, “Error bounds for Tikhonov regularization in Hilbert scales,” Applicable Analysis, vol. 18, no. 1-2, pp. 29–37, 1984.

A. Neubauer, “On Landweber iteration for nonlinear ill-posed problems in Hilbert scales,” Numerische Mathematik, vol. 85, no. 2, pp. 309–328, 2000.

Q. Jin and U. Tautenhahn, “Inexact Newton regularization methods in Hilbert scales,” Numerische Mathematik, vol. 117, no. 3, pp. 555–579, 2011.

Q. Jin and U. Tautenhahn, “Implicit iteration methods in Hilbert scales under general smoothness conditions,” Inverse Problems, vol. 27, no. 4, Article ID 045012, 2011.

S. George and M. T. Nair, “Error bounds and parameter choice strategies for simplified regularization in Hilbert scales,” Integral Equations and Operator Theory, vol. 29, no. 2, pp. 231–242, 1997.

U. Tautenhahn, “On a general regularization scheme for nonlinear ill-posed problems: II. Regularization in Hilbert scales,” Inverse Problems, vol. 14, no. 6, pp. 1607–1616, 1998.

U. Tautenhahn, “Error estimates for regularization methods in Hilbert scales,” SIAM Journal on Numerical Analysis, vol. 33, no. 6, pp. 2120–2130, 1996.

Q. Jin, “On a class of frozen regularized Gauss-Newton methods for nonlinear inverse problems,” Mathematics of Computation, vol. 79, no. 272, pp. 2191–2211, 2010.

S. George, “On convergence of regularized modified Newton's method for nonlinear ill-posed problems,” Journal of Inverse and Ill-Posed Problems, vol. 18, no. 2, pp. 133–146, 2010.