MINRES Seed Projection Methods for Solving Symmetric Linear Systems with Multiple Right-Hand Sides

We consider the MINRES seed projection method for solving multiple right-hand side linear systems AX = B, where A ∈ Rn×n is a nonsingular symmetric matrix, B ∈ R. In general, GMRES seed projection method is one of the effective methods for solving multiple right-hand side linear systems. However, when the coefficient matrix is symmetric, the efficiency of this method would be weak. MINRES seed projection method for solving symmetric systems with multiple right-hand sides is proposed in this paper, and the residual estimation is analyzed. The numerical examples show the efficiency of this method.


Introduction
Consider the multiple right-hand side linear systems where  ∈  × is a nonsingular symmetric matrix, and  ∈  × .Equation ( 1) plays an important role in chemistry, electronics, structures, control, and other problems; see [1,2] for detail.
In the last few years, the block methods have been developed to solve (1), such as the block conjugate gradient algorithm (BCG) [3], the block generalized minimal residual method [4][5][6], the block BiCGSTAB method [7], the block QMR method [8], the block least squares method [9], the block Lanczos method [10], and the block IDR() method [11] which have been proposed recently.In general, the block methods are faster than solving each one separately.
The meshless methods are extensively used for solving (1); these meshless methods show to be efficient and accurate in terms of their numerical results; see [12][13][14][15][16][17][18].The global methods [19,20] are also a class of important methods.Following the work [20], many other global methods have been developed, including the global BiCG and global BiCGSTAB methods [21], the global Hessenberg and global CMRH methods [22], and the polynomial preconditioned global CMRH method [23,24].Generally, the global methods are more appropriate for large and sparse systems.
In many practical applications, the right-hand sides are not arbitrary and are very close; then the seed projection methods are often used to solve (1); see [1,2,25,26].The main idea of this method is selecting one system to be the seed systems firstly, then solving the seed systems by some Krylov subspace method, and creating a Krylov subspace , then projecting the residual of the other systems, called nonseed systems, onto this Krylov subspace  to get the approximate solutions.The process is repeated with other seed systems until all the systems are solved.The seed projection methods were proposed by Smith et al. [1] for the CG method firstly.When  is unsymmetric, Simoncini and Gallopulos [2] proposed the GMRES seed projection method.Later, a seed method which uses Morgan's Krylov subspace augmented with eigenvectors was presented in [25].Moreover, the seed method can be used to solve unsymmetric shifted systems with multiple right-hand sides [26].However, if  is a symmetric matrix, the efficiency of these methods would be weak.

Mathematical Problems in Engineering
In this paper, we propose the MINRES seed projection method for solving symmetric systems with multiple righthand sides, and the residual estimation is analyzed.
The paper is organized as follows.In Section 2, we give a quick overview of the GMRES seed projection method.In Section 3, we present the MINRES seed projection method and the residual estimation.In the last section, we show the efficiency of our method by numerical experiments.

GMRES Seed Projection Method
In this section, we recall the GMRES seed projection method for solving (1).Details of the algorithm can be found in [2,25].We summarize it in the following algorithm.
We now make a few descriptions of Algorithm 1. Firstly, we give an initial approximation to the solutions  (0) , compute the initial residuals, and select seed systems by a function .In this algorithm,  applied to the  returns  and   , where  is the index of column of  having the maximum norm.Secondly, we apply restarted GMRES method for solving the seed systems and function  applies the Arnoldi procedure to generate an orthogonal basis  +1 = [V 1 , . . ., V  ] for the Krylov subspace  +1 (,   ).Meanwhile, the nonseed solutions are approximated by projecting the residual   =   −   on  +1 (,   ) and solving the least square problem min   ∈  ‖  −  Τ +1   ‖ 2 .Thirdly, after the seed systems are solved to desired accuracy, new seed systems are selected from the unsolved systems and then the whole procedure is repeated until all the systems are solved.Some theoretical analysis about the above algorithm can be found in [2,25].

MINRES Seed Projection Method
Based on the MINRES method for solving the symmetric linear systems, in this section, we combine the GMRES seed projection method and the MINRES method and propose the MINRES seed projection method for solving (1).The Arnoldi procedure in GMRES seed projection method is exchanged by Lanczos procedure, and applying the seed projection idea to MINRES method, the MINRES seed projection method is proposed as the following algorithm.
We now make a few descriptions about Algorithm 2. Firstly, we give an initial approximation to the solutions  (0) , compute the initial residuals, and select seed systems by a function .In this algorithm,  applied to the  returns  and   , where  is the index of column of  having the maximum norm.Secondly, we apply restarted Lanczos method for solving the seed systems and function  applies the Lanczos procedure to generate an orthogonal basis  +1 = [ 1 , . . .,   ] for the Krylov subspace  +1 (,   ).Meanwhile, the nonseed solutions are approximated by projecting the residual  () =  () − () on  +1 (,   ) and solving the least square problem min  () ∈  ‖ T  () −  Τ +1  () ‖ 2 .Thirdly, after the seed systems are solved to desired accuracy, new seed systems are selected from the unsolved systems and then the whole procedure is repeated until all the systems are solved.

Numerical Experiments
In order to prove the efficiency of our algorithm, we compare the following methods.(1) MINRES1, it uses MINRES method for solving the multiple right-hand side linear systems one by one and uses the convergent solution of ( − 1)th systems as the iterative initial vector of th systems when the ( − 1)th systems converge.(2) MINRES2, it uses MINRES method for solving the multiple right-hand side linear systems one by one, and the initial vector is zero vector.
All numerical experiments are implemented in MATLAB 2009 and run in Intel Pentium Dual T2390 computer.We set  = 30; all the tests are stopped as soon as ‖ () ‖ 2 <  ≡ 10 −6 .
The numerical results are shown in Tables 1 and 2 and the data in bracket is the sum of iterative steps.
In Table 1, the iterative steps of each system are listed and the data in bracket are the sum of iterative steps of all systems.From Table 1, we can know that Mseed can do better than MINRES1 and MINRES2.
Let  = 5, and the dimensions of projection space  = 25 and results of calculation are shown in Table 4.
From Table 4, we can see that Mseed is superior to MINRES method.

Conclusion
In this paper, we propose the MINRES seed projection method for solving symmetric systems with multiple righthand sides, and the residual estimation is analyzed.The numerical examples show that our method is effective.  2b (3)   b (4)  b (5)

Table 1 :
Iterative steps of convergent solution of each system.

Table 2 :
Convergent time (second) of each method.

Table 4 :
Convergent iterative steps of each system and CPU time (second).

Table 5 :
Iterative steps of convergent solution of each system.

Table 6 :
Convergent time (second) of each method.