ISRN Computational MathematicsVolume 2012 (2012), Article ID 172687, 5 pagesdoi:10.5402/2012/172687

Research Article

Evaluation of the Capability of the Multigrid Method in Speeding Up the Convergence of Iterative Methods

Iman Harimi and Mohsen Saghafian

Department of Mechanical Engineering, Isfahan University of Technology, Isfahan 84156-83111, Iran

Received 20 December 2011; Accepted 11 January 2012

Academic Editor: R. Pandey

Copyright © 2012 Iman Harimi and Mohsen Saghafian. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

The performance of the multigrid method and the effect of different grid levels on the convergence rate are evaluated. The two-, three-, and four-level V-cycle multigrid methods with the Gauss-Seidel iterative solver are employed for this purpose. The numerical solution of the one-dimensional Laplace equation with the Dirichlet boundary conditions is obtained using these methods. For the Laplace equation, a two-frequency function involving high- and low-frequency components is defined. It is observed that, however, the GS method can smooth out the high-frequency error components properly, but because the difference scheme for Laplace equation is remarkably concise, in the fine grids, a very large number of iterations are needed for extending the boundary conditions into the domain. Furthermore, the obtained results reveal that the number of necessary iterations for convergence is reduced considerably by employing the two-level multigrid algorithm. But increasing the number of levels of algorithm does not have any significant effect on the convergence rate in this study.

1. Introduction

The standard iterative methods like Jacobi and Gauss-Seidel (GS) rapidly damp out the local errors (high-frequency errors) of the solution, but they are extremely slow to remove the global errors (low-frequency errors) [1, 2]. In fact, these methods have a local stencil and may require a large number of iterations to converge. The multigrid method (MG) is one of the most efficient methods for solving linear and nonlinear systems, which can speed up the rate of damping out low-frequency errors. In this method, the high-frequency components of the solution error are damped by an iterative solver, or smoother, on a fine grid, whereas the low-frequency components are transferred to the coarser grid. On the coarser grid, these low-frequency error components appear as high-frequency ones, which are iteratively solved by a smoother. The typical application of the multigrid method is the numerical solution of elliptic partial differential equations [3]. The multigrid methods have also been used successfully for problems in image processing and vision [4].

In the past decades, many researchers including Fedorenko, Bakhvalov, and Brandt have studied and developed the multigrid methods [5–10]. The multigrid idea was first introduced by Fedorenko in 1962 and 1964 [5, 6] and then generalized by Bakhvalov in 1966 [7]. The multigrid algorithms were developed to practical applicability by Brandt in 1973 [8]. In 1977, Brandt [9] introduced a multilevel adaptive technique (MLAT) for fast numerical solution to the boundary value problems. He developed a distributive Gauss-Seidel (DGS) method as a smoother for solving the Navier-Stokes equations [10]. Jameson (1983 and 1985) developed the multigrid scheme to efficiently solve hyperbolic equations [11, 12].

There are many recent studies that have employed the multigrid method to increase the convergence rate. For example, Vazquez et al. [13] presented a methodology, equipped with multigrid techniques, to speed up the convergence of a fully implicit solver for the RANS equations for incompressible flows. Bruneau and Mortazavi [14] investigated the flow around a square cylinder. They used a multigrid method with Gauss-Seidel smoother for solution of the problem. In their work, the set of grids was varied, based on the needed accuracy, from the coarsest uniform grid to the finest or uniform grid. Liang et al. [15] investigated a p-multigrid method for solving spectral difference formulations of the scalar wave and Euler equations on unstructured grids. They used a lower-upper symmetric Gauss-Seidel (LU-SGS) method as an iterative smoother. They also employed a Runge-Kutta explicit method for comparison. Liang et al. [16] developed a two-dimensional high-order solver with spectral difference scheme for unsteady incompressible Navier-Stokes equations. They used a p-multigrid method to accelerate the convergence rate.

In the present work, in order to evaluate the capability of the multigrid method and the effect of different grid levels on the convergence rate, the two-, three-, and four-level V-cycle multigrid algorithms with Gauss-Seidel iterative method as a smoother are studied. A two-frequency function, with high and low frequencies, is defined for the Laplace equation. The convergence histories for different cases are compared and discussed.

2. Problem Statement

The one-dimensional Laplace equation and its discretized form (three-point discretization) can be expressed as in (1) and (2). The Dirichlet boundary conditions are set at the boundaries ( and ). 504 nodes with distance are placed in the solution domain Initial distribution of function involving high- and low-frequency components is defined in the solution domain, which is presented in (3). According to this equation, two different frequencies including and exist. The function is plotted in Figure 1, and these two frequencies are distinguished in this figure.

Figure 1: Initial distribution of in the solution domain.

At first, the Laplace equation is solved directly using the GS method. Then, it is solved by using the GS method equipped with the two-, three-, and four-level multigrid algorithms.

3. Four-Level Multigrid Method (MG4) with Gauss-Seidel Smoother (GS)

A four-level multigrid V-cycle and data transition between different grid levels are shown schematically in Figure 2. The levels 1 and 4 represent the finest and coarsest grids, respectively. In the multigrid method, the coarse grid mesh size is typically twice larger than the fine grid one. In the current study, the distance between grid points (mesh size) is doubled at each level (, , , and ). It should be noted that the coarser grids must be coarse enough to make the solution inexpensive compared to their previous grid levels. In the following sections, the procedure of going from finer to coarser level (restriction) and transferring corrections from coarser to finer level (prolongation) is explained in detail.

(a)

(b)

Figure 2: (a) Four-level V-cycle (b) data transition between different grid levels in MG4.

3.1. Smoothing Iterations on the Finest Grid and Transfer the Residual to the Coarser Grid

The Laplace equation is solved using the GS method (2). The number of relaxation sweeps on the finest grid is about 3 to 4. It should be noted that complete convergence is not absolutely necessary. The operator is defined such that becomes the discretized form of Laplace equation, as presented in (4). The residuals are obtained using (5) and then transferred to the coarser grid (level 2). G1 denotes the level 1 in this equation. In order to transfer data to the coarser grids, the injection operator (restriction operator) is employed, which projects the data of the finer grid points to the corresponding points at the coarser grid (see Figure 2(b))

3.2. Computing the Correction Term and New Residuals

The correction term can be calculated using (6), where G2 refers to the level 2. This equation can be expanded to yield (7), where is two times of . In this equation, an initial guess of zero is used for . Similarly, 3 or 4 iterations of the solver are adequate at this stage The updated residuals are obtained as the sum of the old residuals and the correction term as follows: Similarly, in levels 3 and 4, the new residuals and the correction terms can be calculated. It should be noted that is 4 and 8 times of in levels 3 and 4, respectively.

3.3. Transferring Corrections to the Finer Grid

By using a linear interpolation, the correction term obtained in level 4 is transferred back to level 3 and added to the correction term calculated in this level in the restriction process (9). The obtained values are employed as an initial guess for solving Laplace equation in this level (10). In (10), is the updated residuals obtained in the restriction process Similarly, the correction term can be transferred back to level 2. To return to level 1 (finest grid), the correction term obtained in level 2 is transferred to level 1 and added to the function calculated by (2), as follows: The convergence criterion is checked after updating the function . If the desired convergence is not achieved, the entire procedure (Sections 3.1 to 3.3) must be repeated. It should be noted that the updated in the last step (11) is considered as an initial guess for new operation (2). In the two- and three-level multigrid algorithms, the prolongation process is started after reaching the levels 2 and 3, respectively.

4. Numerical Results

Figures 3 and 4 show the smoothing of the function using Gauss-Seidel (GS) and multigrid (MG) methods after iterations. It required 113704 and 5685 iterations for GS and MG methods, respectively, to reach the convergence criterion of . As can be seen in Figure 3, for Gauss-Seidel method, the high-frequency error components are damped completely after 300 iterations, whereas 113704 iterations (about 380 times more) are needed to remove the low-frequency components. On the other hand, as soon as the high-frequency components are smoothed out, the convergence slows down. According to the obtained results, the number of iterations required to smooth out the global errors can be reduced to 5685 by applying the two-level multigrid method. The numbers of iterations for convergence in GS and MG method are presented in Table 1.

Table 1: Number of iterations for convergence.

Method
Convergence criterion

GS
113704
172736
290801

MG2
5685
8637
14540

MG3
5199
7943
13433

MG4
5197
7935
13411

Figure 3: Smoothing the function by GS iterations (), convergence criterion = .

Figure 4: Smoothing the function by MG2 iterations (), convergence criterion = .

The convergence history of the GS and MG methods is plotted in Figures 5 and 6. As can be observed in Figure 5, for the GS method, after the initial iterations, the residuals decrease very slowly. In addition, the slope of the residuals decreases gradually and approaches zero, indicating that the GS method is very time consuming especially for obtaining the exact solution. But for the two-level MG method, the residuals drop rapidly with a relatively constant slope compared to the GS method. Furthermore, according to Figure 6, the trend of residual variations is significantly similar for the two-, three-, and four-level MG methods. It seems that using the two-level MG method is adequate to speed up the convergence in this study.

Figure 5: Comparison of convergence history using Gauss-Seidel and two-level multigrid methods, convergence criterion = .

Figure 6: Comparison of convergence history using two-, three-, and four-level multigrid methods, convergence criterion = .

5. Conclusion

In this study, the capability of the multigrid method in increasing the convergence rate has been evaluated by using the two-, three-, and four-level V-cycle multigrid algorithms (MG2, MG3, and MG4, resp.) and the iterative Gauss-Seidel method (GS). The obtained results confirm that the MG method accelerates the convergence of the solution drastically. For example, the number of iterations required to reach the convergence criterion of decreases from 113704 to 5685 by applying an MG2 method. It is found that the GS method is very time consuming to achieve high accuracy. Furthermore, the comparison of the convergence history of MG2, MG3, and MG4 methods reveals that applying the MG2 method is adequate to increase the convergence speed in this problem. In fact, the choice of the coarsest grid level is problem dependent, and the frequency of errors plays an important role in it.

References

J. C. Tannehill, D. A. Anderson, and R. H. Pletcher, Comutational Fluid Mechanics and Heat Transfer, Taylor & Francis, Philadelphia, Pa, USA, 2nd edition, 1997.

D. M. Young, Iterative Solutions of Large Linear Systems, Academic Press, New York, NY, USA, 1971.

U. Trottenberg, C. W. Oosterlee, and A. Schüller, Multigrid, Academic Press, San Diego, Calif, USA, 2001.

A. Kenigsberg, R. Kimmel, and I. Yavneh, “A multigrid approach for fast geodesic active contours,” Tech. Rep. CIS-2004-06, Technion-Israel Institute of Technology, Haifa, Israel, 2004.

R. P. Fedorenko, “A relaxation method for solving elliptic difference equations,” USSR Computational Mathematics and Mathematical Physics, vol. 1, no. 4, pp. 1092–1096, 1962.

R. P. Fedorenko, “The speed of convergence of one iterative process,” USSR Computational Mathematics and Mathematical Physics, vol. 4, no. 3, pp. 227–235, 1964.

N. S. Bakhvalov, “On the convergence of a relaxation method with natural constraints on the elliptic operator,” USSR Computational Mathematics and Mathematical Physics, vol. 6, no. 5, pp. 101–135, 1966.

A. Brandt, “Multi-level adaptive technique (MLAT) for fast numerical solution to boundary value problems,” in Proceedings of the 3rd International Conference on Numerical Methods in Fluid Mechanics I, pp. 82–89, Springer, Berlin, Germany, 1973.

A. Brandt, “Multi-level adaptive solutions to boundary-value problems,” Mathemathics of Computation, vol. 31, no. 138, pp. 333–390, 1977.

A. Brandt, “Multi-level adaptive solutions to boundary-value problems,” AIAA Journal, vol. 18, no. 10, pp. 1165–1172, 1980.

A. Jameson, “Solution of the Euler equations for two dimensional transonic flow by a multigrid method,” Applied Mathematics and Computation, vol. 13, no. 3-4, pp. 327–355, 1983.

A. Jameson, “Multigrid algorithms for compressible flow calculations,” in Proceedings of the 2nd European Conference on Multigrid Methods, Princeton University Report MAE 1743, Cologne, Germany, 1985.

M. Vazquez, M. Ravachol, and M. Mallet, “Multigrid applied to a fully implicit FEM solver for turbulent incompressible flows,” in Proceedings of the ECCOMAS Computational Fluid Dynamics Conference, Wales, UK, September 2001.

C. H. Bruneau and I. Mortazavi, “Passive control of the flow around a square cylinder using porous media,” International Journal for Numerical Methods in Fluids, vol. 46, no. 4, pp. 415–433, 2004.

C. Liang, R. Kannan, and Z. J. Wang, “A p-multigrid spectral difference method with explicit and implicit smoothers on unstructured triangular grids,” Computers & Fluids, vol. 38, no. 2, pp. 254–265, 2009.

C. Liang, A. S. Chan, and A. Jameson, “A p-multigrid spectral difference method for two-dimensional unsteady incompressible Navier-Stokes equations,” Computers & Fluids, vol. 51, no. 1, pp. 127–135, 2011.