Numerical Solution of Poisson's Equation Using a Combination of Logarithmic and Multiquadric Radial Basis Function Networks

This paper presents numerical solution of elliptic partial differential equations Poisson's equation using a combination of logarithmic and multiquadric radial basis function networks. This method uses a special combination between logarithmic and multiquadric radial basis functions with a parameter r. Further, the condition number which arises in the process is discussed, and a comparison is made between them with our earlier studies and previously known ones. It is shown that the system is stable.


Introduction
Many problems in applied sciences and engineering are reduced to a set of partial differential equations PDEs .Analytical methods are frequently inadequate for obtaining solution, and usually numerical methods must be resorted.Radial basis function network is a well-known method to interpolate unknown functions and approximate numerical solutions.We have some radial basis functions such as "spline functions," "Gaussian functions," "multiquadric functions," and "logarithmic functions."All of researchers have tried to increase accuracy of approximate solutions while the stability of their suggested system is stable the condition number is near to unity as possible .In multiquadric radial basis functions MQ-RBFs , there are some parameters that influence accuracy of the solution, for instance, the width parameter of a basis function, scattered data points, and so on.In recent years, many researchers have worked on these parameters.They have tested many cases and have obtained different relations for such parameters.Kansa 1 has found that the best results are achieved by MQ approximation scheme when the parameter r 2 equivalent to the RBFs width parameter in this paper is varied according to the following expansion: where r 2 min and r 2 max are two input parameters; superscript j indexes the jth data point; N is the number of data points.However, in 1.1 , Kansa 1 did not report how r 2 min and r 2 max should be chosen until later, when Moridis and Kansa 2 have stated that the ratio r 2 max /r 2 min must be in the range of 10 1 -10 9 .Sharan et al. 3 have suggested some relations for these parameters to obtain more accurate solutions and having stable systems.Kansa  and Hon 4 have used MQ-RBFs for ill-conditioning problems.They showed that, in using finite element method FEM to simulate large scale complex PDE problems, the resulting coefficient matrices even with finite band widths can still be ill conditioned, though by using MQ-RBFs, we can solve these problems.Mai-Duy and Tran-Cong 5 have developed the new methods based on the MQ radial basis function networks RBFNs for the approximation of both functions and their first and higher derivatives.The so-called direct RBFN DRBFN and indirect RBFN IRBFN methods were studied, and it was found that the IRBFN method yields consistently better results for both functions and their derivatives.In the IRBFN method, they have set the unknown function as the following relation: 2 is in a two-dimensional PDE.They have let the values of r i named as width parameter of the ith neuron center of MQ-RBF as the following relation: where d i 's are distances between the points x i , y i and the nearest point.They introduced a range for parameter β that in that range they have more accurate approximated solution and have a stable system.Fedoseyev et al. 6 improved MQ approximation scheme for elliptic partial differential equations via PDE collocation.They formulated an improved Kansa-MQ approximation scheme with the PDE collocation on the boundary.The idea of the method is to add an additional set of nodes adjacent to the boundary and, accordingly, an additional set of collocation equations obtained via collocation of the PDE on the boundary.Galperin and Kansa 7 have used MQ-RBFs with global optimization to numerical solutions of weakly singular Volterra integral equations.Mai-Duy and Tran-Cong 8 improved their results for approximation of unknown function and its derivatives.Also, Mai-Cao 9 solved transient PDEs using IRBFN method and showed that it gives better accuracy as before, but, in parabolic PDEs, this method and its ranges for opting the values of β do not work as well as elliptic PDEs, and, in some cases, they have inaccurate solution and ill-conditioned system.In the present paper, we have combined logarithmic and MQ-RBFs with a parameter r and have improved the accuracy of our earlier works, but more important thing is about the condition number of the system that becomes equal to unity.Hence, the stability of the system in this new way is assured.
The organization of the present paper is as follows.In Section 2, we give the theories of the new method.In Section 3, we provide some numerical experiments on the twodimensional Poisson's equation with the Dirichlet, the Neumann, and curved boundary conditions and we propose to examine the stability of the method and its behavior towards input variations.Finally, in Section 4, some conclusions are presented.

The New Method of the Present Study
The form of a Poisson's equation is as follows: in which f X is a known function.Also, Poisson's equation can be in the following two Dirichlet and Neumann boundary conditions: where Γ 1 and Γ 2 are boundaries of the domain.Also, the vector n is the outer unit normal to the boundaries and f 1 , f 2 are two known functions of X.In MQ approximation scheme, we approximate the unknown function u X by an expression.In this study, we consider two-dimensional Poisson's equation.
In this method, we use the following expression: The derivatives in the two-dimensional Cartesian coordinates are presented in the following:

2.5
In expression 2.4 , the set of weights {w i } N i 1 is to be found.In the present study, the closed form of approximation function 2.4 is first obtained from a set of training points and the derivative functions are then calculated directly by differentiation of such closed activity.The nonzero parameter r protects of having zero values inside the logarithmic function.Also, we decrease the parameter r to improve approximate solutions.In fact, this parameter controls the accuracy and the stability of the system.In each experiments, we evaluate the condition number of the system condition number A • A −1 , that A is the coefficient matrix of the system and try to inspect the affect of the parameter r on the stability of our system.

Illustrative Numerical Experiments
In this section, we present three experiments, wherein their numerical solutions illustrate some advantages of the new method with high accuracy and show that, in this new way, the system is not ill conditioned.

Stability of the Solution
A method is said to be stable when the obtained solution undergoes small variations as there are slight variations in inputs and parameters and when probable perturbations in parameters that are effective in equations and conditions prevailing them do not introduce, in comparison to the physical reality of the problem, any perturbations in what is returned.We propose here to compare the new method with other numerical methods i.e., DRBFN and IRBFN methods by offering experiments and examining the stability of the new method Tables 1 and 3 .

3.2
The exact solution is: u e x, y xe y .We denote the root-mean-square error by the RMSE from the following relation: where u k e is exact solution and u k is approximate solution at points x k , y k .We have considered those 20 points that we had used for IRBFN method on the polar coordinates 17 .As we have shown in earlier work 17 , the parameter r influences on accuracy, partially.We have shown that increasing the values of this parameter causes instability, and usually can not affect on accuracy adequately see Table 4 .Although, in that method, we could improve our results by focusing on other parameters such as substituting the scattered point places, in this new way, we can improve our solutions by changing the values of parameter r without having instability.In contrast of MQ-RBFs, in this special combination, as parameter r decreases, the accuracy increases.Also, since, for values greater than 10 −2 , the condition number is not near to unity and we will not have a stable system sufficiently, so we have considered at least r 0.01.For instance, for this value of r, we have RMSE 1.99 × 10 −15 , and, when we continue to decrease this parameter over and over, we get a better solution.For instance, in the best position RMSE 2.26 × 10 −16 while in IRBFN method on the polar coordinates 17 in the best position, we had RMSE 4.36×10 −11 .Also, in this new way, when r reaches to about 10 −9 and smaller values, our accuracy and condition number are almost fixed.As we are decreasing parameter r, the accuracy is going to be better see Table 2 .Further, when we decrease r values quite enough, the accuracy and condition number almost do not change see Table 2 .Note that, for smaller values of r, condition number is very near to unity equals unity in double precision .u x λe λx μy at x 0, x 1, u e λx μy at y 0, y 1.The exact solution is u e x, y e λx μy , where λ and μ are, respectively, 2 and 3.This experiment was solved using MQ approximation scheme by Kansa 1 .The author used a total of 30 points, including 12 scattered data points in the interior and 18 along the boundary.The reported results showed that the norm of error is 2.25 × 10 −2 .Later, Mai-Duy and Tran-Cong 5 used IRBFN method and got a greater accuracy.They reported the norm of error is 2.2 × 10 −4 for this experiment.In this study, we have used those same points see Figure 1 and have achieved better accuracy in comparison with those two previous works.By using present approach, the norm of error that we have gotten in the best position is 3.26 × 10 −7 r 10 −8 .The results are shown in Tables 5 and 6.There are the same properties and results about this new way that we have explained in Experiment 1 more accuracy and stability .

Experiment 3. Consider the following two-dimensional Poisson's equation in the elliptical region:
u xx u yy −2.

3.6
The great diameter of the ellipse is a, and small diameter is b.The boundary condition is u 0 on all of boundary points.The equation of ellipse is Since the above ellipse is a symmetrical region, then we have solved this equation on the first quarter.The Dirichlet and the Neumann boundary conditions are u x 0 on the line x 0, u y 0 on the line y 0, u 0 on the bound of ellipse.

3.8
The analytical solution is u e x, y   The results have been computed for a 10 and b 8.We have used 28 points that 17 of them are boundary points and 11 are interior points see Figure 2 which were selected at random.In this new way, we have achieved a better accuracy in comparison with IRBFN method in the polar coordinates 17 see Tables 7, 8, and 9 .When we decrease parameter r, RMSE decreases too, and so we have better accurate solution.Also, the condition number closes to unity more and more.For r 10 −9 RSME 9.50 × 10 −12 , it almost equals to unity see Table 8 .
We have shown in 17 , in using of MQ-RBFs on the polar coordinate, when we have used 28 data points and we have been increasing the width parameter r, the accuracy of our  solution has been increasing a little, though our system has been going to nonstability see Table 9 .In contrast, in this new way, when we are decreasing the parameter r, the accuracy of our solution is increasing too.Also, the condition number of our system is decreasing and closes to unity see Table 8 .
Here, we would like to emphasize that this experiment had been also solved by 1 and 3 , and the norm of error is 3.57 × 10 −4 in the DRBFN method 1 , wherein the norm of errors in the DRBFN and the IRBFN methods are 1.36 × 10 −5 and 5.41 × 10 −7 3 , respectively.

Conclusion
In the present paper, we have introduced a new way for numerical solution of Poisson's partial differential equation by a special combination between logarithmic and MQ-RBFs.We have showed that by this new method it does not need to control the parameter r the width parameter all times for preventing inaccuracy of solutions or increasing the value of  condition number and having an ill-conditioned system.In this new way that is enough to consider the value of the parameter r smaller than 10 −9 .In the aforesaid experiments, the accuracy is better than those before results obtained by 1, 3, 5, 16, 17 and the condition number of the systems is equal to unity.So we have some complete stable systems and more accurate solutions.
It should be noted that the computations associated with the experiments discussed above were performed by using Maple 13 on a PC, CPU 2.4 GHz.

Figure 2 :
Figure 2: Location of scattered data points 11 points are interior points, and 17 points are boundary points of Experiment 3.

Table 1 :
Comparison between exact solution and approximate solution of the new method of Experiment 1.

Table 2 :
Values of condition number and RMSE for some values of r of Experiment 1 for the new method .Location of scattered data points 12 of these points are interior points, and 18 points are boundary points of Experiment 2.
i , y i ) Figure 1:

Table 3 :
Comparison between exact solution and approximate solution of IRBFN method on the polar coordinate of Experiment 1 17 .

Table 4 :
Values of condition number and RMSE for some values of r of Experiment 1 for IRBFN method on the polar coordinate 17 .

Table 5 :
Comparison between exact solution and approximate solution of the new method of Experiment 2.

Table 6 :
Values of condition number and RMSE for some values of r of Experiment 2 for the new method .

Table 7 :
Comparison between exact solution and approximate solution of the new method of Experiment 3.

Table 8 :
Values of condition number and RMSE for some values of r of Experiment 3 for the new method .

Table 9 :
Values of condition number and RMSE for some values of r of Experiment 3 for IRBFN method on the polar coordinate 17 .