Abstract and Applied Analysis

Volume 2013 (2013), Article ID 124979, 7 pages

http://dx.doi.org/10.1155/2013/124979

Research Article

Iterative Solution to a System of Matrix Equations

Yong Lin1,2 and Qing-Wen Wang¹

¹Department of Mathematics, Shanghai University, Shanghai 200444, China

²School of Mathematics and Statistics, Suzhou University, Suzhou 234000, China

Received 17 May 2013; Accepted 21 September 2013

Academic Editor: Masoud Hajarian

Copyright © 2013 Yong Lin and Qing-Wen Wang. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract.

An efficient iterative algorithm is presented to solve a system of linear matrix equations , with real matrices and . By this iterative algorithm, the solvability of the system can be determined automatically. When the system is consistent, for any initial matrices and , a solution can be obtained in the absence of roundoff errors, and the least norm solution can be obtained by choosing a special kind of initial matrix. In addition, the unique optimal approximation solutions and to the given matrices and in Frobenius norm can be obtained by finding the least norm solution of a new pair of matrix equations , where , . The given numerical example demonstrates that the iterative algorithm is efficient. Especially, when the numbers of the parameter matrices are large, our algorithm is efficient as well.

1. Introduction

Throughout the paper, we denote the set of all real matrix by , the transpose matrix of by , the identity matrix of order by , the Kronecker product of and by , the vector formed by the vertical concatenation of the respective columns of a matrix by , the trace of a matrix by , and the Frobenius norm of a matrix by where .

In this paper, we consider the following two problems.

Problem 1. For the given matrices , , , , , , , , , and , find and such that

Problem 2. When Problem 1 is consistent, let denote the solution set of the pair of matrix equation (1). For the given matrices ,  , find such that

Problem 2 is to find the optimal approximation solutions to the given matrices in the solution set of Problem 1. It occurs frequently in experiment design (see, for instance, [1]). In the recent years, the matrix optimal approximation problem has been studied extensively (e.g., [2–13]).

The research on solving matrix equation pair has been actively ongoing for the last 30 years or more. For instance, Mitra [14] gave conditions for the existence of a solution and a representation of the general common solution to ,  . Shinozaki and Sibuya [15] and van der Woude [16] discussed conditions for the existence of a common solution to ,  . Navarra et al. [5] derived sufficient and necessary conditions for the existence of a common solution to ,  . Yuan [13] obtained an analytical expression of the least-squares solutions of ,   by using the generalized singular value decomposition (GSVD) of matrices. Dehghan and Hajarian [17] presented some examples to show a motivation for studying the general coupled matrix equations ,  , and [18] constructed an iterative algorithm to solve the general coupled matrix equations , . Wang [19, 20] gave the centrosymmetric solution to the system of quaternion matrix equations , . Wang [21] also solved a system of matrix equations over arbitrary regular rings with identity.

Recently, some finite iterative algorithms have also been developed to solve matrix equations. Ding et al. [22, 23] and Xie et al. [24, 25] studied the iterative solutions of matrix equations and and generalized Sylvester matrix equations and . They presented a gradient based and a least-squares based iterative algorithms for the solution. Li et al. [26, 27] and Zhou et al. [28, 29] considered iterative method for some coupled linear matrix equations. Deng et al. [30] studied the consistent conditions and the general expressions about the Hermitian solutions of the matrix equations and designed an iterative method for its Hermitian minimum norm solutions. Li and Wu [31] gave symmetric and skew-antisymmetric solutions to certain matrix equations , over the real quaternion algebra H. For more studies on iterative algorithms on coupled matrix equations, we refer to [3, 10–12, 17, 32–37]. Peng et al. [6] presented iterative methods to obtain the symmetric solutions of , . Sheng and Chen [8] presented a finite iterative method; when , is consistent. Liao and Lei [38] presented an analytical expression of the least-squares solution and an algorithm for , with the minimum norm. Peng et al. [7] presented an algorithm for the least-squares reflexive solution. Dehghan and Hajarian [2] presented an iterative algorithm for solving a pair of matrix equations , over generalized centrosymmetric matrices. Cai and Chen [39] presented an iterative algorithm for the least-squares bisymmetric solutions of the matrix equations , . Yin and Huang [40] presented an iterative algorithm to solve the least squares generalized reflexive solutions of the matrix equations , .

However, to our knowledge, there has been little information on finding the solutions to the system (1) by iterative algorithm. In this paper, an efficient iterative algorithm is presented to solve the system (1) for any real matrices . The suggested iterative algorithm, automatically determines the solvability of equations pair (1). When the pair of equations is consistent, then, for any initial matrices and , the solution can be obtained in the absence of round errors, and the least norm solution can be obtained by choosing a special kind of initial matrix. In addition, the unique optimal approximation solutions and to the given matrices and in Frobenius norm can be obtained by finding the least norm solution of a new pair of matrix equations , , where , . The given numerical examples demonstrate that our iterative algorithm is efficient. Especially, when the numbers of the parameter matrices are large, our algorithm is efficient as well while the algorithm of [32] is not convergent. That is, our algorithm has merits of good numerical stability and ease to program.

The rest of this paper is outlined as follows. In Section 2, we first propose an efficient iterative algorithm for solving Problem 1; then we give some properties of this iterative algorithm. We show that the algorithm can obtain a solution group (the least Frobenius norm solution group) for any (special) initial matrix group in the absence of roundoff errors. In Section 3, a numerical example is given to illustrate that our algorithm is quite efficient.

2. Iterative Algorithm for Solving Problems 1 and 2

In this section, we present the iterative algorithm for the consistence of the system (1).

Algorithm 3. (1) Input matrices , , , , , , , , , , , and (where , are any initial matrices).

(2) Calculate

(3) If (), then stop. Otherwise,

(4) Calculate

Go to (3).

Lemma 4. In Algorithm 3, the choice of makes reach a minimum and and orthogonal to each other.

Proof. From Algorithm 3, we have

From the above, the condition of reaching a minimum is

On the other hand, if the choice of makes and orthogonal to each other, that is, , we can have the same as (7).

Theorem 5. Algorithm 3 is bound to be convergent.

Proof. From Algorithm 3 and Lemma 4 we have

such that

From (9), we know that Algorithm 3 is convergent.

Lemma 6 (see [41]). Suppose that the consistent system of linear equations has a solution ; then is the least Frobenius norm solution of the system of linear equations.

Theorem 7. Assume that the system (1) is consistent. Let , be initial matrices where , are any initial matrices, or, especially, , ; then the solution generated by Algorithm 3 is the least Frobenius norm solution to (1).

Proof. If (1) is consistent, from , , using Algorithm 3, we have the iterative solution pair of (1) as the following:

We know that (1) is equivalent to the system

From (10) and (11) we have

where is the column space of matrix *.

Considering Lemma 6, with the initial matrices , , where , are arbitrary, or, especially, and , then the solution pair generated by Algorithm 3 is the least Frobenius norm solution of the matrix equations (1).

Suppose that Problem 1 is consistent. Obviously the solution set of (1) is nonempty. For given matrices pair , , we can write

Let , , , and . Then Problem 2 is equivalent to find the least Frobenius norm solution pair of the system

which can be obtained using Algorithm 3 with the initial matrix pair , where and are arbitrary, or especially, , , and the solution of the matrix optimal approximation Problem 2 can be represented as , .

3. An Example

In this section, we show a numerical example to illustrate the efficiency of Algorithm 3. All computations are performed by MATLAB 7. For the influence of the error of calculation, we consider the matrix as a zero matrix if .

Example 1. Consider the solution of the linear matrix equations

where

In this example, the numbers of the parameter matrices are larger than the numbers of the parameter matrices in the example of [32]. It can be verified that these matrix equations are consistent and have the solution as

Let

(1) Using Algorithm 3 and iterate 10309 steps, we obtain the least Frobenius norm solution pair of the matrix equation in Example 1 as follows:

The obtained sequence are presented in Figure 1.

Figure 1: The obtained sequence by Algorithm 3 for Example 1.

(2) Using the algorithm of [32], to this example, the iteration is not convergent. The obtained result is presented in Figure 2.

Figure 2: The relative error of the solution and the residual by the algorithm of [32] for Example 1.

This numerical example demonstrates that our algorithm has merits of good numerical stability and ease to program.

Acknowledgments

This research was supported by the Grants from the Key Project of Scientific Research Innovation Foundation of Shanghai Municipal Education Commission (13ZZ080), the National Natural Science Foundation of China (11171205), the Natural Science Foundation of Shanghai (11ZR1412500), and the Nature Science Foundation of Anhui Provincial Education (ky2008b253, KJ2013A248).

References

T. Meng, “Experimental design and decision support, in expert systems,” in The Technology of Knowledge Management and Decision Making for the 21st Century, C. Leondes, Ed., vol. 1, Academic Press, New York, NY, USA, 2001.

M. Dehghan and M. Hajarian, “An iterative algorithm for solving a pair of matrix equations , over generalized centro-symmetric matrices,” Computers & Mathematics with Applications, vol. 56, no. 12, pp. 3246–3260, 2008.

M. Dehghan and M. Hajarian, “An iterative algorithm for the reflexive solutions of the generalized coupled Sylvester matrix equations and its optimal approximation,” Applied Mathematics and Computation, vol. 202, no. 2, pp. 571–588, 2008.

A. L. Andrew, “Solution of equations involving centrosymmetric matrices,” Technometrics, vol. 15, no. 2, pp. 405–407, 1973.

A. Navarra, P. L. Odell, and D. M. Young, “A representation of the general common solution to the matrix equations and with applications,” Computers & Mathematics with Applications, vol. 41, no. 7-8, pp. 929–935, 2001.

Y.-X. Peng, X.-Y. Hu, and L. Zhang, “An iterative method for symmetric solutions and optimal approximation solution of the system of matrix equations , ,” Applied Mathematics and Computation, vol. 183, no. 2, pp. 1127–1137, 2006.

Z.-H. Peng, X.-Y. Hu, and L. Zhang, “An efficient algorithm for the least-squares reflexive solution of the matrix equation ,” Applied Mathematics and Computation, vol. 181, no. 2, pp. 988–999, 2006.

X. Sheng and G. Chen, “A finite iterative method for solving a pair of linear matrix equations ,” Applied Mathematics and Computation, vol. 189, no. 2, pp. 1350–1358, 2007.

N. Li and Q. W. Wang, “Iterative algorithm for solving a class of quaternion matrix equation over the generalized -reflexive matrices,” Abstract and Applied Analysis, vol. 2013, Article ID 831656, 15 pages, 2013.

A.-G. Wu, G. Feng, G.-R. Duan, and W.-J. Wu, “Finite iterative solutions to a class of complex matrix equations with conjugate and transpose of the unknowns,” Mathematical and Computer Modelling, vol. 52, no. 9-10, pp. 1463–1478, 2010.

A.-G. Wu, G. Feng, G.-R. Duan, and W.-J. Wu, “Iterative solutions to coupled Sylvester-conjugate matrix equations,” Computers & Mathematics with Applications, vol. 60, no. 1, pp. 54–66, 2010.

A.-G. Wu, B. Li, Y. Zhang, and G.-R. Duan, “Finite iterative solutions to coupled Sylvester-conjugate matrix equations,” Applied Mathematical Modelling, vol. 35, no. 3, pp. 1065–1080, 2011.

Y.-X. Yuan, “On the minimum norm solution of matrix equation ,” Journal of East China Shipbuilding Institute, vol. 15, no. 3, pp. 34–37, 2001.

S. K. Mitra, “Common solutions to a pair of linear matrix equations and ,” vol. 74, pp. 213–216, 1973.

N. Shinozaki and M. Sibuya, “Consistency of a pair of matrix equations with an application,” Keio Science and Technology Reports, vol. 27, no. 10, pp. 141–146, 1975.

J. W. van der Woude, Freeback decoupling and stabilization for linear systems with multiple exogenous variables [Ph.D. thesis], Technical University of Eindhoven, Eindhoven, The Netherlands, 1987.

M. Dehghan and M. Hajarian, “The general coupled matrix equations over generalized bisymmetric matrices,” Linear Algebra and Its Applications, vol. 432, no. 6, pp. 1531–1552, 2010.

M. Dehghan and M. Hajarian, “The reflexive and anti-reflexive solutions of a linear matrix equation and systems of matrix equations,” The Rocky Mountain Journal of Mathematics, vol. 40, no. 3, pp. 825–848, 2010.

Q.-W. Wang, J.-H. Sun, and S.-Z. Li, “Consistency for bi(skew)symmetric solutions to systems of generalized Sylvester equations over a finite central algebra,” Linear Algebra and Its Applications, vol. 353, pp. 169–182, 2002.

Q.-W. Wang, “Bisymmetric and centrosymmetric solutions to systems of real quaternion matrix equations,” Computers & Mathematics with Applications, vol. 49, no. 5-6, pp. 641–650, 2005.

Q.-W. Wang, “A system of matrix equations and a linear matrix equation over arbitrary regular rings with identity,” Linear Algebra and Its Applications, vol. 384, pp. 43–54, 2004.

F. Ding, P. X. Liu, and J. Ding, “Iterative solutions of the generalized Sylvester matrix equations by using the hierarchical identification principle,” Applied Mathematics and Computation, vol. 197, no. 1, pp. 41–50, 2008.

J. Ding, Y. Liu, and F. Ding, “Iterative solutions to matrix equations of the form ,” Computers & Mathematics with Applications, vol. 59, no. 11, pp. 3500–3507, 2010.

L. Xie, J. Ding, and F. Ding, “Gradient based iterative solutions for general linear matrix equations,” Computers & Mathematics with Applications, vol. 58, no. 7, pp. 1441–1448, 2009.

L. Xie, Y. Liu, and H. Yang, “Gradient based and least squares based iterative algorithms for matrix equations ,” Applied Mathematics and Computation, vol. 217, no. 5, pp. 2191–2199, 2010.

Z.-Y. Li, Y. Wang, B. Zhou, and G.-R. Duan, “Least squares solution with the minimum-norm to general matrix equations via iteration,” Applied Mathematics and Computation, vol. 215, no. 10, pp. 3547–3562, 2010.

Z.-Y. Li, B. Zhou, Y. Wang, and G.-R. Duan, “Numerical solution to linear matrix equation by finite steps iteration,” IET Control Theory & Applications, vol. 4, no. 7, pp. 1245–1253, 2010.

B. Zhou, J. Lam, and G.-R. Duan, “On Smith-type iterative algorithms for the Stein matrix equation,” Applied Mathematics Letters, vol. 22, no. 7, pp. 1038–1044, 2009.

B. Zhou, J. Lam, and G.-R. Duan, “Gradient-based maximal convergence rate iterative method for solving linear matrix equations,” International Journal of Computer Mathematics, vol. 87, no. 1–3, pp. 515–527, 2010.

Y.-B. Deng, Z.-Z. Bai, and Y.-H. Gao, “Iterative orthogonal direction methods for Hermitian minimum norm solutions of two consistent matrix equations,” Numerical Linear Algebra with Applications, vol. 13, no. 10, pp. 801–823, 2006.

Y.-T. Li and W.-J. Wu, “Symmetric and skew-antisymmetric solutions to systems of real quaternion matrix equations,” Computers & Mathematics with Applications, vol. 55, no. 6, pp. 1142–1147, 2008.

M. Dehghan and M. Hajarian, “An efficient algorithm for solving general coupled matrix equations and its application,” Mathematical and Computer Modelling, vol. 51, no. 9-10, pp. 1118–1134, 2010.

M. Dehghan and M. Hajarian, “On the reflexive and anti-reflexive solutions of the generalised coupled Sylvester matrix equations,” International Journal of Systems Science, vol. 41, no. 6, pp. 607–625, 2010.

B. Zhou, Z.-Y. Li, G.-R. Duan, and Y. Wang, “Weighted least squares solutions to general coupled Sylvester matrix equations,” Journal of Computational and Applied Mathematics, vol. 224, no. 2, pp. 759–776, 2009.

I. Jonsson and B. Kågström, “Recursive blocked algorithm for solving triangular systems. I. One-sided and coupled Sylvester-type matrix equations,” ACM Transactions on Mathematical Software, vol. 28, no. 4, pp. 392–415, 2002.

B. Zhou, G.-R. Duan, and Z.-Y. Li, “Gradient based iterative algorithm for solving coupled matrix equations,” Systems & Control Letters, vol. 58, no. 5, pp. 327–333, 2009.

I. Jonsson and B. Kågström, “Recursive blocked algorithm for solving triangular systems. II. Two-sided and generalized Sylvester and Lyapunov matrix equations,” ACM Transactions on Mathematical Software, vol. 28, no. 4, pp. 416–435, 2002.

A.-P. Liao and Y. Lei, “Least-squares solution with the minimum-norm for the matrix equation ,” Computers & Mathematics with Applications, vol. 50, no. 3-4, pp. 539–549, 2005.

J. Cai and G. Chen, “An iterative algorithm for the least squares bisymmetric solutions of the matrix equations ,” Mathematical and Computer Modelling, vol. 50, no. 7-8, pp. 1237–1244, 2009.

F. Yin and G.-X. Huang, “An iterative algorithm for the least squares generalized reflexive solutions of the matrix equations ,” Abstract and Applied Analysis, vol. 2012, Article ID 857284, 18 pages, 2012.

Y.-X. Peng, X.-Y. Hu, and L. Zhang, “An iteration method for the symmetric solutions and the optimal approximation solution of the matrix equation ,” Applied Mathematics and Computation, vol. 160, no. 3, pp. 763–777, 2005.