Nonlinear Least Square Based on Control Direction by Dual Method and Its Application

A direction controlled nonlinear least square (NLS) estimation algorithm using the primal-dual method is proposed. The least square model is transformed into the primal-dual model; then direction of iteration can be controlled by duality. The iterative algorithm is designed. The Hilbert morbid matrix is processed by the new model and the least square estimate and ridge estimate. Themain research method is to combine qualitative analysis and quantitative analysis.The deviation between estimated values and the true value and the estimated residuals fluctuation of different methods are used for qualitative analysis. The root mean square error (RMSE) is used for quantitative analysis. The results of experiment show that the model has the smallest residual error and theminimum root mean square error.The new estimate model has effectiveness and high precision.The genuine data of Jining area in unwrapping experiments are used and the comparison with other classical unwrapping algorithms is made, so better results in precision aspects can be achieved through the proposed algorithm.


Introduction
During the course of data processing of measurement, most problems are nonlinear ones.In the classical least square, the nonlinear approximation function is expanded at the approximate value.This transformation can linearize the data; then the problem can be solved through the linear least square.The precondition of this model is that the initial value of parameter is sufficiently reaching the adjusted value.Otherwise the model error is hard to be ignored.
NLS is one of the optimization methods.And NLS problem can be solved by the optimization method [1][2][3].Primaldual method is a very important and effective optimization method.NLS problems can be transformed into primal-dual model and then be solved.
A direction controlled estimate model is proposed.The least square model is transformed into the primal-dual model [4]; then the direction of iteration can be controlled by duality.In the primal-dual method, a nonlinear optimization problem (primal problem) can be converted into another nonlinear optimization problem (dual problem).The solution of the primal model can be gotten through duality problem [5,6].The theory of primal-dual model is introduced and the algorithm is proposed.The model is contrasted with LS and the ridge estimate.The simulated data are used to check the model.The root mean square error (RMSE) and the deviation between estimated values and the true value are taken as the indexes.The results from the experiments show the feasibility and effectiveness of the model.Unwrapping experiments using genuine data of Jining area and comparing with LS unwrapping algorithms [7], the proposed algorithm achieved better results in precision aspects.Computation time,  value, and the RMSE are taken as quantitative indexes.The dual method achieved better results with regard to all of computation time and the RMSE between rewrapped results and original wrapped phase and  value.

Primal-Dual Models
The primal problem of quadratic optimization with equality constraints is defined as follows [8,9]: where  ∈  × ,  ∈  ×1 ,  ∈  × , and  ∈  ×1 . can be seen as a symmetric matrix.The Lagrange function of (1) is The dual problem of ( 1) is defined as follows: If  is a positive semidefinite matrix, then () is a convex function.In this case, if there is at least one vector quantity  satisfying the equality constraints and () is lower bounded in the feasible region then quadratic optimization has a global minimum.If  is the positive definite matrix then the quadratic optimization has a global unique minimum.
The equivalent quadratic optimization of ( 10) can be expressed as follows [11]: The Lagrange function of (10) is and the dual model is The Lagrange function of (11) is and the dual model is The optimal solution of NLS can be gotten by solving quadratic program and its dual problem.
Following the similar ideas of [12], if matrix  is positive definite, the algorithm is convergent.If matrix  is semipositive definite, but  +  ∑  =1      is positive definite ( is a constant), the algorithm is convergent.
The true value is  = 1.There are two cases of noise in experiments: 1.0 × 10 −5 and 1.0 × 10 −2 .The condition number of matrix is 8.9859 × 10 16 , so this is an ill-condition problem.By using the primal-dual method, LS method, and ridge estimate, the results are compared and analyzed.
The evaluations of experiment are shown in Tables 1 and  2 when the noise is 1.0 × 10 −5 .
The noise has small influence on estimates because it is very small.The estimates of three methods are very close to the true value, which illustrates that all of the methods can accurately estimate the solution.From the RMSE and the standard deviation, ridge estimate model is the best and the dual method is better than LS method.
When the noise is 1.0 × 10 −2 , the evaluations of experiment are shown in Tables 3 and 4.
Dual method and ridge method can obtain accurate results.As the noise increases, the RMSE and the standard deviation of three methods are bigger.Dual method is the best.This illustrates that the dual method is better than other algorithms in stability.
From both noises, the dual method not only obtains good results but also has better stability.1 shows the study area and its surrounding enhanced thematic mapper (ETM) stack digital elevation model (DEM) three-dimensional diagrams.
Table 5 shows the basic parameters of ALOS satellite data.
Figure 2 shows the map of wrapped phase.The sizes of images are 140 pixels × 120 pixels.
From the map of wrapped phase, the interference fringes are clear.Because of the noise, the lower-right sections are discontinuous.After being filtered, the fringes are enhanced, but the noise is still obvious.Figure 3 shows the unwrapping results after the different algorithm.
Both unwrapping methods can run successfully.LS method does well in the relatively noise-free area.In high noise area, the unwrapping results are unsatisfactory.Not only is error transfer clear, but also the incoherent area becomes bigger.The dual method can reduce phase transmission error and get better unwrapping results.
Table 6 shows computation time,  value, and the RMSE between rewrapped results and original wrapped phase.
The computation time of LS method is slightly more compared to dual method, which illustrates that both algorithms are at the same complicated degree.The RMSE and  value of dual method are smaller compared to LS method, which illustrates that the difference between rewrapped results and original wrapped phase is small.Thus the unwrapping phases of dual method are smoother and more reliable.

Conclusions
A direction controlled nonlinear least square (NLS) estimation algorithm using the primal-dual method is proposed.

Figure 1 :Figure 2 :
Figure 1: Study area and the surrounding terrain map.(a) Sketch map of study area.(b) Study area and its surrounding ETM stack DEM three-dimensional diagram.

Table 1 :
The estimated value by dual method, LS method, and ridge estimate.

Table 2 :
The error of dual method, LS method, and ridge estimate.

Table 3 :
The estimated value by dual method, LS method, and ridge estimate.

Table 4 :
The error of dual method, LS method, and ridge estimate.

Table 5 :
The basic parameters of ALOS satellite data.

Table 6 :
Computation time and  value and RMSE between rewrapped results and original wrapped phase.