Solution of Higher-Order ODEs Using Backward Difference Method

The current numerical technique for solving a system of higher-order ordinary differential equations ODEs is to reduce it to a system of first-order equations then solving it using first-order ODE methods. Here, we propose a method to solve higher-order ODEs directly. The formulae will be derived in terms of backward difference in a constant stepsize formulation. The method developed will be validated by solving some higher-order ODEs directly with constant stepsize. To simplify the evaluations of the integration coefficients, we find the relationship between various orders. The result presented confirmed our hypothesis.


Introduction
Differential equations constantly arise in various branches of science and engineering.Many of these problems are in the form of higher-order ordinary differential equations ODEs .
A few examples where these problems can be found are, in the motion of projectiles, the bending of a thin clamped beam and population growth.
The popular practice for solving a system of higher-order ODEs is by reducing it to a system of first-order equations and then solving with first-order methods.These methods worked, so that methods for solving higher-order ODEs have been disregarded as robust codes.However, the work by Krogh 1 , Suleiman 2 , Majid and Suleiman 3 , and Omar and Suleiman 4 has revived the interest in solving higher-order ODEs directly and the theoretical development of the methods.
Related works for solving higher-order ODEs can be found in Collatz 5 , Gear 6 , Krogh 1, 7 , and Suleiman 2 .Krogh 7 proposed the direct integration DI method for nonstiff problems using modified divided difference while Suleiman 2 proposed the DI method using the standard divided difference.In this paper, we will derive the constant stepsize backward difference formulae of solving higher-order ODEs up to third order.The main reason for developing the constant stepsize formulae is that, in developing the theory on convergence and stability, the approach is through constant stepsize formulation.Another reason is that it is possible to use this formula in conjunction with other similar formulae as in Majid and Suleiman 3 to develop a code for variable stepsize and order.
The advantage of such a code is that the integration or differentiation constants are calculated only once at the start of the first step of integration, whereas other formulations calculate the constants at every step.
In this paper, we will focus only on nonstiff ODEs of the form where Y a η in the interval a ≤ x ≤ b and d is the order of the ODE.Without loss of generality, we will be considering the scalar equation in 1.1 .This paper will be organized as follows.First, the integration coefficients of the explicit constant stepsize backward difference formulation of the DI method will be derived.Then, the coefficients of the implicit method are formulated and their relationship with the explicit coefficients is shown.We start the derivation with the coefficients of the first-order system, which is given in Henrici 8 .Next, the second-order coefficients are derived and their relationship with the corresponding first-order coefficients is given, likewise the relationship of the coefficients for the second-and third-order systems.Finally, the method developed using backward difference will be validated numerically.

The Formulation of the Predict-Evaluate-Correct-Evaluate (PECE) Multistep Method in Its Backward Difference Form (MSBD) for Nonstiff Higher-Order ODEs
The code developed will be using the PECE mode.The predictor and corrector will have the following form: predictor:

2.2
The corrector will be reformulated, so that it will be in terms of the predictor.The reformulated corrector can be written as where pr f n 1 indicates f n 1 evaluated using predicted values.The integration coefficient γ d−t ,i and γ * d−t ,i will be derived using the method of generating function.Finally, the constant stepsize algorithm will be constructed and validated with some test problems and examples from physical situations.

Derivation up to Third-Order Explicit Integration Coefficients
Integrating 1.1 once yields y x n 1 y x n x n 1 x n f x, y, y , y dx.

3.1
Let P n x be the interpolating polynomial which interpolates the k values x n , f n , Next, approximating f in 3.1 with P n x and letting gives us where The generating function G 1 t for the coefficients γ 1,i is defined as follows: which leads to 3.9 Equation 3.9 can be written as Hence, the coefficients of γ 1,k are given by

Second-Order ODE Formulae
Integrate 1.1 twice for second-order ODEs where d 2. Integrating once leads to the same coefficients as given in 3.6 .Integrating twice yields The generating function G 2 t of the coefficients γ 2,i is defined as follows Substituting G 1 t into 4.4 yields Equation 4.5 can be written as Mathematical Problems in Engineering Hence the coefficients of γ 2,k in relation to coefficients of the previous order γ 1,k are given by

Third-Order Formulae
Next, the case of the third-order ODE where d 3 will be considered.In the case of y , y , the corresponding coefficients are γ 1,i , γ 2,i as in 3.6 and 4.2 .For the solution y x , integrating three times yields or in the backward difference formulation, given by where

5.3
The generating function G 3 t of the coefficients γ 3,i is defined as follows: As in 4. 4 , we now substitute G 2 t in 5.5 which gives Equation 5.6 can be written as Hence, the coefficients of γ 3,k in relation to coefficients of the previous order γ 2,k are given by , k 1, 2, . . . .5.9

Derivation up to the Third-Order Implicit Integration Coefficients
Integrating 1.1 once yields y x n 1 y x n x n 1 x n f x, y, y , y dx.

6.1
Let P n x be the interpolating polynomial which interpolates the k values x n , f n , As in the previous derivation, we choose Replacing x by s yields Mathematical Problems in Engineering Simplify The generating function G * 1 t of the coefficients γ * 1,i is defined as follows: which leads to For the case d 2, the approximate solution of y has the form x, y, y , y dx.

6.10
The coefficients are given by where γ * 2,i are the coefficients of the backward difference formulation of 6.11 which can be represented by The generating function G * 2 t for the coefficients γ * 2,i is defined as follows:  x n x n 1 − x 2 2 !f x, y, y , y dx.

6.16
The coefficients are given by γ * .17 where γ * 3,i are the coefficients of the backward difference formulation of 6.17 which can be represented by The generating function G * 3 t of the coefficients γ * 3,i is defined as follows:

6.19
Mathematical Problems in Engineering Substituting 6.17 into G * 3 t above yields e −s log 1−t ds.6.20 Solving 6.11 with the substitution of 6.20 produces the relationship 6.21

The Relationship between the Explicit and Implicit Integration Coefficients
Calculating the integration coefficients directly is time consuming when large numbers of integration are involved.A more efficient way of computing the coefficients is by obtaining a recursive relationship between the coefficients.With this recursive relationship, we are able to obtain the implicit integration coefficient with minimal time consumption.The relationship between the explicit and implicit coefficients is expressed below.For first-order coefficients, It can be written as By substituting

7.4
Expanding the equation yields

Mathematical Problems in Engineering 11
This gives the recursive relationship For second-order coefficient, It can be written as Substituting 7.4 into the equation above gives Substituting 4.5 into 7.10 gives

7.11
Expanding the equation, we have

7.12
The above gives the relationship For third-order coefficient, we have It can be written as Substituting 7.10 into 7.15 gives 7.17 Substituting

7.19
Expanding the equation into, which leads to a recursive relationship Tables 1 and 2 are a few examples of the explicit and implicit integration coefficients.

Numerical Results
For error calculations, we will be using the three error tests, namely, absolute error, relative error, and mixed error tests.The error formula is given by, Error Max x n y x n − y n A By x n , 8.1 where A 1, B 0 gives the absolute error test, A 0, B 1 gives the relative error test, and A 1, B 1 gives the mixed error test.In 8.1 , y x n is the exact solution for the problem considered and y n the computed solution.In a general code when the exact solution is not available for the relative error, y x n is replaced by y n the computed value.
When y x n − y n is small, the error in 8.1 will approximate the absolute error.However, when it is large, the mixed error test will approximate the relative error.The numerical results give the three errors.
The following notations hold MAX ABS: maximum error when using absolute error test, MAX MIX: maximum error when using mixed error test, MAX REL: maximum error when using relative error test, h: step size selected.
For the choice of problems to be tested, we choose four linear problems consisting of a second-and a third-order problem.The third problem is a mix system of second-and firstorder equations and the fourth problem is a system of three second-order equations.Our reason for choosing the linear problems is that if the formulae are correct, then they should solve linear problems.The choice of system of equations is to raise the degree of difficulty of solving the problems.The rest of the problems are nonlinear, which occur in physical situations.The choices of the physical problems are those with exact solutions known.We give our comments on the numerical results right after the numerical Tables 3, 4, 5, 6, 7, 8, and 9.This is a third-order problem with an exponential solution.The difference between Problems 1 and 2 is that one is third order and the other is second order.Again, absolute error test does not work for the same reason given above.

8.8
Solution 4. 8.9 Source: Bronson 9 .This problem is the symmetrical bending of a laterally loaded circular plate.
The numerical results of this problem show the failure to control the error using relative error test.This is because the solution is zero when x 2. Problem 6.
8.12 Solution 6. y 1 x cos x, y 2 x sin x.
For this problem, all error tests worked well.All the numerical results show that the errors in the mixed error mode give a reliable error estimate for all the problems given.The absolute error mode failed to give meaningful error results for Problems 1 and 2. This is because the value of y n increases as x increases and this becomes large.Similarly, for Problems 4, 5, and 6, the relative error failed to give an acceptable result because y n is small.
The research work done shows that the method developed for solving higherorder ODEs directly using the backward difference is successful.We recommend that, for multistep method, the error control procedure should use the mixed error test.This research suggests the potential of this work developing a robust code for solving higher-order ODEs directly.

Table 1 :
The explicit integration coefficients for k from 0 to 6.

Table 2 :
The integration coefficients for k from 0 to 6.

Table 3
This is a linear equation used byKrogh 7to test his code.The solution increases exponentially to a maximum value of y 64 64e 64 which is considered large and therefore not suitable for absolute error test and hence the large values of the error.

Table 7
This problem does not work for relative error test because of the small value of the solution for certain values of x.

Table 8
This problem is Newton's equations of motion for the two-body problem.Again, relative error test does not work too well for this problem because y n is very small at certain points x n .