Ridge Regression Method and Bayesian Estimators under Composite LINEX Loss Function to Estimate the Shape Parameter in Lomax Distribution

In this paper, the Ridge Regression method is employed to estimate the shape parameter of the Lomax distribution (LD). In addition to that, the approaches of both classical and Bayesian are considered with several loss functions as a squared error (SELF), Linear Exponential (LLF), and Composite Linear Exponential (CLLF). As far as Bayesian estimators are concerned, informative and noninformative priors are used to estimate the shape parameter. To examine the performance of the Ridge Regression method, we compared it with classical estimators which included Maximum Likelihood, Ordinary Least Squares, Uniformly Minimum Variance Unbiased Estimator, and Median Method as well as Bayesian estimators. Monte Carlo simulation compares these estimators with respect to the Mean Square Error criteria (MSE's). The result of the simulation mentioned that the Ridge Regression method is promising and can be used in a real environment. where it revealed better performance the than Ordinary Least Squares method for estimating shape parameter.


Introduction
Ridge Regression is a popular parameter estimation method for analyzing multiple regression data which has multicollinearity. When Multicollinearity happens, Least squares estimates are unbiased, but their variances are large. As a result, the estimator of the Ordinary Least Squares Method (OLS) becomes far from the true value. Ridge Regression decreases the standard errors when a degree of bias is added to the Regression Estimates. Several authors have addressed Ridge Regression as in [1][2][3][4][5][6][7][8][9][10].
e Lomax distribution (LD) is a proposed distribution of the Pareto distribution of type II; it was used to obtain a good model for biomedical problems. Also, it is an important model for modeling failure times. e Lomax distribution was used as a stochastic model with a decreasing failure rate for the operating times of the electronic vehicles under study. It was also used in studies related to income and studies related to the size of cities. As well as being a useful model in studying queuing theory and in analyzing data related to biostatistics.
Many theoretical and statistician's studies have given great interest to estimating the parameter and survival analysis of LD.
Al-Noor and Alwan [11] compared the Nonbayesian, Bayesian, and Empirical Bayes estimate for the parameters of the LD by considering the symmetric and asymmetric loss functions. Al-Duais and Hmood [12] compared the Bayesian estimators and Classical estimators to estimate the parameter and survival analysis depending on record values and by considering the SELF, LLF, and WLLF. Ellah [13] estimated the parameter, reliability, and hazard function of the LD by applying the Bayesian estimators and Classical estimators based on record values by considering the SELF and LLF. Asl et al. [14] applied the Bayesian estimators and Classical estimators of prediction on unidentified parameters of an LD based on a progressively type-I hybrid censoring scheme. Mohie El-Din et al. [15] studied the Classical estimations and Bayesian estimations of the LD based on progressively type-II censored samples and by considering symmetric (SELF) and asymmetric (LLF and GELF), Okasha [16] estimated the parameters, and survival analysis of the LD by applying the E-Bayesian estimators and Bayesian estimators under type-II censored data and by regarding the balanced squared error loss function. Liu and Zhang [17] studied the Bayesian and E-Bayesian estimations of the LD Based on the Generalized Type-I Hybrid Censoring Scheme. to estimate the unknown parameter of LD and by considering SELF and LLF to estimate the parameter and reliability function. Al-Bossly [18] developed a compound LINEX loss function (CLLF) to estimate the shape parameter of the Lomax distribution utilizing the E-Bayes and Bayes estimation methods for the distributional parameters of the LD.
In the current study, Ridge regression was employed to estimate the shape parameter of LD and compare it with the classical estimators which included Maximum Likelihood, Ordinary Least Squares, Uniformly Minimum Variance Unbiased Estimator, and Median Method as well as Bayesian estimators. e uniqueness of this work comes from the fact that, to date, no attempt has been made to estimate the shape parameter of the LD using the method of Ridge regression. e pdf of LD is given as follows [19]: where x is a random variable, and δ > 0, ϑ > 0 are the scale and shape parameters, respectively. e CDF and reliability function R(t) of (1) are given by the following equation:

MLE's of the Shape Parameter ϑ. Suppose that
x � x 1 , x 2 , . . . x n is a random sample from the LD as in (1), then the L(x |ϑ) for the sample observation will be as follows: e MLE's of ϑ denoted by ϑ MLE is given as follows:
e estimates α and β of the regression parameters, α and β minimize the function, erefore, the estimates β OLS of the parameter, β is given by the following equation: e estimate ϑ OLS of the parameter ϑ is given by the following equation: Computational Intelligence and Neuroscience

Ridge Regression Method.
Ridge Regression estimates can be obtained by minimizing the function.
According to the following constraint where ϕ is a definite positive constant. e Lagrange multiples method requires that we derive the following: erefore, the estimates α Rid and β Rid of the parameters, α and β are given by the following equation: and where ρ represents the number of parameter of the distribution and β ′ β represents the covariance matrix. NOT when λ � 0, we get the estimations of the OLS. e Ridge Regression estimate of ϑ denoted by ϑ Rid is given as follows:

UMVUE Estimator of the Shape Parameter ϑ.
e pdf of LD belongs to the exponential family. erefore, T � n i�1 ln(1 + (x i /δ)) is a complete sufficient statistic for ϑ. en, depending on the theorem of Lehmann-Scheffe [20], the uniformly minimum variance unbiased estimator ϑ UMVUE of ϑ, may be given by the following equation:

Median Method (M.M).
is method is dependent on the basis that the median divides the data into two equal parts By substituting into the cumulative distribution function defined by (2). e equation will become erefore, the estimates ϑ Med of ϑ, can be obtained as follows: where x med is the median of the data.

Prior Distribution.
e Bays estimators demand an appropriate selection of priors for the parameter. If we do not have sufficient knowledge about the parameter, in this case, the noninformative priors are better chosen. Or else, it Computational Intelligence and Neuroscience is desirable to use informative priors. In this research, we study both types of priors: informative priors and noninformative priors.

Non-Informative
Prior. Let us assume that ϑ has noninformative prior density defined as using extended Jeffrey's prior h 1 (ϑ) which is given by the following equation: where I(ϑ) represented Fisher information matrix which defined as follows:

Informative Priors ( e Natural Conjugate Prior).
In this work, three types of prior distributions were used to study the effect of the different prior distributions on a Bayesian estimate of ϑ.
(a) Chi-squared prior (b) Inverted levy prior (c) Gamma Prior

Posterior Density Functions.
e posterior distribution for the shape parameter ϑ can be expressed as follows: Combining the L(|x |ϑ) in (4) and the prior distribution of extended Jeffrey's prior (16), chi-square prior (17), inverted Levy prior (18), and gamma prior (19). e posterior density of ϑ It can be found on respectively as follows:

Loss Functions
In Bayes estimation, we will consider three types of loss functions including SELL, LLF, and CLLF.

Squared Error Loss Function.
e SELF is defined as follows [21]: e Bayes estimator of ϑ relative to SELF, signified by

LINEX Loss Function.
e LINEX loss function for ϑ can be written as follows [22,23]: e Bayes estimator of ϑ relative to LLF, denoted by ϑ BL is Provided that E ϑ � exp[− aϑ] exists and is finite, where E ϑ denotes the expected value.

Composite LINEX Loss
Function. CLLF is given by the following formula [24].

Simulation Study and Results
In this part, a simulation study has been conducted to assess and examine the behavior of Classical methods and Bayes estimators for the shape parameter of LD under different cases. e following steps of the simulation are as follows: (1) Set the true values for the parameters of LD which are varied into three cases to observe their effect on the estimates when δ > ϑ, δ � ϑ, and δ < ϑ "case I (δ � 2, ϑ � 1.5 ), case II (δ � 2, ϑ � 2 ) and case III (δ � 2, ϑ � 2.5 )" (2) Determine the sample size n � 20, 40, 60, 80 and 100 (3) Determine the value λ � 0.75, c � 0.5, (K, d) � (0.6, 0.2) and a � 0.5, 1 and 1.5  (4) For a given sample size n, generate x 1 , x 2 , . . . x n by using the following formula: (57) e results are displayed in the following Tables 1-5.

Conclusions and Recommendations
In this paper, the Ridge Regression method was employed to estimate the shape parameter of LD. (1) Among classical estimators, in Table 1, the performance of the UMVUE was shown as better than other estimators: "MLE, OLS, Ridge, and M.M estimators" in all different cases and all samples sizes. Whereas the performance of Ridge Regression was better than MLE. Estimator especially for a small sample size (n � 10). In the meanwhile, the results showed that the performance of the Ridge estimator was better than OLS estimator in all different cases and sample sizes. (2) With Bayes estimators, gamma prior records full appearance as best prior based on LLF and CLLF for all different cases and all sample sizes. As well as that is true under SELF with δ � ϑ and δ < ϑ , while extended Jeffrey's prior record as best prior based on SELF when δ > ϑ. (3) e MSE values associated with each of the classical and Bayes estimate "corresponding to each prior and every loss function" reduces with the increase in the sample size. Also, the results show a convergence between most of the estimators to increase the sample sizes and this conforms to the statistical theory. (4) For all cases and all sample sizes, LLF (a � 1.5) records full appearance as the best loss function associated with Bayes estimates corresponding to gamma prior. (5) According to the results, MSE values of all classical and Bayes estimators of shape parameters are decreasing as the shape parameter value increase. Data Availability e data used to support the findings of this study are available from the corresponding author upon request.

Conflicts of Interest
e authors declare that they have no conflicts of interest.