Dynamic Pricing and Production Control of an Inventory System with Remanufacturing

We consider optimal pricing andmanufacturing control of a continuous-review inventory systemwith remanufacturing. Customer demand and product return follow independent Poisson processes. Customer demand is filled by serviceable product, which can be either manufactured or remanufactured from the returned product. The lead times for both manufacturing and remanufacturing are exponentially distributed.Theobjective is tomaximize the expected total discounted profit over an infinite planning horizon.We characterize the structural properties of the optimal policy through the optimality equation. Specifically, the optimalmanufacturing policy is a base-stock policy with the base-stock level nonincreasing in the return inventory level.The optimal pricing policy is also a threshold policy, where the threshold level is nonincreasing in the return inventory level.


Introduction
With increasing awareness of sustainable development, and more stringent government regulations, companies are gradually switching focus from profits to triple bottom lines (profit, people, and planet) in their business operations.Remanufacturing, which converts used products into like-new ones, has gained momentum recently as it not only reduces waste and consumption of natural resources but also produces companies economic benefit by reducing production costs and increasing service levels.Meanwhile, governments in Europe and North America have established legislation to urge manufacturers to accept used products and carry out remanufacturing.Examples of remanufacturing programs include those of Caterpillar, IBM, Kodak, and Fuji-Xerox.
One operational challenge in remanufacturing is production planning and pricing management because of uncertain returned product numbers and customer demand volatility.In this paper, we consider optimal pricing and production control of a continuous-review, infinite-horizon inventory system with remanufacturing.Serviceable products that fill customer demand can be either manufactured or remanufactured from the returned products (also called "core").
The system keeps both serviceable product inventory and core inventory.Demand that cannot be satisfied by available serviceable inventory is backlogged.Lead times for both manufacturing and remanufacturing are exponentially distributed.The objective is to maximize the expected total discounted profit over an infinite planning horizon.We characterize the optimal policy through the optimality equation.Specifically, the optimal manufacturing policy follows a basestock policy with the base-stock level nonincreasing in the core inventory level.The optimal pricing policy is also a threshold policy with threshold level nonincreasing in the return inventory level.
Growth of the remanufacturing industry has stimulated extensive research in the field.Ferrer and Whybark [1], Guide [2], and Larson et al. [3] show that remanufacturing is environmentally friendly and economical.McConocha and Speh [4] note that firms benefit from remanufacturing through reduced production cost, reduced pollution, shortened production lead time, new market, and improved reputation.Our paper is closely related to prior studies on production planning and inventory control of remanufacturing systems.The related work can be divided into two streams: the periodic-review systems and the continuous-review systems.

Mathematical Problems in Engineering
Regarding periodic-review systems, Simpson [5] considers a system with zero remanufacturing and manufacturing lead times.The optimal control policy is shown to be characterized by constant thresholds.Inderfurth [6] subsequently extends Simpson's [5] work to models with positive lead times and shows that with equal and deterministic remanufacturing and manufacturing processing times, the optimal policy is the same as the zero lead time model.Zhou et al. [7] study a similar remanufacturing system but with multiple types of remanufacturable products.They derive that the optimal remanufacturing-manufacturing-disposal policy is characterized by a sequence of constant parameters.Tao et al. [8] further consider random yield in remanufacturing inventory systems.DeCroix and Zipkin [9] and DeCroix [10] study multiechelon inventory systems with returns.Our paper differs from such works in that we consider a continuousreview system rather than a periodic-review system.Furthermore, the literature on the periodic-review systems almost assumed that the lead times of the remanufacturing process and the manufacturing process are equal and deterministic.But our paper assumes that the remanufacturing process and the manufacturing process are stochastic and could not necessarily be equal.
Papers on continuous-review models mainly focus on performance evaluation.Heyman [11] and Muckstadt and Isacc [12] formulate the remanufacturing systems as queueing systems.Using the analysis of quasi-birth-and-death process, they obtain the stationary distributions of the systems.Van der Laan and Salomon [13] and Van der Laan et al. [14] consider the push and pull systems.DeCroix et al. [15] study an assemble-to-order system with return; they provide an algorithm to calculate the near-optimal base-stock level.Our paper differs from the previous literature in that we focus on exploring the structural properties of the optimal control policy rather than the performance evaluation.Kim et al. [16] consider a remanufacturing system with all the processes exponentially distributed.The final product is sold at a fixed price.They obtain the structural properties of the optimal policy, including optimal manufacturing, remanufacturing, and disposal policies.Our paper differs from their work in that we assume that the price of the final product is controllable.It could be sold at either high or low price based on the serviceable product inventory.We focus on exploring the optimal pricing and manufacturing strategy.
The remainder of this paper is organized as follows.We specify the model details in Section 2. In Section 3, we examine the structural properties of the value function and characterize the optimal control policies, concluding with a discussion on possible extensions in Section 4.

The Model
Consider a firm managing a hybrid inventory system with remanufacturing.The serviceable product that fills customer demand is either manufactured from new parts or remanufactured from returned products (also called core).We assume that customers feel indifferent whether a serviceable product is manufactured or remanufactured.This happens in remanufacturing of refillable containers, such as printer cartridges and single-use cameras.Return arrives randomly and follows a Poisson process with rate .We assume that return process is independent of the demand arriving process.This assumption is widely used in the previous literature; see Kim et al. [16] and references therein.The returns enter the system and are stocked at the core inventory waiting for remanufacturing.A cost ℎ  is incurred for holding one unit of core per unit time.The remanufacturing and manufacturing lead times are exponentially distributed with rates   and   , respectively.Let   and   denote the unit remanufacturing and manufacturing cost with   ≥   , which means that the remanufacturing is more cost-efficient.A completed product from remanufacturing or manufacturing process is stocked at the serviceable inventory and incurs a holding cost ℎ  per unit per unit time.The demand arrives according to a nonhomogeneous Poisson process with price-dependent arrival rate at that time.There are two sale prices: high price  1 and low price  2 , with corresponding arrival rates  1 and  2 .To make low price economically reasonable, we assume that  1 >  2 and  1 <  2 .Each customer requires only one unit of the serviceable product.The demand that cannot be satisfied immediately from the on-hand serviceable inventory is backlogged and incurs a backorder cost  per unit per unit time.Let which is defined as the marginal profit by changing the price from high to low.Furthermore, we require that  < /, which means that the marginal loss through raising price is smaller than the net value of backlogging an order, and thus it has incentive to rase the price.The firm controls both the manufacturing process and price with an aim to minimize the expected total discounted cost over an infinite planning horizon.Specifically, the manufacturing control characterizes whether to manufacture; the price decision controls the sale price of the serviceable product by observing the current inventory level.The model is illustrated in Figure 1.
Let ((), ()) be the system state, where () denotes the serviceable inventory level at time  and () denotes the core inventory level at time .Then the state space Ω, Ω = {(, ) :  ∈ ,  ∈  + }.The expected discounted total profit over an infinite planning horizon under a policy  with starting state (, ) can be calculated as where 0 ≤  < 1 is the discount factor, () denotes the price listed at time ,   () denotes the total demands up to time ,    () and    () denote the total numbers of manufacturing and remanufacturing products up to time , respectively; and ((), ()) denotes the sum of the holding cost of core products and serviceable products and backorder cost; that is, ((), ()

Remanufacturing queue Return
No, not to manufacture Yes, manufacture

Manufacturing control
Price control: high or low A policy  * is optimal if it satisfies To facilitate notation, we omit the superscript from   * (, ) to denote the optimal expected discounted total profit.Moreover, throughout the paper, we use "increasing" and "decreasing" in a nonstrict sense, that is, they mean "nondecreasing" and "nonincreasing," respectively.

Optimal Analysis
In this section, we aim to find the optimal pricing and manufacturing policies that minimize the long run expected discounted total cost.The exponential distributions of all processes facilitate our analysis.We formulate the system as a Markov decision process.Following Lippman [17], we rescale the time unit and let  +  1 +  2 +  +   +   = 1.Rewriting (2), we get the optimality equation given by where T, T  , T  and T  are operators; In (4), (, ) is the inventory holding cost and backorder cost; the remaining terms denote the expected discounted total profit from next epoch, at which system state changes.
Operator T  determines the sale price, high or low, while T  determines whether or not to manufacture.Note that the firm can remanufacture only when there are cores available; that is,  > 0. The following lemma follows directly from the optimality equation ( 4).
To facilitate the analysis of the structural properties of the optimal control policy, we define a function set V on the state space Ω; if a function (, ) ∈ V, then it satisfies the following properties: Lemma 2. If (, ) ∈ V, then T(, ) ∈ V.
Proof.For notational convenience, we introduce the following difference operators D, where D{(, )} = ( + 1, ) − (, ).It is easy to verify that the first two terms in (4) satisfy P1-P3.Therefore we only have to prove that operators T  , T  , and T  preserve properties P1-P3.
T  Preserves Properties P1-P3.It is easy to show that T  preserves P1-P3 when  ̸ = 0; therefore we only have to prove that T  preserves P1-P3 when  = 0.

P1. Consider
which is due to P1.
where the inequality is due to P1.

Case 2 (D{𝑉(𝑥
where the inequality is due to P1.

Case 3 (D{𝑉(𝑥
where the inequality is due to P1.
where the inequality is due to P2.
where the inequality is due to P3.

Case 3 (D{𝑉(𝑥
where the inequality is due to P3. The concavity property posits that the marginal profit of serviceable inventory is decreasing.The submodularity of (, ) implies that the serviceable inventory and the core inventory are substitutable to each other.
After deriving the structural properties of (, ), we can now characterize the optimal policy in the following theorem.Theorem 3 shows that the optimal control policy is statedependent.If it is optimal to manufacture in state (,  + 1), then it is still optimal to manufacture in state (, ), but one unit decrease in the core inventory leads to at most one unit increase in the manufacturing base-stock level.This implies that manufacturing control policy depends on the core inventory level.The core inventory and the serviceable inventory are substitutable.The reason is that due to the stochastic of the manufacturing and return processes the core inventory may be restored to the original level during the manufacturing process.It is optimal to set high price when the serviceable inventory level is lower than the threshold level.The threshold level is decreasing at the core inventory level, meaning that if it is optimal to set a high price in state (, ), it is still optimal to adopt a high price when the core inventory level is lower than .

Conclusions
We consider a continuous-review inventory system, in which the serviceable product can be either manufactured or remanufactured from the returned product.The system keeps both serviceable and returned product inventory.The lead times of manufacturing and remanufacturing are exponentially distributed.We show that the value function preserves properties P1-P3 and characterizes the optimal pricing and manufacturing policies.Different from the previous literature, we consider pricing decision.The optimal control policy of our model depends on the core inventory level.Specifically, the optimal pricing control policy is the threshold-type policy with threshold level nonincreasing in the core inventory level.The optimal manufacturing control policy is the basestock policy with base-stock level nonincreasing in the core inventory.
One possible extension is to consider multiple prices.In this case, the selling price of the serviceable product is chosen among {  ,  = 1, . . ., } with  1 >  2 > ⋅ ⋅ ⋅ >   > ⋅ ⋅ ⋅ >   .The associated demand arrival rates are {  ,  = 1, . . ., } with  1 <  2 < ⋅ ⋅ ⋅ <   < ⋅ ⋅ ⋅ <   .To facilitate analysis, we further assume that We can again show that (, ) preserves properties P1-P3 and characterizes the optimal control policy.For brevity, we ignore the details here.The optimal manufacturing policy possesses a similar structure as the two price cases, while the optimal pricing control policy is given in the following theorem.
There are other research directions worth exploring.First, we can study models with correlated demand and product return processes.This will increase the state space and make the analysis more challenging.Second, the product return is not controllable in our model.We can incorporate and examine the return product acquisition effort decision.Finally, the present model assumes that the remanufactured and manufactured products are the same to customers.But, in some cases, the remanufactured and manufactured products are treated as two different products and sold at different prices.The firm can expand the market share by selling the remanufactured products at a lower price in the low-end market, even though the remanufactured products perform exactly the same function as the new products.In this case, we need to model customer demand by considering how customers choose between these two products.And pricing decisions can be incorporated.