Stochastic Machine Scheduling to Minimize Waiting Time Related Objectives with Emergency Jobs

We consider a new scheduling model where emergency jobs appear during the processing of current jobs and must be processed immediately after the present job is completed. All jobs have randomprocessing times and should be completed on a singlemachine. The most common case of the model is the surgery scheduling problem, where some elective surgeries are to be arranged in an operation roomwhen emergency cases are coming during the operating procedure of the elective surgeries. Two objective functions are proposed to display this practice in machine scheduling problem. One is the weighted sum of the waiting times and the other is the weighted discounted cost function of the waiting times. We address some optimal policies to minimize these objectives.


Introduction
Machine scheduling problems have attracted researchers for decades since they play an important role in various applications from the areas of operations research, management science, and computer science.There are lots of works of the literature published on these problems.However, most of them study the deterministic case where all the information about jobs and machines is completed without any uncertainty; for example, job processing times are assumed to be exactly known in advance.But it is really hard to know the exact values of these parameters in practical situations and thus such an assumption is hardly justifiable.Instead, one sometimes can only roughly estimate the values of these parameters or their probability distributions.As Albert Einstein said, "As far as the laws of mathematics refer to reality, they are not certain, as far as they are certain, they do not refer to reality." In addition, the majority of machine scheduling problems studied in the literature assume that all jobs are prepared for processing before scheduling.In reality, however, it is a common phenomenon that new jobs may come randomly from time to time.The necessity to account for random coming of jobs is a key drive of developing stochastic approaches to scheduling problems.
In this paper, we study the single machine stochastic scheduling problem with emergency jobs.In our study, we focus on optimal policies to schedule current jobs with some objectives on a single machine when emergency jobs appear during the processing of current jobs and must be processed immediately after the present job is completed.All processing times of jobs are not known.The most common case of the model is the surgery scheduling problem, where some elective surgeries are to be arranged in an operation room when emergency cases are coming during the operating procedure of the elective surgeries.Those emergency cases must be operated as soon as possible.However, since the present surgery occupies the operation room, they should wait to operate until the current surgery is completed.
As indicated by Rothkopf and Smith [1], there are two basic classes of delay costs considered in scheduling problems.The first class includes linear costs, which consider no discount of the value of money over time, whereas the other class involves exponential functions to represent the discounts as a function of time.In our research, two objective functions are expected to minimize.One is the weighted sum of jobs' waiting time and the other is the weighted discounted function of jobs' waiting times.Our first objective belongs to the first class, while our second objective function belongs to the second class.We will give optimal policies to solve those problems.
The remainder of this paper is organized as follows.In Section 2, the related works of the literature will be reviewed.Notations and some definitions of the model are provided in Section 3.And specially, Section 3.1 investigates the optimal policy to schedule jobs with the objective to minimize the total weighted waiting time of jobs.The optimal policy for scheduling jobs to minimize the discount cost of the waiting time of jobs is included in Section 3.2.Concluding remarks and further research are presented in Section 4.

Literature Review
There has been an enormous amount of work on single machine scheduling.We do not intend to do a complete review of results in the area and restrict our attention to works of the literature directly related to the matter of this paper.
The first is scheduling jobs on machines minimizing the total weighted completion time of jobs.It has attracted a great deal of attention, partly because of its importance as a fundamental problem in scheduling and also because of new applications, for instance, in manufacturing, compiler optimization, and parallel computing.Researchers have studied it extensively in different environments, such as allowing different release times of jobs, multimachine scheduling, and online scheduling.We here just review the scheduling problem on a single machine and all jobs have the same release times.
Perhaps the most famous scheduling policy with this objective in the deterministic case is Smith's rule, also known as the WSPT (weighted shortest processing time) rule.It schedules jobs in the order of nonincreasing ratio {  /  }, where   denotes the deterministic processing time of job  and   is the weight assigned to job , and it is shown to be optimal for scheduling jobs on a single machine by Smith [2].Extending this rule to stochastic environment, firstly Rothkopf [4,5] develops the WSEPT (weighted shortest expected processing time) rule, which schedules jobs in the order of nonincreasing ratio {  /E[  ]}.Rothkopf [4,5] proves that the WSEPT rule is optimal for single machine scheduling with identical release dates.The technique adopted is to reduce the problem to the deterministic case by taking the expectations of the processing times.This policy, however, fails in the multimachine case with general processing times, even if the weights are identical; that is,   ≡ .For more details about this research, we refer readers to see [3].
Another stream related to our research is to minimize total weight discounted cost function, such as Rothkopf [4,5].Recently, Cai et al. [6] consider the problem of scheduling a set of jobs on a single machine subject to random breakdowns.They study the preemptive-repeat model, which addresses the situation where, if a machine breaks down during the processing of a job, the work done on the job prior to the breakdown is lost and the job will have to be started from the beginning again when the machine resumes its work.They obtain the optimal policy for a class of problems to minimize the expected discounted cost from completing all jobs.For more results in the area, see the survey [3].
What differentiates our paper from the above works of literature is that we consider a new scheduling problem where the emergency jobs are constantly coming and should be placed as soon as possible.To the best of our knowledge, there is no previous research studying this problem.Therefore, we open up a new research direction for the scheduling problem.In addition, different from previous works of the literature considering the completion time of jobs, we focus on the waiting time of jobs.It is more reasonable in our scheduling environment.

Models and Optimal Policies
We here consider the stochastic scheduling problem with emergency jobs.Specially, what we want to study is how to schedule current jobs on a single machine when emergency jobs appear during the processing of jobs and must be processed immediately after the present job is completed.Without loss of generality, in the following we assume that the emergent stream of jobs has a Poisson process with rate .The processing time   for the emergency job  is arbitrarily distributed with the mean .
Let  = {1, 2, . . ., } be a set of jobs to be processed nonpreemptively on a single machine.In other words, if a job starts to process, other jobs must wait to be processed until the present job is completed.Assume that the processing time   of current job  is a random variable.We denote   as the waiting time of job  and let   be the unit waiting cost of job .In the following, we will propose two objectives and study the optimal polices to minimize those functions.

Objective:
In this subsection, we will first focus on the objective function to minimize total weighted waiting cost, written as E[∑     ] for short.We here will address that the well-known policy in stochastic single machine scheduling, WSEPT, is also an optimal policy for our model.
Theorem 1. WSEPT, that is, sequencing jobs in nonincreasing order of   /E[  ], is an optimal nonpreemptive policy to minimize total weighted waiting cost.
Proof.Consider the schedule 1, 2, . . ., , denoted as Π.For the first job 1, its waiting time is 0. Based on the fact that new jobs' coming follows the Poisson process, it is easy to know that the expected number of emergency jobs, before job 2 starts to process, is (/(1 − ))E[ 1 ].Therefore, the expected waiting time of job 2 is (1 + /(1 − ))E[ 1 ], since each new job has mean processing time .Let   be the completion time of job .Similarly, we can obtain that Thus, we have Without loss of generality, we assume that jobs are ordered in nonincreasing order of If this sequence, denoted by Π for brevity, is not an optimal policy, there must exist job  in some optimal policy such that job  + 1 is processed before job .Without loss of generality, let 1, 2, . . .,  − 1,  + 1, ,  + 2, . . ., , denoted by Π  , be such optimal policy and we hence have Φ(Π) > Φ(Π  ).Comparing these two policies and observing that the waiting cost of jobs 1, 2, . . .,  − 1,  + 2, . . .,  is not changed, we obtain Therefore, Φ(Π) < Φ(Π  ), which leads to a contradiction.With the adjacent pairwise interchange, we can know that WSEPT is an optimal policy.This completes the proof.
Remarks.(1) In fact, the optimal policy for the objective with minimizing total expected waiting cost is equal to that with minimizing total expected completion time.This can be shown according to the following equation: It is well known that WSEPT optimally minimizes the total expected completion time for single machine problem, which coincides with the result we obtained.But here we consider a new scheduling model.Hence, this theorem extends the wellknown optimal policy to a new scheduling environment. ( The theorem shows that it is simple to construct the policy to minimize the total weighted waiting time of jobs.The only information for the optimal policy is the weight and the expected processing time of jobs, while the exact distribution of processing times of jobs is needed so as to obtain optimal policy with simple structure in most works of the literature in stochastic scheduling.

Objective:
In this section, we study the objective of weighted discounted cost of the waiting times; that is, Here  is the discount factor.Before giving the optimal policy for our model, we will release two lemmas.

Lemma 2. Consider
Proof.Let  be a random variable and be followed with Poisson distribution.We then have By multiplying   to both sides of the equality, we have The other lemma which will be used is stated as follows.
Proof.Since  is followed with Poisson distribution, we obtain We now can prove our second main theorem as follows.
Theorem 4. Sequencing jobs with the nonincreasing order of are an optimal policy to minimize the objective where Proof.Assume that 1, 2, . . .,  is a feasible schedule.Let   be the random variable that denotes the total time of processing job  and processing emergence jobs arriving during the processing of job .And let   denote the random variable as the number of emergence jobs during the processing of job .Observing that the emergence jobs arrive according to the Poisson distribution with rate , we know that random variable (  |   ) has a Poisson distribution with mean (/(1 − ))  .Thus, Based on the fact that all {  } = =1 are independent random variables, we thus can know that Therefore, the objective function under sequence  1 ,  2 , . . .,   results is Without loss of generality, we assume that jobs are ordered in nonincreasing order of   /(1 −   ); that is,  1 /(1 −  1 ) ≥  2 /(1− 2 ) ≥ ⋅ ⋅ ⋅ ≥   /(1−  ).If this sequence, denoted by Π, is not an optimal policy, there must exist  in some optimal policy such that job  + 1 is processed before job .Without loss of generality, let 1, 2, . . ., −1, +1, , +2, . . ., , denoted by Π  , be such optimal policy and we hence have Φ(Π) > Φ(Π  ).Comparing these two policies and observing that the waiting cost of jobs 1, 2, . . .,  − 1,  + 2, . . .,  is not changed, we obtain (13) Therefore, we have Φ(Π) < Φ(Π  ), which leads to a contradiction.With the adjacent pairwise interchange, we can know that nonincreasing order of   /(1 −   ) is an optimal policy.This completes the proof.
Remark.The structure of the optimal policy is a little complex comparing to the optimal policy in the last section.In addition to weight and processing time of jobs, this optimal policy is also related to the parameters ,  1 , .It is reasonable since the objective function is really complex.It is, however, also easy to calculate or estimate those values with the help of computer.Besides, if the processing time of current and emergent jobs is followed with some special distribution, the optimal policy will have very simple structure.One example is stated as follows.
Example.Assume that   ∼ exp(]  ) and   ∼ exp().We can easily calculate that It is easy to verify that the optimal policy sequences jobs in nonincreasing order of   (]  +  + (/( + ))).

Conclusions and Future Research
In this paper, we consider a new stochastic scheduling model based on the emergency jobs.We give optimal policies for two classes of objectives: one is the total waiting time of jobs and the other is the weighted sum of an exponential function of the waiting times.One can consider other objectives in scheduling area, such as the weighted number of late jobs.Specially, we can study the environment that each job  has a due date   , which follows the exponential distribution.We believe that it is reasonable to study this case.Taking the surgery scheduling as an example again, we can consider the due date for each elective surgery.One reason is that each elective surgery should have a due date to wait for operating.Otherwise, the patient will die or will leave to search for another hospital for help.The other reason is that in some sense this date can also be as the commitment to the patients.And sometimes this commitment is consistent with patients' condition.Therefore, it can be interpreted as a random variable.In addition, Denton et al. [7] consider the overtime to the model and study how case sequencing affects patient waiting time, operating room idling time (surgeon waiting time), and operation room overtime.Therefore, maybe we can study the objective which includes both the weighted number of late jobs and overtime: where   is the unit overtime cost, Δ  is the width of the th regular time, and   is the subset of cases scheduled in the th day.
Another direction we can study is to take the waiting cost of emergency jobs into consideration.The reason is that emergency surgery which cannot be treated in time will result in substantial losses.It reflects that the unit waiting time cost of emergency jobs is very large in the model.It, thus, is necessary to operate these cases as soon as possible.Clearly, sometimes it is nonsense if the new coming jobs follow the Poisson process, since its influence on the time line is the same.Thus, in this case, maybe we can take another distribution for the emergency jobs' coming.Sometimes it is reasonable since in practice emergency jobs' appearance is related to the timing.For example, Summala and Mikkola [8] show that the fatal accidents appear more frequently during 3am-5am and 2pm-3pm, which is very close to emergency surgeries.