## Problem 1

* Customers of two types arrive to a system according to independent Poisson processes with rates and , respectively. The system has two servers, each serving only one customer type with rates for customer type and for customer type . There is room for only one customer to wait in a queue which is shared by the two servers. When the queue position is occupied, arriving customers are lost.*

Let be a CTMC describing this process

- Define the state space.
- Write the balance equations.
- What is the long-run utilization of server ?

Let the state space be where the first symbol in each state denotes the buffer status, the second symbol denotes the status of server , and the third symbol the status of server . The generator matrix of transition rates is given by

The global balance equations are given by

The utilization of server is given by

## Problem 2

Consider a single server queue where customers arrive according to a Poisson process with intensity and request i.i.d. service times. The server is subject to failures and repairs. The lifetime of a working server is an random variable, while the repair time is an . random variable. Successive lifetimes and repair times are independent, and are independent of the number of customers in the queue. When the server fails, all the customers in the queue are forced to leave, and while the server is under repair no new customers are allowed to join. Model this as a CTMC.

- What is the state space?
- What are the balance equations? Show how to solve them.
- What is the long run fraction of time the server is idle but not operational?
- What fraction of incoming customers leave without service?

Let be a CTMC on state space with transition rates

The balance equations are

Since , we have and hence . It follows that

## Problem 3

Consider an M/M/1/2 queue with impatient customers. As soon as customer ’s sojourn time in the system exceeds , he/she leaves the system without receiving service. (Customers can leave the system even when they are in service.) Suppose that are i.i.d. random variables exponentially distributed with rate . Customers arrive with rate and the service rate is .

- Model this system as a CTMC and give the steady-state equations.
- Give an expression for the long-run average fraction of customers who are not admitted to the queue or choose to leave with either no service or incomplete service after they join.

Let be a CTMC on state space . Transitions to states and occur when a customer abandons. The transition rates are

The transition matrix of the embedded Markov chain is

Solving and yields

The long run fraction of customers who are not admitted is and the effective arrival rate is

The long run fraction of customers who abandon is

Adding this two quantities yields

the long run fraction of throughput lost.

## Problem 4

Customers arrive at a service station according to a Poisson process with rate . Servers arrive at this station according to an independent renewal process with i.i.d. interarrival times with mean and second moment . Each incoming server removes each of the waiting customers with probability in an independent fashion, and departs immediately. Let be the number of customers at the service station after the server departs, and let be the number of customers at the station at time .

- Show that is a DTMC.
- Compute the limiting value of as .
- Show that is a Markov regenerative process.
- Compute the limiting value of as .