(a) Let $S_{k}$ be the sum of $k$ independent exponential random variables of rate $k \mu$. Compute the moment generating function $\phi_{S_{k}}(\theta)=\mathbb{E} e^{\theta S_{k}}$ of $S_{k}$. Show that, as $k \rightarrow \infty$, functions $\phi_{S_{k}}(\theta)$ converge to a limit. Describe the random variable $S$ for which the limiting function $\lim _{k \rightarrow \infty} \phi_{S_{k}}(\theta)$ coincides with $\mathbb{E} e^{\theta S}$.

(b) Define the $M / G / 1$ queue with infinite capacity (sometimes written $M / G / 1 / \infty$ ). Introduce the embedded discrete-time Markov chain $\left(X_{n}\right)$ and write down the recursive relation between $X_{n}$ and $X_{n-1}$.

Consider, for each fixed $k$ and for $0<\lambda<\mu$, an $\mathrm{M} / \mathrm{G} / 1 / \infty$ queue with arrival rate $\lambda$ and with service times distributed as $S_{k}$. Assume that the queue is empty at time 0 . Let $T_{k}$ be the earliest time at which a customer departs leaving the queue empty. Let $A$ be the first arrival time and $B_{k}=T_{k}-A$ the length of the busy period.

(c) Prove that the moment generating functions $\phi_{B_{k}}(\theta)=\mathbb{E} e^{\theta B_{k}}$ and $\phi_{S_{k}}(\theta)$ are related by the equation

$$\phi_{B_{k}}(\theta)=\phi_{S_{k}}\left(\theta-\lambda\left(1-\phi_{B_{k}}(\theta)\right)\right)$$

(d) Prove that the moment generating functions $\phi_{T_{k}}(\theta)=\mathbb{E} e^{\theta T_{k}}$ and $\phi_{S_{k}}(\theta)$ are related by the equation

$$\frac{\lambda-\theta}{\lambda} \phi_{T_{k}}(\theta)=\phi_{S_{k}}\left((\lambda-\theta)\left(\phi_{T_{k}}(\theta)-1\right)\right)$$

(e) Assume that, for all $\theta<\lambda$,

$$\lim _{k \rightarrow \infty} \phi_{B_{k}}(\theta)=\mathbb{E} e^{\theta B}, \quad \lim _{k \rightarrow \infty} \phi_{T_{k}}(\theta)=\mathbb{E} e^{\theta T},$$

for some random variables $B$ and $T$. Calculate $\mathbb{E} B$ and $\mathbb{E} T$. What service time distribution do these values correspond to?