Advances in Mobile Cloud Computing Systems

Cloud Radio Access Networks in Mobile Cloud Computing Systems 279

of decision making, the available CSI is delayed. We can abstract the

total delay between the actual channel state at the moment of deci-

sion making and the one of observation as one single number. Then,

we can map the delay in seconds into the transition steps in Markov

chains. Therefore, the d-step transition probability is given by multi-

plying matrix A by d times, A

d

.

8.3.2 Belief State with Known Delay Steps

Given the delay in steps, we can derive the belief state, which is the

sufficient statistic of the previous action and observation history [17].

A belief state b

t

at time slot