There is some special code handling in the automatic connectivity of the cubes, but we won't be going over it. Those readers that want to extend this example are encouraged to explore the code further. For our purposes, however, the only main thing we need to look at is the changes in the Decision script. Locate the ConnectedDecision script in the Assets/Simple folder and double click on it to open it in your editor to follow along with these steps:
- At the top, we have the following declarations:
public float learningRate = .9f; public float gamma = .9f; public float explorationEpsilon = .9f; private float q; private int lastAction, lastState; private int action;
- You can see that ...