
Evaluating Streaming Algorithms 73
Figure 5.6: The evolution of signed McNemar statistic between two algo-
rithms. Vertical dashed lines indicate drift in data, and vertical lines indicate
when drift was detected. The left panel shows the evolution of the error rate
of two naive-Bayes variants: a standard one and a variant that detects and
relearns a new model whenever drift is detected. The right panel shows the
evolution of the signed McNemar statistic computed for these two algorithms.
2004; Koychev, 2000; Gama et al., 2004). One of the most referred is the
Page-Hinkley test (PH) (described in Section 3.2.2.2), a sequential analysis
technique typically ...