HIGHER-ORDER EXPERIMENTAL DESIGNS
The two principal weaknesses of the analysis of variance are as follows:
When we randomly assign subjects (or plots) to treatment, we may inadvertently assign all males, say, to one of the treatments. The result might be the illusion of a treatment effect that really arises from a sex effect. For example, the following table
suggests there exists a statistically significant difference between treatments.
But suppose, we were to analyze the same data correcting for sex and obtain the following:
We longer observe a statistically significant difference between treatment groups.
Errors in Interpretation
As noted previously, one of the most common statistical errors is to assume that because an effect is not statistically significant it does not exist. One of the most common errors in using the analysis of variance is to assume that because a factor such as sex does not yield a significant p-value that we may eliminate it from the model. Had we done so in the above example, we would have observed a statistically ...