Systems that Defy Understanding — In such systems, we must resort to empirical methods. Instead of reasoning about the system and reading the source to answer questions, we find ways to ask questions about the running system. We can perform such queries by looking at existing logs and metrics, or by adding new instrumentation.
TextFooler — a model for natural language attack on text classification and inference.