Continuous evaluation
Once deployed, there are several ways in which this system may prove to be inaccurate or degrade over time:
- The streaming services (the Twitter API, Reddit API, and/or News API) might eventually fail to provide new posts and comments, due to rate limits, lost connections, or other issues.
- The sentiment detector might be inaccurate; this may be consistent (consistently lower or higher sentiment than the true sentiment), inconsistent (seemingly random decisions about sentiment), or degrading (sentiment becomes less accurate over time due to some change in the format of the inputs provided by the APIs).
- Feedback, in the form of tweets and posts and comments, related to our search terms may degrade over time; the search terms may ...
Get AI Blueprints now with the O’Reilly learning platform.
O’Reilly members experience books, live events, courses curated by job role, and more from O’Reilly and nearly 200 top publishers.
