Inference on backend servers
In today's world, distributed systems are everywhere. Ranging from the websites we browse to the apps that we use on our phones, hardly a day passes when we do not use distributed systems. Given this omnipresent nature, it is an obvious choice to adapt this paradigm for building machine learning systems. A typical pattern in building distributed systems is to perform resource-intensive (and data-sensitive) computations on backend servers whilst pushing lighter (and comparatively independent) compute tasks to the user's device. A large subset of machine learning applications falls into the resource-intensive category. Furthermore, machine learning models are built using data. In a significant fraction of real-world ...
Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.
Read now
Unlock full access