ChapterÂ 16.Â How to Feed and Care for Your Machine-Learning Experts
Machine learning is a craft as well as a science, and for the best results youâll often need to turn to experienced specialists. Not every team has enough interesting problems to justify a full-time machine-learning position, though. As the value of the approach becomes better-known, the demand for part-time or project-based machine-learning work has grown, but itâs often hard for a traditional engineering team to effectively work with outside experts in the field. Iâm going to talk about some of the things I learned while running an outsourced project through Kaggle, a community of thousands of researchers who participate in data competitions modeled on the Netflix Prize. This was an extreme example of outsourcing: we literally handed over a dataset, a short description, and a success metric to a large group of strangers. It had almost none of the traditional interactions youâd expect, but it did teach me valuable lessons that apply to any interactions with machine-learning specialists.
Define the Problem
My company Jetpac creates a travel magazine written by your friends, using vacation photos theyâve shared with you on Facebook and other social services. The average user has had over two hundred thousand pictures shared with them, so we have a lot to choose from. Unfortunately, many of them are not very good, at least for our purposes. When we showed people our prototype, most would be ...