Skip to Content
Building Applications on Mesos
book

Building Applications on Mesos

by David Greenberg
December 2015
Intermediate to advanced
225 pages
4h 19m
English
O'Reilly Media, Inc.
Content preview from Building Applications on Mesos

Chapter 5. Building a Mesos Executor

Now you’ve seen how to build a scheduler for Mesos. However, there are some things that can’t be done with the scheduler API alone. For instance, perhaps you’d like to run several tasks in the same container. Maybe your application has lifecycle messages for the scheduler, reporting on its progress or application-specific statistics. Or perhaps you’d like to layer additional functionality into the executed task. In order to accomplish these things, you need to write a custom Mesos executor.

This is what we’ll learn how to do in this chapter. Initially, we’ll simply provide the functionality of the built-in CommandExecutor, which we learned about at the end of the last chapter. Then, we’ll add support for heartbeats to enable faster failure detection. Finally, we’ll discuss potential designs for progress reporting, improved logging, and running multiple tasks in the same container.

The Executor

We’ve already learned what a scheduler is: it’s the component that interacts with the Mesos masters and the framework’s clients, manages the running tasks, and handles failovers. But what is an executor? An executor has three responsibilities:

  • Executing tasks as requested by the scheduler

  • Keeping the scheduler informed of the status of those tasks

  • Handling other requests from the scheduler

You Probably Don’t Want to Do This

Writing executors is very tedious. Unfortunately, the only way to test whether the communication between your scheduler ...

Become an O’Reilly member and get unlimited access to this title plus top books and audiobooks from O’Reilly and nearly 200 top publishers, thousands of courses curated by job role, 150+ live events each month,
and much more.

Read now

Unlock full access

More than 5,000 organizations count on O’Reilly

AirBnbBlueOriginElectronic ArtsHomeDepotNasdaqRakutenTata Consultancy Services

QuotationMarkO’Reilly covers everything we've got, with content to help us build a world-class technology community, upgrade the capabilities and competencies of our teams, and improve overall team performance as well as their engagement.
Julian F.
Head of Cybersecurity
QuotationMarkI wanted to learn C and C++, but it didn't click for me until I picked up an O'Reilly book. When I went on the O’Reilly platform, I was astonished to find all the books there, plus live events and sandboxes so you could play around with the technology.
Addison B.
Field Engineer
QuotationMarkI’ve been on the O’Reilly platform for more than eight years. I use a couple of learning platforms, but I'm on O'Reilly more than anybody else. When you're there, you start learning. I'm never disappointed.
Amir M.
Data Platform Tech Lead
QuotationMarkI'm always learning. So when I got on to O'Reilly, I was like a kid in a candy store. There are playlists. There are answers. There's on-demand training. It's worth its weight in gold, in terms of what it allows me to do.
Mark W.
Embedded Software Engineer

You might also like

Mastering Mesos

Mastering Mesos

Akhil Das, Dipa Dubhashi
Mesos in Action

Mesos in Action

Roger Ignazio
Cool Tools in the Kitchen

Cool Tools in the Kitchen

Kevin Kelly, Steven Leckart
Food Frying

Food Frying

Alam Zeb

Publisher Resources

ISBN: 9781491926543Errata Page