Category: Mesos
-
A python notebook to experiment with the Apache Mesos HTTP API – Part 3 of 3
This is the third and final part of a three-part series: Part 1 describes the required setup and how to get Apache Mesos Master and Agent running in two Vagrant VMs; Part 2 shows how to connect to the HTTP API and accept resource offers. This series is an extended (and updated) version of the…
-
A python notebook to experiment with the Apache Mesos HTTP API – Part 2 of 3
This is the second part of a three-part series: Part 1 describes the required setup and how to get Apache Mesos Master and Agent running in two Vagrant VMs This series is an extended (and updated) version of the talk I gave at MesosCon Europe 2015 updated for Apache Mesos 1.0.0, which has just been…
-
A python notebook to experiment with the Apache Mesos HTTP API – Part 1 of 3
This is the first of a series of three articles that shows how to setup a Vagrant-based Apache Mesos test/development environment on your laptop; then how to run a Python notebook against the HTTP API; and finally, how to launch Docker containers on the running Agent VM. It is pretty jam-packed and requires a certain…
-
Apache Mesos Anonymous Module Example
Remote Commands Execution I have just published the code for a Mesos module to enable operators to execute remotely arbitrary commands on Apache Mesos Agent/Master nodes, out-of-band from the normal task execution framework. This is a Mesos anonymous module which can be loaded using the enclosed modules.json descriptor; this module will add HTTP endpoints such that: we can monitor…
-
Apache Mesos HTTP API – example IPython notebook
The new Apache Mesos HTTP API We are currently in the process of releasing Mesos 0.24 which introduces a new HTTP API for Frameworks, which are now able to interact with the Scheduler using only JSON payloads. This simplifies the interaction between Frameworks and Mesos, while maintaining the highly scalable and reliable nature of the platform:…
-
libprocess – an Actor-based inter-process communication library
Introduction to libprocess In Apache Mesos we make heavy use of the Actor model implemented in the libprocess library: the most recent implementation can be found under the 3rdparty folder in the Mesos repository (here). libprocess was created originally at Berkley by Benjamin Hindman who is also the original creator of Mesos and implements “an…
-
Annoying Java Popup when Testing Apache Mesos
Running unit tests for Apache Mesos, enabling Java (i.e., omitting the –disable-java flag in configure) you may run into the annoying “You need to install Java” popup, even though you have Java 8 correctly installed. The only workaround I’ve found so far (until I locate where in the test scripts we invoke the wrong version…