Apache says:

Mesos is built using the same principles as the Linux kernel, only at a different level of abstraction. The Mesos
kernel runs on every machine and provides applications (e.g., Hadoop, Spark, Kafka, Elasticsearch) with API’s for
resource management and scheduling across entire datacenter and cloud environments.

Since kubernetes(k8s) is one of the most polular container arrangement framework, you can choose k8s as your resource and state-less applications run on it. Mesos(With Marathon) also could do this work as well. If container is all your want, k8s may your good option, otherwise, mesos could handle distribute big data system.

Install mesos is not that complicated than k8s in my opinion:

Download rpm

You can install mesos with yum or download rpm

In my case, i can't access internet, so the simple way is download rpm directly. If you want install by yum check here

Install rpm

yum install mesos-1.9.0-1.el7.x86_64.rpm

Run mesos on cluster

Mesos cluster require Zookeeper, check here to install

Run master:

mesos-master --work_dir=/var/lib/mesos --zk=zk://mesos-master:2181,mesos-agent:2181,mesos-agent-1:2181/mesos --quorum=2

Note: Your must remove /var/lib/mesos folder if you have run current server as master

rm -rf /var/lib/mesos

Run agent:

mesos-agent --containerizers=mesos,docker --work_dir=/var/lib/mesos --master=zk://mesos-master:2181,mesos-agent:2181,mesos-agent-1:2181/mesos

Note: the zk path "mesos" must pre-constructed and both master and agent the same.

Run in backgroup

Auto-Start Service

Verify you installation


Note: You may need to config hosts to discard alerts