Apache says:
Mesos is built using the same principles as the Linux kernel, only at a different level of abstraction. The Mesos
kernel runs on every machine and provides applications (e.g., Hadoop, Spark, Kafka, Elasticsearch) with API’s for
resource management and scheduling across entire datacenter and cloud environments.
Since kubernetes(k8s) is one of the most polular container arrangement framework, you can choose k8s as your resource and state-less applications run on it. Mesos(With Marathon) also could do this work as well. If container is all your want, k8s may your good option, otherwise, mesos could handle distribute big data system.
Install mesos is not that complicated than k8s in my opinion:
Download rpm
You can install mesos with yum or download rpm
In my case, i can't access internet, so the simple way is download rpm directly. If you want install by yum check here
Install rpm
yum install mesos-1.9.0-1.el7.x86_64.rpm
Run mesos on cluster
Mesos cluster require Zookeeper, check here to install
Run master:
mesos-master --work_dir=/var/lib/mesos --zk=zk://mesos-master:2181,mesos-agent:2181,mesos-agent-1:2181/mesos --quorum=2
Note: Your must remove /var/lib/mesos folder if you have run current server as master
rm -rf /var/lib/mesos
Run agent:
mesos-agent --containerizers=mesos,docker --work_dir=/var/lib/mesos --master=zk://mesos-master:2181,mesos-agent:2181,mesos-agent-1:2181/mesos
Note: the zk path "mesos" must pre-constructed and both master and agent the same.
Run in backgroup
Verify you installation
http://mesos-master:5050/#/agents
Note: You may need to config hosts to discard alerts