We currently use Mesos/Marathon for deploying containers on our infrastructure, see the
services repo for a list of services we deploy with Marathon.
Unfortunately, Marathon has proved less than ideal for us. It has mysterious downtime events, and too much control rests in the web interface, where we’d rather have as much configuration as possible in Git.
Kubernetes is an industry standard and well established alternative to Marathon that we should use. While there’s plenty of documentation for using Kubernetes, it’s rare for users to set up their own clusters-- they usually use a cloud offering (like Amazon’s EKS or Google’s GKE). We’ll have to figure out how to use puppetlabs-kubernetes to set up our cluster, and then migrate services over.
Kubernetes can also be used for more advanced workflows we’d like, such as cron-like scheduling. We could also use it to host containers for OCF users, possibly replacing our apphosting offering!
Services Still on Marathon