Keynote: Operating 600+ Mesos Servers on 7 Datacenters @Criteo - Pierre Cheynier Oct. 31, 2017

from The Linux Foundation·

Keynote: Operating 600+ Mesos Servers on 7 Datacenters @Criteo - Pierre Cheynier, Operations Engineer, Criteo Given the nature of its business, Criteo has a tremendous need for scalability. Historically based on bare-metal infrastructure and serving billions of user requests per day with the lowest latencies, we will present how Mesos became a first-class citizen on our platform. In this talk, we will describe how we deploy and operate 600+ Mesos agents, hosting hundreds of applications and handling up to 200K requests per second, with up to 40Gbps of outgoing traffic. We'll mostly focus on net/dev/ops concerns, like how we dealt …



Keynote: Operating 600+ Mesos Servers on 7 Datacenters @Criteo - Pierre Cheynier, Operations Engineer, Criteo Given the nature of its business, Criteo has a tremendous need for scalability. Historically based on bare-metal infrastructure and serving billions of user requests per day with the lowest latencies, we will present how Mesos became a first-class citizen on our platform. In this talk, we will describe how we deploy and operate 600+ Mesos agents, hosting hundreds of applications and handling up to 200K requests per second, with up to 40Gbps of outgoing traffic. We'll mostly focus on net/dev/ops concerns, like how we dealt with configuration management, app secrets, logging, service discovery, networking, metrology and SLAs, tests, etc. The aim of this presentation is to share what we have learnt during this long journey of setting up a production-grade Mesos infrastructure from scratch and what we expect from it in a near future. About Pierre Cheynier Pierre Cheynier is an Operations Engineer at Criteo, a world leader in performance advertising. As a SRE since 2015, he mainly focuses on automating deployment, troubleshooting and providing support to developers on Mesos clusters and a very large legacy Windows / C# infrastructure. Prior to working at Criteo, Pierre worked in the IPTV field for a French ISP, where he also introduced and deployed Mesos.