Apache Mesos

What is it ? Beyond Hadoop Resource Sharing Mesos Intentions Architecture Users

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz

Apache Mesos What is it ?

A cluster manager Provides resource isolation sharing Run distri!uted systems on the same pool o" nodes

Hadoop# Spar$# Storm# %en$ins# & '''

(luster monitoring via )e! UI *as$s isolated via +inu, (ontainers Scala!le -.$/s Written in (00 (00 %ava Python API/s "or ne) app dev

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz

Apache Mesos What is it ?

Its "ault tolerant

+eader election via 1oo &eeper +inu, # 2S3 # 2pen Solaris

Multi plat"orm

It is no) a "ull Apache pro4ect A Master Slave !ased system

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz

Apache Mesos Beyond Hadoop

What re5uirements are there !eyond Hadoop ?

(luster sharing multi tenancy Higher resource utili6ation 7aster response times Resource sharing A )ider range o" "unctionality More out o" the !o, "unctionality

8raphical (luster monitoring 8raphical drag and drop cluster manipulation

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz

Apache Mesos Resource Sharing

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz

Apache Mesos Intentions

Avoid multiple specialised clusters Avoid the need "or 9silo/ed: clusters Avoid the lo)er utili6ation that this !rings 2""er the a!ility "or multi tenancy Which o""ers

+o)er hard)are maintenance costs Higher utilisation Scala!ility Higher "ault tolerance

Program "or the ;ata (enter

info@semtech-solutions.co.nz

www.semtech-solutions.co.nz

Apache Mesos Architecture

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz

Apache Mesos Users

(ompanies using Mesos

Air !n! (loud Physics Hu!Spot Shopi"y *)itter <imeo Among many others

www.semtech-solutions.co.nz

info@semtech-solutions.co.nz

(ontact Us

7eel "ree to contact us at

)))'semtech=solutions'co'n6 in"o>semtech=solutions'co'n6

We o""er I* pro4ect consultancy We are happy to hear a!out your pro!lems ?ou can 4ust pay "or those hours that you need *o solve your pro!lems