You are on page 1of 23

High Scalability - http://highscalability.

com/

COPYRIGHT © 2018, TODD HOFF. ALL RIGHTS RESERVED.

RECENT

POSTS

Sponsored

Post:

PA

File

Sight,

Etleap,

PerfOps,

InMemory.Net,

Triplebyte,

Stream,

Scalyr

2019

Open

Source

Database

Report:

Top

Databases,

Public

Cloud

vs.

On-
advertise
Premise,

Polyglot

Persistence
Login
Sponsored
Register
Post:

Etleap,

PerfOps,

High InMemory.Net,

Scalability Triplebyte,

RSS Stream,

High Scalyr

Scalability Gone

Comments Fishin'

RSS Sponsored

Post:

PerfOps,

1 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

InMemory.Net,

Triplebyte,

Etleap,

Stream,

Scalyr

Stuff

The

Internet

Says

On

Scalability

For

May

10th,

2019

Stuff

The

Internet

Says

On

Scalability

For

May

3rd,

2019

Stuff

The

Internet

Says

On

Scalability

For

April

26th,

2019

Stuff

The

Internet

Says

On

Scalability

For

April

19th,

2019

MySQL

High

Availability

Framework

Explained

2 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Part

III:

Failover

Scenarios

Thursday
Jun272019

Sponsored Post: PA File


Sight, Etleap, PerfOps,
InMemory.Net, Triplebyte,
Stream, Scalyr
THURSDAY, JUNE 27, 2019 AT 9:37AM

Who's Hiring?
Triplebyte lets exceptional software
engineers skip screening steps at hundreds
of top tech companies like Apple, Dropbox,
Mixpanel, and Instacart. Make your job
search O(1), not O(n). Apply here.

Need excellent people? Advertise your job


here!

Cool Products And Services


PA File Sight - Actively protect servers from
ransomware, audit file access to see who is
deleting files, reading files or moving files, and
detect file copy activity from the server. Historical
audit reports and real-time alerts are built-in. Try
the 30-day free trial!

For heads of IT/Engineering responsible for


building an analytics infrastructure, Etleap is an
ETL solution for creating perfect data pipelines
from day one. Unlike older enterprise solutions,
Etleap doesn’t require extensive engineering work
to set up, maintain, and scale. It automates most
ETL setup and maintenance work, and simplifies
the rest into 10-minute tasks that analysts can own.
Read stories from customers like Okta and
PagerDuty, or try Etleap yourself.

PerfOps is a data platform that digests real-time


performance data for CDN and DNS providers
as measured by real users worldwide. Leverage
this data across your monitoring efforts and
integrate with PerfOps’ other tools such as Alerts,

3 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Health Monitors and FlexBalancer – a smart


approach to load balancing. FlexBalancer makes it
easy to manage traffic between multiple CDN
providers, API’s, Databases or any custom
endpoint helping you achieve better performance,
ensure the availability of services and reduce
vendor costs. Creating an account is Free and
provides access to the full PerfOps platform.

InMemory.Net provides a Dot Net native in


memory database for analysing large amounts of
data. It runs natively on .Net, and provides a native
.Net, COM & ODBC apis for integration. It also has
an easy to use language for importing data, and
supports standard SQL for querying
data. http://InMemory.Net

Build, scale and personalize your news feeds and


activity streams with getstream.io. Try the API now
in this 5 minute interactive tutorial. Stream is free
up to 3 million feed updates so it's easy to get
started. Client libraries are available for Node,
Ruby, Python, PHP, Go, Java and .NET. Stream is
currently also hiring Devops and Python/Go
developers in Amsterdam. More than 400
companies rely on Stream for their production feed
infrastructure, this includes apps with 30 million
users. With your help we'd like to ad a few zeros to
that number. Check out the job opening
on AngelList.

Scalyr is a lightning-fast log management and


operational data platform. It's a tool (actually,
multiple tools) that your entire team will love. Get
visibility into your production issues without juggling
multiple tabs and different services -- all of your
logs, server metrics and alerts are in your browser
and at your fingertips. . Loved and used by teams
at Codecademy, ReturnPath, Grab, and
InsideSales. Learn more today or see why Scalyr is
a great alternative to Splunk.

Advertise your product or service here!

Fun And Informative Events


Advertise your event here!

If you are interested in a sponsored post for an event,


job, or product, please contact us for more

4 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

information.

PA File Sight Monitors File


Access On A Server In Real-
time.
It can track who is accessing what, and with that
information can help detect file copying, detect (and stop)
ransomware attacks in real-time, and record the file
activity for auditing purposes. The collected audit records
include user account, target file, the user’s IP address
and more. This solution does NOT require Windows
Native Auditing, which means there is no performance
impact on the server. Join thousands of other satisfied
customers by trying PA File Sight for yourself. No sign up
is needed for the 30-day fully functional trial.

Make Your Job Search O(1) —


Not O(n)
Triplebyte is unique because they're a team of engineers
running their own centralized technical assessment.
Companies like Apple, Dropbox, Mixpanel, and
Instacart now let Triplebyte-recommended engineers
skip their own screening steps.

We found that High Scalability readers are about 80%


more likely to be in the top bracket of engineering skill.

Take Triplebyte's multiple-choice quiz (system design and


coding questions) to see if they can help you scale your
career faster.

The Solution To Your


Operational Diagnostics Woes
Scalyr gives you instant visibility of your production
systems, helping you turn chaotic logs and system
metrics into actionable data at interactive speeds. Don't
be limited by the slow and narrow capabilities of
traditional log monitoring tools. View and analyze all your
logs and system metrics from multiple sources in one
place. Get enterprise-grade functionality with sane pricing
and insane performance. Learn more today.

If you are interested in a sponsored post for an event,


job, or product, please contact us for more information.

Todd Hoff | Post a Comment | Permalink | Share Article Print Article Email

Article

in sponsored post

Thursday

5 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Like 6 people like this. Be the first of your friends.

Tweet Jun272019

2019 Open Source Database


Report: Top Databases,
Public Cloud Vs. On-
Premise,
Polyglot Persistence
THURSDAY, JUNE 27, 2019 AT 9:33AM

Ready to transition from a commercial database to open


source, and want to know which databases are most
popular in 2019? Wondering whether an on-premise vs.
public cloud vs. hybrid cloud infrastructure is best for your
database strategy? Or, considering adding a new
database to your application and want to see which
combinations are most popular? We found all the
answers you need at the Percona Live event last month,
and broke down the insights into the following free trends
reports:

Click to read more ...

Kristi Anderson | Post a Comment | Permalink | Share Article Print Article

Email Article

tagged Azure, Db2, Google Cloud Platform, MariaDB, MongoDB, SQL Server,

aws, database, mysql, oracle, postgresql, redis in AWS, ClickHouse,

Database, DevOps, HBase, Memcached, MongoDB, MySQL, Oracle,

Postgres, RDBMS, Redis, Redis Cluster, Statistics, best platform, cassandra,

cloud, cloud computing, cluster, data, data management, databases, db2,

deployment, enterprise, google, hosting, hybrid, management, mysql cluster,

nosql, open source, postgresql, private cloud, public cloud, sql, sql server

2008

Like 21 people like this. Be the first of your friends.

Tweet

Tuesday

6 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Jun042019

Sponsored Post: Etleap,


PerfOps, InMemory.Net,
Triplebyte, Stream, Scalyr
TUESDAY, JUNE 4, 2019 AT 8:54AM

Who's Hiring?

Triplebyte lets exceptional software


engineers skip screening steps at hundreds
of top tech companies like Apple, Dropbox,
Mixpanel, and Instacart. Make your job
search O(1), not O(n). Apply here.

Need excellent people? Advertise your job


here!

Fun And Informative Events


Advertise your event here!

Cool Products And Services


For heads of IT/Engineering responsible for
building an analytics infrastructure, Etleap is an
ETL solution for creating perfect data pipelines
from day one. Unlike older enterprise solutions,
Etleap doesn’t require extensive engineering work
to set up, maintain, and scale. It automates most
ETL setup and maintenance work, and simplifies
the rest into 10-minute tasks that analysts can own.
Read stories from customers like Okta and
PagerDuty, or try Etleap yourself.

PerfOps is a data platform that digests real-time


performance data for CDN and DNS providers
as measured by real users worldwide. Leverage
this data across your monitoring efforts and
integrate with PerfOps’ other tools such as Alerts,
Health Monitors and FlexBalancer – a smart
approach to load balancing. FlexBalancer makes it
easy to manage traffic between multiple CDN
providers, API’s, Databases or any custom
endpoint helping you achieve better performance,
ensure the availability of services and reduce
vendor costs. Creating an account is Free and
provides access to the full PerfOps platform.

InMemory.Net provides a Dot Net native in


memory database for analysing large amounts of

7 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

data. It runs natively on .Net, and provides a native


.Net, COM & ODBC apis for integration. It also has
an easy to use language for importing data, and
supports standard SQL for querying
data. http://InMemory.Net

Build, scale and personalize your news feeds and


activity streams with getstream.io. Try the API now
in this 5 minute interactive tutorial. Stream is free
up to 3 million feed updates so it's easy to get
started. Client libraries are available for Node,
Ruby, Python, PHP, Go, Java and .NET. Stream is
currently also hiring Devops and Python/Go
developers in Amsterdam. More than 400
companies rely on Stream for their production feed
infrastructure, this includes apps with 30 million
users. With your help we'd like to ad a few zeros to
that number. Check out the job opening
on AngelList.

Scalyr is a lightning-fast log management and


operational data platform. It's a tool (actually,
multiple tools) that your entire team will love. Get
visibility into your production issues without juggling
multiple tabs and different services -- all of your
logs, server metrics and alerts are in your browser
and at your fingertips. . Loved and used by teams
at Codecademy, ReturnPath, Grab, and
InsideSales. Learn more today or see why Scalyr is
a great alternative to Splunk.

Advertise your product or service here!

If you are interested in a sponsored post for an event,


job, or product, please contact us for more
information.

Make Your Job Search O(1) —


Not O(n)
Triplebyte is unique because they're a team of engineers
running their own centralized technical assessment.
Companies like Apple, Dropbox, Mixpanel, and
Instacart now let Triplebyte-recommended engineers
skip their own screening steps.

We found that High Scalability readers are about 80%


more likely to be in the top bracket of engineering skill.

Take Triplebyte's multiple-choice quiz (system design and


coding questions) to see if they can help you scale your
career faster.

8 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

The Solution To Your


Operational Diagnostics Woes
Scalyr gives you instant visibility of your production
systems, helping you turn chaotic logs and system
metrics into actionable data at interactive speeds. Don't
be limited by the slow and narrow capabilities of
traditional log monitoring tools. View and analyze all your
logs and system metrics from multiple sources in one
place. Get enterprise-grade functionality with sane pricing
and insane performance. Learn more today.

If you are interested in a sponsored post for an event,


job, or product, please contact us for more information.

Todd Hoff | Post a Comment | Permalink | Share Article Print Article Email

Article

in sponsored post

Like 4 people like this. Be the first of your friends.

Tweet

Friday
May172019

Gone Fishin'
FRIDAY, MAY 17, 2019 AT 7:29AM

Well, not exactly Fishin', but I'll be on a month long


vacation starting today. I won't be posting new content, so
we'll all have a break. Disappointing, I know. Please use
this time for quiet contemplation and other inappropriate
activities.

If you really need a not so quick fix there's always the


back catalog of Stuff the Internet Says. Odds are there's
a lot you didn't read—yet.

Todd Hoff | Post a Comment | Permalink | Share Article Print Article Email

9 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Article

Like 7 people like this. Be the first of your friends.

Tweet

Tuesday
May142019

Sponsored Post: PerfOps,


InMemory.Net, Triplebyte,
Etleap, Stream, Scalyr
TUESDAY, MAY 14, 2019 AT 11:00AM

Who's Hiring?

Triplebyte lets exceptional software


engineers skip screening steps at hundreds
of top tech companies like Apple, Dropbox,
Mixpanel, and Instacart. Make your job
search O(1), not O(n). Apply here.

Need excellent people? Advertise your job


here!

Fun And Informative Events


Join Etleap, an Amazon Redshift ETL tool to learn
the latest trends in designing a modern analytics
infrastructure. Learn what has changed in the
analytics landscape and how to avoid the major
pitfalls which can hinder your organization from
growth. Watch a demo and learn how Etleap can
save you on engineering hours and decrease your
time to value for your Amazon Redshift analytics
projects. Register for the webinar today.

Advertise your event here!

Cool Products And Services


PerfOps is a data platform that digests real-time
performance data for CDN and DNS providers
as measured by real users worldwide. Leverage
this data across your monitoring efforts and
integrate with PerfOps’ other tools such as Alerts,
Health Monitors and FlexBalancer – a smart
approach to load balancing. FlexBalancer makes it
easy to manage traffic between multiple CDN
providers, API’s, Databases or any custom
endpoint helping you achieve better performance,
ensure the availability of services and reduce

10 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

vendor costs. Creating an account is Free and


provides access to the full PerfOps platform.

InMemory.Net provides a Dot Net native in


memory database for analysing large amounts of
data. It runs natively on .Net, and provides a native
.Net, COM & ODBC apis for integration. It also has
an easy to use language for importing data, and
supports standard SQL for querying
data. http://InMemory.Net

Build, scale and personalize your news feeds and


activity streams with getstream.io. Try the API now
in this 5 minute interactive tutorial. Stream is free
up to 3 million feed updates so it's easy to get
started. Client libraries are available for Node,
Ruby, Python, PHP, Go, Java and .NET. Stream is
currently also hiring Devops and Python/Go
developers in Amsterdam. More than 400
companies rely on Stream for their production feed
infrastructure, this includes apps with 30 million
users. With your help we'd like to ad a few zeros to
that number. Check out the job opening
on AngelList.

Scalyr is a lightning-fast log management and


operational data platform. It's a tool (actually,
multiple tools) that your entire team will love. Get
visibility into your production issues without juggling
multiple tabs and different services -- all of your
logs, server metrics and alerts are in your browser
and at your fingertips. . Loved and used by teams
at Codecademy, ReturnPath, Grab, and
InsideSales. Learn more today or see why Scalyr is
a great alternative to Splunk.

Advertise your product or service here!

If you are interested in a sponsored post for an event,


job, or product, please contact us for more
information.

Make Your Job Search O(1) —


Not O(n)
Triplebyte is unique because they're a team of engineers
running their own centralized technical assessment.
Companies like Apple, Dropbox, Mixpanel, and
Instacart now let Triplebyte-recommended engineers
skip their own screening steps.

We found that High Scalability readers are about 80%

11 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

more likely to be in the top bracket of engineering skill.

Take Triplebyte's multiple-choice quiz (system design and


coding questions) to see if they can help you scale your
career faster.

The Solution To Your


Operational Diagnostics Woes
Scalyr gives you instant visibility of your production
systems, helping you turn chaotic logs and system
metrics into actionable data at interactive speeds. Don't
be limited by the slow and narrow capabilities of
traditional log monitoring tools. View and analyze all your
logs and system metrics from multiple sources in one
place. Get enterprise-grade functionality with sane pricing
and insane performance. Learn more today.

If you are interested in a sponsored post for an event,


job, or product, please contact us for more information.

Todd Hoff | Post a Comment | Permalink | Share Article Print Article Email

Article

in sponsored post

Like 2 people like this. Be the first of your friends.

Tweet

Friday
May102019

Stuff The Internet Says On


Scalability For May
10th, 2019
FRIDAY, MAY 10, 2019 AT 9:35AM

Wake up! It's HighScalability time:

Deep-sky mosaic, created from nearly 7,500


individual exposures, provides a wide portrait of the
distant universe, containing 265,000 galaxies that

12 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

stretch back through 13.3 billion years of time to just


500 million years after the big bang. (hubblesite)

Do you like this sort of Stuff? I'd greatly appreciate your


support on Patreon. I wrote Explain the Cloud Like I'm
10 for people who need to understand the cloud. And
who doesn't these days? On Amazon it has 45 mostly 5
star reviews (107 on Goodreads). They'll learn a lot and
hold you in awe.

Number Stuff:
36%: of the world touches a Facebook app every
month, 2 years over a life time
$84.4: average yearly Facebook ad revenue per
user in North America
1%: performers raked in 60% of all concert-ticket
revenue world-wide in 2017—more than double
their share in 1982
...

Quotable Stuff:
@mjpt777: APIs to IO need to be asynchronous
and support batching otherwise the latency of calls
dominate throughput and latency profile under
burst conditions. Languages need to evolve to
better support asynchronous interfaces and have
state machine support, not try to paper over the
obvious issues with synchronous APIs. Not
everyone needs high performance but the blatant
waste and energy consumption of our industry
cannot continue.
Guido van Rosuum: I did not enjoy at all when the
central developers were sending me hints on
Twitter questioning my authority and the wisdom of
my decisions, instead of telling me in my face and
having an honest debate about things.
Isobel Cockerell: A kind of WeChat code had
developed through emoji: A half-fallen rose meant
someone had been arrested. A dark moon, they
had gone to the camps. A sun emoji—“I am alive.”
A flower—“I have been released.”
@scottsantens: Australian company shifts to 4-day
week with every Weds off and no decrease in pay.
Result? 46% more revenue, a tripling of profits, and
happier employees taking fewer sick days. Also
Thurs are now much more productive. We work too
much.

13 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

There's a lot more where that came from.

Don't miss all that the Internet has to say on


Scalability, click below and become eventually
consistent with all scalability knowledge (which
means this post has many more items to read so please
keep on reading)...

Click to read more ...

Todd Hoff | 1 Comment | Permalink | Share Article Print Article Email Article

in hot links

Like 4 people like this. Be the first of your friends.

Tweet

Friday
May032019

Stuff The Internet Says On


Scalability For May
3rd, 2019
FRIDAY, MAY 3, 2019 AT 9:07AM

Wake up! It's HighScalability time:

Event horizon? Nope. It's a close up of a security


hologram. Makes one think.

Do you like this sort of Stuff? I'd greatly appreciate your


support on Patreon. I wrote Explain the Cloud Like I'm
10 for people who need to understand the cloud. And
who doesn't these days? On Amazon it has 45 mostly 5

14 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

star reviews (105 on Goodreads). They'll learn a lot and


hold you in awe.

Number Stuff:
$1 trillion: Microsoft is the most valuable company
in the world (for now)
20%: global enterprises will have deployed
serverless computing technologies by 2020
390 million: paid Apple subscriptions, revenue from
the services business climbed from $9.9 billion to
$11.5 billion, services now account for “one-third” of
the company’s gross profits
1011: CubeStat missions
$326 billion: USA farm expenses in 2017
61%: increase in average cyber attack losses from
$229,000 last year to $369,000 this, a figure
exceeding $700,000 for large firms versus just
$162,000 in 2018.
$550: can yield 20x profit on the sale of
compromised login credentials

Quotable Stuff:
Robert Lightfoot~ Protecting against risk and being
safe are not the same thing. Risk is just simply a
calculation of likelihood and consequence. Would
we have ever launched Apollo in the environment
we’re in today? Would Buzz and Neil have been
able to go to the moon in the risk posture we live in
today? Would we have launched the first shuttle
with a crew? We must move from risk management
to risk leadership. From a risk management
perspective, the safest place to be is on the
ground. From a risk leadership perspective, I
believe that’s the worst place this nation can be.
Paul Kunert: In dollar terms, Jeff Bezos's cloud
services wing grew 41 per cent year on year to
$7.6bn, figures from Canalys show. Microsoft was
up 75 per cent to $3.4bn and Google grew a
whopping 83 per cent to $2.3bn.
@codinghorror: 1999 "MIT - We estimate that the
puzzle will require 35 years of continuous
᯲- LOL"

computation to solve" 2019 "ᯰ
https://www.csail.mit.edu/news/programmers-solve-
mits-20-year-old-cryptographic-puzzle T
A few more quotes...if you dare.

Don't miss all that the Internet has to say on


Scalability, click below and become eventually
consistent with all scalability knowledge (which

15 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

means this post has many more items to read so please


keep on reading)...

Click to read more ...

Todd Hoff | 1 Comment | Permalink | Share Article Print Article Email Article

in hot links

Like 3 people like this. Be the first of your friends.

Tweet

Friday
Apr262019

Stuff The Internet Says On


Scalability For April
26th, 2019
FRIDAY, APRIL 26, 2019 AT 9:33AM

Wake up! It's HighScalability time:

Found! The One Ring. In space!

Do you like this sort of Stuff? I'd greatly appreciate your


support on Patreon. I wrote Explain the Cloud Like I'm
10 for people who need to understand the cloud. And
who doesn't these days? On Amazon it has 45 mostly 5
star reviews (103 on Goodreads). They'll learn a lot and
hold you in even greater awe.

$30 million: Apple's per month AWS bill (a ~50%


reduction); 73%: Azure YoY growth; 3,500: times
per day andon cords are pulled at Toyota; $1
trillion: size of micromobility market; $1 billion:
cryptopiracy is the new sea piracy; $702 million:
Tesla fist quarter loss; $5.0 billion: FTC Facebook

16 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

fine; 1.56 billion: Facebook DAUs, 8% growth;


93%: Facebook mobile advertising revenue out of
total; 40%: internet traffic driven by bots; one litre
per hour: required by Roman galley oarsmen;
1200: Fortnite World Cup cheaters; 26: states ban
community broadband; $50M: Slack yearly AWS
spend; 575: companies paying slack $100k/year;

Quotable Quotes:
Claude Shannon: Then there’s the idea of
dissatisfaction. By this I don’t mean a
pessimistic dissatisfaction of the world — we
don’t like the way things are — I mean a
constructive dissatisfaction. The idea could
be expressed in the words, This is OK, but I
think things could be done better. I think there
is a neater way to do this. I think things could
be improved a little. In other words, there is
continually a slight irritation when things don’t
look quite right; and I think that dissatisfaction
in present days is a key driving force in good
scientists.
Albert Kao: A feature of modular structure is
that there’s always information loss, but the
effect of that information loss on accuracy
depends on the environment. Surprisingly, in
complex environments, the information loss
even helps accuracy in a lot of situations.
Eduards Sizovs: Be the company that says:
we are hiring mentoring.
???: There Is No Shortage of Talent. There's
a Shortage of Suckers.
You know the drill.

Don't miss all that the Internet has to say on


Scalability, click below and become eventually
consistent with all scalability knowledge (which
means this post has many more items to read so please
keep on reading)...

Click to read more ...

Todd Hoff | 4 Comments | Permalink | Share Article Print Article Email Article

in hot links

Like 3 people like this. Be the first of your friends.

Tweet

Friday
Apr192019

17 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Stuff The Internet Says On


Scalability For April
19th, 2019
FRIDAY, APRIL 19, 2019 AT 9:05AM

Wake up! It's HighScalability time:

Spirit? Smoke? Lightning? Nope. It's a gorgeous


LIDAR image showing 1500 years of Willamette
River movement (@Blacky_Himself)

Do you like this sort of Stuff? I'd greatly appreciate your


support on Patreon. I wrote Explain the Cloud Like I'm
10 for people who need to understand the cloud. And
who doesn't these days? On Amazon it has 44 mostly 5
star reviews (102 on Goodreads). They'll learn a lot and
hold you in awe.

536: IRS tax return submissions per second;


400,000: drone planted trees in a day; 200 million:
smart speaker observers installed by year end; 54
million: GoT pirated in first 24 hours; 123,052: kg of
crashed human spacecraft on the surface of the
moon; 610 pounds: 128 kilobytes of IBM S/360
core memory; 33%: per account month over month

18 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Lambda function growth; $100,000: Netflix bug


bounty payout; $1 million: Shopify bug bount
payout; ~$2300: cost to transfer 23TB from S3 to
Backblaze B2 in 7 hours; 14%: Netflix users share
passwords; 88%: believe P != NP; 30-90: minutes
saved by StackOverflow per week; 83%: US teens
have an iPhone; $2m: Microsoft bug bounty payout;
$1 million: made by Colin Cowherd on 331 million
Facebook page views, moving more to Instagram;
0: lines of code in Pong; ~95%: redis is slower
when GDPR complient;

Quotable Quotes:
melodysheep: The universe has only just
begun.
@matthew_d_green: I spent the year before
Heartbleed visiting important people in DC
trying to convince them OpenSSL was a
mess, and they should fund it as “critical
infrastructure”. They laughed and told me
that term referred to dams and power plants.
Tim Cook: No
@asymco: Among 8,000 U.S. high school
students surveyed, 83% have an iPhone, 9%
Android. 86% plan their next phone to be an
iPhone. -Piper Jaffray Taking Stock With
Teens survey
@dialtone: Do you know S3 throughput is
higher than a SATA 3 controller and almost
as much as PCIe 4.0 2x? Depending on the
usecase, mounting S3 as a filesystem, not
only makes sense, but it saves a LOT of
money (and time) as well. You just need to
use it a special kind of filesystem.
Steven Melendez: By 2022, automation will
displace about 75 million jobs worldwide. On
the other hand, they will create an estimated
133 million new jobs. The predictions come
from extrapolating from surveys sent to more
than 300 major employers around the world.
So many more quotes...

Don't miss all that the Internet has to say on


Scalability, click below and become eventually
consistent with all scalability knowledge (which
means this post has many more items to read so please
keep on reading)...

Click to read more ...

Todd Hoff | 5 Comments | Permalink | Share Article Print Article Email Article

in hot links

19 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Like 4 people like this. Be the first of your friends.

Tweet Tuesday
Apr162019

MySQL High Availability


Framework Explained –
Part III: Failover Scenarios
TUESDAY, APRIL 16, 2019 AT 9:33AM

In this three-part blog series, we introduced a High


Availability (HA) Framework for MySQL hosting in Part I,
and discussed the details of MySQL semisynchronous
replication in Part II. Now in Part III, we review how the
framework handles some of the important MySQL failure
scenarios and recovers to ensure high availability.

MySQL Failover Scenarios


Scenario 1 – Master MySQL Goes
Down
The Corosync and Pacemaker framework detects
that the master MySQL is no longer available.
Pacemaker demotes the master resource and tries
to recover with a restart of the MySQL service, if
possible.
At this point, due to the semisynchronous nature of
the replication, all transactions committed on the
master have been received by at least one of the
slaves.
Pacemaker waits until all the received transactions
are applied on the slaves and lets the slaves report
their promotion scores. The score calculation is
done in such a way that the score is ‘0’ if a slave is
completely in sync with the master, and is a
negative number otherwise.
Pacemaker picks the slave that has reported the 0
score and promotes that slave which now assumes
the role of master MySQL on which writes are
allowed.

20 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

After slave promotion, the Resource Agent triggers


a DNS rerouting module. The module updates the
proxy DNS entry with the IP address of the new
master, thus, facilitating all application writes to be
redirected to the new master.
Pacemaker also sets up the available slaves to
start replicating from this new master.

Thus, whenever a master MySQL goes down (whether


due to a MySQL crash, OS crash, system reboot, etc.),
our HA framework detects it and promotes a suitable
slave to take over the role of the master. This ensures
that the system continues to be available to the
applications.

Scenario 2 – Slave MySQL Goes


Down
The Corosync and Pacemaker framework detects
that the slave MySQL is no longer available.
Pacemaker tries to recover the resource by trying
to restart MySQL on the node. If it comes up, it is
added back to the current master as a slave and
replication continues.
If recovery fails, Pacemaker reports that resource
as down – based on which alerts or notifications
can be generated. If necessary, the
ScaleGrid support team will handle the recovery of
this node.
In this case, there is no impact on the availability of
MySQL services.

Scenario 3 – Network Partition –


Network Connectivity Breaks
Down Between Master And Slave
Nodes
This is a classical problem in any distributed system
where each node thinks the other nodes are down, while
in reality, only the network communication between the
nodes is broken. This scenario is more commonly known
as split-brain scenario, and if not handled properly, can
lead to more than one node claiming to be a master
MySQL which in turn leads to data inconsistencies and
corruption.

Let’s use an example to review how our framework deals


with split-brain scenarios in the cluster. We assume that
due to network issues, the cluster has partitioned into two
groups – master in one group and 2 slaves in the other
group, and we will denote this as [(M), (S1,S2)].

Corosync detects that the master node is not able

21 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

to communicate with the slave nodes, and the


slave nodes can communicate with each other, but
not with the master.
The master node will not be able to commit any
transactions as the semisynchronous replication
expects acknowledgement from at least one of the
slaves before the master can commit. At the same
time, Pacemaker shuts down MySQL on the master
node due to lack of quorum based on the
Pacemaker setting ‘no-quorum-policy = stop’.
Quorum here means a majority of the nodes, or two
out of three in a 3-node cluster setup. Since there
is only one master node running in this partition of
the cluster, the no-quorum-policy setting is
triggered leading to the shutdown of the MySQL
master.
Now, Pacemaker on the partition [(S1), (S2)]
detects that there is no master available in the
cluster and initiates a promotion process. Assuming
that S1 is up to date with the master (as
guaranteed by semisynchronous replication), it is
then promoted as the new master.
Application traffic will be redirected to this new
master MySQL node and the slave S2 will start
replicating from the new master.

Thus, we see that the MySQL HA framework handles


split-brain scenarios effectively, ensuring both data
consistency and availability in the event the network
connectivity breaks between master and slave nodes.

This concludes our 3-part blog series on the MySQL High


Availability (HA) framework using semisynchronous
replication and the Corosync plus Pacemaker stack. At
ScaleGrid, we offer highly available hosting for MySQL
on AWS and MySQL on Azure that is implemented based
on the concepts explained in this blog series. Please visit
the ScaleGrid Console for a free trial of our solutions.

Kristi Anderson | Post a Comment | Permalink | Share Article Print Article

Email Article

tagged High Availability Framework, Master Slave, MySQL Crash, MySQL

Failover Scenarios, MySQL High Availability, MySQL Semisynchronous

Replication, MysQL Hosting, Network Connectivity, Replication, Split-Brain,

database, sql in AWS, Database, DevOps, Failure Analysis, Geo-distributed

Clusters, Monitoring, MySQL, administration, administrator, application, cloud,

cloud computing, cloud storage, cluster, clusters, data management, database

replication, database scalability, databases, datacenter, deployment,

distirbuted, distributed systems, enterprise architecture, failure, high

availability, high availablilty, infrastructure, management, mysql cluster,

network, nodes, open source, paritioning, partitioning, platform, replication,

sql, tutorial, uptime

22 of 23 7/5/2019, 8:50 PM
High Scalability - http://highscalability.com/

Like 5 people like this. Be the first of your friends.

Tweet

23 of 23 7/5/2019, 8:50 PM

You might also like