Cloud Architecture Tutorial - Platform Component Architecture (2of3)

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Ad

Cloud
Architecture
Tutorial

Pla$orm
Component
Architecture

...

Don’t
Do
That!

A
Discussion
of
AnM-‐Architecture

(wriCen
as
an
Ignite
talk)

Architecture

PaCerns
to
guide
detailed

design
and
construcMon

AnM-‐Architecture

Constraints
that
limit
detailed

design
and
construcMon

Misplaced
Enthusiasm

How
could
that
happen?

Anatomy
of
a
Failure

What
I
Wanted

•  Moving
to
Cassandra
as
primary
data
store

•  We
need
backups!

•...

AddiMonal
Goals

I
would
like
it
next
week
-‐
Keep
it
simple

No
singl...

Prototype

•  Created
S3
bucket

•  Carefully
ﬁgured
out
a
good
S3
path
hierarchy
...

Now
comes
the
hard
part!

Restore
is
trickier,
Cassandra
is
wriCen
in
Java,

progr...

Days
Pass…

•  Programmer
is
re-‐wriMng
backup
in
python

•  Installs
Python
2.7
on ...

Weeks
Pass…

•  Python
based
full
backup
&
restore
works!

•  But
only
to
the
C...

Cassandra
in
ProducMon

We
do
have
backups
running
now,
right?

W...

Whoops!

ProducMon
data
trashed
while
sefng
up
backup

Luckily
–
it
was
recoverable
...

Months
Pass

•  Python
prototype
re-‐wriCen
in
Java
(Priam)

•  Integrated
with
other
...

AnM-‐Architecture

•  Deﬁne
the
things
you
don’t
want

•  Constrain
the
outcome

•  C...

AnM-‐Architecture
Success

hCp://techblog.ne$lix.com/2011/04/lessons-‐ne$lix-‐learned-‐from-‐aws-‐outage.html ...

AnM-‐Architecture

Deﬁne
the
space
the
thing
will
inhabit

...

Cloud
Architecture
PaCerns

Where
do
we
start?

Goals

•  Faster

–  Lower
latency
than
the
equivalent
datacenter
web
pages
and
API ...

Datacenter
AnM-‐PaCerns

What
do
we
currently
do
in
the

datacenter
that
prevents
u...

Architecture

•  So?ware
Architecture

–  The
abstracMons
and
interfaces
that
developers
bui...

Rewrite
from
Scratch

Not
everything
is
cloud
speciﬁc

Pay
down
technical
debt

...

Ne$lix
Datacenter
vs.
Cloud
Arch

Central
SQL
Database
Distributed
Key/Value
NoSQ...

The
Central
SQL
Database

•  Datacenter
has
a
central
database

–  Everything
in
one
...

The
Distributed
Key-‐Value
Store

•  Cloud
has
many
key-‐value
data
stores

–  More
...

The
SMcky
Session

•  Datacenter
SMcky
Load
Balancing

–  Eﬃcient
caching
for
low
late...

Shared
Session
State

•  ElasMc
Load
Balancer

–  We
don’t
use
the
cookie
based
...

ChaCy
Opaque
and
BriCle
Protocols

•  Datacenter
service
protocols

–  Assumed
low
laten...

Robust
and
Flexible
Protocols

•  Cloud
service
protocols

–  JSR311/Jersey
is
used
for
...

Persisted
Protocols

•  Persist
Avro
in
Memcached

–  Save
space/latency
(zigzag
encoding,
...

Tangled
Service
Interfaces

•  Datacenter
implementaMon
is
exposed

–  Oracle
SQL
queries
...

Untangled
Service
Interfaces

•  New
Cloud
Code
With
Strict
Layering

–  Compile
against...

Untangled
Service
Interfaces

Two
layers:

•  SAL
-‐
Service
Access
Library

–  Basic
...

Service
InteracMon
PaCern

Sample
Swimlane
Diagram

Service
Architecture
PaCerns

•  Internal
Interfaces
Between
Services

–  Common
paCerns
as ...

CLIENT

Request
Start

...

Boundary
Interfaces

•  Isolate
teams
from
external
dependencies

–  Fake
SAL
built
by
...

One
Object
That
Does
Everything

•  Datacenter
uses
a
few
big
complex
objects

–  ...

An
Interface
For
Each
Component

•  Cloud
uses
faceted
Video
and
Visitor

–  Basic
...

Basic
Types

Epistemology
and
Design

By
Stan
Lanning

Avoiding
“Level
Confusion”
[Catataxis]

•  Business
Level
Objects
(BLO?)

–  Customers,
...

Facets

•  No
single
Abstract
Type
captures
everything

about
a
BLO

–  Diﬀerent
t...

Basic
Types

•  Module
external
interfaces
deal
in
basic
types;

internal
calls
are
...

Type
Manager

•  Holds
the
“factory”
objects
that
manage

instances
of
facets

–  T...

Switching
Facets

•  Each
Basic
Type
B
implements
a
method
that

uses
the
Type
M...

IDs!
(huh)
What
are
they
good
for?

•  IDs
exist
because
implementaKons
need
to

...

ConverMng
IDs
ßàObjects

Long id = xx;!
MyVisitor visitor =!
TypeManager.findObject(Visitor.class, id)!
...

Stan’s
Soap
Box

•  Don’t
pass
around
IDs
when
you
mean
to
refer

to
the
BLO;...

So?ware
Architecture
PaCerns

•  Object
Models

–  Basic
and
derived
types,
facets,
seria...

Model
Driven
Architecture

•  TradiMonal
Datacenter
PracMces

–  Lots
of
unique
hand-‐tweak...

Ne$lix
Cloud
Pla$orm

Ne$lix
ApplicaMons

Ne$lix
Cloud
Pla$orm
/
PaaS

AWS...

Ne$lix
PaaS
Principles

•  Maximum
FuncMonality

–  Developer
producMvity
and
agility

•  L...

Ne$lix
Global
PaaS

•  Architecture
Features
and
Overview

•  Portals
and
Explorers

•  ...

Global
PaaS?

Toys
are
nice,
but
this
is
the
real
thing…

•  Supports
al...

Basic
PaaS
EnMMes

•  AWS
Based
EnMMes

–  Instances
and
Machine
Images,
ElasMc
IP
...

Core
PaaS
Services

•  AWS
Based
Services

–  S3
storage,
to
5TB
ﬁles,
parallel
mu...

Instance
Architecture

Linux
Base
AMI
(CentOS
or
Ubuntu)

OpMonal

Apache

frontend...

Security
Architecture

•  Instance
Level
Security
baked
into
base
AMI

–  Login:
ssh
...

Core
Pla$orm
Frameworks
and
APIs

Portals
and
Explorers

•  Ne$lix
ApplicaMon
Console
(NAC)

–  Primary
AWS
provisioning/conﬁg...

AWS
Usage

for
test,
carefully
omifng
any
$
numbers…

Cassandra
Explorer

Cassandra
Explorer

Pla$orm
Services

•  Discovery
–
service
registry
for
“ApplicaMons”

•  IntrospecMon
–
E...

IntrospecMon
-‐
Entrypoints

•  REST
API
for
tools,
apps,
explorers,
monkeys…

–  E.g.
...

Entrypoints
Queries

MongoDB
used
for
low
traﬃc
complex
queries
against
complex
objec...

Metrics
Framework

•  System
and
ApplicaMon

–  CollecMon,
AggregaMon,
Querying
and
ReporMn...

ConﬁguraAon
Management

•  Ne$lixConﬁguraMon

–  ValidaMon
Framework

–  Sitewide
ProperMes
...

Interprocess
CommunicaAon

•  Discovery
Service
registry
for
“applicaMons”

–  “here
I
am” ...

Security
Key
Management

•  AKMS

–  Dynamic
Key
Management
interface

–  Update
AWS
...

AWS
Persistence
Services

•  SimpleDB

–  Got
us
started,
migrated
to
Cassandra
now

...

Aside:
Adrian’s
Rant
on
CAP
Theorem

Choose
Consistency
or
Availability
when
Par...

What
Ne$lix
Needed
from
NoSQL

Basic
Requirements

•  Supports
running
on
Amazon
EC2

•  Supports
Amazon
Availability
Z...

Scenario
–
Immediate
Read
a?er
Write

Q1:
Is
rouMng
and
replicaMon
zone
aware?
...

Network
ParMMon

Q2:
What
happens
next?

TV
Device ...

Network
ParMMon

Q3:
Supports
Append
vs.
Read/Modify/Write?

...

Silent
Data
CorrupMon

Q4:
How
is
it
detected
and
corrected?

...

NePlix
PlaPorm
Persistence

•  Ephemeral
VolaMle
Cache
–
evcache

–  Discovery-‐aware
memca...

Why
Cassandra?

•  We
value
Availability
over
Consistency
–
AP

–  Cassandra
is
a
...

Priam
–
Cassandra
AutomaMon

Available
at
hCp://github.com/ne$lix

•  Ne$lix
Pl...

Astyanax

Available
at
hCp://github.com/ne$lix

•  Cassandra
java
client

•...

IniMalizing
Astyanax

// Configuration either set in code or nfastyanax.properties
platform.ListOfComponentsToInit=L...

Astyanax
Query
Example

Paginate
through
all
columns
in
a
row

ColumnList<String>
columns...

Data
MigraMon
to
Cassandra

Distributed
Key-‐Value
Stores

•  Cloud
has
many
key-‐value
data
stores

–  More
compl...

MulA-‐Regional
Data
ReplicaAon

•  IR
Framework
–
Datacenter
Item
Replicator

–  Built
...

TransiAonal
Steps

•  BidirecMonal
ReplicaMon

–  Oracle
to
SimpleDB

–  Queued
reverse
p...

API

AWS
EC2

Front
End
Load
Balancer

Disco...

Cufng
the
Umbilical

•  TransiMon
Oracle
Data
Sources
to
Cassandra

–  Oﬄoad
Datacenter ...

API

AWS
EC2

Front
End
Load
Balancer

Discovery

...

High
Availability

•  Cassandra
stores
3
local
copies,
1
per
zone

–  Synchronous
...

“TradiMonal”
Cassandra
Write
Data
Flows

Single
Region,
MulMple
Availability
Zone, ...

Astyanax
-‐
Cassandra
Write
Data
Flows

Single
Region,
MulMple
Availability
...

Data
Flows
for
MulM-‐Region
Writes

Token
Aware,
Consistency
Level
=
Local
...

Remote
Copies

•  Cassandra
duplicates
across
AWS
regions

–  Asynchronous
write,
replicate...

Cassandra
Backup

•  Full
Backup
Cassa...

Cassandra
Restore

•  Full
Restore
Cassandra ...

Cassandra
Online
AnalyMcs

•  Brisk
=
Hadoop
+
Cass
...

ETL
for
Cassandra

•  Data
is
de-‐normalized
over
many
clusters!

•  Too
many
to
...

Cassandra
Archive
A

Appropriate
level
of ...

Extending
to
MulM-‐Region

In
producMon
for
UK/Eire
support

...

Tools
and
AutomaMon

•  Developer
and
Build
Tools

–  Jira,
Perforce,
Eclipse,
Jenkins...

NoSQL
Developer
MigraMon

•  Jason
Brown
@jasobrown

–  Cassandra
from
the
Trenches

–...

Open
Sourcing
the
Ne$lix
PaaS

Open
Source
Strategy

•  Release
PaaS
Components
git-‐by-‐git

–  Source
at
github.com/ne$...

Current
OSS
Projects
and
Posts

Github
/
Techblog

Priam
...

Takeaway

NePlix
has
built
and
deployed
a
...

Share Slideshare

LinkedIn
Facebook
Twitter

Embed

Size (px)

Show related Slideshows at end

WordPress Shortcode

Link

Share
Email

Cloud Architecture Tutorial - Runni... by Adrian Cockcroft 14346 views
Cloud Architecture Tutorial - Why a... by Adrian Cockcroft 27575 views
Speeding Up Innovation by Adrian Cockcroft 79929 views
Flowcon (added to for CMG) Keynote ... by Adrian Cockcroft 64444 views
Yow Conference Dec 2013 Netflix Wor... by Adrian Cockcroft 49393 views
Cloud Architecture: Patterns and Be... by Sascha Möllering 5414 views

View on Slideshare

1 of 112 Ad

View on Slideshare

1 of 112 Ad