Building distributed systems - PhpDay 2013
Upcoming SlideShare
Loading in...5
×
 

Building distributed systems - PhpDay 2013

on

  • 1,212 views

 

Statistics

Views

Total Views
1,212
Views on SlideShare
1,212
Embed Views
0

Actions

Likes
5
Downloads
13
Comments
0

0 Embeds 0

No embeds

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

Building distributed systems - PhpDay 2013 Building distributed systems - PhpDay 2013 Presentation Transcript

  • BUILDING DISTRIBUTEDSYSTEMSJuozas Kaziukėnas // juokaz.com // @juokaz
  • 300’000’000 products/ 24 hours = 12’500’00 products/ 3600 seconds = 3’472 products/ 3000 nodes = 1.1 sec. per product
  • BUICNOSCNLKSANCLAS
  • Juozas Kaziukėnas, LithuanianYou can call me JoeMore info http://juokaz.com
  • ONE SERVER IS NOTENOUGH
  • SCALINGTO MULTIPLESERVERS
  • INDEPENDENTNODES
  • 1TO 2 SERVERS = HARD2TO 100 SERVERS = EASY .
  • TWO GENERALS PROBLEM
  • LOCKING... LOL
  • MYSQLTRANSACTIONS
  • STATELESS
  • USETIMEOUTS
  • ASYNCHRONOUSPROCESSING
  • MESSAGING AND QUEUES
  • COMMUNICATION BETWEENPROCESSES
  • MESSAGE SIZE
  • GEARMAN
  • NO RUNNING ORDER ORRELIABILITY
  • DATA
  • LOCATION
  • DE-NORMALIZATION
  • CAPTHEOREM
  • EVENTUAL CONSISTENCY
  • ATOMIC OPERATIONS
  • CACHE
  • SETTING SERVERS UP
  • CONFIGURATION
  • PUPPET FOR SERVERSMANAGEMENT
  • DYNAMIC SCALING
  • SELF DISCOVERY
  • AMAZON EC2 SPOTINSTANCES10x cheaper than normal on-demand instances
  • 24’000 CORE CLUSTER = $300/H
  • PROTOTYPING
  • START SMALL
  • VAGRANT FORVMSMANAGEMENT
  • WHAT IS GOING ON?
  • HARD
  • DEBUGGING DISTRIBUTEDSYSTEMS IS HARD
  • ALL STACK LEVELS FAIL
  • MONITORING
  • COUNT EVERYTHING
  • UPTIME,VMSTAT, NETSTAT,IOSTAT, MPSTAT,TCPDUMP,GDB,VALGRIND, ULIMIT,SYSCTL ETC...
  • THANKS!Juozas Kaziukėnas@juokaz