Internet scaleservice

•

10 likes•1,764 views

DaeMyung Kang

Internet Scale Service

Engineering

About Me
•KakaoStory Backend Engineer
•Redis Contributor
•Apache Tajo Committer

Paper
https://www.usenix.org/legacy/event/lisa07/tech/full_pape
rs/hamilton/hamilton_html/

Check List
https://gist.github.com/acolyer/95ef23
802803cb8b4eb5

Stateless
Load Balancer
Storage Layer
API
Servers
API
Servers
API
Servers
API
Servers

Range
User #1
User #10
User #1000000
User #1000001
User #1000100
User #2000000
User #2000001
User #2000200
User #3000000
User #1000005

Moduler
User #1
User #4
User #7
User #2
User #5
User #8
User #3
User #6
User #9
User #0
#0 / 3 = 0

Indexed
User #5000 Index Server
User #1
User #2000
User #1000000
User #2
User #2001
User #10000
User #3
User #6
User #5000
#5000 is in Server2

Redis
Don’t execute long-time
Spend Commands.

Cache is Storage
Server
Cache #1
Cache #2
Cache #3
Cache #4
Searching Key

Client Side Load Balancing
Server
Cache #1
Cache #2
Cache #3
Cache #4
Searching Key
Cache #1
Cache #2
Cache #3
Cache #4
Coordinator

Server Side Load Balancing
proxy
Cache #1
Cache #2
Cache #3
Cache #4
Searching Key
Server

VIP
Server
DB Master
192.168.0.10
DB Slave
192.168.0.11
VIP 192.168.0.12

Dynamic DNS
Server
DB Master
192.168.0.10
DB Slave
192.168.0.11
db1-master.a.com

Latency #1
IDC 1 IDC 2
API Server DB Server
Latency 50ms

Latency #1
IDC 1 IDC 2
API Server DB Server
Select * from posts where id=123;
results
Select member from members
where id=poster.group;
results

Latency #1
IDC 1 IDC 2
API Server
DB Server
getMembersList()
results
Logic Server

What's hot

Embulk and Machine Learning infrastructureHiroshi Toyama

Counting image views using redis clusterRedis Labs

Spilo, отказоустойчивый PostgreSQL кластер / Oleksii Kliukin (Zalando SE)Ontico

Altitude SF 2017: Optimizing your hit rateFastly

Single tenant software to multi-tenant SaaS using K8SCloudLinux

Wordpress optimizationAlmog Baku

RedisConf17- Using Redis at scale @ TwitterRedis Labs

Troubleshooting redisDaeMyung Kang

Happy Browser, Happy User! WordSesh 2019Katie Sylor-Miller

State of the CLI- Kat MarchanNodejsFoundation

How Percolate uses CFEngine to Manage AWS Stateless InfrastructurePercolate

GoSF Summerfest - Why Go at ApceraDerek Collison

HighLoad Solutions On MySQL / Xiaobin Lin (Alibaba)Ontico

Capacity PlanningMongoDB

Running Cloud Foundry for 12 months - An experience report | anyninesanynines GmbH

Altitude SF 2017: Reddit - How we built and scaled r/placeFastly

Automating aws infrastructure and code deployments using Ansible @WebEngageVishal Uderani

Whats wrong with postgres | PGConf EU 2019 | Craig KerstiensCitus Data

AWS Summit Milan - AWS RDS for your data (and your sleep)Matteo Moretti

Apcera Case Study: The selection of the Go languageDerek Collison

What's hot (20)

Embulk and Machine Learning infrastructure

Counting image views using redis cluster

Spilo, отказоустойчивый PostgreSQL кластер / Oleksii Kliukin (Zalando SE)

Altitude SF 2017: Optimizing your hit rate

Single tenant software to multi-tenant SaaS using K8S

Wordpress optimization

RedisConf17- Using Redis at scale @ Twitter

Troubleshooting redis

Happy Browser, Happy User! WordSesh 2019

State of the CLI- Kat Marchan

How Percolate uses CFEngine to Manage AWS Stateless Infrastructure

GoSF Summerfest - Why Go at Apcera

HighLoad Solutions On MySQL / Xiaobin Lin (Alibaba)

Capacity Planning

Running Cloud Foundry for 12 months - An experience report | anynines

Altitude SF 2017: Reddit - How we built and scaled r/place

Automating aws infrastructure and code deployments using Ansible @WebEngage

Whats wrong with postgres | PGConf EU 2019 | Craig Kerstiens

AWS Summit Milan - AWS RDS for your data (and your sleep)

Apcera Case Study: The selection of the Go language

Viewers also liked

Better softwareengineer hanDaeMyung Kang

Opensource sw dayDaeMyung Kang

Redis trouble shooting_engDaeMyung Kang

Random 111203223949-phpapp02DaeMyung Kang

Redis trouble shootingDaeMyung Kang

Soscon lt 1DaeMyung Kang

Open source ossDaeMyung Kang

OpenSource ContributorDaeMyung Kang

Redis on AWSDaeMyung Kang

2015 SW마에스트로 100+ 컨퍼런스_카카오 플랫폼과 Elastic Web Service2015 SW마에스트로 100+ 컨퍼런스

Elastic webserviceDaeMyung Kang

聊聊我接触的集群管理rfyiamcool

Redis as a Main Database, Scaling and HADave Nielsen

大话redis设计实现rfyiamcool

Redis acc 2015DaeMyung Kang

Redis edu 4DaeMyung Kang

오픈소스 그리고 기회Sungju Jin

Raft rfyiamcool

Redis edu 5DaeMyung Kang

대규모서비스를지탱하는기술 7HyeonSeok Choi

Viewers also liked (20)

Better softwareengineer han

Opensource sw day

Redis trouble shooting_eng

Random 111203223949-phpapp02

Redis trouble shooting

Soscon lt 1

Open source oss

OpenSource Contributor

Redis on AWS

2015 SW마에스트로 100+ 컨퍼런스_카카오 플랫폼과 Elastic Web Service

Elastic webservice

聊聊我接触的集群管理

Redis as a Main Database, Scaling and HA

大话redis设计实现

Redis acc 2015

Redis edu 4

오픈소스 그리고 기회

Raft

Redis edu 5

대규모서비스를지탱하는기술 7

Similar to Internet scaleservice

ENT309 Scaling Up to Your First 10 Million UsersAmazon Web Services

How to Build a Big Data Application: Serverless Editionecobold

How to Build a Big Data Application: Serverless EditionLecole Cole

Restful风格web服务架构Benjamin Tan

The State of Serverless Computing | AWS Public Sector Summit 2017Amazon Web Services

Building a web application without serversAmazon Web Services

ENT309 Scaling Up to Your First 10 Million UsersAmazon Web Services

Getting Started with AWS Lambda and the Serverless Cloud - AWS Summit Cape T...Amazon Web Services

SMC301 The State of Serverless ComputingAmazon Web Services

API Gateways are going through an identity crisisChristian Posta

2016-06 - Design your api management strategy - AWS - Microservices on AWSSmartWave

Scaling up to Your First 10 Million UsersAmazon Web Services

Getting Started with AWS Lambda and Serverless ComputingAmazon Web Services

Scaling on AWS for the First 10 Million Users at Websummit DublinAmazon Web Services

Scaling on AWS for the First 10 Million Users at Websummit DublinIan Massingham

Leapfrog into Serverless - a Deloitte-Amtrak Case Study | Serverless Confere...Gary Arora

AWS Lambda support for AWS X-RayEitan Sela

Raleigh DevDay 2017: Build a serverless web application in one day workshopAmazon Web Services

Getting Started with AWS Lambda and Serverless ComputingKristana Kane

Similar to Internet scaleservice (20)

ENT309 Scaling Up to Your First 10 Million Users

How to Build a Big Data Application: Serverless Edition

Restful风格web服务架构

The State of Serverless Computing | AWS Public Sector Summit 2017

Building a web application without servers

ENT309 Scaling Up to Your First 10 Million Users

Getting Started with AWS Lambda and the Serverless Cloud - AWS Summit Cape T...

SMC301 The State of Serverless Computing

API Gateways are going through an identity crisis

2016-06 - Design your api management strategy - AWS - Microservices on AWS

Scaling up to Your First 10 Million Users

Getting Started with AWS Lambda and Serverless Computing

Scaling on AWS for the First 10 Million Users at Websummit Dublin

Leapfrog into Serverless - a Deloitte-Amtrak Case Study | Serverless Confere...

AWS Lambda support for AWS X-Ray

Raleigh DevDay 2017: Build a serverless web application in one day workshop

Getting Started with AWS Lambda and Serverless Computing

Recently uploaded

2022 AWS DNA Hackathon 장애 대응 솔루션 jarvis.elesangwon

11. Properties of Liquid Fuels in Energy Engineering.pdfHafizMudaserAhmad

Python Programming for basic beginners.pptxmohitesoham12

Module-1-(Building Acoustics) Noise Control (Unit-3). pdfManish Kumar

Novel 3D-Printed Soft Linear and Bending ActuatorsResearcher Researcher

Immutable Image-Based Operating Systems - EW2024.pdfDrew Moseley

Paper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdfNainaShrivastava14

Engineering Drawing section of solidnamansinghjarodiya

System Simulation and Modelling with types and Event SchedulingBootNeck1

Earthing details of Electrical Substationstephanwindworld

Robotics Group 10 (Control Schemes) cse.pdfsahilsajad201

Computer Graphics Introduction, Open GL, Line and Circle drawing algorithmDeepika Walanjkar

Levelling - Rise and fall - Height of instrument methodManicka Mamallan Andavar

Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...Sumanth A

Designing pile caps according to ACI 318-19.pptxErbil Polytechnic University

CS 3251 Programming in c all unit notes pdfBalamuruganV28

High Voltage Engineering- OVER VOLTAGES IN ELECTRICAL POWER SYSTEMSsandhya757531

Prach: A Feature-Rich Platform Empowering the Autism Communityprachaibot

List of Accredited Concrete Batching Plant.pdfisabel213075

Comprehensive energy systems.pdf Comprehensive energy systems.pdfalene1

Recently uploaded (20)

2022 AWS DNA Hackathon 장애 대응 솔루션 jarvis.

11. Properties of Liquid Fuels in Energy Engineering.pdf

Python Programming for basic beginners.pptx

Module-1-(Building Acoustics) Noise Control (Unit-3). pdf

Novel 3D-Printed Soft Linear and Bending Actuators

Immutable Image-Based Operating Systems - EW2024.pdf

Paper Tube : Shigeru Ban projects and Case Study of Cardboard Cathedral .pdf

Engineering Drawing section of solid

System Simulation and Modelling with types and Event Scheduling

Earthing details of Electrical Substation

Robotics Group 10 (Control Schemes) cse.pdf

Computer Graphics Introduction, Open GL, Line and Circle drawing algorithm

Levelling - Rise and fall - Height of instrument method

Robotics-Asimov's Laws, Mechanical Subsystems, Robot Kinematics, Robot Dynami...

Designing pile caps according to ACI 318-19.pptx

CS 3251 Programming in c all unit notes pdf

High Voltage Engineering- OVER VOLTAGES IN ELECTRICAL POWER SYSTEMS

Prach: A Feature-Rich Platform Empowering the Autism Community

List of Accredited Concrete Batching Plant.pdf

Comprehensive energy systems.pdf Comprehensive energy systems.pdf

Internet scaleservice

1. Internet Scale Service charsyam@naver.com

2. About Me •KakaoStory Backend Engineer •Redis Contributor •Apache Tajo Committer

3. Internet Scale Service

4. High Scale Service

5. Mass Traffic Huge Users Many IDCs

6. Build Internet Scale Service

7. Paper https://www.usenix.org/legacy/event/lisa07/tech/full_pape rs/hamilton/hamilton_html/

8. Check List https://gist.github.com/acolyer/95ef23 802803cb8b4eb5

9. What should be considered?

10. Your Service is Elastic?

11. Sharding Shared Nothing

12. Shared Nothing

13. Stateless

14. Stateless Load Balancer Storage Layer API Servers API Servers API Servers API Servers

15. Stateless Load Balancer Storage Layer API Servers API Servers API Servers API Servers

16. Need Log Collector

17. Sharding

18. Database Partitioning

19. Vertical Partitioning

20. Horizontal Partitioning

21. Sharding = Horizontal Partitioning

22. But Not only DB

23. Searching Key

24. Range User #1 User #10 User #1000000 User #1000001 User #1000100 User #2000000 User #2000001 User #2000200 User #3000000 User #1000005

25. Moduler User #1 User #4 User #7 User #2 User #5 User #8 User #3 User #6 User #9 User #0 #0 / 3 = 0

26. Indexed User #5000 Index Server User #1 User #2000 User #1000000 User #2 User #2001 User #10000 User #3 User #6 User #5000 #5000 is in Server2

27. Searching Key with Coordinator

28. Clustering

29. Don’t need Search Key

30. Hbase Cassandra MongoDB etc

31. Mature But Not Mature

32. Cache Solution

33. Memcached/Redis

34. Memcached Chunk Slab Algorithm

35. Redis Collections Replication

36. Redis is Single Threaded

37. Redis 150,000 TPS In commodity server

38. Redis Must manage Redis Memory(RSS)

39. Redis Don’t execute long-time Spend Commands.

40. Cache is Storage Server Cache #1 Cache #2 Cache #3 Cache #4 Searching Key

41. Client Side Load Balancing Server Cache #1 Cache #2 Cache #3 Cache #4 Searching Key Cache #1 Cache #2 Cache #3 Cache #4 Coordinator

42. Server Side Load Balancing proxy Cache #1 Cache #2 Cache #3 Cache #4 Searching Key Server

43. Circuit Breaker

44.

45. How many API Calls?

46. If one call fails?

47. Fast FailBack and Background Check

48. Netflix Hystrix

49. Using Coordinator

50. Zookeeper Consul Etcd

51. Get Configuration From Coordinator

52. Servers List Feature Flags

53. Failover

54. VIP Dynamic DNS

55. VIP Server DB Master 192.168.0.10 DB Slave 192.168.0.11 VIP 192.168.0.12

56. VIP Server DB Master 192.168.0.10 DB Slave 192.168.0.11 VIP 192.168.0.12

57. Dynamic DNS Server DB Master 192.168.0.10 DB Slave 192.168.0.11 db1-master.a.com

58. Dynamic DNS Server DB Master 192.168.0.10 DB Slave 192.168.0.11 db1-master.a.com

59. Must Check Environments For Dynamic DNS

60. JVM DNS Cache Issue

61. Latency #1

62. Latency #1 IDC 1 IDC 2 API Server DB Server Latency 50ms

63. What Happen?

64. Latency #1 IDC 1 IDC 2 API Server DB Server Select * from posts where id=123; results Select member from members where id=poster.group; results

65. Latency #1 IDC 1 IDC 2 API Server DB Server getMembersList() results Logic Server

66. Latency #2

67.

68.

69. QnA

70. Thanks

Internet scaleservice

Recommended

Recommended

More Related Content

What's hot

What's hot (20)

Viewers also liked

Viewers also liked (20)

Similar to Internet scaleservice

Similar to Internet scaleservice (20)

More from DaeMyung Kang

More from DaeMyung Kang (20)

Recently uploaded

Recently uploaded (20)

Internet scaleservice