SlideShare a Scribd company logo
1 of 23
Download to read offline
Under the Hood
- Daum UCC
Reach For More Secure
And Responsive Architecture
1. The Path of Daum
2. Problems on Mass Network Traffic
Environment and Their Solutions
3. Things can Never be forsaken for
your own UCC Service
4. Conclusion
The Path of Daum
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•Approx. 1,000 Proprietary Unix Servers
•Poor R.O.I, Low Scalability
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•Decision made
•Migrate to Linux based x86 servers.
•Adopt Open Source Software
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•Radical Growth
•The Portion Linux based, cheap x86
servers kept Increasing.
•The Opening of Scaling out ERA
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•The quality of x86 servers and open
source software were getting better
day by day.
•Open Source and Linux Boom up
•Keep Scaling Out.
2001 2002 2003 20052001 2002 2003 2005 20072007
1. The Path of Daum
•Approx. 10,000 Servers, 4 PB of Storages
•The Largest of IT Infrastructure in Korea.
•DAUM Pioneered UCC World.
1. The Path of Daum
UCC service is Growing Fast
2006.4
6360 %
2007.9
Problems on Mass
Network Traffic
Environment And
Their Solutions
2. Problems & Solutions
Optimizing Cost
•What was in our hand
The Largest Portion is Network Traffic
Network Traffic Cost
Cut down Cost by Optimizing Contents Delivery Procedure
2. Problems & Solutions
Optimizing Cost
•Grasp the characteristic of UCC Service
"Let users have their contents as fast as Possible!“
Not always Good.
Not all users are play video files till the end
If we could restrict download bandwidth to minimum...?
2. Problems & Solutions
Optimizing Cost
•What we did
What we need was a little more than 1Mbps per session.
Set max download bandwidth
Infinite 5 Mbps
Try to use just as much as we need.
2. Problems & Solutions
Optimizing Cost
•The Result
Immediate Response: Network Traffic Reduced 15%
We also can cut the cost about 10% a month
Before After Decrement Ratio
Day 1 24 Gbps 19 Gbps - 15.4 %
Day 2 22 Gbps 19 Gbps - 26.1 %
Day 3 19 Gbps 16 Gbps - 16.9 %
2. Problems & Solutions
Performance Boost on Image Caching
•What was in our hand
Single request Dozens of images
As burden on image servers
gets bigger, QoS gets poorer.
2. Problems & Solutions
Performance Boost on Image Caching
•What we did
Enforce Cache Servers more Optimally,
That is Hierarchical architecture that scales well
Origin Server
Primary Cache
Secondary Cache
2. Problems & Solutions
Performance Boost on Image Caching
•The Result
Origin Server Workload dropped
2. Problems & Solutions
Performance Boost on Image Caching
•The Result
Response Time improved dramatically
Worst: more than 5 seconds
Current : Less than 500ms
Things can never be
forsaken for your own
UCC Video Service
3. Things can never be forsaken
Origin Data Protection
•NO WONDER
Whether you do it or let others do it
No matter what,
You Have to prepare appropriate Protection
3. Things can never be forsaken
Architecture represents essence of service
•The Long Tail
Contents must be transferred through Hot Zone
and Cool Zone freely.
Decent Architecture is required.
Traffic
Hot Zone
Cool Zone
“The Challenge
For Reliable and Efficient Service”
Makes Daum UCC More Vaulable.
5.Conclusion
Thank you.
SungKyu Park, Daum Communicaions
lointain@daumcorp.com

More Related Content

Similar to Under the hood daum ucc.20071105

The challenges of live events scalability
The challenges of live events scalabilityThe challenges of live events scalability
The challenges of live events scalability
Guy Tomer
 
2 b brychan watkins
2 b brychan watkins2 b brychan watkins
2 b brychan watkins
CFG
 
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Jay Hung
 
High performance Infrastructure Oct 2013
High performance Infrastructure Oct 2013High performance Infrastructure Oct 2013
High performance Infrastructure Oct 2013
Server Density
 

Similar to Under the hood daum ucc.20071105 (20)

Get Connected Minehead 05.04
Get Connected Minehead 05.04Get Connected Minehead 05.04
Get Connected Minehead 05.04
 
Flood modelling on the Cloud
Flood modelling on the CloudFlood modelling on the Cloud
Flood modelling on the Cloud
 
Rendering Takes Flight
Rendering Takes FlightRendering Takes Flight
Rendering Takes Flight
 
Rendering Takes Flight
Rendering Takes FlightRendering Takes Flight
Rendering Takes Flight
 
E2 evc 3-2-1-rule - mikeresseler
E2 evc   3-2-1-rule - mikeresselerE2 evc   3-2-1-rule - mikeresseler
E2 evc 3-2-1-rule - mikeresseler
 
Mage uk-2013-1345-chris-wells-131030120920-phpapp01
Mage uk-2013-1345-chris-wells-131030120920-phpapp01Mage uk-2013-1345-chris-wells-131030120920-phpapp01
Mage uk-2013-1345-chris-wells-131030120920-phpapp01
 
The Importance of Site Performance and Simple Steps to Achieve It
The Importance of Site Performance and Simple Steps to Achieve ItThe Importance of Site Performance and Simple Steps to Achieve It
The Importance of Site Performance and Simple Steps to Achieve It
 
The challenges of live events scalability
The challenges of live events scalabilityThe challenges of live events scalability
The challenges of live events scalability
 
2 b brychan watkins
2 b brychan watkins2 b brychan watkins
2 b brychan watkins
 
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
Velocity NY 2013 - From Slow to Fast: Improving Performance on Intuit Website...
 
Scalable Media Processing in the Cloud (MED302) | AWS re:Invent 2013
Scalable Media Processing in the Cloud (MED302) | AWS re:Invent 2013Scalable Media Processing in the Cloud (MED302) | AWS re:Invent 2013
Scalable Media Processing in the Cloud (MED302) | AWS re:Invent 2013
 
Praxistaugliche notes strategien 4 cloud
Praxistaugliche notes strategien 4 cloudPraxistaugliche notes strategien 4 cloud
Praxistaugliche notes strategien 4 cloud
 
PostgreSQL at 20TB and Beyond
PostgreSQL at 20TB and BeyondPostgreSQL at 20TB and Beyond
PostgreSQL at 20TB and Beyond
 
AWS re:Invent 2013 Scalable Media Processing in the Cloud
AWS re:Invent 2013 Scalable Media Processing in the CloudAWS re:Invent 2013 Scalable Media Processing in the Cloud
AWS re:Invent 2013 Scalable Media Processing in the Cloud
 
Cloud Backup Solutions for Your Church
Cloud Backup Solutions for Your ChurchCloud Backup Solutions for Your Church
Cloud Backup Solutions for Your Church
 
Using commercial Clouds to process IceCube jobs
Using commercial Clouds to process IceCube jobsUsing commercial Clouds to process IceCube jobs
Using commercial Clouds to process IceCube jobs
 
Architectural Tactics for Large Scale Systems
Architectural Tactics for Large Scale SystemsArchitectural Tactics for Large Scale Systems
Architectural Tactics for Large Scale Systems
 
Lugano Tech Talks - Why Docker
Lugano Tech Talks - Why DockerLugano Tech Talks - Why Docker
Lugano Tech Talks - Why Docker
 
High performance Infrastructure Oct 2013
High performance Infrastructure Oct 2013High performance Infrastructure Oct 2013
High performance Infrastructure Oct 2013
 
Addressing Uncertainty How to Model and Solve Energy Optimization Problems
Addressing Uncertainty How to Model and Solve Energy Optimization ProblemsAddressing Uncertainty How to Model and Solve Energy Optimization Problems
Addressing Uncertainty How to Model and Solve Energy Optimization Problems
 

Recently uploaded

Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Safe Software
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
WSO2
 

Recently uploaded (20)

Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf[BuildWithAI] Introduction to Gemini.pdf
[BuildWithAI] Introduction to Gemini.pdf
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Exploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone ProcessorsExploring the Future Potential of AI-Enabled Smartphone Processors
Exploring the Future Potential of AI-Enabled Smartphone Processors
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers:  A Deep Dive into Serverless Spatial Data and FMECloud Frontiers:  A Deep Dive into Serverless Spatial Data and FME
Cloud Frontiers: A Deep Dive into Serverless Spatial Data and FME
 
CNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In PakistanCNIC Information System with Pakdata Cf In Pakistan
CNIC Information System with Pakdata Cf In Pakistan
 
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUKSpring Boot vs Quarkus the ultimate battle - DevoxxUK
Spring Boot vs Quarkus the ultimate battle - DevoxxUK
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
Apidays New York 2024 - The Good, the Bad and the Governed by David O'Neill, ...
 
ICT role in 21st century education and its challenges
ICT role in 21st century education and its challengesICT role in 21st century education and its challenges
ICT role in 21st century education and its challenges
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
Apidays New York 2024 - APIs in 2030: The Risk of Technological Sleepwalk by ...
 

Under the hood daum ucc.20071105

  • 1. Under the Hood - Daum UCC Reach For More Secure And Responsive Architecture
  • 2. 1. The Path of Daum 2. Problems on Mass Network Traffic Environment and Their Solutions 3. Things can Never be forsaken for your own UCC Service 4. Conclusion
  • 3. The Path of Daum
  • 4. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •Approx. 1,000 Proprietary Unix Servers •Poor R.O.I, Low Scalability
  • 5. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •Decision made •Migrate to Linux based x86 servers. •Adopt Open Source Software
  • 6. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •Radical Growth •The Portion Linux based, cheap x86 servers kept Increasing. •The Opening of Scaling out ERA
  • 7. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •The quality of x86 servers and open source software were getting better day by day. •Open Source and Linux Boom up •Keep Scaling Out.
  • 8. 2001 2002 2003 20052001 2002 2003 2005 20072007 1. The Path of Daum •Approx. 10,000 Servers, 4 PB of Storages •The Largest of IT Infrastructure in Korea. •DAUM Pioneered UCC World.
  • 9. 1. The Path of Daum UCC service is Growing Fast 2006.4 6360 % 2007.9
  • 10. Problems on Mass Network Traffic Environment And Their Solutions
  • 11. 2. Problems & Solutions Optimizing Cost •What was in our hand The Largest Portion is Network Traffic Network Traffic Cost Cut down Cost by Optimizing Contents Delivery Procedure
  • 12. 2. Problems & Solutions Optimizing Cost •Grasp the characteristic of UCC Service "Let users have their contents as fast as Possible!“ Not always Good. Not all users are play video files till the end If we could restrict download bandwidth to minimum...?
  • 13. 2. Problems & Solutions Optimizing Cost •What we did What we need was a little more than 1Mbps per session. Set max download bandwidth Infinite 5 Mbps Try to use just as much as we need.
  • 14. 2. Problems & Solutions Optimizing Cost •The Result Immediate Response: Network Traffic Reduced 15% We also can cut the cost about 10% a month Before After Decrement Ratio Day 1 24 Gbps 19 Gbps - 15.4 % Day 2 22 Gbps 19 Gbps - 26.1 % Day 3 19 Gbps 16 Gbps - 16.9 %
  • 15. 2. Problems & Solutions Performance Boost on Image Caching •What was in our hand Single request Dozens of images As burden on image servers gets bigger, QoS gets poorer.
  • 16. 2. Problems & Solutions Performance Boost on Image Caching •What we did Enforce Cache Servers more Optimally, That is Hierarchical architecture that scales well Origin Server Primary Cache Secondary Cache
  • 17. 2. Problems & Solutions Performance Boost on Image Caching •The Result Origin Server Workload dropped
  • 18. 2. Problems & Solutions Performance Boost on Image Caching •The Result Response Time improved dramatically Worst: more than 5 seconds Current : Less than 500ms
  • 19. Things can never be forsaken for your own UCC Video Service
  • 20. 3. Things can never be forsaken Origin Data Protection •NO WONDER Whether you do it or let others do it No matter what, You Have to prepare appropriate Protection
  • 21. 3. Things can never be forsaken Architecture represents essence of service •The Long Tail Contents must be transferred through Hot Zone and Cool Zone freely. Decent Architecture is required. Traffic Hot Zone Cool Zone
  • 22. “The Challenge For Reliable and Efficient Service” Makes Daum UCC More Vaulable. 5.Conclusion
  • 23. Thank you. SungKyu Park, Daum Communicaions lointain@daumcorp.com