• Share
  • Email
  • Embed
  • Like
  • Save
  • Private Content
Using AWS CloudFront with S3 at SMARTSTUDY
 

Using AWS CloudFront with S3 at SMARTSTUDY

on

  • 1,742 views

AWS 한국 사용자 그룹 2013년 1회 세미나에서 발표한 자료입니다.

AWS 한국 사용자 그룹 2013년 1회 세미나에서 발표한 자료입니다.

Statistics

Views

Total Views
1,742
Views on SlideShare
1,690
Embed Views
52

Actions

Likes
4
Downloads
18
Comments
0

3 Embeds 52

https://twitter.com 41
http://www.slashdocs.com 6
http://woworiya.wordpress.com 5

Accessibility

Categories

Upload Details

Uploaded via as Adobe PDF

Usage Rights

© All Rights Reserved

Report content

Flagged as inappropriate Flag as inappropriate
Flag as inappropriate

Select your reason for flagging this presentation as inappropriate.

Cancel
  • Full Name Full Name Comment goes here.
    Are you sure you want to
    Your message goes here
    Processing…
Post Comment
Edit your comment

    Using AWS CloudFront with S3 at SMARTSTUDY Using AWS CloudFront with S3 at SMARTSTUDY Presentation Transcript

    • Using CloudFront with S3 at SMARTSTUDY Amazon Web Service Korean User Group Park Hyun-woo, a SCV of SMARTSTUDY / ez@smartstudy.co.kr
    • What is S3 and CF?● S3 : Simple Storage Service ○ Extreme durability. ○ Multiple copies in selected region. ■ vs EBS : Multiple copies in single available zone.● CF : CloudFront ○ Content Delivery Network(CDN) service. ○ Distribute from origin to AWS Edge Network ■ http://aws.amazon.com/cloudfront/#details ■ About 30 edges in global. (only in Earth, lol)
    • Why choose these?● We serve large multimedia contents to global market in mobile application era.● We need redundant, fast and reasonable price content delivery service aims globally.● We have not enough human resource to maintain various system.
    • Flash Movie
    • TranscoderFlash Gnash FFmpeg Package ( encrypted )Movie qtfaststart Thumbnails npk Video S3 Bucket s3cmd ( tokyo )
    • npk Video S3 Bucket s3cmd ( tokyo ) {Edge Edge Edge CloudFront Edge Edge
    • How it works?● Copy to S3 ○ ~100 files, just use Cyberduck or other GUI tool. ○ Or, you have to use s3fs or s3cmd. ○ If you need sync or invalidation, use s3cmd. ○ We have ~30,000 files. Thus, s3cmd. ○ We chose Tokyo bucket for faster uploading.● s3cmd ○ Awesome! ○ Works on S3 and CloudFront.
    • How it works? (cont.)● s3cmd ○ Can do almost everything as like as AWS console. ○ Support INI-style configuration file. ○ And, magical sync command. (yeah!)● s3cmd sync ○ Support glob-style exclude / include option. ○ ... rexclude / rinclude for regular expression. ○ Support automatic invalidation request. ○ ... with rsync-like dry-run option. (-n, --dry-run)
    • How it works? (cont.)● s3cmd sync ○ Basically, sync based on MD5 information. ○ (!) Over 15MB files, using only filesize. ○ Our 30,000 files, 60GB = 8 min to dry-run. ( env : i7 2500K + SATA HDD to bucket in tokyo )● s3cmd sync --cf-invalidate ○ Call invalidation API automatically. ○ (!) Simultaneous invalidation is up to 3. ○ (!) Free for ~1,000 files per month. ○ Check it up by s3cmd cfinvalinfo
    • So, is it really? FAST{ REDUNDANT NOT EXPENSIVE
    • Its fast enough.8.0MB /s
    • Its very redundant.BETTER THAN YOUR OWNSERVER, EVER
    • And NOTEXPENSIVE
    • Bill for Bill forDomestic CDN CloudFrontBased on Based onPeak traffic Total traffic● 350Mbps/@peak ● 10TB/month● $6.00/Mbps ● $0.209/GB = $2,100 = $2,090* * without transfer fee for deploying origin bucket to edges
    • STILLEXPENSIVE?
    • * Photo from Linkedin page of Lee, Jung-in / Amazon Korea
    • For over 10TB, RESERVEDCapacity Pricing
    • Tips● Smaller ○ Encode media with optimal options. ○ Use dedicated option for each platform. ○ Storage is cheaper than transfer fee!● Static ○ Do not deploy volatile objects to CloudFront. ○ Invalidation needs ~10min, often. ○ Were still using Nginx for them.● Streamable ○ Mobile networks are still slow. ○ Do not make users to wait until finishing download.
    • Link● Gnash ○ http://www.gnu.org/software/gnash/● FFmpeg ○ http://www.ffmpeg.org/● qtfaststart ○ https://github.com/danielgtaylor/qtfaststart● npk ○ https://github.com/lqez/npk● s3cmd ○ http://s3tools.org/
    • Using CloudFront with S3 at SMARTSTUDY Amazon Web Service Korean User Group Park Hyun-woo, a SCV of SMARTSTUDY / ez@smartstudy.co.kr