New York Enterprise
Collaboration Meet up
Dec 2nd 2015 Meetup No. 9
wireless -MSFTOpen
Dec Meetup
Azure vs AWS
www.sohodragon.nyc
AWS vs Azure Bakeoff
AWS by Eugene Y. Jen
Who I am
I am a software engineer for a long time, have worn different hats in my career.
I also worked in system administration on and off.
I built some interested software, unfortunately not open sourced.
I did some startups; one was close to be bought to join AWS before AWS
launched then it failed through.
I had used AWS since 2007 on and off.
I am using AWS daily since 2014.
I have been in a project to do immutable deployment in AWS in last 2 years.
What I am going to present
Overview
The Goods
The Bads
The Uglies
Best way to get on board
Overview of AWS
It is an alphabet soup.
Luckily, AWS in Plain English
Launched officially in 2006 with S3 (Simple Storage Service) and EC2 (Elastic
Computing Cloud)
But SQS (Simple Queue Service) was launched in 2004 publicly.
EC2 was Linux focused. But it added support to Microsoft Windows later. and
even FreeBSD.
Sorry no OS X
Overview of AWS (cont 2/5)
EIP ( Elastic Ip Address )
EBS ( Elastic Block Store )
VPC ( Virtual Private Cloud )
IAM ( Identity and Access Management )
ELB ( Elastic Load Balancer )
RDS ( Relational Data Service ), MySQL, Oracle, MS SQL, PostgresQL
DynamoDB
SimpleDB
Overview of AWS (cont 3/5)
Route 53
Elastic MapReduce
CloudFront
OpsWork
CodeDeploy
CloudWatch
Management Console
KMS ( Key Management Service )
Overview of AWS ( cont 4/5 )
SNS (Simple Notification Service )
Mechanical Turk
Machine Learning
Kinesis
Fulfillment
API Gateway
CloudSearch
ElasticSearch
Overview of AWS ( cont 5/5 )
Device Farms
FPS ( Flexible Payments Service )
DevPay
EFS
Glacier
Storage Gateway
DirectConnect
Inspector
I think you have given up now
There are more services unlisted in previous slides.
AWS is keeping on adding new services
AWS is keeping on adding new features to existing products
AWS is keeping on fixing bugs
AWS is keeping on adding more data centers around the world see regions
What are those services and regions all about? A dream from a mad scientist?
Probably will be the largest distributed system
AWS is probably will be largest working distributed system
I maybe wrong. Maybe Google or Facebook has bigger distributed systems.
It serves Amazon.com itself
It serves a lot of Web traffic ( Netflix, AirBnB, Slack, FourSquare …)
So far, it seems like under pretty good leadership of Werner Vogels
It also starts to bring us to microservices based architecture due to AWS
success. And success from Netflix as a customer start to encourage other
companies to use AWS to build elastic scalable computing systems
The Goods
Elasticity on resources
Elasticity is more than scalability.
Enable computing as utilities
Plan well, then it enables you to see the cost of your own services.
Plan well, then it also changse your company’s tax deduction ( From
investment of capital expenditures of data centers to operating cost of
AWS service charges )
Lambda, API Gateway
The Goods ( cont )
Fully programmable
Enable infrastructure as code
Enable automated infrastructure operation
Enable immutable deployment
Enable reproducible infrastructures
Easier continuous delivery
You almost can build anything you can imagine
Enpower tech teams if plan well.
The Goods ( cont )
Variety of Services
Most services are derived from Amazon’s internal services.
New services and features on customer feedback
The Goods ( Cont )
A very large group of users
AWS re:Invent 2015: more than 10k attendees
A lot of code in Github that utilize AWS APIs.
The Goods ( Cont )
A lot of third party offerings
A lot of niche offering on management, monitoring, training, data analysis, IoT
The Goods ( cont )
Relative strong customer supports and training material
In NYC, A monthly meetup in AWS Pop-up Loft.
Relative well written documentation
A lot of videos and slides from past conference online, and you can spend time
to learn from other pioneers that use AWS before you.
The Bads
Relative expensive than hosting your own servers.
Your EC2 instances died
Relative complex in IAM configuration
Relative complex in Glacier policies
UDP packet lost is high
Cloud Formation config file is hard to maintained
VPC lacks some features to make peering easier
Most service are just good enough in comparison to other similar offering if you
The Uglies
AWS is going to be the single point of success, especially in U.S.
I have not yet seen competitors’ offerings catching up
If you want to use AWS efficiently, you probably need to rewrite everything in
your current stack.
Otherwise it is more expensive than running your service on other providers,
such as Softlayers, Rackspace, Linode and Digital Ocean.
Or more expensive to run your own data centers if you are big as Facebook or
Google
Do you trust Amazon with your data?
Best way to get on board
Move some of system to AWS and read the doc.
Depends who you are, and you need to change your ways of thinkings
C-level Management of existing software company
C-level Management of startups
Middle Management of existing software company
Developer/Engineer
System Admin/DevOps
Database Administrators
C-Level Management of Existing Software
If you commit to migrate to AWS, being prepared for expenses increase in
current software stack in the beginning.
You need to invest to retool your software stack to use AWS efficiently to
reduce your cost
You need to invest your tech team to train them in AWS and learn basic
distributed systems in computer science. So they will use the AWS well.
That means it may take years to reap benefits
Know your external dependencies.
C-Level Management of Startups
You probably should use Lambda and Beanstalk in the beginning.
Build MVP first.
You probably can scale up to EC2 later if the product is proven
Lambda probably saves you a lot of money in operations than salary to
developers
Exploit the elasticity of AWS and services. Focus on your own product/service
and lower operation cost.
Middle Management of existing software
Be sure to include cost of software rewriting / re-architect from existing software
Support you tech team to exploit elasticity to create continuous delivery pipeline
for your own software
Train your tech team to learn AWS and distributed systems
Educate your product team to utilize the elasticity of computations in your own
service and product to your customers and support tech team to build those
Use AWS to track down costs in your software systems and perform cost
benefit analysis for product development
Encourage work smarter, instead of long hours.
Developers/Engineers
Learn By Doing, trials and errors.
Learn basics of distributed system if you did not take course before in school.
Read some great papers in distributed computing / systems
Build micro service based system.
Build stateless workers
Avoid database schema spaghetti
Exploit Continuous Integration / Continuous Delivery for your own good
Test driven development
System Administrators/DevOps
Infrastructure as code
Configuration Management may not be scalable. So use with caution.
Code and Configurations are artifact
Build continuous integration / continuous delivery pipeline for your dev teams
Educate yourselfs for distributed systems
Monitoring
Build / Adopt tools for your tech teams
Build your service as self-service so it can scale
Database Administrators
You should now do frequent backup and restore exercises. There is no excuses
of not doing those tasks due to you have a elastic database services in AWS.
Investigate how to migrate data among your environment in AWS to encourage
better test driven development in your tech team.
You may not be able to tweak too much on AWS instances. But if you build a
reproducible infrastructure, then you now can experiment on your databases
without worrying screwing up critical company’s business.
Remove yourself from critical path and single point of success.
Data Scientists
Storage is cheap
Learn to script and reproducible experiment with source control
Exploit the elasticity in computing power
Learn how to move large data from S3 to your instances/containers
Learn to exploit EMR, RedShift, Beanstalk
Thanks
Thanks for my coworkers to review my slides
Daniel T. Kristjansson
Milen Pavlov
Ilya A. Sukhanov
Kulesh Shanmugasundaram
Aaron W. Harnly
Pratap Chand

Aws vs azure bakeoff

  • 1.
    New York Enterprise CollaborationMeet up Dec 2nd 2015 Meetup No. 9 wireless -MSFTOpen Dec Meetup Azure vs AWS www.sohodragon.nyc
  • 2.
    AWS vs AzureBakeoff AWS by Eugene Y. Jen
  • 3.
    Who I am Iam a software engineer for a long time, have worn different hats in my career. I also worked in system administration on and off. I built some interested software, unfortunately not open sourced. I did some startups; one was close to be bought to join AWS before AWS launched then it failed through. I had used AWS since 2007 on and off. I am using AWS daily since 2014. I have been in a project to do immutable deployment in AWS in last 2 years.
  • 4.
    What I amgoing to present Overview The Goods The Bads The Uglies Best way to get on board
  • 5.
    Overview of AWS Itis an alphabet soup. Luckily, AWS in Plain English Launched officially in 2006 with S3 (Simple Storage Service) and EC2 (Elastic Computing Cloud) But SQS (Simple Queue Service) was launched in 2004 publicly. EC2 was Linux focused. But it added support to Microsoft Windows later. and even FreeBSD. Sorry no OS X
  • 6.
    Overview of AWS(cont 2/5) EIP ( Elastic Ip Address ) EBS ( Elastic Block Store ) VPC ( Virtual Private Cloud ) IAM ( Identity and Access Management ) ELB ( Elastic Load Balancer ) RDS ( Relational Data Service ), MySQL, Oracle, MS SQL, PostgresQL DynamoDB SimpleDB
  • 7.
    Overview of AWS(cont 3/5) Route 53 Elastic MapReduce CloudFront OpsWork CodeDeploy CloudWatch Management Console KMS ( Key Management Service )
  • 8.
    Overview of AWS( cont 4/5 ) SNS (Simple Notification Service ) Mechanical Turk Machine Learning Kinesis Fulfillment API Gateway CloudSearch ElasticSearch
  • 9.
    Overview of AWS( cont 5/5 ) Device Farms FPS ( Flexible Payments Service ) DevPay EFS Glacier Storage Gateway DirectConnect Inspector
  • 10.
    I think youhave given up now There are more services unlisted in previous slides. AWS is keeping on adding new services AWS is keeping on adding new features to existing products AWS is keeping on fixing bugs AWS is keeping on adding more data centers around the world see regions What are those services and regions all about? A dream from a mad scientist?
  • 11.
    Probably will bethe largest distributed system AWS is probably will be largest working distributed system I maybe wrong. Maybe Google or Facebook has bigger distributed systems. It serves Amazon.com itself It serves a lot of Web traffic ( Netflix, AirBnB, Slack, FourSquare …) So far, it seems like under pretty good leadership of Werner Vogels It also starts to bring us to microservices based architecture due to AWS success. And success from Netflix as a customer start to encourage other companies to use AWS to build elastic scalable computing systems
  • 12.
    The Goods Elasticity onresources Elasticity is more than scalability. Enable computing as utilities Plan well, then it enables you to see the cost of your own services. Plan well, then it also changse your company’s tax deduction ( From investment of capital expenditures of data centers to operating cost of AWS service charges ) Lambda, API Gateway
  • 13.
    The Goods (cont ) Fully programmable Enable infrastructure as code Enable automated infrastructure operation Enable immutable deployment Enable reproducible infrastructures Easier continuous delivery You almost can build anything you can imagine Enpower tech teams if plan well.
  • 14.
    The Goods (cont ) Variety of Services Most services are derived from Amazon’s internal services. New services and features on customer feedback
  • 15.
    The Goods (Cont ) A very large group of users AWS re:Invent 2015: more than 10k attendees A lot of code in Github that utilize AWS APIs.
  • 16.
    The Goods (Cont ) A lot of third party offerings A lot of niche offering on management, monitoring, training, data analysis, IoT
  • 17.
    The Goods (cont ) Relative strong customer supports and training material In NYC, A monthly meetup in AWS Pop-up Loft. Relative well written documentation A lot of videos and slides from past conference online, and you can spend time to learn from other pioneers that use AWS before you.
  • 18.
    The Bads Relative expensivethan hosting your own servers. Your EC2 instances died Relative complex in IAM configuration Relative complex in Glacier policies UDP packet lost is high Cloud Formation config file is hard to maintained VPC lacks some features to make peering easier Most service are just good enough in comparison to other similar offering if you
  • 19.
    The Uglies AWS isgoing to be the single point of success, especially in U.S. I have not yet seen competitors’ offerings catching up If you want to use AWS efficiently, you probably need to rewrite everything in your current stack. Otherwise it is more expensive than running your service on other providers, such as Softlayers, Rackspace, Linode and Digital Ocean. Or more expensive to run your own data centers if you are big as Facebook or Google Do you trust Amazon with your data?
  • 20.
    Best way toget on board Move some of system to AWS and read the doc. Depends who you are, and you need to change your ways of thinkings C-level Management of existing software company C-level Management of startups Middle Management of existing software company Developer/Engineer System Admin/DevOps Database Administrators
  • 21.
    C-Level Management ofExisting Software If you commit to migrate to AWS, being prepared for expenses increase in current software stack in the beginning. You need to invest to retool your software stack to use AWS efficiently to reduce your cost You need to invest your tech team to train them in AWS and learn basic distributed systems in computer science. So they will use the AWS well. That means it may take years to reap benefits Know your external dependencies.
  • 22.
    C-Level Management ofStartups You probably should use Lambda and Beanstalk in the beginning. Build MVP first. You probably can scale up to EC2 later if the product is proven Lambda probably saves you a lot of money in operations than salary to developers Exploit the elasticity of AWS and services. Focus on your own product/service and lower operation cost.
  • 23.
    Middle Management ofexisting software Be sure to include cost of software rewriting / re-architect from existing software Support you tech team to exploit elasticity to create continuous delivery pipeline for your own software Train your tech team to learn AWS and distributed systems Educate your product team to utilize the elasticity of computations in your own service and product to your customers and support tech team to build those Use AWS to track down costs in your software systems and perform cost benefit analysis for product development Encourage work smarter, instead of long hours.
  • 24.
    Developers/Engineers Learn By Doing,trials and errors. Learn basics of distributed system if you did not take course before in school. Read some great papers in distributed computing / systems Build micro service based system. Build stateless workers Avoid database schema spaghetti Exploit Continuous Integration / Continuous Delivery for your own good Test driven development
  • 25.
    System Administrators/DevOps Infrastructure ascode Configuration Management may not be scalable. So use with caution. Code and Configurations are artifact Build continuous integration / continuous delivery pipeline for your dev teams Educate yourselfs for distributed systems Monitoring Build / Adopt tools for your tech teams Build your service as self-service so it can scale
  • 26.
    Database Administrators You shouldnow do frequent backup and restore exercises. There is no excuses of not doing those tasks due to you have a elastic database services in AWS. Investigate how to migrate data among your environment in AWS to encourage better test driven development in your tech team. You may not be able to tweak too much on AWS instances. But if you build a reproducible infrastructure, then you now can experiment on your databases without worrying screwing up critical company’s business. Remove yourself from critical path and single point of success.
  • 27.
    Data Scientists Storage ischeap Learn to script and reproducible experiment with source control Exploit the elasticity in computing power Learn how to move large data from S3 to your instances/containers Learn to exploit EMR, RedShift, Beanstalk
  • 28.
    Thanks Thanks for mycoworkers to review my slides Daniel T. Kristjansson Milen Pavlov Ilya A. Sukhanov Kulesh Shanmugasundaram Aaron W. Harnly Pratap Chand