This document discusses how AWS developer tools can help optimize productivity through automating the development, testing, and deployment process. It describes how tools like AWS SDKs, APIs, CLI, and services like EC2, EBS, S3, RDS, SNS, and SQS can be used to automate provisioning of IT resources during development. The document discusses how continuous integration powered by AWS can automate building, testing, and deploying code in parallel across environments. It also discusses how AWS services like CloudFormation, AMIs, and auto-scaling help enable continuous deployment of code changes.

1. Optimizing productivity with
AWS Developer Tools
Johannes Borch – Solutions Architect

2. From Idea to Launch
DEVELOP RELEASE
IDEA BUILD OPERATE LAUNCH

3. Learning from customers
Lots of Learning
DEVELOP RELEASE
IDEA BUILD OPERATE LAUNCH
Some Learning

4. Learning from customers
DEVELOP RELEASE
IDEA BUILD OPERATE LAUNCH
Little or no Learning

5. Reduce the cycle time
DEVELOP RELEASE
IDEA BUILD OPERATE LAUNCH
Cycle Time

6. Automation with Cloud helps
DEVELOP RELEASE
IDEA BUILD OPERATE LAUNCH
Agile Development DevOps
+ Automation + Automation
+ AWS + AWS

7. Continuous Integration
powered by Amazon Web Services
DEVELOP RELEASE
IDEA BUILD OPERATE LAUNCH

8. During Development, Test, Build, …
… you need IT resources

9. My test server
crashed!!!
http://img.ehowcdn.com/article-new/ds-photo/getty/article/83/254/80619407_XS.jpg

11. Compute

12. Amazon EC2
On-demand instances with admin access

15. Storage

16. Amazon EBS
Elastic Block Storage

18.  Tb
per Volume

19. Amazon S3
Simple Storage Service

21. 1b  Tb

22. 99.999999999%
durability

23. Databases

24. Amazon RDS
Relational Database Service

28. Messaging

29. Amazon SNS
Simple Notification Service

30. Amazon SQS
Simple Queue Service

31. IT resources controlled from your development
environment
http://www.flickr.com/photos/pasukaru76/4656715715/sizes/l/in/photostream/

32. Developer tools
Manage your IT infrastructure

33. AWS Management Console

34. AWS Toolkit for Eclipse and Visual Studio

35. APIs / CLI
Script your IT infrastructure

36. JAVA PHP
AWS SDK
RUBY .NET

37. AWS Service coverage
Compute Storage Database CDN Dep. / App.
Mgt. Services
Java
.Net
PHP
Ruby

38. API Documentation

39. Community Contributed
Software

40. 
Starting an EC2 instance

41. JAVA SDK
…
res = ec2.runInstances new RunInstancesRequest([
imageId: "ami-00754474",
keyName: "aws-sa-ww-key",
instanceType: "m1.small",
securityGroups: ["httpssh"],
minCount: 1,
maxCount: 1,
userData: "AWSWeb.war".bytes.encodeBase64().toString()
])
…

42. CLI
PROMPT> ec2-run-instances ami-b232d0db
-n 3 --availability-zone us-east-1a

43. AWS HTTP
https://ec2.amazonaws.com/?Action=RunInstances
&ImageId=ami-60a54009
&MaxCount=3
&MinCount=1
&Placement.AvailabilityZone=us-east-1b
&Monitoring.Enabled=true
&AUTHPARAMS

44. 
Cloud Continuous
Integration

45. Repo
Package
Config Builder Install
Create AMIs
Code Push
Config Test Env
Tests Version Deploy
CI Server Staging Env
Commit to Control Pull Server
Git/master Code Prod Env
Dev
Distributed Builds
Run Tests in parallel
Send Build Report to Dev
Stop everything if build failed
Cloud Continuous Integration

46. Build Job does the following:
1. build the artifact,
2. publish it to Artifactory,
3. build the package,
4. publish the package to the repo .
Then there is a follow on job that mounts a base OS image, installs the
packages and then creates the final AMI.
Source: http://techblog.netflix.com/2011/08/building-with-legos.html

47. Automated Testing in Parallel
• Load Tests
• Web Performance Tests
• Usability Tests
• Unit Tests
• Regression Tests
• Acceptance Tests
• Functional Tests
• Integration Tests
• Capacity Tests
• System Tests

48. RDS Snapshots – Test something quickly
6 PM
7 AM
PROD Bob Test Ted Test Mary Test
Very Very Very
Very Large Small Small Small
Server Server Server
Server
Storage Storage Storage Storage

49. Measure your code
optimization efforts
in $

50. Continuous Deployment
powered by Amazon Web Services
DEVELOP RELEASE
IDEA BUILD OPERATE LAUNCH

51. Incremental Product improvement
1.0.0 1.0.1 1.1.0 2.0.1 2.1.3
http://www.flickr.com/photos/incandopolis/2867941478/sizes/l/in/set-72157607359396757/

52. Your deployment process needs to follow
http://www.flickr.com/photos/victorhansonsmith/1420734769/

53. Software Inventory is lost revenue

54. Amazon May Continuous Deployment Stats
(production hosts and environments only)
11.6 Mean Time between deployments (weekday)
Seconds
1079 Max # of deployments in a single hour
10000 Mean # of hosts simultaneously receiving a deployment
30000 Max # of hosts simultaneously receiving a deployment

55. Automate
AWS is a programmable datacenter

56. Amazon Machine
Images
Pre-configured server Image

57. Virtual Images = Real Productivity Gain
WebIIS
Apache
Server
ASP.NET
Mongrel
Tomcat
App Server
ASP.NET MVC
Struts
Rails
MVC
Your Code
Log4Net
logger
Log4J
Libraries
Spring.NET
RubyGems
Spring
Packages
memcached
nHibernate
Hibernate
DB Caching
Ruby JEE
Runtime
.NET
Framework
Windows
Centos
Linux
OS
Java Stack .NET Stack RoR stack

58. Push to an AMI or Pull from an Instance
Apache Your Code
Your Code Fetch on boot
Fetch on boot
Tomcat
Apache
Apache
Struts Struts
Struts Log4J
Tomcat
Log4J
Tomcat
Spring
Fetch on boot Hibernate
Spring scripts
Struts
Your Code Amazon S3 Amazon S3 Chef/puppet
Your Code
Apache
Log4J A
p
a
c
h
e
Log4J
T
o
A m
p c A
a a p
c t a
h c
A
p
a
c
T
o
m
c
e
Tomcat H
i
b
e
h
e
T
o
A
p
a
c
h a r
Te tS A n m h
o t p a c e
m r a J
t a
c u c E
e t T
a t h E o
Spring
tS s
Y Te A H m
t o o p i c
Spring r u m a b a
CHEF
u r c c e t
h L r
a
t
s
Y
o
C
L
o
tS
t
T
o
e i
n
n
a
H
i
JEE
u J
u d
g r m t b
x E
r e
4 u c e e
t a E r
Hibernate
J
Puppet
C
L S s
Y tS n
o p o t a
d u r J
t
g r
e
4 r u E
e
i L E
J
S
p
n
g
H
i
C
L
o
t
s
Y
o
i
n Linux JEE
u
r b d
g u
x
i e e
4 r
L
n r J
i
Hibernate
g
H n
J S C
L
n
i a
E p o
u
b t
E r d
g
x
e e i e
4
r
n
J
a
E
L
i
n
g
H
i
J
S
p JEE Linux
Hibernate
t
E n b r
JEE
e u e i
x r n
L n
J g
H
i a
E i
n t
E b
u e e
x r
L n
J
i a
E
n t
E
u e
JEE x
L
i
Linux
n
u
x
Linux
JEE Linux
Amazon EC2 Amazon EC2
Amazon EC2
JeOS AMI
Java AMI
Linux Java AMI
Golden AMI and JeOS AMI and library of recipes
Inventory of AMIs Fetch binaries on boot (install scripts)
Java App Stack
Frozen Pizza Model Take N Bake Pizza Model Made to order Pizza Model

59. AWS CloudFormation
Template-based provisioning service

61. {
"AWSTemplateFormatVersion" : "2010-09-09",
"Description" : "Sample web server",
"Parameters" : {
"KeyName" : {
"Description" : "Existing EC2 KeyPair",
"Type" : "String"
}},
…

62. "WebServer": {
"Type": "AWS::EC2::Instance",
"Properties": {
"ImageId" : "ami-7f418316",
"InstanceType" : "m1.small",
"KeyName" : { "Ref" : "KeyName" }
},
"UserData“ : “
…
"
…

63. "UserData": {
"Fn::Base64": {
"Fn::Join": [
"",
[
"#!/bin/bash -exn",
"yum -y install git-coren",
"yum -y install php-pearn",
"pear install Crypt_HMAC2-1.0.0n",
"pear install HTTP_Request-1.4.4n",
"pear channel-discover
pear.amazonwebservices.comn",
"pear install aws/sdkn",

64. "Metadata" : {
"AWS::CloudFormation::Init" : {
"config" : {
"packages" : {
"yum" : { "httpd" : [], "php" : [], "php-mysql" : []
} },
"sources" : {
"/var/www/html" : “http://s3.amazonaws.com/myapp/latest.tar.gz" },
"files" : {
"/var/www/html/myapp/my-config.php" : {
“source” : "https://s3.amazonaws.com/myapp/my-config.php"}},
"services" : {
"sysvinit" : {
"httpd" : {
"enabled" : "true",
"ensureRunning" : "true" },
}
}
}

65. "UserData": {
"Fn::Base64" : { "Fn::Join" : ["",
[ "#!/bin/bashn",
"/opt/aws/bin/cfn-init -s ", { "Ref" : "AWS::StackName" },
"-r WebServer ",
" --access-key ", { "Ref" : "HostKeys" },
" --secret-key ", {"Fn::GetAtt": ["HostKeys", "SecretAccessKey"]},
" --region ", { "Ref" : "AWS::Region" }, "n"]]}} ,

66. aws.amazon.com/cloudformation/aws-cloudformation-articles-and-tutorials/

67. http://aws.amazon.com/cloudformation/aws-cloudformation-
templates/aws-cloudformation-templates-eu-west-1/

68. Example: Redmine

81. 
Cloud Continious
Deployment

82. Repo
Instances
Package
Config Builder Scripts
Cloud-init
CloudFormation
Push Templates
Code
Config
Tests Version Deploy
CI Server
Commit to Control Pull Server
Git/master Code
Dev Build
Run Tests Base AMIs
Send Build Report to Dev
Stop everything if build failed
Cloud Continuous Deployment (Simple)

85. Take advantage of the
AWS programmable
infrastructure in your
software design

86. Auto-discover backend instances

87. Who am I? Infrastructure aware
software components

88. Increasing the speed of Iteration

89. Break your problem into small batches
Stream of small deployments
Incremental changes
Easy rollbacks

90. Deploy new software quickly
Revert a bad change quickly
Cost of
Mistakes

91. Dynamism of the cloud makes its easy

92. FREE TIER!
aws.amazon.com/free

94. Q &A

95. THANK YOU
aws.amazon.com