Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
David Potes – Manager, Solution Architecture at ...
Couchbase and AWS Partnership
● >25% of Couchbase customers run on AWS
● Listed on AWS Marketplace since 2012
● APN Advanc...
Couchbase and AWS Customers
Understanding AWS Storage
AWS Storage
Amazon S3
Multi-tenant
Key-store
Native API
Amazon EBS
Single-tenant
Block-store
Amazon EFS
Shared/Distributed...
A little EBS history…
• 2006 – EC2 launched with instance storage
• 2008 – EBS (Elastic Block Storage) launched on magneti...
AWS
block storage
offerings
EC2 instance
store
sc1st1
io1gp2
EBS
SSD-backed
volumes
EBS
HDD-backed
volumes
EBS volume types
●General
Purpose
gp2
●Provisio
ned IOPS
io1
●Throughput
Optimized
HDD
st1
●Co
ld
sc1
SSD HDD
Throughput
is more important
Small, random I/O Large, sequential I/O
Latency?
I2/3
gp2 io1 sc1 st1
d2
Choosing an EBS volu...
Understanding Amazon EC2
Host Server
Hypervisor
Guest 1 Guest 2 Guest n
Amazon EC2 instances
In the past
 First launched in August 2006
 M1 instance
 “One size fits all” M1
Instance generation
c4.xlarge
Instance family Instance size
EC2 instance families
General
purpose
Compute
optimized
C3
Storage and I/O
optimized
I3 P2
Accelerated
Memory
optimized
R4...
What’s a virtual CPU? (vCPU)
 A vCPU is typically a hyper-threaded physical core*
 On Linux, “A” threads enumerated befo...
Network security in VPC
Network ACLs: Stateless firewalls
English translation: Allow all traffic in
Can be applied on a subnet basis
“MyWebServers” Security Group
“MyBackends” Security Group
Allow only “MyWebServers”
Security groups follow application str...
Security groups example: Web servers
In English: Hosts in this group are reachable from the
Internet on port 80 (HTTP)
Security groups example: Backends
In English: Only instances in the MyWebServers Security Group
can reach instances in thi...
Security groups in VPC: Additional notes
• Follow the “principle of least privilege”
• VPC allows creation of egress as we...
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Best Practices
Architecture
us-east-1a
(Availability
Zone)
Auto Scaling Group
us-east-1 (Region)
us-east-1b
(Availability
Zone)
us-east-1...
Compute
● EBS backed – t2, m4, c4, r4
● 4 or more cores
● R4.4xlarge is the go to
● Use Auto Scaling groups
● Disable Auto...
Storage
● EBS gp2 is the go to
● EBS io1
● + performant
● - expensive
● Instance storage
● + performant
● - costly
● - com...
Networking
● Deployment is simpler with the
default VPC
● Configure nodes with public DNS
Amazon
VPC
© 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Deployment
AWS Quick Start
Automated reference deployments on AWS
Help streamline installation and configuration
Focus on enabling cu...
Couchbase on AWS Marketplace
● Couchbase Enterprise
• Server
• Sync Gateway
● AMI and CFT
● Hourly Pricing and BYOL
● Mark...
Announcing Availability of Multi-AMI Solutions
● Launch Couchbase Server
and Sync Gateway with a
single Marketplace listin...
Couchbase Partners Github
● Deploy with the AWS CLI
● Source for all the
Marketplace offers
● Simple template that is a
go...
Next Steps
● More information is available at
https://www.couchbase.com/partners/aws
● Couchbase QuickStart on Github
● Ma...
Upcoming SlideShare
Loading in …5
×

Couchbase on AWS – Connect Silicon Valley 2017

227 views

Published on

Speakers: Ben Lackey, Couchbase and David Potes, Amazon

Learn about deploying Couchbase on AWS with the AWS Marketplace using the new multi AMI feature, the AWS Quick Start as well as the AWS CLI. See how to deploy clusters that leverage MDS, XDCR, and Mobile. Hear about best practices, including EC2 instance types, disk configurations, networking, and HA/FD. Couchbase is an AWS Advanced Partner and collaborates closely with AWS engineering in Seattle to ensure Couchbase leverages the latest AWS features.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

Couchbase on AWS – Connect Silicon Valley 2017

  1. 1. © 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. David Potes – Manager, Solution Architecture at AWS Ben Lackey – Director, Cloud Partnerships at Couchbase Couchbase on AWS
  2. 2. Couchbase and AWS Partnership ● >25% of Couchbase customers run on AWS ● Listed on AWS Marketplace since 2012 ● APN Advanced Tier Partner ● Collaborative joint engineering
  3. 3. Couchbase and AWS Customers
  4. 4. Understanding AWS Storage
  5. 5. AWS Storage Amazon S3 Multi-tenant Key-store Native API Amazon EBS Single-tenant Block-store Amazon EFS Shared/Distributed POSIX NFS/SMB (CIFS)
  6. 6. A little EBS history… • 2006 – EC2 launched with instance storage • 2008 – EBS (Elastic Block Storage) launched on magnetic storage • 2012 – EBS Provisioned IOPS and EBS-Optimized instances • 2014 – SSD-Backed general purpose storage • 2014 – EBS data volume encryption.2015 – Larger and faster EBS volumes.2015 – EBS boot volume encryption • 2016 – EBS Throughput Optimized HDD (st1) and Cold HDD (sc1) volume types • 2017 – EBS Elastic Volumes!
  7. 7. AWS block storage offerings EC2 instance store sc1st1 io1gp2 EBS SSD-backed volumes EBS HDD-backed volumes
  8. 8. EBS volume types ●General Purpose gp2 ●Provisio ned IOPS io1 ●Throughput Optimized HDD st1 ●Co ld sc1 SSD HDD
  9. 9. Throughput is more important Small, random I/O Large, sequential I/O Latency? I2/3 gp2 io1 sc1 st1 d2 Choosing an EBS volume type IOPS ≤ 65,000> 65,000 < 1 ms Single-digit ms ≤ 1,250 MB/s Aggregate throughput? > 1,250 MB/s is more important ≤ 10k IOPS > 10k IOPS Throughput per volume 250 MiB/s 500 MiB/s IOPS per volume
  10. 10. Understanding Amazon EC2
  11. 11. Host Server Hypervisor Guest 1 Guest 2 Guest n Amazon EC2 instances
  12. 12. In the past  First launched in August 2006  M1 instance  “One size fits all” M1
  13. 13. Instance generation c4.xlarge Instance family Instance size
  14. 14. EC2 instance families General purpose Compute optimized C3 Storage and I/O optimized I3 P2 Accelerated Memory optimized R4C4 M4 D2 X1 G2 F1
  15. 15. What’s a virtual CPU? (vCPU)  A vCPU is typically a hyper-threaded physical core*  On Linux, “A” threads enumerated before “B” threads  On Windows, threads are interleaved  Divide vCPU count by 2 to get core count  Cores by EC2 & RDS DB Instance type: https://aws.amazon.com/ec2/virtualcores/ * The “t” family is special
  16. 16. Network security in VPC
  17. 17. Network ACLs: Stateless firewalls English translation: Allow all traffic in Can be applied on a subnet basis
  18. 18. “MyWebServers” Security Group “MyBackends” Security Group Allow only “MyWebServers” Security groups follow application structure
  19. 19. Security groups example: Web servers In English: Hosts in this group are reachable from the Internet on port 80 (HTTP)
  20. 20. Security groups example: Backends In English: Only instances in the MyWebServers Security Group can reach instances in this Security Group
  21. 21. Security groups in VPC: Additional notes • Follow the “principle of least privilege” • VPC allows creation of egress as well as ingress security group rules • Many application architectures lend themselves to a 1:1 relationship between security groups (who can reach me) and IAM roles (what I can do)
  22. 22. © 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Best Practices
  23. 23. Architecture us-east-1a (Availability Zone) Auto Scaling Group us-east-1 (Region) us-east-1b (Availability Zone) us-east-1c (Availability Zone) ap-south-1a (Availability Zone) Auto Scaling Group ap-south-1 (Region) ap-south-1b (Availability Zone) XDCR
  24. 24. Compute ● EBS backed – t2, m4, c4, r4 ● 4 or more cores ● R4.4xlarge is the go to ● Use Auto Scaling groups ● Disable Auto Scaling ● Multiple AZ with Couchbase Server Groups Auto Scaling AMI Amazon EC2 Auto Scaling group AMI AMI
  25. 25. Storage ● EBS gp2 is the go to ● EBS io1 ● + performant ● - expensive ● Instance storage ● + performant ● - costly ● - complex administration Amazon EBS (Data) Amazon EBS (OS) AMI
  26. 26. Networking ● Deployment is simpler with the default VPC ● Configure nodes with public DNS Amazon VPC
  27. 27. © 2015, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Deployment
  28. 28. AWS Quick Start Automated reference deployments on AWS Help streamline installation and configuration Focus on enabling customers Couchbase on AWS preview available!
  29. 29. Couchbase on AWS Marketplace ● Couchbase Enterprise • Server • Sync Gateway ● AMI and CFT ● Hourly Pricing and BYOL ● Marketplace
  30. 30. Announcing Availability of Multi-AMI Solutions ● Launch Couchbase Server and Sync Gateway with a single Marketplace listing using CFT ● Announcement ● Marketplace
  31. 31. Couchbase Partners Github ● Deploy with the AWS CLI ● Source for all the Marketplace offers ● Simple template that is a good starting point for customizations ● Generator for MDS and advanced configurations ● GitHub
  32. 32. Next Steps ● More information is available at https://www.couchbase.com/partners/aws ● Couchbase QuickStart on Github ● Mail partners@couchbase.com for an AWS credit code to get started

×