What about high volume data transfers when moving your data to the AWS Cloud the first time? Well, you can think of it this way – what would the best route be when travelling to Electronics City from Bangalore city? You would ofcourse take the Elevated Toll Way, right? That is the quickest route & should save you a lot of time, effort & money. Yes, you do pay the Toll but with the smooth journey, you more than make it up for the fuel costs as well as time. Think in the same way about the Metro in the city. The Namma Metro was something Bangalore has been needing for almost a decade and what a relief it has been providing. Basically you need to know which one is the shortest route when travelling through these parts …
If you are new to Chennai OR even an existing native of Chennai (anywhere in Tamil Nadu for that matter), what do you think is a ‘MUST-try’ dish? Ofcourse it is the Dosai and/or Idlis, be it at your nearest SarvanandBhavan or AnandBhavan or even our local open roadside stall. Because that is befitting of the culture here, is sure to taste great, is mostly cost-effective and hardly takes time to serve. On similar lines, it is very important to remember the key tenets of Cloud Computing and the advantages you should leverage once migrated to the Cloud. Without these key tenets, running on the Cloud would just be like running on on-premise hardware or Managed Hosting data center without any of the true Cloud benefits.The main ones among others are Elasticity, Automation, fault-tolerance & Security.
Planning The Migration To The Cloud Santanu Dutt (@san_dutt) Solutions Architect
The “Living and Evolving” AWS Cloud Tools to access services Cross Service features Platform building blocks Infrastructure building blocks
Cloud Building a Cloud Strategy Benefits Zero upfront investment Build a New Cloud-Ready On-demand provisioning applications Design Instant scalability Cloud Strategy “No-brainer to Auto scaling and elasticity move” Apps Existing Pay as you go Applications Planned Phased Removes undifferentiated Migration heavy lifting Startup Developer productivity or SMB Automation orLarge Enterprise
Includes:• Financial Assessment (TCO/ROI Analysis)• How much will it cost to run?• Security and Compliance Assessment• Technical Assessment – Choosing the right candidate – Migrating licensed products – Identifying tools you can reuse – Functional/architectural assessment
“No-brainer to move” Apps • Dev/Test applications • Self-contained Web applications • Social media product marketing Campaigns • Customer training sites • Video portals (transcoding and hosting) • Pre-sales demo portal • Software downloads • Trial applications
Stack rank IT assetsSelect low-hanging fruit first • Search for under-utilized IT assets • Applications that have immediate business need to scale • Applications that are running out of capacity • Easiest to move today • That builds support within your organization and creates awareness and excitement
Identify the Toolsyou can Use and ReuseResource/System Management Tools(AWS Management Console, S3Fox, CA automation manager,NOC, RightScale, enStratus….)Resource Configuration Tools(CloudFormation with Cfengine, Chef, Puppet, Pallet…..)Development and Integration Tools(SDKs, Libraries, Command Line Tools, AWS Resource Center)
Migrating Licensed ProductsBring Your Own License (BYOL)(Oracle, Adobe, MySQL, IBM, MatLab….)Use a utility style pricing model with support package(Redhat, Microsoft, IBM, Wowza, Several DevPay-basedproducts….)Use ISV cloud service(Quantivo, Pervasive, Cast Iron, Cloud Mathematica….)
Includes:• Get your feet wet with Amazon Web Services – Learning AWS – Build reference architecture – Be aware of the security features• Build a prototype/pilot – Build support in your organization – Validate the technology – Test legacy software in the cloud – Perform benchmarks
Amazon EC2, EBS, S3, CloudFront, AMIs, Elastic IPs Launch a Customize AMI Bundle AMI customized AMI Launch AMI Test different Learn about Cloud Front Availability Security Groups Zones Learn Create SnapshotAmazon EC2 of a Volume Create EBS S3 Bucket Attach Volume Volume Restore Snapshot Map DNS to Create Elastic IP Elastic IP S3 Bucket
Includes:• Learning about different database storage options available today• Uploading/moving your data in batches• Analyzing your database/datasets• Build necessary tools and scripts to migrate data• Security of your data (encryption)
Leverage Storage Options in the AWS Cloud Amazon S3 + CloudFront Amazon EC2 Amazon EBS Amazon Amazon RDS Ephemeral Store DynamoDBIdeal for Storing large write-once, read- Storing non-persistent Off-instance Query-able Storing and many types of objects, Static transient updates persistent light-weight querying Content Distribution storage for any attribute data structured kind of data, relational and referential dataIdeal examples Media files, audio, video, images, Config data, scratch Clusters, boot Querying, Web apps, Backups, archives, versioning files, TempDB data, Log or indexing complex data of mapping, transactional commercial tagging, click- systems, RDBMS like stream logs, inventory Oracle, DB2 metadata, management configuration, and order catalogs. fulfillment systemsNot recommended Querying, searching Storing database logs Static data, Complex joins Clustersfor or backups, customer Web-facing or transactions, data content, key- BLOBs value data Relational, typed dataNot recommended Database, file systems Shared drives, Content OLTP, DW cube Clustered DB,examples sensitive data distribution rollups simple lookups
VM Import / Export vCenter Windows Server Server 2008 PluginVMware ESX APIs BucketsVMDK imagesfor Windows VM ImportServer 2008 service Root Data Volume Volume SnapshotsSP2 Amazon EBS Availability Zone #1
Forklift Migration Strategy Forklift Migration StrategyTraditional Data Center AWS cloud Billing Search Service Service Billing SearchD DB BApp-DB Combo
Forklift Migration Strategy Forklift Migration StrategyTraditional Data Center AWS cloud Billing Search Billing Service Service Service Billing Search Billing DB DB DB App-DB Combo
You can extend your data centre! Amazon Virtual Private Cloud Corporate (VPC)Data Center
Expanding Systems into the CloudProvision a private, isolated section of the AWS Cloudwith a topology that closely resembles your network. Corporate data centre Corporate UsersComplete control of networking including private IPs,subnets, ACLs, route tables, gateways Router & FirewallSecure segregation of components and networkaccess for internal users and externalcustomers/partners. VPN Connection Customers/ Partners
Includes:• Leveraging other AWS services• Implementing “Elasticity”• Automating in-cloud software development and deployment lifecycle• Increasing high availability by leveraging multiple Availability Zones• Hardening security
Elasticity is a keytenet of Cloud… Proactive Cyclic Scaling: Periodic scaling that occurs at fixed intervals (daily, weekly, monthly, quarterly) Proactive Event-based Scaling: Scaling just when you are expecting a big surge of traffic requests due to a scheduled business event (new product launch, marketing campaigns) Auto-scaling based on demand: By using monitoring service, your system can sendtriggers to take appropriate actions so that it scales upor down based on metrics (utilization of the servers or network i/o, for instance)
Security is shared responsibility Encrypt data in transitSAS 70 Type II Audit Encrypt data at restISO 27001/2 Certification Protect your AWS credentialsPCI DSS 2.0 Level 1-5 Rotate your keysHIPAA/SOX Compliance Infrastructure Application Secure your application, OS,FISMA A&A Low Security Security Stack and AMIsHow we secure our How can you secure yourinfrastructure application and what is your responsibility? Services SecurityWhat security options Enforce IAM policiesand features are available use MFA, VPC, leverage S3to you? bucket policies, EC2 security groups, EFS in EC2 Etc..
Includes:• Understanding your usage patterns and managing cloud resources more effectively• Optimizing to increase performance, improve efficiency and save further costs• Advanced monitoring and telemetry• Ensuring enhanced security• Refactoring applications as necessary• Leverage AWS best practices
Optimize and Get Immediate ROI• Understand your usage patterns and manage your cloud resources more effectively – Terminate your under-utilized instances – Invest in reserved instances• Improve performance and efficiency – Caching at different levels• Increase visibility of your apps by implementing advanced monitoring and telemetry – Create dashboards to monitor your business SLAs
Define your Success Criteria Developer productivity Business agility Reduced time to marketCloud is not Data center efficiencyjust about Redundancy Chargeback and billingsaving money Eliminates “heavy lifting” Foundation of 21st century Architectures Hardware upgrades Less number of 24/7 personnel
NDTV Video is a cloud-based application for premium video content for itsfive national channels in India.In July 2010, NDTV started the migration of its video properties to theAmazon Web Services (AWS) Cloud in phases over six months.Used its learning from this greenfield deployment and gradually migratedseveral other properties like ndtv.com, NDTV Profit and NDTV Social.Agility, faster time-to-market, elastic capacity and cost savings were someof the clear benefits.
EC2, EBS ELB S3 RDS“AWS gives flexibility in terms of scaling our CloudWatch ”Hardware, based on our day-to-day requirements.Kawaljit Singh Bedi, CTO NDTV Convergence
Use of AWS Business BenefitsInMobi is the world’s largest Scalability to support its rapid growthindependent mobile advertising as well as elasticity to expand andnetwork. contract the IT infrastructure as needed.Migrated its business applications inphases over 12 months with careful Geographically distributedplanning. architecture to serve customers across continents.Used Direct Connect and VPC toextend its current Data Centers into Faster provisioning of apps.AWS.