Dev Ops on AWS with PowerShell (PowerShell Conference Asia 2016)
•Download as PPTX, PDF•
1 like•615 views
Guillermo Musumeci gave a presentation on deploying and managing infrastructure on AWS using PowerShell. He demonstrated how to launch Windows EC2 instances, configure security groups, add tags, attach EBS volumes, bootstrap instances, create VPCs and subnets, launch Active Directory and IIS servers, configure load balancers and auto scaling groups to build scalable multi-AZ architectures on AWS using PowerShell commands. The presentation provided examples of common infrastructure automation tasks that can be performed programmatically using the AWS Tools for PowerShell.
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (12)
Similar to Dev Ops on AWS with PowerShell (PowerShell Conference Asia 2016)
Similar to Dev Ops on AWS with PowerShell (PowerShell Conference Asia 2016) (20)
Recently uploaded
Recently uploaded (20)
Dev Ops on AWS with PowerShell (PowerShell Conference Asia 2016)
- 1. PowerShell Conference Asia DevOps on AWS with PowerShell Guillermo Musumeci @gmusumeci #psconfasia
- 2. PowerShell Conference Singapore 2016 Who is this guy? • Started my career in Microsoft, 20 years ago. • Lived in Buenos Aires, Washington DC, Madrid, Paris and Singapore. • Solutions Architect @ AWS Singapore, Microsoft SME for ASEAN. • Cloud Evangelist. Expert in automating and deploying Microsoft workloads in Amazon Web Services, Microsoft Azure & Google Cloud. • Love to create and build stuff. Developer. Entrepreneur. Curious. • Book author. Books lover. Husband & Dad. Foodie. • Startup Mentor. I ♥ Startups.
- 3. PowerShell Conference Singapore 2016 What we will cover • Tools setup • Launching EC2 instances • Tagging resources • Creating Security Groups • Finding resources using filters • Adding storage to instances • Bootstrapping instances with UserData • Configuring VPCs and Subnets
- 4. PowerShell Conference Singapore 2016 What we will cover (continued) • Configuring Internet Gateways and NAT Gateways • Launching RDP Gateway servers • Launching Active Directory Domain Controllers • Launching IIS Web Servers • Single-AZ Full Stack • Multi-AZ Full Stack • Elastic Load Balancer • Auto Scaling EC2 Instances
- 5. PowerShell Conference Singapore 2016 Before you get started • You need an AWS account • PowerShell 2.0 or later installed. • Basic knowledge of some AWS services: • EC2 instances • Security Groups • VPCs and subnets
- 6. PowerShell Conference Singapore 2016 Setting up the tool • Download and install AWS Tools for Windows PowerShell from https://aws.amazon.com/powershell/ • The installer for the Tools for Windows PowerShell installs the most recent version of the AWS SDK for .NET and also the AWS Toolkit for Visual Studio. • If you are using an AWS EC2 instance as bastion or management server, AWS Tools for Windows PowerShell is preinstalled on the Windows machine.
- 7. PowerShell Conference Singapore 2016 Installing the AWS Tools for PowerShell Core • The AWS Tools for PowerShell Core can be installed on computers that are running Microsoft PowerShell 5.1 or a later release of PowerShell, including: • Ubuntu 14.04 LTS and later • CentOS Linux 7 • Mac OS X • Windows 8.1 Enterprise • Windows Server 2012 R2 • Windows 10 for Business • Download the AWS Tools for PowerShell Core at https://www.powershellgallery.com/packages/AWSPowerShell.NetCore
- 9. PowerShell Conference Singapore 2016 Configuring the AWS Command Line Interface • To add a new profile to the AWS SDK store, call Set-AWSCredentials as follows: where • -AccessKey – The access key. • -SecretKey – The secret key. • -StoreAs – The profile name, which must be unique. • To specify the default profile, set the profile name to default.
- 10. PowerShell Conference Singapore 2016 Configuring the AWS Command Line Interface • List profiles You can check the current list of names as follows: • Remove a profile To remove a profile, use the following command: • The -StoredCredentials parameter specifies the profile name.
- 11. 14 Regions 38 Availability Zones 59 Edge Locations Build it once, repeat it everywhere
- 12. PowerShell Conference Singapore 2016 Configure the AWS region • Using the Get-AWSRegion command to list AWS regions available
- 13. Exploring the AWS PowerShell Module
- 14. PowerShell Conference Singapore 2016 Exploring AWS PowerShell Module • Use the Get-Command command to lists all commands in the AWS module
- 15. PowerShell Conference Singapore 2016 Exploring AWS PowerShell Module • Using Get-Command with the –Noun parameter to filter commands
- 16. PowerShell Conference Singapore 2016 Exploring AWS PowerShell Module • Using Get-Command cmdlet with –Noun and –Verb parameters to filter commands
- 17. PowerShell Conference Singapore 2016 Exploring AWS PowerShell Module • Using Help cmdlet with –Examples parameter to display examples
- 18. PowerShell Conference Singapore 2016 History of AWS cmdlets • The $AWS-History command enumerate AWS cmdlets that are being used
- 19. Building an EC2 instance
- 20. PowerShell Conference Singapore 2016 Compute Services 20 Auto Scaling Elastic Load Balancing Automated scaling of EC2 capacity Dynamic traffic distribution Amazon EC2 Elastic virtual servers in the cloud EC2 EC2 EC2 EC2 EC2 EC2 Actual EC2
- 21. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Choosing the right AMI for your instance
- 22. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Select the EC2 instance type
- 23. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • EC2 Instance Families
- 24. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Configure instance details
- 25. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Configures EC2 instance storage
- 26. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Using tags to identify your EC2 instances
- 27. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Configure Security Groups. A security group acts as a virtual firewall that controls the traffic for one or more instances
- 28. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Final step: select existing or create a key pair
- 29. Building an EC2 instance Choosing the Amazon Machine Instance (AMI)
- 30. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • The Get-EC2Image cmdlet retrieves a list of AMIs that you can use.
- 31. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • The Get-EC2ImageByName cmdlet filter the list of AWS Windows AMIs based on the type of server configuration you are interested in.
- 32. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Getting the ImageId using the Get-EC2ImageByName cmdlet
- 33. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Getting the ImageId using the Get-EC2ImageByName cmdlet
- 34. Building an EC2 instance Launching an EC2 instance
- 35. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Creating an EC2 instance using New-EC2Instance cmdlet
- 36. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Creating an EC2 instance using New-EC2Instance cmdlet. • Using $instance_id to capture the result of the cmdlet.
- 37. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Using $instance_id to capture the result of the cmdlet. • Getting details of EC2 instance with .Instances parameter.
- 38. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Using Remove-EC2Instance cmdlet to stop and terminate the EC2 Instance stored in the $ec2 variable • Use the Select –ExpandProperty to simplify your life
- 39. Building an EC2 instance Configuring Security Groups
- 40. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Using Get-EC2SecurityGroup cmdlet to list security groups
- 41. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Filter Security Groups and then list rules
- 42. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Add a new rule to existing security group
- 43. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Adding the new inbound rule to the Security Group • Using the .IpPermission parameter to verify new rule was added successfully to the Security Group
- 44. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Creating a new Security Group
- 45. Building an EC2 instance Tagging EC2 Instances
- 46. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Creating a new tag • Filter the Get-EC2Instance cmdlet results using tags
- 47. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Using the Get-ECTag cmdlet to filter instances
- 48. Building an EC2 instance Managing storage
- 49. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Create a new EBS Block Device • Then a Block Device Mapping
- 50. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Add an extra EBS drive to EC2 instance when launched • Use Get-EC2Volume cmdlet to list volumes attached to EC2 instances
- 51. PowerShell Conference Singapore 2016 Building a Windows EC2 instance • Creating a new EBS volume • Attaching EBS volume to existing EC2 Instance
- 53. PowerShell Conference Singapore 2016 Managing EC2 Instance Password • Using the Get-EC2PasswordData cmdlet to decrypt the administrator password for EC2 instances launched using a key pair • If you keep all key pair files in the same folder also you can type:
- 55. PowerShell Conference Singapore 2016 Bootstrapping an EC2 Instance • Configuring Instances with User Data • Note: User data is limited to 16 KB in raw form, not base64-encoded form. User data is executed only at launch.
- 56. Accessing local EC2 Instance Metadata
- 57. PowerShell Conference Singapore 2016 Accessing local EC2 instance Metadata • Instance metadata is data about your instance that you can use to configure or manage the running instance. • You can only access instance metadata and user data from within the instance itself.
- 58. PowerShell Conference Singapore 2016 Accessing local EC2 instance Metadata • Retrieving the metadata information from the local machine
- 60. PowerShell Conference Singapore 2016 Amazon Virtual Private Cloud (VPC) • Provision a logically isolated section of the AWS cloud • Control your virtual networking environment • Subnets • Route Tables • Security Groups • Network ACLs • Connect to your on-premises network via hardware VPN • Control if and how your instances access the Internet
- 61. PowerShell Conference Singapore 2016 Create a VPC with Public and Private Subnets
- 62. PowerShell Conference Singapore 2016 Creating the VPC • Using the New-EC2Vpc cmdlet to create a new VPC and New-EC2Tag to tag it
- 63. PowerShell Conference Singapore 2016 Creating subnets • Using the New-EC2Subnet cmdlet to create public and private subnets and New-EC2Tag to tag them
- 64. PowerShell Conference Singapore 2016 Creating the Internet Gateway • The Internet Gateway connects the VPC to the Internet and to other AWS services • We using the New-EC2InternetGateway cmdlet to create a new IG and Add-EC2InternetGateway cmdlet to attach the IG to the VPC
- 65. PowerShell Conference Singapore 2016 Creating the NAT Gateway • The NAT gateway uses Elastic IP address. This enables instances in the private subnet to send requests to the Internet • We are using the New-EC2Address cmdlet to get an Elastic IP address and then New-EC2NatGateway cmdlet to create the NAT Gateway
- 66. PowerShell Conference Singapore 2016 Creating Security Groups for External Access • Create rules and security groups to allow RDP and SSH from internet
- 67. PowerShell Conference Singapore 2016 Creating Security Groups for Internal Access • Create rules and security groups to allow RDP from DMZ and unrestricted access inside private subnet
- 68. PowerShell Conference Singapore 2016 Creating Routes • Create public route table rules • Create private route table rules
- 70. PowerShell Conference Singapore 2016 Building a RDP Gateway • Using User Data script to create the Remote Desktop Gateway • Launching the RDP Gateway on the public subnet
- 72. PowerShell Conference Singapore 2016 Building a AD Domain Controller • Using User Data script to create an Active Directory domain controller
- 73. PowerShell Conference Singapore 2016 Building a AD Domain Controller • Using the New-EC2Instance cmdlet and user data to automate the launch of an Active Directory domain controller on the private subnet
- 75. PowerShell Conference Singapore 2016 Building a IIS Web Servers • Using User Data script to configure the IIS Web Server • Launching the IIS Web Server on the private subnet
- 77. PowerShell Conference Singapore 2016 Example 3-tier Web App architecture
- 78. Configuring ELB (Elastic Load Balancer)
- 79. PowerShell Conference Singapore 2016 Creating an ELB • Creating a Security Group for the ELB • Creating the ELB Listener
- 80. PowerShell Conference Singapore 2016 Creating an ELB (continues) • Using the New-ELBLoadBalancer cmdlet to launch the ELB • Configuring ELB health check settings with the Set-ELBHealthCheck cmdlet
- 82. PowerShell Conference Singapore 2016 Creating an Auto Scaling group • Creating a Security Group for the Auto Scaling Group • User Data to bootstrap the web server
- 83. PowerShell Conference Singapore 2016 Creating an Auto Scaling group (continues) • Using the New-ASLaunchConfiguration cmdlet to configure the EC2 instance configuration • Finally, using the New-ASAutoScalingGroup cmdlet to create and launch the Auto Scaling Group
- 84. PowerShell Conference Singapore 2016 Sample code available at https://github.com/guillermo-musumeci/PowerShell Thank you! Guillermo Musumeci @gmusumeci
Editor's Notes
- User data is limited to 16 KB. This limit applies to the data in raw form, not base64-encoded form. User data must be base64-encoded before being submitted to the API. User data is executed only at launch.
- Amazon Virtual Private Cloud (Amazon VPC) lets you provision a logically isolated section of the Amazon Web Services (AWS) Cloud where you can launch AWS resources in a virtual network that you define. You have complete control over your virtual networking environment, including selection of your own IP address range, creation of subnets, and configuration of route tables and network gateways. You can easily customize the network configuration for your Amazon Virtual Private Cloud. For example, you can create a public-facing subnet for your webservers that has access to the Internet, and place your backend systems such as databases or application servers in a private-facing subnet with no Internet access. You can leverage multiple layers of security, including security groups and network access control lists, to help control access to Amazon EC2 instances in each subnet. Additionally, you can create a Hardware Virtual Private Network (VPN) connection between your corporate datacenter and your VPC and leverage the AWS cloud as an extension of your corporate datacenter. http://aws.amazon.com/vpc/ ** Discuss enhanced networking too