AWS Dev Day Kyiv 2019 Track: Backend & Architecture Session: "Automating AWS Infrastructure with PowerShell" Speaker: Martin Beeby, AWS Principle Evangelist Level: 300 AWS Dev Day is a free, full-day technical event where new developers will learn about some of the hottest topics in cloud computing, and experienced developers can dive deep on newer AWS services. Provectus has organized AWS Dev Day Kyiv in close collaboration with Amazon Web Services: 800+ participants, 18 sessions, 3 tracks, a really AWSome Day!  Now, together with Zeo Alliance, we're building and nurturing AWS User Group Ukraine — join us on Facebook to stay updated about cloud technologies and AWS services: https://www.facebook.com/groups/AWSUserGroupUkraine Video: https://youtu.be/rgIjjK2J4dQ

1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
PowerShell on AWS
Martin Beeby
@thebeebs
mbeeby@amazon.com

2. © 2019, Amazon Web Services, Inc. or its Affiliates.
@ t h e b e e b s
A software developer since I was 16
Developer for 20 years
Work at Amazon Web Services
MARTIN BEEBY
@THEBEEBS
THEBEEBS.CO.UK/INCEPTION

3. © 2019, Amazon Web Services, Inc. or its Affiliates.
Session topics
• Overview of PowerShell at AWS
• Finding your way around
• PowerShell with AWS Systems Manager
• DSC and AWS Systems Manager
• Serverless PowerShell

4. https://infrastructure.aws

8. AWS Command Line Interface (CLI)

11. Visual Studio 2017, 2019

13. © 2019, Amazon Web Services, Inc. or its Affiliates.
Overview of PowerShell at AWS

14. © 2019, Amazon Web Services, Inc. or its Affiliates.
AWS Tools for Windows PowerShell
• Module named AWSPowerShell
• V1.0.0 released December 5, 2012
• PowerShell Gallery support announced May 14, 2015
• Module pre-installed on Amazon-provided Windows images in EC2
v1.0:
approx. 550 cmdlets across 20 or so services
v3.3.498.0 released April 24, 2019
5,510 cmdlets across 160+ services

15. © 2019, Amazon Web Services, Inc. or its Affiliates.
AWS Tools for PowerShell Core (v6)
• Module named AWSPowerShell.NetCore
• Announced August 18, 2016
• Launch partner with Microsoft J
• Released to PowerShell Gallery August 23, 2016 (v3.2.7.0)
• 100% compatibility with AWS Tools for Windows PowerShell
• Now targets PowerShell Standard

16. © 2019, Amazon Web Services, Inc. or its Affiliates.
Release progression
0
1000
2000
3000
4000
5000
6000
7000
5/8/2015
6/8/2015
7/8/2015
8/8/2015
9/8/2015
10/8/2015
11/8/2015
12/8/2015
1/8/2016
2/8/2016
3/8/2016
4/8/2016
5/8/2016
6/8/2016
7/8/2016
8/8/2016
9/8/2016
10/8/2016
11/8/2016
12/8/2016
1/8/2017
2/8/2017
3/8/2017
4/8/2017
5/8/2017
6/8/2017
7/8/2017
8/8/2017
9/8/2017
10/8/2017
11/8/2017
12/8/2017
1/8/2018
2/8/2018
3/8/2018
4/8/2018
5/8/2018
6/8/2018
7/8/2018
8/8/2018
9/8/2018
10/8/2018
11/8/2018
12/8/2018
1/8/2019
2/8/2019
3/8/2019
4/8/2019

17. © 2019, Amazon Web Services, Inc. or its Affiliates.
Other significant releases
• 31 May 2017: updates to some cmdlet and parameter names
• Responding to community feedback and latest PowerShell standards
• 22 March 2018: Amazon EC2 AMIs with PowerShell Core installed by
default on Amazon Linux 2 and Ubuntu
• 20 August 2018: PowerShell Core added to CodeBuild .NET Docker images
• 11 September 2018: AWS Lambda launches PowerShell Core Language
support
• 18 September 2018: PowerShell code samples added to .NET Developer
Center

18. © 2019, Amazon Web Services, Inc. or its Affiliates.
Demo Install PowerShell

19. © 2019, Amazon Web Services, Inc. or its Affiliates.
Install Module
Install-Module -Name AWSPowerShell.NetCore -AllowClobber

20. © 2019, Amazon Web Services, Inc. or its Affiliates.
Import Module
if (Get-Module -Name 'AWSPowerShell.NetCore' -ListAvailable)
{
Import-Module -Name 'AWSPowerShell.NetCore'
}
elseif (Get-Module -Name 'AWSPowerShell' -ListAvailable)
{
Import-Module -Name 'AWSPowerShell'
}
else
{
throw 'Please install an AWS PowerShell Module.'
}

21. © 2019, Amazon Web Services, Inc. or its Affiliates.
Create a Bucket
$region = 'us-east-1'
Set-DefaultAWSRegion -Region $region
$s3BucketName = 'powershellsummit2019-beeby-us-east-1'
# Create Bucket
New-S3Bucket -BucketName $s3BucketName

22. © 2019, Amazon Web Services, Inc. or its Affiliates.
Create a few Buckets
@(
'dscdemo-report-bucket-beeby',
'dscdemo-status-bucket-beeby',
'dscdemo-ssmoutput-bucket-beeby'
) | ForEach-Object {
$null = New-S3Bucket -BucketName $_
}

23. © 2019, Amazon Web Services, Inc. or its Affiliates.
What’s in the modules?
• Almost all cmdlets map 1:1 to AWS service APIs
• Some cmdlets wrap multiple APIs (eg Write-S3Object)
• Cmdlets sit atop the public AWS SDK for .NET
If you can code something in an SDK, you can script it in PowerShell!

24. © 2019, Amazon Web Services, Inc. or its Affiliates.
Create a VPC
# Deploy the VPC
$stackName = 'VPC'
$zones = ((Get-EC2AvailabilityZone -Region $awsRegion).ZoneName | Select-Object
-First 2) -join ','
dotnet lambda deploy-serverless $stackName --template vpc.yml --region
$awsRegion --s3-bucket $global:s3BucketName --profile $awsProfileName --
template-parameters AvailabilityZones="$zones"

25. © 2019, Amazon Web Services, Inc. or its Affiliates.
Create a Fleet
# Deploy the DSC Demo SpotFleet
$stackName = 'AWSDSCDemoInstances'
dotnet lambda deploy-serverless $stackName --template ec2-spot-fleet.yml --
region $awsRegion --s3-bucket $global:s3BucketName --profile $awsProfileName

26. © 2019, Amazon Web Services, Inc. or its Affiliates.
Cloud Formation

27. © 2019, Amazon Web Services, Inc. or its Affiliates.
Cloud Formation

28. © 2019, Amazon Web Services, Inc. or its Affiliates.

29. © 2019, Amazon Web Services, Inc. or its Affiliates.
PowerShell and AWS Systems
Manager

30. © 2019, Amazon Web Services, Inc. or its Affiliates.
What is AWS Systems Manager?
• “Single pane of glass” to give you visibility and control of your
infrastructure
• View operational data from multiple services
• Automate operational tasks across your resources
• Supports Amazon EC2 and on-premises systems
• Simplified resource and application management
• Easy to operate and manage your infrastructure securely at scale

31. © 2019, Amazon Web Services, Inc. or its Affiliates.
Get-AWSCmdletName -ApiOperation describeinstances

32. © 2019, Amazon Web Services, Inc. or its Affiliates.
Get-AWSPowerShellVersion -ListServices

33. © 2019, Amazon Web Services, Inc. or its Affiliates.
Get-AWSCmdletName -Service "Systems Manager"

34. © 2019, Amazon Web Services, Inc. or its Affiliates.
Where can I use PowerShell with Systems Manager?
• Run Command – October 2015: automate common administrative
tasks and ad-hoc configuration at scale
• State Manager – November 2016: automate configurations to keep
systems in a defined state
• Session Manager – September 2018: secure, interactive browser-
based or AWS CLI shell sessions without opening inbound ports
• Compliance / Inventory – November 2016: custom scripts to publish
your own compliance or inventory data

35. © 2019, Amazon Web Services, Inc. or its Affiliates.
Demo
Parameter Store
Run Command
Session Manager

36. © 2019, Amazon Web Services, Inc. or its Affiliates.
DSC and AWS Systems Manager

37. © 2019, Amazon Web Services, Inc. or its Affiliates.
PowerShell DSC support in AWS Systems Manager
• Launched 15 November 2018
• Public Systems Manager Document: AWS-ApplyDSCMofs
• Execute via Run Command or State Manager
• Integrates with AWS:
• AWS Systems Manager - Parameter Store
• AWS Systems Manager - Compliance
• AWS Secrets Manager
• Amazon S3

38. © 2019, Amazon Web Services, Inc. or its Affiliates.
AWS Lambda meets PowerShell
• PowerShell Core Language Support launched 11 September 2018
• Open Sourced: https://github.com/aws/aws-lambda-dotnet
• New Module: AWSLambdaPSCore
• Also contains ‘new project’ blueprints
• Uses the AWS Lambda .NET Core 2.1 runtime

39. © 2019, Amazon Web Services, Inc. or its Affiliates.
What is AWS Lambda?

40. © 2019, Amazon Web Services, Inc. or its Affiliates.
Benefits of AWS Lambda
• Run code without provisioning or managing servers
• Scales automatically
• Invoked directly through API calls, or in response to events
• Only pay for the compute time you consume
• Don’t pay for idle!

41. © 2019, Amazon Web Services, Inc. or its Affiliates.
What about PowerShell in
AWS Lambda?

42. © 2019, Amazon Web Services, Inc. or its Affiliates.
PowerShell Lambda: Input
• Two pre-defined variables are made available…
• $LambdaInput
• PSObject containing the Lambda function input data.
• $LambdaContext
• An Amazon.Lambda.Core.ILambdaContext object that contains
information about the currently running Lambda environment.
• Eg: FunctionName, RemainingTime, LogGroupName, LogStreamName
• Variables are positional parameters for PowerShell Function support

43. © 2019, Amazon Web Services, Inc. or its Affiliates.
PowerShell Lambda: Logging
• PowerShell streams are sent to Amazon CloudWatch Logs
• Includes:
• Write-Host
• Write-Verbose
• Write-Information
• Write-Warning
• Write-Error

44. © 2019, Amazon Web Services, Inc. or its Affiliates.
PowerShell Lambda: Output
• Last object added to the Output stream is the return data
• If object is a string -> Returned as is.
• Anything else -> ConvertTo-Json is used to convert into a string.

45. @ t h e b e e b s
Import-Module -Name AWSLambdaPSCore

46. Get-Command -Module AWSLambdaPSCore

47. Get-AWSPowerShellLambdaTemplate

48. @ t h e b e e b s
Using a Blueprint (Template)
$functionName = 'demo-basics'
New-AWSPowerShellLambda -Template 'Basic' -ScriptName $functionName

50. @ t h e b e e b s
Publishing Direct
$publishAWSPowerShellLambdaSplat = @{
Name = $functionName
ScriptPath = ".$functionName$functionName.ps1"
}
Publish-AWSPowerShellLambda @publishAWSPowerShellLambdaSplat

51. @ t h e b e e b s
Publishing To Zip
$zipfile =
[System.IO.Path]::Combine([System.IO.Path]::GetTempPath(),
"$functionName.zip")
$package = New-AWSPowerShellLambdaPackage -ScriptPath
".$functionName$functionName.ps1" -OutputPackage $zipfile

52. @ t h e b e e b s
Invoke
$response = Invoke-LMFunction -FunctionName $functionName
"`n$($response.Payload | ConvertTo-String)`n"

54. @ t h e b e e b s
Our Function Just Writes to Log
#Requires -Modules
@{ModuleName='AWSPowerShell.NetCore';ModuleVersion='3.3.522.0'}
# Uncomment to send the input event to CloudWatch Logs
Write-Host (ConvertTo-Json -InputObject $LambdaInput -Compress -Depth 5)

55. © 2019, Amazon Web Services, Inc. or its Affiliates.
Serverless and Event Driven
Computing

56. © 2019, Amazon Web Services, Inc. or its Affiliates.
How does Event Driven Computing differ?
• Code is triggered in response to an event
• Direct invocation through an API
• Service Events
• Loosely coupled systems
• Asynchronous
• Automatic scaling
• Don’t pay for idle!

57. © 2019, Amazon Web Services, Inc. or its Affiliates.
Meaning of Life, the Universe, and Everything

58. © 2019, Amazon Web Services, Inc. or its Affiliates.
The Almighty Answer to the Meaning of Life, the
Universe, and Everything. Was calculated by the
computer Deep Thought for seven million years.
The answer was “42”
Hitchhickers Guide to The Galaxy

59. © 2019, Amazon Web Services, Inc. or its Affiliates.

60. © 2019, Amazon Web Services, Inc. or its Affiliates.

61. © 2019, Amazon Web Services, Inc. or its Affiliates.

62. © 2019, Amazon Web Services, Inc. or its Affiliates.

63. © 2019, Amazon Web Services, Inc. or its Affiliates.
Amazon S3 Event -> AWS Lambda
Users /
Service S3 Bucket Lambda
Function
Put Object S3 Event Trigger

64. © 2019, Amazon Web Services, Inc. or its Affiliates.
? -> Event -> AWS Lambda
Lambda
Function
Event
?

65. © 2019, Amazon Web Services, Inc. or its Affiliates.
AWS Integrations
Lambda
Function
Event
Amazon Kinesis
Amazon Simple
Notification Service
Amazon Simple Queue
Service
AWS Step Functions
Amazon DynamoDB
AWS CodeBuild
AWS CodeCommit
AWS CodeDeploy
AWS CodePipeline
AWS IoT Button
Amazon CloudWatch
AWS CloudFormation
AWS CloudTrail Amazon API Gateway
Amazon Cognito
Amazon CloudFront

66. © 2019, Amazon Web Services, Inc. or its Affiliates.
Amazon CloudWatch Event Types
https://docs.aws.amazon.com/AmazonCloudWatch/latest/events/EventTypes.html
• AWS Batch
• Amazon CloudWatch Events
• AWS CodeBuild
• AWS CodeCommit
• AWS CodeDeploy
• AWS CodePipeline
• Amazon EBS
• Amazon EC2 Auto Scaling
• Amazon EC2 Spot Instance Interruption
• Amazon EC2 State Change
• Amazon ECS
• Amazon EMR
• Amazon GameLift
• AWS Glue
• Amazon GuardDuty
• AWS Health
• AWS KMS
• Amazon Macie
• AWS Management Console Sign-in
• AWS OpsWorks Stacks
• Amazon SageMaker
• AWS Server Migration Service
• AWS Systems Manager
• AWS Systems Manager Configuration
Compliance
• AWS Systems Manager Maintenance
Windows
• AWS Systems Manager Parameter Store
• Tag Change Events on AWS Resources
• AWS Trusted Advisor
• Amazon WorkSpaces
• Any AWS API Call logged by AWS
CloudTrail

67. © 2019, Amazon Web Services, Inc. or its Affiliates.
Amazon CloudWatch Events
Lambda
Function
Event
Amazon
CloudWatch
Scheduled:
• 1 minute
• 5 minutes
• 1 day
• cron expression

68. © 2019, Amazon Web Services, Inc. or its Affiliates.

69. © 2019, Amazon Web Services, Inc. or its Affiliates.
Demo in Console

70. © 2019, Amazon Web Services, Inc. or its Affiliates.
Recap: What have we learnt so far…
• Demonstrated PowerShell Lambda
• It’s just PowerShell running in AWS
• Serverless
• Focus on your customer
• Event driven computing
• Stop paying for idle

71. © 2019, Amazon Web Services, Inc. or its Affiliates.
Resources
GitHub links:
https://github.com/aws/aws-tools-for-powershell
https://github.com/aws/aws-lambda-dotnet
PowerShell Gallery links:
https://www.powershellgallery.com/packages/AWSPowerShell/
https://www.powershellgallery.com/packages/AWSPowerShell.NetCore/
AWS Developer Blog:
https://aws.amazon.com/blogs/developer/

72. Thank you!
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Martin Beeby
@thebeebs