Deep Dive - Advanced Usage of the AWS CLI
•
31 likes•5,451 views
The AWS CLI is a command line interface that allows you to control the full set of AWS services. You learn how to perform quick ad hoc service operations, and how to create rich scripts to automate your ongoing maintenance. We also share tips on getting the most out of the AWS CLI through built-in features and complementary tools. Speakers: Martin Elwin, AWS Solutions Architect
Recommended
More Related Content
What's hot
What's hot (20)
Viewers also liked
Viewers also liked (20)
Similar to Deep Dive - Advanced Usage of the AWS CLI
Similar to Deep Dive - Advanced Usage of the AWS CLI (20)
More from Amazon Web Services
More from Amazon Web Services (20)
Recently uploaded
Recently uploaded (20)
Deep Dive - Advanced Usage of the AWS CLI
- 1. ©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved Deep Dive: AWS Command Line Interface Martin Elwin
- 2. CRASH COURSE Intro to the AWS CLI FOUNDATION ADVANCED SCENARIOS Exploring Key Functionality Looking at Advanced CLI Features
- 3. Crash Course Intro to the AWS CLI
- 4. AWS Command Line Interface Unified tool to manage your AWS services
- 5. MSI (Windows) Bundled (cross platform) pip (cross platform)
- 7. $ aws ec2 describe-‐instances Service (command) Operation (subcommand)
- 8. $ aws iam list-‐access-‐keys Service (command) Operation (subcommand)
- 9. { "Places": [ { "City": "Seattle", "State": "WA" }, { "City": "Las Vegas", "State": "NV" } ] } --output JSON
- 10. PLACES Seattle WA PLACES Las Vegas NV --output text
- 11. -‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐ | SomeOperationName | +-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐+ || Places || |+-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐+-‐-‐-‐-‐-‐-‐-‐-‐-‐+| || City | State || |+-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐+-‐-‐-‐-‐-‐-‐-‐-‐-‐+| || Seattle | WA || || Las Vegas | NV || |+-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐+-‐-‐-‐-‐-‐-‐-‐-‐-‐+| --output table
- 12. All Outputs JSON Text PLACES Seattle WA PLACES Las Vegas NV Table -‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐ | SomeOperationName | +-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐+ || Places || |+-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐+-‐-‐-‐-‐-‐-‐-‐-‐-‐+| || City | State || |+-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐+-‐-‐-‐-‐-‐-‐-‐-‐-‐+| || Seattle | WA || || Las Vegas | NV || |+-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐-‐+-‐-‐-‐-‐-‐-‐-‐-‐-‐+| { "Places": [ { "City": "Seattle", "State": "WA" }, { "City": ”Las Vegas", "State": "NV" } ] }
- 13. Demo Basic AWS CLI Usage
- 15. Configuration
- 16. aws configure
- 17. aws configure AWS Access Key ID [**ABCD]: AWS Secret Access Key [****************EFGH]: Default region name [us-‐west-‐2]: Default output format [None]:
- 19. list - list common configuration sources get -‐ get the value of a single config var set -‐ set the value of a single config var aws configure <subcommand>
- 20. aws configure get region
- 21. aws configure set region eu-‐west-‐1
- 22. A profile is a group of configuration values
- 23. aws configure -‐-‐profile prod
- 24. aws configure set profile.prod.region eu-‐west-‐1
- 25. Configuration Files ~/.aws/credentials ~/.aws/config • Supported by all AWS SDKs • Only contains credentials • Used only by the CLI • Can contain credentials (but not the default behavior)
- 27. aws configure set profile.prod.aws_access_key_id foo ~/.aws/credentials ~/.aws/config
- 28. aws configure set profile.prod.aws_access_key_id foo ~/.aws/credentials ~/.aws/config [prod] aws_access_key_id = foo
- 29. aws configure set profile.prod.aws_secret_access_key bar ~/.aws/credentials ~/.aws/config [prod] aws_access_key_id = foo
- 30. aws configure set profile.prod.aws_secret_access_key bar ~/.aws/credentials ~/.aws/config [prod] aws_access_key_id = foo aws_secret_access_key = bar
- 31. aws configure set profile.prod.region euwest1 ~/.aws/credentials ~/.aws/config [prod] aws_access_key_id = foo aws_secret_access_key = bar
- 32. aws configure set profile.prod.region euwest1 ~/.aws/credentials ~/.aws/config [prod] aws_access_key_id = foo aws_secret_access_key = bar [profile prod] region = eu-west-1
- 33. aws configure set profile.prod.output text ~/.aws/credentials ~/.aws/config [prod] aws_access_key_id = foo aws_secret_access_key = bar [profile prod] region = eu-west-1
- 34. aws configure set profile.prod.output text ~/.aws/credentials ~/.aws/config [prod] aws_access_key_id = foo aws_secret_access_key = bar [profile prod] region = eu-west-1 output = text
- 35. create-new-user.sh aws iam create-‐user -‐-‐user-‐name summit-‐user = aws iam create-‐access-‐key -‐-‐user-‐name summit-‐user -‐-‐query -‐-‐output text = | cut -‐d -‐f 1 = | cut -‐d -‐f 2 aws configure profile.summit.aws_access_key_id aws configure profile.summit.secret_access_key
- 36. aws iam create-‐user -‐-‐user-‐name summit-‐user = aws iam create-‐access-‐key -‐-‐user-‐name summit-‐user -‐-‐query -‐-‐output text = | cut -‐d -‐f 1 = | cut -‐d -‐f 2 aws configure profile.summit.aws_access_key_id aws configure profile.summit.secret_access_key create-new-user.sh
- 37. aws iam create-‐user -‐-‐user-‐name summit-‐user = aws iam create-‐access-‐key -‐-‐user-‐name summit-‐user -‐-‐query -‐-‐output text = | cut -‐d -‐f 1 = | cut -‐d -‐f 2 aws configure profile.summit.aws_access_key_id aws configure profile.summit.secret_access_key create-new-user.sh
- 38. aws iam create-‐user -‐-‐user-‐name summit-‐user = aws iam create-‐access-‐key -‐-‐user-‐name summit-‐user -‐-‐query -‐-‐output text = | cut -‐d -‐f 1 = | cut -‐d -‐f 2 aws configure profile.summit.aws_access_key_id aws configure profile.summit.secret_access_key create-new-user.sh
- 39. aws iam create-‐user -‐-‐user-‐name summit-‐user = aws iam create-‐access-‐key -‐-‐user-‐name summit-‐user -‐-‐query -‐-‐output text = | cut -‐d -‐f 1 = | cut -‐d -‐f 2 aws configure profile.summit.aws_access_key_id aws configure profile.summit.secret_access_key create-new-user.sh
- 40. aws iam create-‐user -‐-‐user-‐name summit-‐user = aws iam create-‐access-‐key -‐-‐user-‐name summit-‐user -‐-‐query -‐-‐output text = | cut -‐d -‐f 1 = | cut -‐d -‐f 2 aws configure profile.summit.aws_access_key_id aws configure profile.summit.secret_access_key create-new-user.sh
- 41. Use the aws configure suite of subcommands
- 42. Query
- 43. -‐-‐query (string) A JMESPath query to use in filtering the response data.
- 44. Implementation Details --query Processing
- 45. Implementation Details --query Processing
- 46. Implementation Details --query Processing
- 47. Implementation Details --query Processing
- 48. Implementation Details --query Processing -‐-‐query User[0].[UserName,Path,UserId]
- 49. Implementation Details --query Processing -‐-‐query User[0].[UserName,Path,UserId]
- 50. Implementation Details --query Processing
- 51. Implementation Details --query Processing
- 52. http://jmespath.org A Query Language for JSON
- 53. Demo JMESPATH
- 54. http://jmespath.org A Query Language for JSON
- 55. Waiters
- 56. Amazon EC2 Instance State Transitions
- 57. ec2-instance-running.sh #!/bin/bash instance_id=$(aws ec2 run-‐instances -‐-‐image-‐id ami-‐12345 -‐-‐query Reservations[].Instances[].InstanceId -‐-‐output text) instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') while [ "$instance_state" != "running" ] do sleep 1 instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') done
- 58. #!/bin/bash instance_id=$(aws ec2 run-‐instances -‐-‐image-‐id ami-‐12345 -‐-‐query Reservations[].Instances[].InstanceId -‐-‐output text) instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') while [ "$instance_state" != "running" ] do sleep 1 instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') done ec2-instance-running.sh
- 59. #!/bin/bash instance_id=$(aws ec2 run-‐instances -‐-‐image-‐id ami-‐12345 -‐-‐query Reservations[].Instances[].InstanceId -‐-‐output text) instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') while [ "$instance_state" != "running" ] do sleep 1 instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') done ec2-instance-running.sh
- 60. #!/bin/bash instance_id=$(aws ec2 run-‐instances -‐-‐image-‐id ami-‐12345 -‐-‐query Reservations[].Instances[].InstanceId -‐-‐output text) instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') while [ "$instance_state" != "running" ] do sleep 1 instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') done ec2-instance-running.sh
- 61. #!/bin/bash instance_id=$(aws ec2 run-‐instances -‐-‐image-‐id ami-‐12345 -‐-‐query Reservations[].Instances[].InstanceId -‐-‐output text) instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') while [ "$instance_state" != "running" ] do sleep 1 instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') done ec2-instance-running.sh
- 62. #!/bin/bash instance_id=$(aws ec2 run-‐instances -‐-‐image-‐id ami-‐12345 -‐-‐query Reservations[].Instances[].InstanceId -‐-‐output text) instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') while [ "$instance_state" != "running" ] do sleep 1 instance_state=$(aws ec2 describe-‐instances -‐-‐instance-‐ids $instance_id -‐-‐query 'Reservations[].Instances[].State.Name') done ec2-instance-running.sh • No timeouts • Failure states • Hand-written code
- 63. ec2-waiters.sh instance_id=$(aws ec2 run-‐instances -‐-‐image-‐id ami-‐12345 -‐-‐query Reservations[].Instances[].InstanceId -‐-‐output text) aws ec2 wait instance-‐running -‐-‐instance-‐ids $instance_id
- 64. instance_id=$(aws ec2 run-‐instances -‐-‐image-‐id ami-‐12345 -‐-‐query Reservations[].Instances[].InstanceId -‐-‐output text) aws ec2 wait instance-‐running -‐-‐instance-‐ids $instance_id ec2-waiters.sh subcommand Describe-instances options waiter name
- 65. Advanced Scenarios Looking at advanced AWS CLI features
- 66. Templates
- 67. The AWS CLI is data driven
- 68. Implementation Details JSON Models
- 69. Implementation Details JSON Models
- 70. Implementation Details JSON Models
- 71. aws ec2 run-‐instances -‐-‐cli-‐input-‐json file://arguments.json
- 72. aws ec2 run-‐instances -‐-‐generate-‐cli-‐skeleton
- 73. Demo Creating and using JSON templates
- 80. Delegate access to AWS resources using AWS Identity and Access Management (IAM) roles
- 83. v IAM Roles Production Development Role Policy Trust Policy role
- 84. IAM Roles Production Development AssumeRole AWS Security Token Service role
- 85. IAM Roles Production Development AssumeRole AWS Security Token Service role token
- 86. IAM Roles Production Development AssumeRole AWS Security Token Service role token
- 87. aws configure set profile.prodrole.source_profile dev aws configure set profile.prodrole.role_arn arn:aws:iam… configure-role.sh
- 88. ~/.aws/credentials ~/.aws/config [dev] aws_access_key_id = foo aws_secret_access_key = bar [profile prodrole] role_arn = arn:aws:iam....... source_profile = dev
- 89. ~/.aws/credentials ~/.aws/config [dev] aws_access_key_id = foo aws_secret_access_key = bar [profile prodrole] role_arn = arn:aws:iam source_profile = dev
- 90. Demo Using roles with the AWS CLI
- 92. aws s3 cp
- 93. We want to avoid disk
- 94. aws s3 cp – s3://bucket/key
- 95. aws s3 cp s3://bucket/key -‐
- 96. Compress
- 97. aws s3 cp s3://bucket/key -‐ | bzip2 -‐-‐best | aws s3 cp -‐ s3://bucket/key.bz2
- 98. Summary
- 99. Wrapping Up • Configuration • Waiters • Query • Templates • Credential Providers • Amazon S3 Streaming