The AWS Command Line Interface (AWS CLI) provides an easy-to-use command line interface to AWS and allows you to create powerful automation scripts. In this session, you learn advanced techniques that open up new scenarios for using the AWS CLI. We demonstrate how to filter and transform service responses and how to chain and script commands, and we explore new features in the AWS CLI.

1. ©2015, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Deep Dive: AWS Command Line Interface
Thomas Jones, Solutions Architect
Kyle Lichtenberg, Solutions Architect

2. Crash
Course
Intro to the AWS CLI
FOUNDATION ADVANCED
SCENARIOS
Exploring Key
Functionality
Looking at Advanced
CLI Features

3. Crash Course
Intro to the AWS CLI

4. AWS Command Line Interface
Unified tool to manage your AWS services

5. Why use the AWS CLI?
Scripting of actions
DevOps
Automation
Versioning
Speed
Programmatic input parameters
Reuse

6. MSI (Windows)
Bundled (cross platform)
pip (cross platform)

7. aws configure

8. $ aws ec2 describe-instances
Service (command) Operation (subcommand)

9. $ aws iam list-access-keys
Service (command) Operation (subcommand)

10. {
"Places": [
{
"City": "Seattle",
"State": "WA"
},
{
"City": ”Las Vegas",
"State": "NV"
}
]
}
--output JSON

11. PLACES Seattle WA
PLACES Las Vegas NV
--output text

12. --------------------------
| SomeOperationName |
+------------------------+
|| Places ||
|+------------+---------+|
|| City | State ||
|+------------+---------+|
|| Seattle | WA ||
|| Las Vegas | NV ||
|+------------+---------+|
--output table

13. All Outputs
JSON Text
PLACES Seattle WA
PLACES Las Vegas NV
Table
--------------------------
| SomeOperationName |
+------------------------+
|| Places ||
|+------------+---------+|
|| City | State ||
|+------------+---------+|
|| Seattle | WA ||
|| Las Vegas | NV ||
|+------------+---------+|
{
"Places": [
{
"City": "Seattle",
"State": "WA"
},
{
"City": ”Las Vegas",
"State": "NV"
}
]
}

14. Demo
Basic AWS CLI Usage

15. Foundation
Exploring Key Functionality

16. Configuration

17. aws configure

18. aws configure
AWS access key ID [**ABCD]:
AWS secret access key [****************EFGH]:
Default region name [us-west-2]:
Default output format [None]:

19. aws configure <subcommand>

20. aws configure <subcommand>
list - list common configuration sources
get - get the value of a single config var
set - set the value of a single config var

21. aws configure get region

22. aws configure set profile.prod.region us-west-2

23. A profile is a group of configuration values

24. aws configure --profile prod

25. Configuration Files
~/.aws/credentials ~/.aws/config
• Supported by all AWS SDKs
• Only contains credentials
• Used only by the CLI
• Can contain credentials (but not
the default behavior)

26. ~/.aws/credentials ~/.aws/config

27. aws configure set profile.prod.aws_access_key_id foo
~/.aws/credentials ~/.aws/config

28. aws configure set profile.prod.aws_access_key_id foo
~/.aws/credentials ~/.aws/config
[prod]
aws_access_key_id = foo

29. aws configure set profile.prod.aws_secret_access_key bar
~/.aws/credentials ~/.aws/config
[prod]
aws_access_key_id = foo

30. aws configure set profile.prod.aws_secret_access_key bar
~/.aws/credentials ~/.aws/config
[prod]
aws_access_key_id = foo
aws_secret_access_key = bar

31. aws configure set profile.prod.region uswest2
~/.aws/credentials ~/.aws/config
[prod]
aws_access_key_id = foo
aws_secret_access_key = bar

32. aws configure set profile.prod.region uswest2
~/.aws/credentials ~/.aws/config
[prod]
aws_access_key_id = foo
aws_secret_access_key = bar
[profile prod]
region = us-west-2

33. aws configure set profile.prod.output text
~/.aws/credentials ~/.aws/config
[prod]
aws_access_key_id = foo
aws_secret_access_key = bar
[profile prod]
region = us-west-2

34. aws configure set profile.prod.output text
~/.aws/credentials ~/.aws/config
[prod]
aws_access_key_id = foo
aws_secret_access_key = bar
[profile prod]
region = us-west-2
output = text

35. create-new-user.sh

36. create-new-user.sh

37. create-new-user.sh

38. create-new-user.sh

39. create-new-user.sh

40. create-new-user.sh

41. Use the aws configure
suite of subcommands

42. Query

44. Implementation Details --query Processing

45. Implementation Details --query Processing

46. Implementation Details --query Processing

47. Implementation Details --query Processing

48. Implementation Details --query Processing
--query User[0].[UserName,Path,UserId]

49. Implementation Details --query Processing
--query User[0].[UserName,Path,UserId]

50. Implementation Details --query Processing

51. Implementation Details --query Processing

52. http://jmespath.org
A Query Language for JSON

53. Demo
JMESPATH

54. http://jmespath.org
A Query Language for JSON

55. Waiters

56. Amazon EC2 Instance State Transitions

57. ec2-instance-running.sh
#!/bin/bash
instance_id=$(aws ec2 run-instances –image-id ami-12345
--query Reservations[].Instances[].InstanceId
--output text)
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
while [ "$instance_state" != "running" ]
do
sleep 1
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
done

58. ec2-instance-running.sh
#!/bin/bash
instance_id=$(aws ec2 run-instances –image-id ami-12345
--query Reservations[].Instances[].InstanceId
--output text)
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
while [ "$instance_state" != "running" ]
do
sleep 1
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
done

59. ec2-instance-running.sh
#!/bin/bash
instance_id=$(aws ec2 run-instances –image-id ami-12345
--query Reservations[].Instances[].InstanceId
--output text)
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
while [ "$instance_state" != "running" ]
do
sleep 1
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
done

60. ec2-instance-running.sh
#!/bin/bash
instance_id=$(aws ec2 run-instances –image-id ami-12345
--query Reservations[].Instances[].InstanceId
--output text)
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
while [ "$instance_state" != "running" ]
do
sleep 1
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
done

61. ec2-instance-running.sh
#!/bin/bash
instance_id=$(aws ec2 run-instances –image-id ami-12345
--query Reservations[].Instances[].InstanceId
--output text)
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
while [ "$instance_state" != "running" ]
do
sleep 1
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
done

62. ec2-instance-running.sh
#!/bin/bash
instance_id=$(aws ec2 run-instances –image-id ami-12345
--query Reservations[].Instances[].InstanceId
--output text)
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
while [ "$instance_state" != "running" ]
do
sleep 1
instance_state=$(aws ec2 describe-instances –instance-ids $instance_id
--query 'Reservations[].Instances[].State.Name')
done

63. ec2-waiters.sh
instance_id=$(aws ec2 run-instances –image-id ami-12345
--query Reservations[].Instances[].InstanceId
--output text)
aws ec2 wait instance-running –instance-ids $instance_id

64. ec2-waiters.sh
instance_id=$(aws ec2 run-instances –image-id ami-12345
--query Reservations[].Instances[].InstanceId
--output text)
aws ec2 wait instance-running –instance-ids $instance_id
subcommand
Describe-instances options
waiter name

65. Advanced Scenarios
Looking at advanced AWS CLI features

66. Templates

67. The AWS CLI is data driven

68. Implementation Details JSON Models

69. Implementation Details JSON Models

70. Implementation Details JSON Models

71. aws ec2 run‐instances –cli-input-json file://arguments.json

72. What else can we do?

73. aws ec2 run‐instances –generate-cli-skeleton

74. Demo
Creating and using JSON templates

75. Credential Providers

76. Credential Providers

77. Credential Providers

78. Credential Providers

79. Credential Providers

80. Credential Providers

81. Delegate access to AWS resources using
AWS Identity and Access Management (IAM) roles

82. IAM Roles
Production Development

83. IAM Roles
Production Development

84. IAM Roles
Production Development
Role
Policy
Trust Policy
role

85. IAM Roles
Production Development
AssumeRole
AWS Security
Token Service
role

86. IAM Roles
Production Development
AssumeRole
AWS Security
Token Service
role
token

87. IAM Roles
Production Development
AssumeRole
AWS Security
Token Service
role
token

88. aws configure set profile.prodrole.source_profile dev
aws configure set profile.prodrole.role_arn arn:aws:iam…
configure-role.sh

89. ~/.aws/credentials ~/.aws/config
[profile prodrole]
role_arn = arn:aws:iam
source_profile = dev

90. ~/.aws/credentials ~/.aws/config
[profile prodrole]
role_arn = arn:aws:iam
source_profile = dev

91. Demo
Using roles with the AWS CLI

92. Amazon S3 Streaming

93. aws s3 ls s3://mybucket

94. aws s3 sync myfolder s3://mybucket/myfolder

95. aws s3 cp myfolder s3://mybucket/myfolder --recursive

96. aws s3 cp

97. We want to avoid disk

98. aws s3 cp – s3://bucket/key

99. aws s3 cp s3://bucket/key -

100. Compress

101. aws s3 cp s3://bucket/key ‐ |
bzip2 -best |
aws s3 cp - s3://bucket/key.bz2

102. Summary

103. Wrapping Up
• Configuration
• Waiters
• Query
• Templates
• Credential Providers
• Amazon S3 Streaming

104. For More Information
• https://github.com/aws/aws-cli
• http://docs.aws.amazon.com/cli/latest/userguide/
• https://forums.aws.amazon.com/forum.jspa?forumID=150
• http://docs.aws.amazon.com/cli/latest/reference/
• http://jmespath.org/

105. Your Feedback is Important to AWS
Please complete the session evaluation. Tell us what you think!

106. CHICAGO