The AWS SDK for Java (Version 1.x) has been connecting JVM based applications to AWS services since 2010. However, the JVM eco-system has changed a lot in the last 7 years. Based on a lot of customer feedback, we recently launched a developer preview of Version 2.0 of the AWS SDK for Java, which has been completely re-written from the core HTTP layer to the service clients. In this session, we'll get under the covers of the code-base to see how we've been able to get over 100,000 TPS from a single client instance during initial testing. We'll also go over some of the many new features and highlight some of the major differences with 1.x including: pluggable HTTP, non-blocking I/O, enhanced pagination, immutability and more.

1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS re:INVENT
Developing Applications on AWS in
the JVM
K y l e T h o m s o n – S e n i o r S o f t w a r e E n g i n e e r – A W S S D K
D E V 2 0 5
N o v e m b e r 2 8 , 2 0 1 7

2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agenda
• Quick recap of AWS SDK for Java version 1.x
• Eco-system
• High-level APIs
• Introducing AWS SDK for Java version 2.0 (developer preview)
• Motivation
• Programming API
• Demo

3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Recap of AWS SDK for Java 1.11.x

4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
A little bit of history
March 2010 (1.0)
•Single maven
module
•Java 5 baseline
•Nine services
supported
June 2014 (1.8)
•Dropped
support for
Java 5
•35 services
supported
October 2014
(1.9)
•Separate
maven module
per service
Present Day
(1.11.x)
• 100+ services
supported

5. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Not just the SDK
AWS SDK for Java
Kinesis
Consumer
Library
Kinesis
Producer
Library
Kinesis
S3 Transfer
Manager
S3A
Hadoop FS
S3 Encryption
Client
Amazon S3
DynamoDB
Mapper
DynamoDB
Document
API
DynamoDB
Encryption
Client
Amazon DynamoDB
DynamoDB
Accelerator
(DAX) Client
SWF
Flow Library
Step
Functions
DSL
Workflow
AWS Scala
SDK
Eclipse
Toolkit
Beanstalker
Maven
Plugins
Client-Side Build Tools
Third Party
Scala SDKs
SQS
Extended
Client Library
IAM Policy
DSL
Java Mail
Client for SES
Other
Code Deployment
AWS
CodeStar
AWS
CodeDeploy
AWS
CodePipeline
Execution Environments
AWS Elastic
Beanstalk
AWS
Lambda
Amazon
Elastic Map
Reduce
(EMR)
Amazon EC2
Container
Service (ECS)
Amazon
Elastic
Compute
(EC2)
Ships with SDK
AWS Open Source
3rd Party Open Source
AWS Services
Legend

6. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
v1 High-level abstractions

7. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS TransferManager
• Useful for moving files/directories to and from Amazon S3 asynchronously
• Sophisticated exception handling/retry strategies
• Support for multi-part uploads and downloads
• Hooks for progress reporting
import com.amazonaws.services.s3.transfer.TransferManager;
TransferManager tm = TransferManagerBuilder.standard()
.withS3Client(s3Client)
.build();
Transfer download = tm.downloadDirectory(BUCKET, KEY_PREFIX, new File("/some/local/dir"));
download.addProgressListener((ProgressListener) System.out::println);
download.waitForCompletion();

8. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• ORM for DynamoDB
• Annotation-based
Amazon DynamoDBMapper
import com.amazonaws.services.dynamodbv2.datamodeling.DynamoDBTable;
import com.amazonaws.services.dynamodbv2.datamodeling.DynamoDBMapper;
@DynamoDBTable(tableName = "People")
public final class Person {
private String name;
private int age;
@DynamoDBHashKey(attributeName = "Name")
public String getName() { ...; }
public void setName(String name) { ...; }
public int getAge() { ...; }
public void setAge(int age) { ...; }
}
Person person = mapper.load(Person.class, "Kyle");
person.setAge(34);
mapper.save(person);

9. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
DynamoDB Document API
• Java-friendly API for working with DynamoDB items
• Works with built-in Java types—no need to use low-level AttributeValue structures
• Takes care of paging for scan and query requests
import com.amazonaws.services.dynamodbv2.document.DynamoDB;
AmazonDynamoDB dynamoDBClient = ...;
DynamoDB dynamoDBDocumentApi = new DynamoDB(dynamoDBClient);
Table people = dynamoDBDocumentApi.getTable("People");
Item jeff = new Item().withPrimaryKey("Name", "Jeff”).withInt("Age", 53);
people.putItem(jeff);
jeff = people.getItem("Name", "Jeff");
people.scan().forEach(System.out::println);

10. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AWS SDK for Java 2.0 (de ve lope r pre vie w)

11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Key drivers for the new version
Java
Ecosystem
evolution
Customer
feedback

12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SDK for modern Java
• Released in June
• Core principles
• Open-source first (https://github.com/aws/aws-sdk-java-v2)
• Run both 1.11.x and 2.0 versions side-by-side
• Make it simple; complex things possible
• Improve performance

13. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
New programming API
• Immutable clients and models
• Enhanced pagination
• Smart configuration merging
• Forward-compatible enums
• Streaming operations as first-class concepts

14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Immutable clients
SESClient sesClient = SESClient.builder()
.region(Region.US_WEST_2)
.credentialsProvider(ProfileCredentialsProvider.builder().profileName("test").build())
.build();
AmazonSimpleEmailService sesClient = new AmazonSimpleEmailServiceClient(new ProfileCredentialsProvider("test"));
sesClient.setRegion(Region.getRegion(Regions.US_WEST_2));

15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Immutable models
client.sendEmail(SendEmailRequest.builder()
.destination(Destination.builder()
.toAddresses("kyle@example.com")
.build())
.replyToAddresses("kyle@example.com")
.message(Message.builder()
.subject(Content.builder()
.data("Hello")
.build())
.body(Body.builder()
.text(Content.builder()
.data("This is the body of the email")
.build())
.build())
.build())
.build());
sesClient.sendEmail(new SendEmailRequest()
.withDestination(new Destination().withToAddresses("kyle@example.com"))
.withReplyToAddresses("kyle@example.com")
.withMessage(new Message().withSubject(new Content().withData("Hello"))
.withBody(new Body().withText(new Content().withData("This is the body of the email")))));

16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Immutable models
sesClient.sendEmail(r -> r.destination(d -> d.toAddresses("kyle@example.com"))
.replyToAddresses("kyle@example.com")
.message(msg -> msg.subject(sub -> sub.data("Hello"))
.body(b -> b.text(txt -> txt.data("This is the body of the email")))));
default SendEmailResponse sendEmail(Consumer<SendEmailRequest.Builder> sendEmailRequest) throws … {
return sendEmail(SendEmailRequest.builder().apply(sendEmailRequest).build());
}
sesClient.sendEmail(new SendEmailRequest()
.withDestination(new Destination().withToAddresses("kyle@example.com"))
.withReplyToAddresses("kyle@example.com")
.withMessage(new Message().withSubject(new Content().withData("Hello"))
.withBody(new Body().withText(new Content().withData("This is the body of the email")))));

17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Immutable models
SendEmailRequest mutatedRequest = request.toBuilder()
.destination(Destination.builder().toAddresses("bill@example.com").build())
.build();
request.withDestination(new Destination().withToAddresses("kyle@example.com"));
SendEmailRequest mutatedRequest = request.copy(r -> r.destination(d -> d.toAddresses("bill@example.com")));

18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Enhanced pagination
dynamoDB.listTablesIterable().stream().flatMap(resp -> resp.tableNames().stream()).forEach(System.out::println);
ListTablesResult listTablesResult = dynamoDB.listTables();
listTablesResult.getTableNames().forEach(System.out::println);
while (listTablesResult.getLastEvaluatedTableName() != null) {
listTablesResult = dynamoDB.listTables(listTablesResult.getLastEvaluatedTableName());
listTablesResult.getTableNames().forEach(System.out::println);
}
dynamoDB.listTablesIterable().tableNames().forEach(System.out::println);
dynamoDB.listTablesIterable().tableNames().stream().filter(tn -> tn.contains("kyle")).forEach(System.out::println);

19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming API
SynthesizeSpeechRequest request = SynthesizeSpeechRequest.builder().text("Hello re:Invent!").build();
try (ResponseInputStream<SynthesizeSpeechResponse> response = pollyClient.synthesizeSpeech(request)) {
Files.copy(response, DESTINATION_FILE);
}
AmazonPolly pollyClient = new AmazonPollyClient();
SynthesizeSpeechResult result = pollyClient.synthesizeSpeech(new SynthesizeSpeechRequest().withText("Hello re:Invent!"));
try (InputStream audio = result.getAudioStream()) {
Files.copy(audio, DESTINATION_FILE);
}

20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming API
SynthesizeSpeechRequest request = SynthesizeSpeechRequest.builder().text("Hello re:Invent!").build();
pollyClient.synthesizeSpeech(request, new StreamingResponseHandler<SynthesizeSpeechResponse, String>() {
@Override
public String apply(SynthesizeSpeechResponse response, AbortableInputStream inputStream) throws Exception {
try {
Files.copy(inputStream, DESTINATION_FILE);
} finally {
inputStream.close();
}
return response.contentType();
}
});
AmazonPolly pollyClient = new AmazonPollyClient();
SynthesizeSpeechResult result = pollyClient.synthesizeSpeech(new SynthesizeSpeechRequest().withText("Hello re:Invent!"));
try (InputStream audio = result.getAudioStream()) {
Files.copy(audio, DESTINATION_FILE);
}

21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming API
SynthesizeSpeechRequest request = SynthesizeSpeechRequest.builder().text("Hello re:Invent!").build();
pollyClient.synthesizeSpeech(request, (response, inputStream) -> {
try {
Files.copy(inputStream, DESTINATION_FILE);
} finally {
inputStream.close();
}
return response.contentType();
});
AmazonPolly pollyClient = new AmazonPollyClient();
SynthesizeSpeechResult result = pollyClient.synthesizeSpeech(new SynthesizeSpeechRequest().withText("Hello re:Invent!"));
try (InputStream audio = result.getAudioStream()) {
Files.copy(audio, DESTINATION_FILE);
}

22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Streaming API
SynthesizeSpeechRequest request = SynthesizeSpeechRequest.builder().text("Hello re:Invent!").build();
pollyClient.synthesizeSpeech(request, DESTINATION_FILE);
AmazonPolly pollyClient = new AmazonPollyClient();
SynthesizeSpeechResult result = pollyClient.synthesizeSpeech(new SynthesizeSpeechRequest().withText("Hello re:Invent!"));
try (InputStream audio = result.getAudioStream()) {
Files.copy(audio, DESTINATION_FILE);
}

23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Pluggable HTTP layer
• HTTP implementations can be swapped out at run-time
• First-class support for synchronous and asynchronous clients
• Default implementations
• Apache (sync)
• URL connection (sync)
• Netty (async)
• JDK9 HttpClient (coming soon)

24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Performance

25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Truly asynchronous clients
• Non-blocking I/O HTTP implementation
• Netty-backed default implementation
• API’s return CompletableFutures
• Have exceeded 100,000 TPS for a single client instance in initial testing
• Reactive streams API to provide publish/subscribe interface with back
pressure

26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SDK Client
Request lifecycle in the SDK
Caller
Serialization
To Wire
Format
Make
HTTP
Request
AWS
Receive
HTTP
Response
De-
Serialization
To Pojo
JSON/XML
BytesJSON/XML

27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SDK Client
Callers thread
Threading—synchronous
Caller
Serialization
To Wire
Format
Make
HTTP
Request
AWS
Receive
HTTP
Response
De-
Serialization
To Pojo
JSON/XML
BytesJSON/XML

28. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SDK Client
SDK Client Thread PoolCallers thread
Threading—asynchronous
Caller
Serialization
To Wire
Format
De-
Serialization
To Pojo
AWS
BytesComplete Future
Make
HTTP
Request
Receive
HTTP
Response

29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SDK Client
Anatomy of an HTTP request
Caller
Serialization
To Wire
Format
De-
Serialization
To Pojo
AWS
Make
HTTP
Request
Receive
HTTP
Response
HTTP
Layer

30. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Single thread
Anatomy of an HTTP request
AWS
Connection
Pool
Request Connection
Connection
Send Bytes
Receive Bytes
Socket
HTTP
Layer

31. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
So what’s wrong with that?

32. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Non-blocking I/O
AWS
Request Connection
Open Socket
Socket
HTTP
Layer
Event Loop
Data Available Event
Send Bytes
Ready for Data Event
Callbacks O/S Events

33. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Non-blocking I/O
AWS
Event Loop
Socket
Socket
Socket
Socket
Socket
Socket
Socket
Events

34. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SDK Client
SDK Client Thread PoolCallers thread
Threading—synchronous
Caller
Serialization
To Wire
Format
De-
Serialization
To Pojo
AWS
BytesComplete Future
Make
HTTP
Request
Receive
HTTP
Response

35. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
SDK Client
Callers thread
Threading—non-blocking I/O
Caller
Serialization
To Wire
Format
De-
Serialization
To Pojo
AWS
Make
HTTP
Request
Receive
HTTP
Response
Event Loop

36. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Demo

37. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Get involved

38. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
The SDK needs you!
• Looking to GA in Q2 2018
• Help us prioritize features - https://github.com/aws/aws-sdk-java-v2/issues
• Follow our blog - https://aws-blogs-prod.amazon.com/developer/tag/aws-sdk-java-v2/
• Email us - aws-java-sdk-v2-feedback@amazon.com
• Reach out to us on Gitter - https://github.com/aws/aws-sdk-java-v2
• Engage the community on StackOverflow -
https://stackoverflow.com/questions/tagged/aws-java-sdk

39. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!
D E V 2 0 5