The document outlines steps to migrate data from an old DynamoDB table and S3 bucket to new ones using the AWS SDK for PHP version 3. It discusses: 1. Scanning the old DynamoDB table and copying records to a WriteRequestBatch for the new table. 2. Using S3 copy object commands to copy files from the old bucket to new while updating URLs in DynamoDB records. 3. Executing the copy commands and flushing the WriteRequestBatch to complete the migration.

1. November 12, 2014 | Las Vegas, NV
Jeremy Lindblom (@jeremeamia), AWS Developer Resources
@awsforphp

2. 1.Introduce the SDK (including Version 3)
2.Build an app with the SDK
3.Demonstrate advanced SDK features

4. $ec2 = ::factory
'region' => 'us-east-1'
'version' => '2014-06-15'
$ec2->runInstances
'ImageId' => 'ami-6a6dcc02'
'MinCount' =>
'MaxCount' =>
'InstanceType' => 'm1.small'

6. (semver.org)

8. (cont.)

9. $ec2=::factory
'region' =>'us-east-1'
$ec2->runInstances
'ImageId'=>'ami-6a6dcc02'
'MinCount' =>
'MaxCount'=>
'InstanceType' =>'m1.small'

10. $ec2=::factory
'region' =>'us-east-1'
$ec2->runInstances
'ImageId'=>'ami-6a6dcc02'
'MinCount' =>
'MaxCount'=>
'InstanceType' =>'m1.small'
'version' =>'2014-06-15'

11. •Asyncrequests with FutureResultobjects and a Promise API
•Support for custom HTTP adapters
–cURLno longer required (still the default)
–Possible to implement with non-blocking event loops
•Result "Paginators" for iterating paginated data
•JMESPathquerying of result data
•"debug" client option for easy debugging

13. PHPPHP
#nofilter
#selphpie
#instagood

14. PHPPHP

15. (Storage of selPHPies) (Storage of URLs/captions) PHPPHP

17. "require": {
"aws/aws-sdk-php": "~3.0@dev",
"silex/silex": "~1.2",
"twig/twig": "~1.16",
}
getcomposer.org

18. •Instance profile credentials
•Credentials file
•Environment variables
•Hard coding

19. •Instance profile credentials
•Credentials file
•Environment variables
•Client configuration

20. •Instance profile credentials
•Credentials file
•Environment variables
•Client configuration
FYI: Also supported by the AWS CLI and other SDKs.

21. •Instance profile credentials
•Credentials file
•Environment variables
•Client configuration

22. •Instance profile credentials
•Credentials file
•Environment variables
•Client Configuration (BEWARE)
'credentials' =>
'key' =>$yourAccessKeyId
'secret' =>$yourSecretAccessKey

24. phpbin/setup.phpS3 bucketDynamoDBtable
Amazon S3
Amazon
DynamoDB

25. $s3->createBucket'Bucket' =>$bucket
$s3->waitUntil'BucketExists''Bucket' =>$bucket
$dynamoDb->createTable(['TableName'=>$table...
$dynamoDb->waitUntil'TableExists'
'TableName'=> $table
echo "Done.n"

28. $result =$dynamoDb->createTable([
'TableName' =>$table,
'@future' => true,
]);
// Do other things...
// Blocks once dereferenced.
$result['TableDescription']['TableStatus'];

29. $waiter =$dynamoDb->getWaiter(
'TableExists', [...]
);
$waiter->wait();
// THIS IS THE SAME AS:
$dynamoDb->waitUntil'TableExists'...

30. $result =$client->operation([...]);
$result->then(
$onFulfilled,
$onRejected,
$onProgress,
);
// See the React/Promise library

31. $dynamoDb->createTable([
'TableName' =>$table,
'@future' => true,
])->then(function($result)use ($dynamoDb,$table) {
return$dynamoDb->getWaiter('TableExists', [
'TableName'=>$table,
])->promise();
})->then(function($result) {
echo"Done.n";
});

32. $dynamoDb->createTable([…])
->then(...)
->then(...);
$s3->createBucket([…])
->then(...)
->then(...);

34. $app =new
$app'aws'=function
returnnew
'region' => 'us-east-1'
'version' => 'latest'
// ROUTES AND OTHER APPLICATION LOGIC
$app->run

35. $app->get'/'function...

36. $dynamoDb=$app'aws'->getDynamoDb
$result =$dynamoDb->query
'TableName' => 'selphpies'
'Limit' =>
// ...
$items =$result'Items'

37. $results =$dynamoDb->getPaginator'Query'
'TableName' => 'selphpies'
// ...
$items =$results->search'Items[]'

38. $results =$s3->getPaginator'ListObjects'...
$files =$results->search'Contents[].Key'

39. # With Paginators
$results =$s3->getPaginator'ListObjects'
'Bucket' =>'my-bucket'
$keys =$results->search'Contents[].Key'
foreach$keys as$key
echo$object'Key'."n"
# Without Paginators
$marker=
do
$args='Bucket' =>'my-bucket'
if$marker
$args'Marker'=$marker
$result =$s3->listObjects$args
$objects =array$result'Contents'
foreach$objects as$object
echo$object'Key'."n"
$marker $result->search
'NextMarker|| Contents[-1].Key'while$result'IsTruncated'

40. http://jmespath.org/
$result->search'<JMESPathExpression>'
> 'Contents[].Key'
> '[CommonPrefixes[].Prefix, Contents[].Key][]'
> 'NextMarker|| Contents[-1].Key'

41. $app->get'/upload'function...

42. POST
$app->post'/upload'function...

43. try {
$caption = $request->request->get('selphpieCaption', '...');
$file = $request->files->get('selphpieImage');
if (!$file instanceofUploadedFile|| $file->getError()) {
throw new RuntimeException('...');
}
#1. UPLOAD THE IMAGE TO S3
#2. SAVE THE IMAGE DATA TO DYNAMODB
$app['session']->getFlashBag()->add('alerts', 'success');
return $app->redirect('/');
} catch (Exception $e) {
$app['session']->getFlashBag()->add('alerts', 'danger');
return $app->redirect('/upload');
}

44. $s3 =$app['aws']->getS3();
$result =$s3->putObject([
'Bucket' => 'selphpies',
'Key' => $file->getClientOriginalName(),
'Body' =>fopen($file->getFileName(), 'r'),
'ACL' => 'public-read',
]);

45. // Automatically switches to multipart uploads
// if the file is larger than default threshold.
$result=$s3->upload(
'selphpies',
$file->getClientOriginalName(),
fopen($file->getPathname(), 'r'),
'public-read'
);

46. $dynamoDb->putItem([
'TableName' =>'selphpies',
'Item'=>[
// ...
'src'=>['S' =>$result['ObjectURL']],
'caption'=>['S' =>$caption],
],
]);

47. PHP
such php
so cloud
wow
very selfie
much app
#phpdoge

48. PHP

49. Really

50. PHP

51. PHP

52. PHP

53. PHP
Step 1
Step 2
Step 3
Step 4

54. Step 1

55. $results=$dynamoDb->getPaginator'Scan'
'TableName' =>$oldTable
'KeyConditions' =>

56. Step 2

57. $records =new$dynamoDb
'table' =>$newTable
// $records->put($selphpie);
$records->flush

58. Step 3

59. $commands =
$commands=$s3->getCommand'CopyObject'...
$commands=$s3->getCommand'CopyObject'...
$commands=$s3->getCommand'CopyObject'...
// ...
$s3->executeAll$commands

60. $getCopyCommands= function$resultsuse...
foreach$results->search'Items[]'as$selphpie
$command =$s3->getCommand'CopyObject'
'Bucket' =>$newBucket
'Key' => $key
'SourceFile' =>"{$oldBucket}/{$key}"
// ... (Attach event listener in Step 4) ...
yield$command
$s3->executeAll$getCopyCommands$results

61. Step 4

62. $emitter =$command->getEmitter
$emitter->on'process'function$eventuse...
if$result =$event->getResult
$selphpie'url''S'=$result'ObjectURL'
// Add new record to WriteRequestBatch
$records->put$selphpieelse
// Log/handle error...

63. PHP
Step 1
Step 2
Step 3
Step 4

64. PHP
$results = $dynamoDb->getPaginator('Scan', [
'TableName' => $oldBucket,
'KeyConditions' => [
'app' => [
'AttributeValueList' => [['S' => $oldAppKey]],
'ComparisonOperator' => 'EQ',
],
],
]);
$records = new WriteRequestBatch($dynamoDb, [
'table' => $newTable
]);
$getCopyCommands= function ($results) use (
$s3, $records, $oldBucket, $newBucket, $newAppKey
) {
foreach($results->search('Items[]') as $selphpie) {
$key = Url::fromString($selphpie['url']['S'])->getPath();
$command = $s3->getCommand('CopyObject', [
'Bucket' => $newBucket,
'Key' => $key,
'SourceFile' => "{$oldBucket}/{$key}",
]);
$emitter = $command->getEmitter();
$emitter->on('process', function ($event) use (
$selphpie, $records, $newAppKey
) {
if ($result = $event->getResult()) {
$selphpie['url']['S'] = $result['ObjectURL'];
$selphpie['app']['S'] = $newAppKey;
// Add new record to WriteRequestBatch
$records->put($selphpie);
} else {
// Log/handle error...
}
});
yield $command;
}
};
$s3->executeAll($getCopyCommands($results));
$records->flush();

66. @awsforphpgithub.com/aws/aws-sdk-php/releasesblogs.aws.amazon.com/php

67. github.com/aws/aws-sdk-phpforums.aws.amazon.com

68. http://bit.ly/awsevals
@awsforphp
Come find us at the AWS booths
if you have questions.
Your Homework: