The document summarizes sessions from the AWS re:Invent 2018 conference related to digital advertising and machine learning. It provides an index of breakout sessions, chalk talks, and workshops on topics like using Amazon Rekognition for video analysis, global cloud architecture, and real-time targeted advertising. A highlighted session discusses how The Trade Desk has evolved to use AI/ML techniques and another session describes how VidMob leverages Amazon Rekognition for video creative asset production and analysis.

1. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
re:Invent 2018 Recap
Digital Advertising
Tatsuya, Yagi
Solutions Architect
18/12/2018

2. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
* [AWS Black Belt Online Seminar] AWS re:Invent 2018 QA
https://aws.amazon.com/jp/blogs/news/webinar-bb-reinvent-2018/
* AWS Slideshare
: https://www.slideshare.net/AmazonWebServices
JP: https://www.slideshare.net/AmazonWebServicesJapan
* AWS Youtube re:Invent 2018 Slideshare
https://www.youtube.com/user/AmazonWebServices

3. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
I n d e x : D i g i t a l M a r k e t i n g s e s s i o n s
Breakout Sessions
ADT201-L – Leadership Session: Digital Advertising – Customer Learning & The Road Ahead
ADT202 – Use Amazon Rekognition to Power Video Creative Asset Production
Chalk Talks
ADT205 – Go Global with Cloud-Native Architecture: Deploy AdTech Services Across Four Continents
CTD406 – Monetizing Live OTT Streams Made Easier
CTD403 – Personalized Ad Targeting Using Real-Time, Content – Aware Machine Learning
Workshops
ADT401 – Real-Time Web Analytics with Amazon Kinesis Data Analytics
Builders Sessions
ADT301 – Create a Serverless Web Event Pipeline
ADT302 – Democratize Data Preparation for Analytics & Machine Learning: A Hands-On Lab
ADT303 – ML for Real-Time Self-Service Trend Detection & Root Cause Analysis: A Hands-On Lab

4. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
:
Breakout Sessions
ADT201-L – Leadership Session: Digital Advertising – Customer Learning & The Road Ahead
ADT202 – Use Amazon Rekognition to Power Video Creative Asset Production
Chalk Talks
ADT205 – Go Global with Cloud-Native Architecture: Deploy AdTech Services Across Four Continents
CTD406 – Monetizing Live OTT Streams Made Easier
CTD403 – Personalized Ad Targeting Using Real-Time, Content – Aware Machine Learning
Workshops
ADT401 – Real-Time Web Analytics with Amazon Kinesis Data Analytics
Builders Sessions
ADT301 – Create a Serverless Web Event Pipeline
ADT302 – Democratize Data Preparation for Analytics & Machine Learning: A Hands-On Lab
ADT303 – ML for Real-Time Self-Service Trend Detection & Root Cause Analysis: A Hands-On Lab

5. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
:
Breakout Sessions
ADT201-L – Leadership Session: Digital Advertising – Customer Learning & The Road Ahead
ADT202 – Use Amazon Rekognition to Power Video Creative Asset Production
Chalk Talks
ADT205 – Go Global with Cloud-Native Architecture: Deploy AdTech Services Across Four Continents
CTD406 – Monetizing Live OTT Streams Made Easier
CTD403 – Personalized Ad Targeting Using Real-Time, Content – Aware Machine Learning
Workshops
ADT401 – Real-Time Web Analytics with Amazon Kinesis Data Analytics
Builders Sessions
ADT301 – Create a Serverless Web Event Pipeline
ADT302 – Democratize Data Preparation for Analytics & Machine Learning: A Hands-On Lab
ADT303 – ML for Real-Time Self-Service Trend Detection & Root Cause Analysis: A Hands-On Lab

6. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Leadership Session: Digital Advertising
Customer Learnings & the Road Ahead
Karl Bunch
Worldwide Technical Leader,
Digital Advertising, AWS
A D T 2 0 1 - L
Alex Collmer
Founder & CEO
VidMob
Dave Pickles
CTO
The Trade Desk

7. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
• Intro
• The evolution of AI in advertising – The Trade Desk
• Future of creative - VidMob
• AI in advertising media
• Discussion
• Questions & answers

8. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Agenda
• Intro
• The evolution of AI in advertising – The Trade Desk
• Future of creative - VidMob
• AI in advertising media
• Discussion
• Questions & answers

9. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI

10. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI: …
= State of the art is AI/ML powered.

11. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
= State of the art is AI/ML powered.
AI: …

12. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
= State of the art is AI/ML powered.
AI: …

13. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
= State of the art is AI/ML powered.
AI: …

14. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

15. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI as a new data source …
AI

16. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition
•
• API

17. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Transcribe: Speech to text
Amazon Transcribe is an automatic speech recognition (ASR) service that makes it easy for
developers to add speech to text capability to their applications
SUPPORT FOR BOTH REGULAR &
TELEPHONY AUDIO S3 INTEGRATION
TIMESTAMPS FOR
TEMPORAL DATA PUNCTUATION AND FORMATTING RECOGNIZE MULTIPLE SPEAKERS
CUSTOM
VOCABULARY
§

18. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
STORM
WORLD SERIES
STOCK MARKET
WASHINGTON
LIBRARY O F
NEW S ARTICLES
Amazon
Comprehend
Amazon Comprehend: Understanding textual data
Natural language processing to discover insights from text

19. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Fully managed
hosting with
auto-scaling
One-click
deployment
Pre-built
notebooks for
common
problems
Built-in, high
performance
algorithms
One-click
training
Hyperparameter
optimization
Build Train Deploy
Amazon SageMaker: AI for the masses

20. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
AI

21. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
:
Breakout Sessions
ADT201-L – Leadership Session: Digital Advertising – Customer Learning & The Road Ahead
ADT202 – Use Amazon Rekognition to Power Video Creative Asset Production
Chalk Talks
ADT205 – Go Global with Cloud-Native Architecture: Deploy AdTech Services Across Four Continents
CTD406 – Monetizing Live OTT Streams Made Easier
CTD403 – Personalized Ad Targeting Using Real-Time, Content – Aware Machine Learning
Workshops
ADT401 – Real-Time Web Analytics with Amazon Kinesis Data Analytics
Builders Sessions
ADT301 – Create a Serverless Web Event Pipeline
ADT302 – Democratize Data Preparation for Analytics & Machine Learning: A Hands-On Lab
ADT303 – ML for Real-Time Self-Service Trend Detection & Root Cause Analysis: A Hands-On Lab

22. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Using Amazon Rekognition to
Power Video Creative Asset
Production
James Kupernik
CTO, VidMob
Joline McGoldrick
SVP, Data and Insights, VidMob

23. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Today’s Agenda
Creative data
Amazon Rekognition
What we’ve built

24. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
We Are VidMob
VidMob

25. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

26. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

27. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

28. Data is everywhere
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

29. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

30. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

31. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
2

32. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

33. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Creative needs to be:

34. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
creative data ?

35. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AI

36. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition Image
•

37. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition Video
•

38. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Rekognition
/

39. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

40. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
:
/
/

41. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

42. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
&
Storage Compute/Application
Integration
Machine Learning

43. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

44. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Step Functions
Start
Recognition
Update Status
Process
Response

45. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Start recognition
data = json.loads(message['Body'])
start_step_function(data['media_id'],
data.get('api_type’))
if api_type is None or len(api_types) == 0:
rekognition.start_label_detection()
elif api_type == ‘Person’
rekognition.start_face_detection()
rekognition.start_person_tracking()

46. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
{
"Label": {
"Confidence": 66.68119812011719,
"Name": "Snow"
},
"Timestamp": 200
},
{
"Label": {
"Confidence": 60.01740264892578,
"Name": "Snowboarding"
},
"Timestamp": 200
},
{
"Label": {
"Confidence": 60.01740264892578,
"Name": "Sport"
},
"Timestamp": 200
},
{
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

47. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
[ 0, 200, 400, 600, 800, 1000, 1200, 1400, 1600, 2000 ]

48. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
[400] [800] [1000] [ 2000]

49. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
{
"Timestamp": 400,
"Label": {
"Name": "Snowboard",
"Confidence": 61.29149627685547
}
},
{
"Timestamp": 1200,
"Label": {
"Name": "Snowboard",
"Confidence": 56.50600051879883
}
} [400] [800] [1000] [1200]
Processing response data

50. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

51. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
, ,
Face: {
BoundingBox: {
Height: 0.036666665226221085,
Left: 0.19312499463558197,
Top: 0.2522222101688385,
Width: 0.020625000819563866
},
Pose: {
Roll: -20.857219696044922,
Pitch: 3.1029155254364014,
Yaw: 13.885883331298828
},
...
}

52. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Not just for flying
if Yaw < -20:
if Pitch < -20:
return "down-left"
elif Pitch > 20:
return "up-left"
else:
return "left"
elif Yaw > 20:
...

53. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

54. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
vid
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

55. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
vid
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
https://www.youtube.com/watch?v=S0KI9YRvusM
AWS re:Invent 2018: Use Amazon Rekognition to Power Video Creative Asset Production
(ADT202)

56. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Watch Dashboard
Amazon Rekognition
Amazon Rekognition Amazon Transcribe

57. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
x

58. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

59. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
22.5 K
Hours
21
Days
+80%
ROI

60. © 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

61. aws
https://aws.amazon.com/jp/careers/teams/solutionsarchitect/

62. Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.