The document discusses The Washington Post's adoption of AWS and digital transformation efforts. It provides details on: 1) How The Post migrated systems and tools to AWS to improve scalability, performance, and innovation. 2) New tools and platforms The Post developed on AWS, like Arc Publishing, which are now used by other media companies. 3) How The Post uses AWS services like machine learning to improve content recommendations and moderation.

1. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
지정아 매니저
글로벌 미디어 고객사의 AWS 활용사례
‘워싱턴 포스트’
데이터 사이언스 & 인공지능 총괄/ 워싱턴 포스트
어카운트 매니저/ 아마존 웹서비스
한의홍 (Sam Han)

2. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
디지털시대, 위협받는 종이신문
0
10
20
30
40
50
60
70
1996 2000 2004 2008 2012 2017
69.3%
59.8%
48.3%
36.8%
24.7%
9.9%
59.4%
(1996 ~ 2017)

3. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
변화를 이끈 요소들
인터넷 기술의 변화 미디어소비패턴의 변화
새로운 기술은 새로운
경험을 가져옵니다
인터넷은 일상입니다.
1 2 3
1. 코드커팅 (Code-Cutting)
2. 주문형 비디오 (On-demand)
3. 모바일 광고시장 확대
4. 시장의 글로벌화

4. 변화하는 시장에서는 새로운 전략이 필요합니다
• 시각화…?
• 개인화…?
• 컨텐츠에 집중…?
• 모바일…?
• 글로벌 서비스…?
1. 미디어 R&D
2. 신기술 접목
(AI, VR, IoT, 빅데이터)
3. 뉴스 노출 알고리즘 고도화
4. 방송에 준하는 CMS
……
디지털 멀티미디어
사용자
편집자
콘텐츠 인식 기술
사용자 행동
실험 비용 최소화, 반복적인 실험 작은 프로젝트를 큰 규모로!
빅데이터/ 머신러닝
모바일/ 미디어프로세싱
AI (인공지능),
VR (가상현실), IoT…

5. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
AWS와 함께 변화에 적응하는 글로벌 미디어 기업들
• 양질의, 많은 콘텐츠 생산
• 추천엔진 (빅데이터)
• 미디어 공급채널
• Unbundling / Skinny Bundles
“시청하는 영상의
75% 이상이
빅데이터 추천에서
비롯됩니다“
“넷플릭스를
벤치마크하여,
사용자들의 시청데이터를
기반으로 새로운 쇼들을
제안합니다“
연간 컨텐트 투자 비용 ($B)
‘2018년 가장
혁신적인
미디어사로 선정＇

6. 1. Clarity of ambition
2. A technology company
3. Truly Digital First
4. Expansion of editorial resources
5. Metrics at the centre of the editorial process
6. Clear Editorial Direction
7. A strong innovation culture
8. Building content networks
9. Fully multi-media
10. Clear management structures and processes
워싱턴 포스트의 혁신 테넌트
“The Washington Post
recorded
80.7 million visitors,
1 billion page views
in May 2017”

7. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
워싱턴 포스트의 디지털 혁신
엔지니어링 디렉터, 데이터 사이언스 & 인공지능
워싱턴 포스트
한의홍 (Sam Han)

8. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

9. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

10. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

11. Title Text
Body Level One

12. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
63 Pulitzer Prizes
Most Innovative
Media Company
2018
WAN-IFRA’s
Digital Media Awards
2017
Hottest Digital
Publication in News
2017

13. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Why Did The Post Adopt AWS?
• Cloud had “come of age” and need to be rapidly adopted
• Pivot from a “buy” IT department to a “build” technology
company
• DevOps model where individual teams were given ownership
and responsibility
• Scalability and performance during heavy traffic days (e.g.,
elections, hearings, breaking news)

14. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Journey
• Use AWS for all new products/services/tools/projects
• Incremental adoption grew to about $500K per year usage
• Migrate existing tools to AWS or replace them with new tools on
AWS
• Offer our tools as service on AWS to other media companies => Arc
Publishing
• Collaboration with AWS AI team and early adoption of AI/ML tools

15. Arc
The Platform for Digital Innovation

16. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
REVENUE
(Subscriptions)
ELLIPSIS
(editor)
ANGLERFIS
H
(photos)
GOLDFIS
H
(videos)
REVENUE
(Subscriptions)
REVENUE
(Subscriptions)
WEBSKED
(news planning & workflow management)
THE ARC ECOSYSTEM
An end-to-end, hosted suite of interconnected tools hand-picked by publishers to meet your needs
Arc Publishing

17. Bandito
Clavis
Coral
Darwin
Heliograf
ARTICLESVIDEOSUBSCRIPTIONS PHOTO AUDIO NEWSLETTERSHOMEPAGE
Ellipsis
WebSked
Goldfish
Lionfish
Anglerfish
Carta
Revere
PageBuilder
ADVERTISINGALERTS
Zeus
FlexPlay
PostPulse
In Context
Re-Engage
Distrib
uted
Platfor
ms
Arc I/O
Acquisition
Identity
Lagoon
Meter

18. Bandito
Clavis
Coral
Darwin
Heliograf
ARTICLESVIDEOSUBSCRIPTIONS PHOTO AUDIO NEWSLETTERSHOMEPAGE
Ellipsis
WebSked
Goldfish
Lionfish
Anglerfish
Carta
Revere
PageBuilder
ADVERTISINGALERTS
Zeus
FlexPlay
PostPul
se
Distribut
ed
Platform
s
Arc I/O
Acquisition
Identity
Lagoon
Meter
/
Powered by Arc

20. ModBot
First Place - Excellence in Use of Artificial Intelligence
Heliograf
First Place - Excellence in Use of Bots
7th Big Data & AI for Media Conference, 2018

21. Title Text
Body Level One

22. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Metadata Features
Contextual Features
Temporal Features
Social Features
TRAINING DATA
Regression
Model
Clicks @24
hours after
publication
Virality Model Building
Multiple Linear Regression
Lasso Regression
Ridge Regression
Tree Regression

23. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Popularity Forecast Slack Room
The “Virality
Oracle” Bot

24. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
PostPulse
The Recommendation Engine for Your Target Audience
Aggregate all of the assets relevant to your campaign
Curate and filter assets using Clavis and article
popularity
Deliver a tailored personalized experience to the right
user, in the right place, at the right time across
mobile, desktop and tablet

25. • Measures the quality of
comments automatically
• Reduce the number of
comments that need to
be reviewed by human
moderators
• Maintain a high quality
online comment section
ModBot
Automatic Content Moderation

26. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
How ModBot works
CLASSIFIER
Not filtered
Comment
Filtered
score = 1.0
Predicted
score
(0.0, 1.0)
1.0
0.0
Delete
Approve
ModBot
Icons by Freepik
1 million comments per month
SCORE
PRE-FILTER

27. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
How ModBot works
1.0
0.0
Delete
Approve
Now f*ck off all the rest of you lazy b*star*s … …
I agree with the reliever suggestion; this
left handed right handed nonsense is
slowing down the game … … Fans would
be more engaged in watching that attempt,
and pitchers would stop throwing to first
nine or ten times for one runner.
A
B
A
B
ModBot

28. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
How ModBot Was Trained
Learn from data
• Offensive words
• URL links
• Special Symbols
• Comment length
• … ...
Hey you stupid idiot, that is called
mainstream media. Damn you are too dumb
to realize and too stupid to change.
? :) ==== Watch and Download HD Quality
==== :) ? ☛
http://4k.useehd.us/movie/155/the-dark-
knight.html ☛
http://4k.useehd.us/movie/680/pulp-
fiction.html.
I agree with this piece. The points made were
fair, and overall made me appreciate
Gorsuch a bit more. … …
Good morning, As a Brit and marginal
“remain” voter, I‘m sanguine about this
situation. From a business perspective, … …
Train Predict
Natural language processing
Machine learning
Training data: Over 60,000 Comments
Data validation: Comment Team Lead
…
…
ModBot
What low life. Stupid, idiotic
people.
Interesting article with a lot
of research. what I read ,
that is hopeful for people
with the stated special
situations … …

29. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Now f*ck off all the rest of you lazy b*star*s … …
How ModBot works in production
Thresholds
0.8
…
Human review
Automatically
approve
Automatically delete
You are a trumptard. Do whatever you want to do. no one cares.
I am sick to death of seeing these liars be given a platform on TV news.
I live right by the mosque/FP and when my alarm went off this morning so I
could get ready to go run in the park before it got too hot, I saw the WaPo
alert … … Love to all my fellow Londoners.
I've coached soccer for about 14 years total … … and in watching him ref,
I've gained even more respect for those that do it … … thank you for your
time and sacrifice for the kids!!
Logic, where are you getting your facts? you are making up things.
………
0.2
You're a troll, right?
Trump is too worried about getting canned. He is an idiot.

30. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
ModBot Recommends
Feature Score
[0.0, 1.0]Comment
Relatedness
If the comment is highly related to the article, it’s more
likely to be good comment
Commenter
ProfileA commenters’ historical commenting behavior can be a
signal for his/her comments’ quality.
Comment Quality
The quality of a comment matters. If a comment shows
signs of violating online discussion policy, it hardly can be
a featured comment.
Comment Length
A comment with a proper length can be a good sign. We
calculate the distance of a comment’s length to a
desirable length.

31. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
ModBot Recommends
As someone who has served in prior Republican administrations in the national security field, I am appalled
that Mr. Kushner has been afforded any access to classified information. Those of us working for our
country felt it our duty and privilege to avoid even the appearance of conflicts. All of my assets were placed
into a blind trust, sold and converted into other securities, the identity and nature of which I did not know
until the day I returned to the private sector: a less wealthy person, by the way. This foolishness needs to
end, the White House returned to normalcy instead of propinquity, and Mr. Kushner released to the private
sector to work out and pay off his debts.
Relatedne
ssHigh
Profile
High
Quality
High
Length
Medium
Feature Score
0.71
*THIS* is why there is a comprehensive background check process in place. When I was a young, new
attorney with the federal government and applying for a security clearance for the first time, I thought the
questions on the SF-86 were silly: "do you have foreign property?," "have you had contact with anyone in a
foreign government?," etc. I, as a non-billionaire with zero foreign interests, could not understand why I
repeatedly had to answer these questions under threat of perjury. Now, I understand. What I DON'T
understand is how Jared has even MINIMAL clearance - all access needs to be revoked immediately, and
he needs to be escorted out of the White House. That's how it would go down for me or any of my
colleagues.
Relatedne
ssHigh
Profile
High
Quality
High
Length
Medium
Feature Score
0.71
Say, did you know that Hillary Clinton had an email server? I will never stop reminding you Trump fanboys
just how stupid and insane it was to elect this monstrosity of an administration.
Relatedne
ssLow
Profile
Low
Quality
Medium
Length
Low
Feature Score
0.25
7326
Comments

32. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
What’s next for ModBot
ModBot
Icon by Freepik
Site-wide
Comments
50%
The Coral
Project
Automatically
Approve /
Delete
Automatically
Recommend
• Find better solution for data issue
• Explore models to improve performance
ModBot Moderates
• Integrate with the newsroom workflow
• Improve models by feature engineering and better training
ModBot Recommends

33. Title Text
Body Level One

34. Title Text
Body Level One

35. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.

36. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
Before polls close
As results come in
Race is called

37. NFL Player Card

38. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
High School
Football

40. © 2018, Amazon Web Services, Inc. or Its Affiliates. All rights reserved.
WaPo & AWS AI Collaboration
1) Article Keyword Extraction – Comprehend
2) Video Recommendation – ReKognition
3) Machine Learning Infrastructure
 Deep Learning – MXNet
 Machine Learning Framework - SageMaker

41. 감사합니다