Successfully reported this slideshow.
We use your LinkedIn profile and activity data to personalize ads and to show you more relevant ads. You can change your ad preferences anytime.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
S U M M I T
S E O U L
© 2019, Amazon Web Service...
Enhancing your Media Workflows
with Amazon Machine Learning
Shweta Jain
APAC Head of Business Development, M&E
Amazon Web ...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Viewer
Expectation
Content discoverability,
reco...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
The Amazon ML stack: Broadest & deepest set of c...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
WHY AWS FOR AI?
200 new features and services
la...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sample ML Use Cases in M&E
Automate the creation...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Identify and path player activity in the field o...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Media Enrichment and Analysis
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Confidential
Amazon Rekognition Image - F...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Confidential
Amazon Rekognition Video - F...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Confidential
Object and scene detection m...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Confidential
New features: object and sce...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Confidential
Blowing a candle Drinking
Ob...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Confidential
Measure the likelihood that ...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Confidential
Recognize other public figur...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use-Case: From manual tagging to AI based taggin...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Use-Case: Event Broadcasting Enrichment
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its Affilia...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Content Moderation & Redaction
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its Affilia...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sports media tagging
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Sports Highlights and Player Activity Pathing
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Automated Subtitling
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Personalization
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Users increasingly expect every interaction to b...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Effective personalization involves multiple hard...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon Personalize
Real-time personalization and...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Activity stream
from app
Views, signups,
convers...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
How we can help
Discovery Workshops - ML Solutio...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Get Started: Media2Cloud Solution
3-Phased Proje...
© 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Start leveraging Machine Learning for your video...
감사합니다
Upcoming SlideShare
Loading in …5
×

[AWS Media Symposium 2019] Enhancing your Media Workflows with Amazon Machine Learning - Shweta Jain, AWS APAC Head of Business Development

159 views

Published on

인공지능과 기계학습에 관한 활용은 모든 산업군에서 최고의 관심사입니다. 이 세션에서는 AWS의 AI&ML 서비스를 활용한 다양한 고객 사례를 설명드리고 국제 방송 컨퍼런스인 IBC2019에서 발표한 AWS의 ML 서비스 활용 방안에 대해서도 알려드릴 예정입니다.

Published in: Technology
  • Be the first to comment

  • Be the first to like this

[AWS Media Symposium 2019] Enhancing your Media Workflows with Amazon Machine Learning - Shweta Jain, AWS APAC Head of Business Development

  1. 1. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. S U M M I T S E O U L © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. AWS MEDIA DAY
  2. 2. Enhancing your Media Workflows with Amazon Machine Learning Shweta Jain APAC Head of Business Development, M&E Amazon Web Services
  3. 3. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Viewer Expectation Content discoverability, recommendations, personalization Business Opportunity Learn about viewers, use the data to increase engagement Customer Obsession Customer satisfaction increases brand value and drives revenue The New Media and Entertainment Reality
  4. 4. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. The Amazon ML stack: Broadest & deepest set of capabilities M L F R A M E W O R K S & I N F R A S T R U C T U R E A I S E R V I C E S R E K O G N I T I O N I M A G E A M A Z O N P O L L Y A M A Z O N T R A N S C R I B E A M A Z O N T R A N S L A T E A M A Z O N C O M P R E H E N D A M A Z O N L E X R E K O G N I T I O N V I D E O Vision Speech Chatbots A M A Z O N S A G E M A K E R B U I L D T R A I N A M A Z O N F O R E C A S T A M A Z O N T E X T R A C T A M A Z O N P E R S O N A L I Z E D E P L O Y Pre-built algorithms & notebooks Data labeling (G R O U N D T R U T H ) One-click model training & tuning Optimization (N E O ) One-click deployment & hosting M L S E R V I C E S F r a m e w o r k s I n t e r f a c e s I n f r a s t r u c t u r e E C 2 P 3 & P 3 d n E C 2 C 5 F P G A s G R E E N G R A S S E L A S T I C I N F E R E N C E Reinforcement learning Algorithms & models ( A W S M A R K E T P L A C E F O R M A C H I N E L E A R N I N G ) Language Forecasting Recommendations
  5. 5. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. WHY AWS FOR AI? 200 new features and services launched this last year alone Unmatched flexibility Broadest and deepest set of AI and ML services 70% cost reduction in data-labeling 10x faster performance 75% lower inference cost Accelerate your adoption of ML with SageMaker Built on the most comprehensive cloud platform optimized for ML AWS holds the top spots on Stanford’s benchmark, for fastest training time, lowest cost, lowest inference latency
  6. 6. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sample ML Use Cases in M&E Automate the creation of rich metadata index (object, scene, activity, faces etc.), extracted from audio visual content and integrated into digital and media asset management systems AWS SERVICES TO BUILD USE CASE: AMAZON REKOGNITION, AMAZON SAGEMAKER, AMAZON TRANSCRIBE, AMAZON COMPREHEND Media Metadata Tagging Automated captions, transcription and translation of audio content AWS SERVICES TO BUILD USE CASE: AMAZON TRANSCRIBE, AMAZON TRANSLATE, AMAZON COMPREHEND Closed Captioning Detect potentially inappropriate content to avoid compliance issues in global markets, and to increase brand safety for advertisers AWS SERVICES TO BUILD USE CASE: AMAZON REKOGNITION, AMAZON TRANSCRIBE, AMAZON SAGEMAKER Automated Compliance Marking Identify objects and emotion in content that enables users to integrate personalized ads into subscriber video streams AWS SERVICES TO BUILD USE CASE: AMAZON SPARK/EMR, AMAZON SAGEMAKER, AWS MEDIATAILOR Ad Personalization
  7. 7. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Identify and path player activity in the field or identify the precise timecodes when actors enter and leave a scene, both visually and in spoken dialog (off-screen voice) AWS SERVICES TO BUILD USE CASE: AMAZON REKOGNITION, AMAZON TRANSCRIBE Player/ Actor identification & activity pathing Translate transcripts and metadata. Improve localization workflows and search experience AWS SERVICES TO BUILD USE CASE: AMAZON TRANSLATE Language Translation Analysis disparate data and enable the consumer to make personalized content choices and the business to predict behavior AWS SERVICES TO BUILD USE CASE: AMAZON SAGEMAKER Content Recommendations Detect and pixelate faces captured incidentally to preserve the privacy of non-persons of interest in news feeds and security footage AWS SERVICES TO BUILD USE CASE: AMAZON REKOGNITION, AMAZON TRANSCRIBE, AMAZON SAGEMAKER Automated Redaction Sample ML Use Cases in M&E
  8. 8. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Media Enrichment and Analysis
  9. 9. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential Amazon Rekognition Image - Features Object and Scene Detection Facial Analysis Face Search Text in Image Deep learning-based image analysis service Unsafe Image Detection Celebrity Recognition
  10. 10. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential Amazon Rekognition Video - Features Deep learning-based video analysis service Object & Activity Detection Person Pathing Face Search Real-time Live Stream Unsafe Video Detection Celebrity Recognition
  11. 11. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential Object and scene detection makes it easy for you to add features that search, filter, and curate large image and video libraries. Identify objects and scenes with confidence scores Flower Arrangement Chair Coffee Table Living Room Indoors Furniture Cushion Vase Maple Villa Plant Garden Water Swimming Pool Tree Potted Plant Backyard Patio Object and Scene Detection
  12. 12. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential New features: object and scene detection
  13. 13. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential Blowing a candle Drinking Object and Activity Detection
  14. 14. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential Measure the likelihood that faces are of the same person Similarity 93% Similarity 0% Face Comparison
  15. 15. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Confidential Recognize other public figures in a photo or video using your private repository of face images Search Index Collection Face Search
  16. 16. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Use-Case: From manual tagging to AI based tagging Background • Over 200,000 hours of content • Only half of content is manually tagged • How can we enrich our metadata in AWS? • How can we unleash the value of content we already own once in AWS? Challenge • Large scale video library • High accuracy required • Limited budget • Ability to extract from video • Keep up with daily increase in content Results • Solution developed within three weeks • Live video frame based analysis • Established, searchable baseline archive • All content is now tagged and indexed • Over 99,000 faces indexed and searchable • Saved ~9,000 hours a year in manual curation costs
  17. 17. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Use-Case: Event Broadcasting Enrichment
  18. 18. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Trademark Tag, filter, and redact inappropriate content Person 99.2% Gun 84.6% Handgun 73.5% Drink 96.4% Alcohol 80.1% Wine 69.9%
  19. 19. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Content Moderation & Redaction
  20. 20. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. © 2019, Amazon Web Services, Inc. or its Affiliates. All rights reserved. About OSN OSN is MENA’s leading entertainment network with rights to broadcast in 25 countries across the region. With over 150 channels, OSN’s strength is its unbeatable range of exclusive programming led by its long-term partnerships with studio majors including Disney, HBO, NBC Universal, Fox, Paramount, MGM, Sony and DreamWorks. Using AWS’s AI services Amazon Rekognition and Amazon Transcribe, we reduced the amount of footage our human curators needed to review by over a third, accelerating our media supply chain and getting content to our audiences faster than ever. Dave Mace, Digital and Cloud Services, OSN “ ” AI-accelerated Compliance CHALLENGE OSN receives content from around the world with different compliance standards. OSN was looking for a way to accelerate compliance with applicable laws (35 page document), efficiently flag potential issues, objectively defend decisions to regulators, and identify issues for deciding ratings. SOLUTION Working with APN Partner GrayMeta, OSN leveraged Amazon Transcribe and Amazon Rekognition to automate metadata tagging and flag potential issues to human curators. BENEFIT Decreased manual footage review for compliance by over one third, decreasing time for content to be live to audiences by days
  21. 21. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sports media tagging
  22. 22. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Sports Highlights and Player Activity Pathing
  23. 23. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Automated Subtitling
  24. 24. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved.
  25. 25. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Personalization
  26. 26. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Users increasingly expect every interaction to be personalized Activity & Content Recommendation Search Personalization Personalized Notifications Emails
  27. 27. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Effective personalization involves multiple hard problems Popularity Trap Naïve models give recommendations similar to popular items Cold Starts New users should get relevant recommendations, new items should show in recommendations Scale Recommendations should scale across millions of users and items Real-Time Personalization must be responsive to the changing user intent Custom models Personalization models must accurately reflect business context and user behavior
  28. 28. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Amazon Personalize Real-time personalization and recommendation service, based on the machine learning technology used by Amazon.com Generates personalized recommendations for your users via API calls • State-of-the-art deep learning algorithms that out-perform traditional methods • Auto-ML capabilities that automate the entire process from data ingestion to inference • Real-time personalized recommendations – Ability to ingest activity/clickstream data and generate recommendations, in real time, based on the session/context of the use
  29. 29. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Activity stream from app Views, signups, conversion, etc. Inventory Articles, products, videos, etc. Demographics (optional) INSPECT DATA IDENTIFY FEATURES SELECT ALGORITHMS SELECT HYPERPARAMETERS TRAIN MODELS OPTIMIZE MODELS HOST MODELS BUILD FEATURE STORE CREATE REAL-TIME CACHES Customized personalization & recommendation API Fully managed by Amazon Personalize Amazon Personalize Machine learning personalization and recommendations Age, location, etc. AmazonPersonalize
  30. 30. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. How we can help Discovery Workshops - ML Solutions Lab – ML ProServ Brainstorming Custom modeling Training Work side-by-side with Amazon experts Partner Ecosystem AWS Media Solutions
  31. 31. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Get Started: Media2Cloud Solution 3-Phased Project Template: Export assets with metadata, process/analysis, and import to MAM Flexible to accommodate different workflows, content types, and partner components Professional Services to provide optional assessment, project management, and offline tape migration Drain the Existing Archive Generate Content Value Import into a Modern MAM
  32. 32. © 2019, Amazon Web Services, Inc. or its affiliates. All rights reserved. Start leveraging Machine Learning for your video assets https://aws.amazon.com/solutions/media2cloud/
  33. 33. 감사합니다

×