Create a Custom Celebrity List for Your Media Assets (AIM349-R1) - AWS re:Invent 2018

•

1 like•149 views

When indexing large amounts of media files, it can become difficult to search through them to find certain objects and individuals. In this session, we show you how creating a custom celebrity list enables you to index your media files by the people you train it to recognize. Come and see how this solution can serve as the foundation for creating automated sports highlight reels, building face-based user verification systems, and more.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Create a Custom Celebrity List for
Your Media Assets
Suman Koduri
Sr. Technical Account Manager
Enterprise Support, AWS
A I M 3 4 9

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Why do we need custom celebrity list?
Provide face-based verification
Recognize VIP’s
Recognize key individuals from uploaded media files

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Current Approach & Challenges
Speed?
Scale? Cost?Manual?
Automation?

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Solution Pipeline
21 3
Collect Process Transform

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon RekognitionAmazon S3 Face collection
Faces
1. Store images of recognized people
from your own image database
2. Index individuals into a collection
Collect

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
Amazon S3
(Media Bucket)
Amazon ElasticsearchAWS Lambda: Analysis
AWS Lambda: Commit
AWS Step FunctionsVídeos
Amazon RekognitionAmazon S3 Face collection
Faces
2. Index individuals into a collection
4. Recognize individual faces based on your uploaded files3. Store video files
Process
Collect
5. Index and store metadata on ES
1. Store images of recognized people
from your own image database

© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
AWS LambdaAmazon API Gateway9. Visualize Metadata
Amazon RekognitionAmazon S3 Face collection
AWS Lambda: Transcode
Amazon S3
(Media Clips)
Faces
2. Index individuals into a collection
6. Clip video for specific faces
7. Transcode file to generate clips
AWS Elemental MediaConvert
Transform
Amazon S3
(Media Bucket)
Amazon ElasticsearchAWS Lambda: Analysis
AWS Lambda: Commit
AWS Step FunctionsVídeos
3. Store video files
Process
5. Index and store metadata on ES
Collect
8. Collection of Custom
Celebrity clips
1. Store images of recognized people
from your own image database
4. Recognize individual faces based on your uploaded files
Visualize

Thank you!
© 2018, Amazon Web Services, Inc. or its affiliates. All rights reserved.
• @sumankoduri
• https://www.linkedin.com/in/sumankoduri
Suman Koduri (skkoduri@amazon.com)

What's hot

Sophisticated AI capabilities can help us manage the exploding number of information sources and tools required to perform our daily tasks. In this chalk talk, we describe how intelligent agents can be designed to quickly and efficiently complete tasks delegated by users. To build this intelligent agent, we combine a number of AWS services, such as Amazon Polly, Amazon Lex, Amazon Rekognition, Amazon Sumerian, and Amazon ElastiCache along with other technologies, such as CLIPS and Reinforcement Learning. Come hear us discuss the project’s architecture, implementation, and demo progress made to date.

Build an Intelligent Multi-Modal User Agent with Voice and NLU (AIM340) - AWS...

Amazon Web Services

Veritas Technologies is an AWS Partner Network (APN) Advanced Technology Partner that addresses information management challenges, including backup and recovery, business continuity, software-defined storage, and information governance to simplify backup and improve efficiency. In this chalk talk, we do a deep dive on Veritas NetBackup, an industry-leading backup software that protects on-premises and Amazon EC2 workloads and provides support for Amazon S3 Standard-Infrequent Access and Amazon Glacier. We also hear from Bell Media, who is utilizing Veritas NetBackup to retain backups long-term on Amazon S3.

Enterprise Data Protection with Veritas NetBackup on AWS (STG347) - AWS re:In...

Amazon Web Services

Amazon S3 Security Settings & Controls (STG308-R1) - AWS re:Invent 2018

Amazon Web Services

Train Models on Amazon SageMaker Using Data Not from Amazon S3 (AIM419) - AWS...

Amazon Web Services

Tailor Your Alexa Skill Responses to Deliver Truly Personal Experiences (ALX3...

Amazon Web Services

About 80% of data held by an organization is unstructured—such as emails, social media feeds, news articles, and customer feedback—which makes it difficult to analyze and use. NLP and ML can help. Amazon Comprehend is an NLP service that uses ML to find insights and relationships in text. In this session, learn how to easily process, analyze, and visualize data by pairing Amazon Comprehend with Amazon RDS, Amazon Elasticsearch Service, and Amazon Neptune. Also see real-world examples of how customers have built advanced text analytics solutions with Amazon Comprehend.

Create Advanced Text Analytics Solutions with NLP - BDA310 - New York AWS Sum...

Amazon Web Services

Best Practices for Building Multi-Region, Active-Active Serverless Applicatio...

Amazon Web Services

In this session, learn from market-leader Vonage how and why they re-architected their QoS-sensitive, highly available and highly performant legacy real-time communications systems to take advantage of Amazon EC2, Enhanced Networking, Amazon S3, ASG, Amazon RDS, Amazon ElastiCache, AWS Lambda, StepFunctions, Amazon SNS, Amazon SQS, Amazon Kinesis, Amazon EFS, and more. We also learn how Aspect, a multinational leader in call center solutions, used AWS Lambda, Amazon API Gateway, Amazon Kinesis, Amazon ElastiCache, Amazon Cognito, and Application Load Balancer with open-source API development tooling from Swagger, to build a comprehensive, microservices-based solution. Vonage and Aspect share their journey to TCO optimization, global outreach, and agility with best practices and insights.

Vonage & Aspect: Transform Real-Time Communications & Customer Engagement (TL...

Amazon Web Services

In this session, participate in a hands-on exercise with AWS IoT Core. You begin by leveraging the AWS IoT Device SDKs to securely connect to AWS IoT, then you modify and send sample data over MQTT to AWS IoT Core. Lastly, you learn how to make that data actionable by leveraging the AWS IoT rules engine. By the end of the session, expect to have a solid understanding of how AWS IoT works and how to begin using AWS IoT in your applications.

Build an End-To-End IoT Example with AWS IoT Core (IOT211-R2) - AWS re:Invent...

Amazon Web Services

ConocoPhillips is exploring the combination of machine vision and machine learning. Four proof of concepts were developed using AWS DeepLens, Amazon SageMaker, Amazon S3, and more. These projects address the security, safety, and inventory associated with upstream field operations. In this session, we describe our successes, challenges, and lessons learned. We also share our ideas for future product improvements.

New AI/ML Solutions with AWS DeepLens & Amazon SageMaker with ConocoPhillips ...

Amazon Web Services

Organizations that use data as a competitive differentiator are more likely to lead and outperform their peers. Many organizations have transformed their data architectures and adopted the cloud to meet a variety of scalability and automation challenges. In this session, we develop a blueprint for data flows from data sources to data lakes, data warehousing, advanced analytics, and machine learning (ML). We look at the big picture, understand how to build data pipelines and repositories for different use cases, and enable data science at enterprise scale in a way that unleashes the value of corporate data, and embeds AI/ML in business processes.

Drive Customer Value with Data-Driven Decisions (GPSBUS206) - AWS re:Invent 2018

Amazon Web Services

Private Network Connectivity: Connecting AWS into Public Sector Networks (WPS...

Amazon Web Services

In this hands-on workshop, learn how to use Alexa Built-In to create products that you can talk to and use to access music, information, control smart-home devices, and all of Alexa's skills. We use the C++-based AVS Device SDK and a Raspberry Pi to access the cloud-based Alexa Voice Service (AVS). Leave this session with your own working prototype and the knowledge to bring your products to market.

Alexa for Device Makers: Create Products with Alexa Built-In Using AVS (ALX30...

Amazon Web Services

In this workshop, learn how to get started with the PyTorch deep learning framework using Amazon SageMaker, a fully managed platform to build, train, and deploy machine learning (ML) models at scale quickly and easily. First, we create a computer vision model using deep neural networks that helps us discover analytical information from our image dataset. Then, we use Amazon Redshift, a fully managed data warehouse, to perform analytics and find business value using the output of our ML model.

Build Deep Learning Applications Using PyTorch and Amazon SageMaker (AIM432-R...

Amazon Web Services

Content lake architecture can evolve the media workflow by providing efficiency from content security all the way to value-added services, such as machine learning and content monetization. In this session, technical leaders from 21st Century Fox, Warner Bros., and Astro Malaysia discuss the migration of their petabyte-scale video libraries (production and distribution archives) to the cloud in order to increase the customer reach and value of their media archives. Discover some of the lessons learned, the TCO analysis around various different storage tiers, the challenges and best practices from 10s of petabytes ingest, storage, and value-added compute at scale.

Hollywood's Cloud-Based Content Lakes: Modernized Media Archives (MAE203) - A...

Amazon Web Services

For many IT professionals, cloud data protection can be challenging. In this session, we explore options for protecting and restoring your Amazon EC2 instances, relational databases, and NoSQL databases, such as MongoDB and Cassandra. We show you how solutions such as Rubrik Cloud Data Management and Rubrik Datos IO augment your Amazon EC2 backup strategy, including lifecycle management of Amazon EBS snapshots and Amazon Machine Images (AMI), automation and simplification of Amazon EBS volume and file-level restores from Amazon EBS snapshots, and application-consistent backup and recovery for Oracle, Microsoft SQL Server, MongoDB, and Cassandra databases on Amazon EC2. This session is brought to you by AWS partner, Rubrik.

Protecting Amazon EC2 Instances, Relational Databases, and NoSQL Workloads (S...

Amazon Web Services

In this wide-ranging keynote session, first hear from AWS VP Carla Stratfold on the major forces affecting the industry, then learn from AWS Global M&E Tech Lead Usman Shakeel about the latest and most exciting releases coming out of re:Invent relevant to the M&E industry. And finally, hear how technical leaders at the forefront of the industry are responding to accelerating changes in the media landscape.

M&E Leadership Session: The State of the Industry, What's New from AWS for M&...

Amazon Web Services

In this chalk talk, we discuss why using temporary security credentials to manage access to your AWS resources is an AWS Identity and Access Management (AWS IAM) best practice. IAM roles help you follow this best practice by delivering and rotating temporary credentials automatically. We discuss the different types of IAM roles, the assume role functionality, and how to author fine-grained trust and access policies that limit the scope of IAM roles. We then show you how to attach IAM roles to your AWS resources, such as Amazon EC2 instances and AWS Lambda functions. We also discuss migrating applications that use long-term AWS access keys to temporary credentials managed by IAM roles.

Unleash the Power of Temporary AWS Credentials (a.k.a. IAM roles) (SEC390-R1)...

Amazon Web Services

Machine learning is powering innovation across industries, including media & entertainment, healthcare, finance, and many more. In this session, representatives from AWS and Sony Interactive Entertainment discuss building real-world scalable enterprise solutions with machine learning using Amazon SageMaker. Join us as we talk about managing large-scale systems and processes to get more value from data at any scale, with examples from Sony and AWS.

Machine Learning for the Enterprise, ft. Sony Interactive Entertainment (ENT2...

Amazon Web Services

DevOps and Data Science? How does that work? In software teams where innovation is a priority, DevOps can be an accelerator. In data science and machine learning, there are a number of factors that increase complexity of systems and thus the complexity of DevOps. This session will touch on fundamental concepts in data science such as data management, ETL, modeling, and model validation, and open discussion around some ways that common tools and processes can be used to decouple and stabilize workflows to accelerate research.

DevOps Concepts for Data Science (DEV347-R2) - AWS re:Invent 2018

Amazon Web Services

What's hot (20)