As video content is becoming mainstream, video summarization is becoming a hot research topic in academia and industry. Video thumbnail generation and summarization has been worked on for years, but deep learning and reinforcement learning is changing the landscape and emerging as the winner for optimal frame selection. Recent advances in GANs are improving the quality, aesthetics and relevancy of the frames to represent the original videos. Come join this session to get an understanding of various challenges and emerging solutions around video summarization.
In this presentation we'll cover some of the cutting edge tech that we are using for video summarizations, but we will start with an introduction of Adobe, AI @ adobe (Sensei) , some of the industry usecases around Videos and then deep dive into Video summarization of why, what and how.
Adobe has been setting the standard for digital experiences since the company’s founding in December 1982.
One thing that hasn’t changed is Adobe’s commitment to the community and our people. We are dedicated to creating an exceptional work environment for our 18,000+ employees in 37 countries. 76% of our employee workspaces are LEED certified as Green Buildings. In addition, we invested more than 36 million to charitable causes in the communities in which we work and live in 2017.
We also heavily invest in innovation and Adobe’s patent portfolio is proof. Nearly 4,300 patents – actual: 4,280 patents (3,716 US + 564 Global patents) *As of June 30, 2018
Interbrand Best Global Brands – No. 56 in 2017 (up from 63 in 2016) Fast Company’s 50 Most Innovative Companies for Artificial Intelligence – Ranked among top 10 companies for innovation in AI for Adobe Sensei FORTUNE’s 100 Best Companies to Work for – No. 26 (up from No. 60 in 2017), Adobe has been on the list for 18 years
In addition to these accolades, Adobe has been highlighted on lists such as: Fortune’s Most Admired Companies – No. 3 in the software category in 2018 Forbes Most Innovative Companies – No. 13 in 2018 Global 100 - For the second time, Adobe was named to the Global 100 Most Sustainable Corporations in the World index 100 Best Corporate Citizens -- Adobe has been included on CR Magazine's 100 Best Corporate Citizens List, recognized for transparency in reporting and responsible business practices. Electronic Frontier Foundation – In 2017 Adobe received a 5 star rating from the Electronic Frontier foundation for protecting your data from Government Requests
Adobe Sensei is the only comprehensive AI and Machine Learning framework that is 100% focused on digital experiences. The Adobe Sensei AI and ML framework and intelligent services are built into the Adobe Cloud Platform. It is unique in two fundamental ways: First, it harnesses the vast amount of data and content flowing through our cloud solutions. Second, it has a deep understanding of how our customers work in the design and delivery of great experiences.
Unlike other general-purpose AI approaches our belief is that Adobe Sensei will amplify human creativity and intelligence and not replace it. Our focus is on three intelligence domains you see represented on this slide along with some of the many service capabilities we have powered by Adobe Sensei. Let me walk you through a few examples:
Creative Intelligence – using machine learning, artificial intelligence and deep learning to support the creative process, here are just a few examples of features already in our creative products powered by Adobe Sensei: • Face Aware Editing: Finds faces in an image and uses “landmarks” such as eyebrows, lips and eyes to understand their position and change the facial expression without ruining the image. • Font Recognition, where the system recognizes a font from a creative asset and can recommend similar fonts. • Morph Cut: Adobe Sensei in Adobe Premiere Pro can create seamless transitions between jump cuts – which would otherwise have required hours of editing.
Experience Intelligence – leading brands are focusing on providing an amazing experience to their customers with every interaction. We use AI and ML to help you deliver the right content, to the right person, at the right time.so you can provide better personalized content and recommendations, and analyze performance. Here are some specific examples of Adobe Sensei in our Experience Cloud offering: Virtual Analyst: Adobe Analytics delivers Intelligent Alerts when a statistically significant event is detected. A retailer, for instance, can get an alert when an items jumps in sales on a particular day, or when smartphone cart abandonments see an irregular spike. It detects statistically significant data anomalies, and runs contribution analysis and embeds the result in your Analysis Workspace. Auto Target, Personalized Recommendations, Auto Offers: Adobe Target determines the best, personalized experience to serve individuals. Brands can select options such as different layouts, wording and images, and personalize them for individuals. With one click, Adobe Target automatically determines the right website or app experience to show each visitor to drive better engagement and conversion.
Content Intelligence – We have experience in creating content, publishing content, and monetizing content Using ML/AI to understand the various parts of content whether it be words, paragraphs or forms so that technology can work on your behalf, automating repetitive tasks and boosting productivity. Visual Stock Search: Adobe Stock uses content intelligence to improve search results – allowing users to even search by aesthetics like depth of field, to find the perfect image faster. Creating searchable, editable, sharable documents: Acrobat DC uses technology that classifies words, paragraphs, lists, tables, form fields and figures in order to insert rich semantics into documents that have none. This allows you to capture scans, images of documents or any content and convert it to a PDF that is smart, searchable and easy to share and store. Intelligent Scans: Adobe Scan uses ML more rapidly convert documents to high quality PDFs, detecting boundaries, removing shadows and auto cropping the image.