DN 2017 | Putting the P in A(P)I - Why APIs are key to make AI scale | Carmen Sutter | Adobe
•Download as PPTX, PDF•
1 like•443 views
Carmen Sutter is responsible for building out Adobe's Developer Community programs. In her role, she works with the internal & external developer ecosystem on extending the Adobe Platform. Previously, she was a Product Manager for Adobe Social, focusing on social data and analytics. She retired as a founding board member of the Big Boulder Initiative (bigboulderinitiative.org), the world’s first social data-focused industry association. Prior to joining Adobe, she led the digital analytics teams at Warner Music Group and Scholastic in New York City.
Recommended
Recommended
More Related Content
What's hot
What's hot (20)
Similar to DN 2017 | Putting the P in A(P)I - Why APIs are key to make AI scale | Carmen Sutter | Adobe
Similar to DN 2017 | Putting the P in A(P)I - Why APIs are key to make AI scale | Carmen Sutter | Adobe (20)
More from Dataconomy Media
More from Dataconomy Media (20)
Recently uploaded
Recently uploaded (20)
DN 2017 | Putting the P in A(P)I - Why APIs are key to make AI scale | Carmen Sutter | Adobe
- 1. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Putting the P in A(P)I: Why APIs are key to make AI Scale Carmen Sutter
- 2. The Intelligence of Experiences
- 3. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
- 4. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Computational Creativity Experience Intelligence Content Understanding Perspective correction Algorithmic attributionAnomaly detection Boundary detection Budget optimization Predictive Fatigue Spend recommendation Send time optimization Automated personalization Lookalike modeling Lip synch Morph cut Propensity modeling Image similarity search Automated form conversion Magic layout Smart tagging Personalized recommendations Automatic text summarization Auto-clean & shadow removal Face aware liquify Auto-target Auto-allocate SAFE System Content aware fill Probabilistic device stitching Remix Contribution analysis Visual stock search Segment size estimator Audience clustering
- 5. Bring the Magic of Technology to Experiences
- 6. Discover what is hidden
- 7. Segment Discovery in Target
- 8. Accelerate what is slow
- 9. Face-Aware Liquify in Photoshop
- 10. Decide when it matters
- 11. Auto-Allocate in Adobe Target
- 12. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Serve the Creator, Respect the Consumer
- 13. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Adobe Sensei is delivered in Adobe Products Adobe Sensei Content Data Algorightmic attribution Audience segmentationAuto-tagging Lookalike modeling Automated Personalization Morph cut Face aware liquify Auto Allocate Smart tags Intelligent alertsAuto-target Anomaly detection Contribution analysis Visual stock search Font recognition Propensity modeling
- 14. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Intelligent Creative Services Intelligent DocumentServices Intelligent ExperienceServices Adobe I/O Private, Public or Hybrid Cloud Content Intelligence Semantic Structure Analysis Attribution Morph Cut Document Flow Extraction Personalization Font Recognition Document Similarity Anomaly Detection Face Aware Editing Document Summarization Sentiment Analysis Semantic Segmentation Optical Character Recognition Intelligent Audience Segmentation Content Data Framework for Artificial Intelligence and Machine Learning Adobe Sensei is also delivered as part of the Adobe Cloud Platform Adobe Sensei
- 15. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Adobe I/O Adobe Cloud Platform Private, Public or Hybrid Cloud Adobe Sensei Content Data Developer Ecosystem Develop Consume Execute Console APIs Events Documentation SDKs Runtime
- 16. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Visual Search API is now available on adobe.io
- 17. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Adobe Sensei Services All Adobe Sensei Services will be exposed in the Adobe I/O Console along side other Adobe APIs YTD Adobe Sensei Services available for images*: 1. Image Auto-Crop 2. Color Swatch 3. Image Auto-Tagger 4. Face Detection 5. Image Quality 6. Auto Background * Available to lighthouse customers. For information email sensei-lighthouse@adobe.com
- 18. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Accelerate content velocity with Adobe Sensei Services Leverage Existing Assets Automate Asset Production Personalization at Scale Custom Workflows and Applications Adobe I/O Events & Runtime
- 19. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. Reduce time to market, increase quality, increase productivity Automate Asset Production Upload 500 raw assets to Creative Cloud Files Adobe I/O Runtime Image Quality API Auto-Crop API Auto Tagger API Upload 432 resulting assets to AEM Assets Adobe I/O Runtime trigger/event Adobe Sensei Services trigger/eventtrigger/event Auto Background API Color Swatch API
- 20. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential.
- 21. © 2017 Adobe Systems Incorporated. All Rights Reserved. Adobe Confidential. POWERING EXPERIENCE WITH INTELLIGENCE @AdobeSensei
Editor's Notes
- I'm here to talk about Putting the P in AI and why api's are key to make AI scale I am actually a member of the Developer Relations team so I'm here to talk to you about business strategy and how Adobe's been thinking about AI machine learning we have been doing this for literally decades right we've had a research group at Adobe for about 20 years we were doing machine learning and AI when it was just called research AI when it was just advanced algorithms and now we're really thinking about how do we keep being relevant and where do we need to go so this is a bit about our journey and the things that we've learned a bit about me I'm a Product Manager and I would say that I'm code literate and I spend a lot of my time thinking about what our customers are trying to do and what we need to do from a business perspective to enable that and as we keep going - business and Technology are really closely entwined
- Adobe is in the Experience Business – empowering Creative and Marketers with our products and services and Content and Data as the heart and soul of the experience wave Content and Data volumes are exploding, thankfully for us so is processing power we have new tools at our disposal – new algorithms, machine learning, deep learning I'm sure there'll be something else soon But really it's about customers and brands At Adobe we we have two different customer bases - creatives using our tools and marketers that are also helping deliver that content right so we look at it from content and data and we are very focused on digital experience unlike some of the tools that you've seen where they're building a framework, a general-purpose like AWS or Google Tensorflow we really started top-down we started in terms of applications and using machine learning to empower our users to deliver digital experiences because just like content and data and technology is changing so are our customers their expectations are way out there right they want it to be relevant. they wanted it to be contextualized, they want it to be novel and it's hard to keep up
- Quick look at what we’re building at Adobe Adobe Sensei is Adobe’s AI machine learning platform. We built it for us. Goal was to make it easier to product teams to use and incorporate machine learning to build new features
- so this is where we are today we have over 50 features in production MAX – creativity conference, announced 14 more I think close to 200 that are in development our product teams feel empowered - they are all working simultaneously to bring new things to their customer base so this means that we really need to think about what is Adobe sensei what kinds of things do we want to build and how we do it so we went through this process almost a census of what technology do we have and how do we make sense of it going forward so we came up with a criteria set for what makes something Adobe sensei it has three parts
- to it the first part is about the technology it uses One of my favorite quotes arthur c clarke talking about any sufficiently advanced technology is indistinguishable from magic Magic if you follow adobe branding it's been a term that we've used a lot because we really wanted to delight our customers we want them to have that you know I want that, I want to play with it, maybe I can be creative too and gh it's not just in the creation of it but in the experience of it so that selfie technology that we're working on in terms of how do we bring selfie photography to the next level and kind of make blend that you know everyday user with pro photographer experience that's about the magic of technology. looking at AI and machine learning and then we go through a series of three really really want to think about what does this do for our users and we try to boil it down to three very simple things
- discover what is hidden
- Example from our digital marketing business segment discovery and target right you have a sense of who your customers are but actually when you look at the patterns of how they interact with which products they buy or what kind of things lead to engagement or conversion you may actually have a segment you haven't identified before so somebody's needs when you need to take into account same thing where it's like anomaly detection and analytics so all of the things we've been hearing about in the conference we we see those in our products a
- we think about accelerating with slow
- and and this is really about things like face aware liquify so if you take a picture and you want to change the expression to do it while would take hours and a lot of training because you want to make sure that you don't introduce distortion that it looks natural and so if you want to take you know your CFO whatever from you know kind of a stern serious look to a big smile you know it would take some doing totally worth it so there's lots of features that we have in our portfolio where we think about this in terms of accelerating what slow
- we also think about helping users decide when it matters
- and this really falls into two categories one is well there's just so much data that you couldn't possibly go through it all or you could but it would take many of you and it would be difficult things like allocating budget for marketing campaign or creating a campaign so out of allocate and adobe target is actually we talk about it as one-click personalization because there's literally one button that a marketer clicks and then it looks at users coming to the website the potential experiences that they could have and makes it so that they have the best possible experience right so it's constantly ongoing
- the last one really talks about our corporate values this is serves the creator and respects the consumer it was really important to us that this be baked into the definition of what is Adobe sensei so we are thinking about things like best practices not just in things like data governance and security where we you know have been doing this for a while and it's people's full-time job to make sure that we comply and are proactive about it but things like data ethics so are we either perpetuating or introducing bias based on our data set and you know we don't have a firm answer yet but we know that this is part of what it means to be in the space and where we want to take our company
- Adobe Sensei – until now – is delivered in our products.
- you know you get the sense that there's this cloud of features and you could be using them and not even know but where do we go from here and that's really what the talk is is about so all of these features are powered by services these are internal api's that we've used these are the kinds of services that we have you may have one service one API that powers a feature in multiple products so like image tagging image tagging is used in adobe experience manager which is a web content management solution it's also used in Adobe stock there's no reason why it can't be used anywhere else or why can't be used on its own and that's really the realization that we're coming to that we need to do this we have a framework that we use to train our models and we're trying to standardize on set of tools we know that we can't have just one but we also want to speed it up for teams so that it's easier for them to get to there and goal and to really focus on their domain expertise and all of this is built and tied into content and data and this is important because when we think about our customers particularly on the enterprise side or partners where they're building experiences for major brands a lot of their data already resides with Adobe whether it's click streams or you know all of the Associated images for example for catalog shoot so we want to make it easy for them to leverage their own data and to personalize models to their business
- so we have a cloud platform and we're in the process of opening it up and what opening it up means is enabling people outside of Adobe to use it we call it Adobe i/o if you go to adobe.io Adobe's been around longer than many software companies and we are going through a transformation – from box software to services to platform. we really think that in order for us to stay relevant in order for us to meet the needs of our customers we can't do it on our own right there are new experiences and new integrations that need to be built and they're going to be built by an ecosystem This means thinking about who the end consumer is for those API is starting from the beginning and there's a lot of refactoring technical debt we're also starting to think about things like events we want to make sure that it's that you can create trigger based workflows runtime so we are actually co-developing open whisk with IBM because we believe that serverless is going to be a big thing for our customers and something that we need to enable so as we think about this gradual opening up right we don't want to have this grand reveal a few years from now we want to learn from our mistakes and also to stay in contact with our customers and what they want right I mentioned for example the runtime we have the theory right hypothesis that our customers are going to want to use our API as functions
- one's a visual search API for fonts it's from Typekit and it's our first sensei service that is available
- We're starting off looking at content intelligence which is a broad category for some of our image api's things like auto crop, color swatch, we talked about the image tagger, before the face detection that enables some of those you know I don't want to call it manipulations like the face aware liquify or even just determining you know this is a you know male in this age range you could custom train it you, image quality s
- Automating Asset Production – outsourced Help automate workflows, custom training, personalize at scale Better understand the content you have, understand the context and what customers are trying to do, personalize and even create composite content on the fly Scale -> APIs that are general enough starting with the mundane and thinking about things like automation right of asset production Retailers that have standardized on Adobe. Use Creative Cloud for photo shoots, store, tag manipulate Push it through to many channels running marketing campaigns and so we feel that we can help them start to automate some of this to give them more time to be creative and to do the things that that really make a difference for their company you