Machine learning is at the core of Pinterest. Pinterest personalizes and ranks 1B+ pins, 700+ million boards for 100M+ users all over the world, using data gathered from collaborative filtering, user curation, web crawling, and more. At Pinterest we model relationships between pins, handle cold-start problems and deal with real-time recommendations.
In this presentation Jure gave an overview of the problems and effective solutions developed at Pinterest. He focused on systems and effective engineering choices made to enable productive machine learning development and enable multiple engineers effectively develop, test, and deploy machine-learned models.
The Hive Think Tank - Design Thinking by Bernie Roth, Professor at Stanford U...The Hive
Bernie Roth is a founder of Stanford's d.school and author of The Achievement Habit: how to stop wishing, start doing, and take command of life.
Bernie brings to the d.school a wealth of experience in teaching design, an intimate knowledge of the functioning of Stanford University, and a worldwide reputation as a researcher in kinematics and robotics. Together with Doug Wilde and the late Rolf Faste, Bernie developed the concept of a Creativity Workshop. This has been offered to students, faculty and professionals around the world. These same techniques have been made available to d.school students and are described in his book The Achievement Habit. He has found that these types of learning experiences enhance students’ ability to make meaningful positive difference in their own lives. He is especially pleased that his activities at the d.school have contributed to creating an environment where students and coworkers get the tools and values for realizing the enduring satisfactions that come from assisting others in the human community.
Design Thinking & Re-imagining the role of HRVikram Bhonsle
Let`s take a look at the applications of the "Design Mindset" in tackling modern day people conundrums. How can HR use design thinking to redefine and reshape HR strategies and processes to cater to a demanding and advanced workforce. A look also at select organizations who have carried this successfully and the business benefits.
In case you require instructor notes, do send me an email to bhonslevb@gmail.com
Redesigning the Table: The Case For Organizational DesignAdam Connor
As design talent becomes more sought after and designers achieve higher levels of leadership in organizations, it's becoming more and more apparent that having design talent does not ensure design success. An organization's culture - its shared beliefs and behaviors - have a tremendous effect on how that company utilizes and capitalizes on design talent. If we want our organizations to make the most of not only designers, but the creative talent and innovative ideas of all and any of it's people, then we must make a focused effort to change our organizations culture and the various aspects and facets of an organization in which culture manifests. This is Organizational Design, a practice focused on optimizing the structures of an organization to achieve a desired outcome.
Design Thinking Dallas by Chris BernardChris Bernard
These are the slides I gave for a keynote at a conference hosting by IMC2 for the Design Thinking Dallas Conference. Some of the content here is repetitive across other presentations I give.
Questions? Email me at chris.bernard@microsoft.com
For a Knowledge Management Round Table, Melbourne. An exploration workshop into using design thinking to support workplace change coupled with digital technologies.
Design Thinking for Social Innovation at IEMax Oliva
How might we provide drinkable water to low income rural communities? How might we provide premature baby incubation solutions for the Base of the Pyramid? How might we create a process and culture which enables innovaiton to be at the core of our organization, be it from a social enteprise, a responsible business or a cross collaboration with unlikely allies? We need to re-imagine, re-invent and re-design the way that we do business, the way in which we create and deliver value. Design is too important to be left to designers alone. During this workshop, you will learn the key concepts of Design Thinking with a focus on social innovation, experimenting with collective creativity, and practicing with key tools to apply in future social challenges. Design thinking you can learn at a workshop; it takes a lifetime to master it.
Design Thinking Action Lab
Lecturer: Leticia Britos Cavagnaro: Ph.D., Deputy Director of the National Center for Engineering Pathways to Innovation (Epicenter), Stanford University
The Hive Think Tank - Design Thinking by Bernie Roth, Professor at Stanford U...The Hive
Bernie Roth is a founder of Stanford's d.school and author of The Achievement Habit: how to stop wishing, start doing, and take command of life.
Bernie brings to the d.school a wealth of experience in teaching design, an intimate knowledge of the functioning of Stanford University, and a worldwide reputation as a researcher in kinematics and robotics. Together with Doug Wilde and the late Rolf Faste, Bernie developed the concept of a Creativity Workshop. This has been offered to students, faculty and professionals around the world. These same techniques have been made available to d.school students and are described in his book The Achievement Habit. He has found that these types of learning experiences enhance students’ ability to make meaningful positive difference in their own lives. He is especially pleased that his activities at the d.school have contributed to creating an environment where students and coworkers get the tools and values for realizing the enduring satisfactions that come from assisting others in the human community.
Design Thinking & Re-imagining the role of HRVikram Bhonsle
Let`s take a look at the applications of the "Design Mindset" in tackling modern day people conundrums. How can HR use design thinking to redefine and reshape HR strategies and processes to cater to a demanding and advanced workforce. A look also at select organizations who have carried this successfully and the business benefits.
In case you require instructor notes, do send me an email to bhonslevb@gmail.com
Redesigning the Table: The Case For Organizational DesignAdam Connor
As design talent becomes more sought after and designers achieve higher levels of leadership in organizations, it's becoming more and more apparent that having design talent does not ensure design success. An organization's culture - its shared beliefs and behaviors - have a tremendous effect on how that company utilizes and capitalizes on design talent. If we want our organizations to make the most of not only designers, but the creative talent and innovative ideas of all and any of it's people, then we must make a focused effort to change our organizations culture and the various aspects and facets of an organization in which culture manifests. This is Organizational Design, a practice focused on optimizing the structures of an organization to achieve a desired outcome.
Design Thinking Dallas by Chris BernardChris Bernard
These are the slides I gave for a keynote at a conference hosting by IMC2 for the Design Thinking Dallas Conference. Some of the content here is repetitive across other presentations I give.
Questions? Email me at chris.bernard@microsoft.com
For a Knowledge Management Round Table, Melbourne. An exploration workshop into using design thinking to support workplace change coupled with digital technologies.
Design Thinking for Social Innovation at IEMax Oliva
How might we provide drinkable water to low income rural communities? How might we provide premature baby incubation solutions for the Base of the Pyramid? How might we create a process and culture which enables innovaiton to be at the core of our organization, be it from a social enteprise, a responsible business or a cross collaboration with unlikely allies? We need to re-imagine, re-invent and re-design the way that we do business, the way in which we create and deliver value. Design is too important to be left to designers alone. During this workshop, you will learn the key concepts of Design Thinking with a focus on social innovation, experimenting with collective creativity, and practicing with key tools to apply in future social challenges. Design thinking you can learn at a workshop; it takes a lifetime to master it.
Design Thinking Action Lab
Lecturer: Leticia Britos Cavagnaro: Ph.D., Deputy Director of the National Center for Engineering Pathways to Innovation (Epicenter), Stanford University
Mental Health Care Technologies: Context-Aware Stress Assessment and Stress Coping
Thank You for referencing this work, if you find it useful!
Reference/Citation: Allan Berrocal, Mental Health Care Technologies: Context-Aware Stress Assessment and Stress Coping, CUSO PhD school 2017.
Additional Reference/Citation for a latest scientific paper: Katarzyna Wac, Maddalena Fiordelli, Mattia Gustarini, Homero Rivas, Quality of Life Technologies: Experiences from the Field and Key Research Challenges, IEEE Internet Computing, Special Issue: Personalized Digital Health, July/August 2015.
Design Thinking: Finding Problems Worth Solving In HealthAdam Connor
Ideas for new devices and services can come from anywhere. But great ideas come from aligning solutions with real value and desirability for people. Design thinking provides a set of principles and structure that can act as scaffolding for teams to find and understand challenges and opportunities to focus on fan find solutions for.
Embrace People Experience for good: Design Thinking In House. Straddle qualitative and quantitative thinking is incredibly valuable for the future of an organization. Digital Era beyond Technologizing us is Humanizing us
These are the often requested slides from a SXSW 2013 presentation by MIT Prof. Sanjay Sarma and I about the importance of space design and location for innovation, with very specific recommendations. One example is the often overlooked importance of a coffee system. Investing in a great central coffee system can promote serendipitous human collisions from multiple disciplines and thereby increase innovation.
The first prototype of our approaches to move beyond design thinking at DNA. Touching on a number of new tools and techniques as well as theoretical positions from a number of sources. Very much the bleeding edge of our current position.
A summary of the basic principles of design thinking, human centered innovation and its application to strategy. Created by Natalie Nixon of Figure 8 Thinking.
Why Design Thinking is Important for Innovation? - Favarin Vitillo - ViewConf...Simone Favarin
Design is a way of thinking, of determining people's true, underlying needs, and then delivering products and services that help them. This is the starting about Design. The meaning of the concept.
VR is a new technology that is entering in many industrial and creative processes: nowadays many company and people are experimenting with VR, because it opens new possibilities and it allows costs and time reduction. It is important to understand what is the current status of the technology, the future projections and especially its applications.
Motivated by curiosity and a strong conviction that the tools and methods of design thinking ignite innovative ideas and solutions, a group of Portland-based, like-minded practitioners set out to survey the local landscape. Our goal: to uncover the tactics, challenges, benefits and themes surrounding design thinking in our community.
This is the result.
We found more than a dozen common themes and insights. Some of them speak directly to the benefits of a design thinking approach. Some express deep challenges to making that approach work in the real world. In all cases, we are pleasantly surprised by the conviction, passion, and commitment to overcoming those challenges and sharing the benefits of design thinking. !
This set of method cards introduces briefly the design thinking approach. It explains the design process as well as the prototyping phases of design thinking projects.
There basically 2 ways of getting involved with the University of St.Gallen in order to have a design thinking team working for your organization.
1. Design Thinking @ HSG
2. Embedded Design Thinking
Both ways are explained in the set.
For more information visit http://dthsg.com
Design Thinking: A Quick Course in Creative Problem SolvingSpring Studio
Mary Wharmby, a UX Design Director at our agency, taught at UC Berkeley’s one-day educational event RGB 2015. In this presentation, she walked students through the foundations of design thinking, from understanding your users to iterating solutions. The deck, complete with speaker notes, provides a quick snapshot of the most important principles behind using design to solve problems.
In February I spent one week with 25 students from different disciplines at European institute of Design in Rome, (IED Rome University). Every year the university holds the event called IED Factory where a cross-pollination of skills and backgrounds mingle to boost creativity, diversity and collaboration. Twelve workshops take place and the students are bound to deliver a final project after an intense week of activities. I designed the workshop to introduce the Design Thinking approach and to instill creative confidence. Visual Communication, Fashion Designers, Fashion Stylist, Photography, Animation, Jewellery Design are the different areas where the participants came from.
The following are my findings.
What’s the problem? Create trust and serendipity.
At the outset my approach was to build up the atmosphere of one spine of 25 designers. In the first two sessions I tried to instill the design thinking skill set: observations, empathy, trust and collaboration. Then I set up 5 teams and showed them three challenges in Sustainability, Transport and Health & Food.
A culture of innovation.
As soon as the participants begun to perceive the sense of purpose, the edge of ‘Familiar vs Unfamiliar’ using storytelling, the Design Thinking methodology is a toolkit that implies a culture of risk, trust and failure. It creates scenarios of use, provokes and inspires alternatives.
The projects…? No, it’s the path, it's the discovery.
People are creative. Yes, they are indeed. In few days they went through ‘discover, ideation and prototype’ phases delivering an app and website for ‘Health & Food’, two ‘Educational rubbish bin’ for Sustainability, a thematic bus. Well, they did not find any investors. They adopted the mindset to show themselves things to explore, test and learn. The video below shows an example.
From the idea of design object to think instead designing behaviours.
First I needed to understand why I was going to do the workshop and what was the gap I could support as facilitator. The plan was to create contents, activities and my approach based on a design for knowledge, skills and motivation. So I focused on those scenarios rather than a design for habits, communication and environment.
Designers design their way through the problem
Once the participants start learning by doing, they also trust the process and forge their own way to go through. Eventually the thorny issues such as get people talking in the streets, reframe questions and create a storyboard helped them to see new opportunities. Then they transformed data into actionable ideas. However, as facilitator you are a designer as well. Therefore you also design your way through the problem with them.
Lesson Learnt
By focusing on creating a challenging context you might be able to offset the pressure to provide all the interactions; let the learners interact with each other. In terms of content, it is less than you think it is.
Presentation for the Barcamp Penang 2013 unconference on Design thinking and its application in creating great consumer experiences for an online business
Design-Thinking for Applications Development and Knowledge Management
Legal Tech Meets Human-Centered Design
Lee-Sean Huang and V. Mary Abraham
August 2016
Design Thinking in Solving Problem - HCMC Scrum Breakfast - July 27, 2019Scrum Breakfast Vietnam
Did you know that Design Thinking is one of the most advantageous processes in dealing with difficulties?
Particularly true for developers, who always lean on teamwork to solve problems, Design Thinking becomes more important as it helps boost team’s performance to the next level after all.
Join this Scrum Breakfast event now if you are finding a practical and effective problem–solving way!!
– Topic: Design thinking in solving problems
The basic concept of Design Thinking
How the entire Design Thinking process works
How Design Thinking helps in understanding problems from customer’s perspective
How Design Thinking helps in defining and brainstorming solutions
– Speaker: Mr. Nhung Ngo – Scrum Master at Axon Active Vietnam
– Time: 09:00 AM – 11:00 AM | Saturday, 27th July 2019
– Location: Trung Nguyen coffee, 264A Nam Ky Khoi Nghia Str., District 3, HCMC
Come and enjoy this Scrum breakfast event with us now! There are free light breakfast and drinks for everyone.
FIND MORE INFORMATION HERE http://bit.ly/2FTc6XA
UXSG2014 Workshop (Day 1) - Leading UX (Trend Micro)ux singapore
Leading UX - are you kidding me?
Facilitated by
Hsin Olive Eu
Director, HIE
Trend Micro, Taiwan
and
Mike Chou
Staff UX Designer, HIE
Trend Micro, Taiwan
The Hive Think Tank: Machine Learning Applications in Genomics by Prof. Jian ...The Hive
In this The Hive Think Tank talk, Professor Jian Ma introduces machine learning methods that can be used to help tackle some of the most intriguing questions in genomics and biomedicine. He discusses the research projects in his group to study genome structure and function, including algorithms to unravel complex genomic aberrations in cancer genomes and gene regulatory principles encoded in our genome, by utilizing
probabilistic graphical models and deep neural network techniques. The knowledge obtained from such computational methods can greatly enhance our ability to understand disease genomes.
In this The Hive Think Tank talk, Heron team provides an introduction to Heron, how it is being used at Twitter and shares an operating experiences and challenges of running Heron at scale. They recently announced the open sourcing of Heron under the permissive Apache v2.0 license. Heron has been in production nearly 2 years and is widely used by several teams for diverse use cases. Prior to Heron, Twitter used Apache Storm, which we open sourced in 2011. Heron features a wide array of architectural improvements and is backward compatible with the Storm ecosystem for seamless adoption.
Mental Health Care Technologies: Context-Aware Stress Assessment and Stress Coping
Thank You for referencing this work, if you find it useful!
Reference/Citation: Allan Berrocal, Mental Health Care Technologies: Context-Aware Stress Assessment and Stress Coping, CUSO PhD school 2017.
Additional Reference/Citation for a latest scientific paper: Katarzyna Wac, Maddalena Fiordelli, Mattia Gustarini, Homero Rivas, Quality of Life Technologies: Experiences from the Field and Key Research Challenges, IEEE Internet Computing, Special Issue: Personalized Digital Health, July/August 2015.
Design Thinking: Finding Problems Worth Solving In HealthAdam Connor
Ideas for new devices and services can come from anywhere. But great ideas come from aligning solutions with real value and desirability for people. Design thinking provides a set of principles and structure that can act as scaffolding for teams to find and understand challenges and opportunities to focus on fan find solutions for.
Embrace People Experience for good: Design Thinking In House. Straddle qualitative and quantitative thinking is incredibly valuable for the future of an organization. Digital Era beyond Technologizing us is Humanizing us
These are the often requested slides from a SXSW 2013 presentation by MIT Prof. Sanjay Sarma and I about the importance of space design and location for innovation, with very specific recommendations. One example is the often overlooked importance of a coffee system. Investing in a great central coffee system can promote serendipitous human collisions from multiple disciplines and thereby increase innovation.
The first prototype of our approaches to move beyond design thinking at DNA. Touching on a number of new tools and techniques as well as theoretical positions from a number of sources. Very much the bleeding edge of our current position.
A summary of the basic principles of design thinking, human centered innovation and its application to strategy. Created by Natalie Nixon of Figure 8 Thinking.
Why Design Thinking is Important for Innovation? - Favarin Vitillo - ViewConf...Simone Favarin
Design is a way of thinking, of determining people's true, underlying needs, and then delivering products and services that help them. This is the starting about Design. The meaning of the concept.
VR is a new technology that is entering in many industrial and creative processes: nowadays many company and people are experimenting with VR, because it opens new possibilities and it allows costs and time reduction. It is important to understand what is the current status of the technology, the future projections and especially its applications.
Motivated by curiosity and a strong conviction that the tools and methods of design thinking ignite innovative ideas and solutions, a group of Portland-based, like-minded practitioners set out to survey the local landscape. Our goal: to uncover the tactics, challenges, benefits and themes surrounding design thinking in our community.
This is the result.
We found more than a dozen common themes and insights. Some of them speak directly to the benefits of a design thinking approach. Some express deep challenges to making that approach work in the real world. In all cases, we are pleasantly surprised by the conviction, passion, and commitment to overcoming those challenges and sharing the benefits of design thinking. !
This set of method cards introduces briefly the design thinking approach. It explains the design process as well as the prototyping phases of design thinking projects.
There basically 2 ways of getting involved with the University of St.Gallen in order to have a design thinking team working for your organization.
1. Design Thinking @ HSG
2. Embedded Design Thinking
Both ways are explained in the set.
For more information visit http://dthsg.com
Design Thinking: A Quick Course in Creative Problem SolvingSpring Studio
Mary Wharmby, a UX Design Director at our agency, taught at UC Berkeley’s one-day educational event RGB 2015. In this presentation, she walked students through the foundations of design thinking, from understanding your users to iterating solutions. The deck, complete with speaker notes, provides a quick snapshot of the most important principles behind using design to solve problems.
In February I spent one week with 25 students from different disciplines at European institute of Design in Rome, (IED Rome University). Every year the university holds the event called IED Factory where a cross-pollination of skills and backgrounds mingle to boost creativity, diversity and collaboration. Twelve workshops take place and the students are bound to deliver a final project after an intense week of activities. I designed the workshop to introduce the Design Thinking approach and to instill creative confidence. Visual Communication, Fashion Designers, Fashion Stylist, Photography, Animation, Jewellery Design are the different areas where the participants came from.
The following are my findings.
What’s the problem? Create trust and serendipity.
At the outset my approach was to build up the atmosphere of one spine of 25 designers. In the first two sessions I tried to instill the design thinking skill set: observations, empathy, trust and collaboration. Then I set up 5 teams and showed them three challenges in Sustainability, Transport and Health & Food.
A culture of innovation.
As soon as the participants begun to perceive the sense of purpose, the edge of ‘Familiar vs Unfamiliar’ using storytelling, the Design Thinking methodology is a toolkit that implies a culture of risk, trust and failure. It creates scenarios of use, provokes and inspires alternatives.
The projects…? No, it’s the path, it's the discovery.
People are creative. Yes, they are indeed. In few days they went through ‘discover, ideation and prototype’ phases delivering an app and website for ‘Health & Food’, two ‘Educational rubbish bin’ for Sustainability, a thematic bus. Well, they did not find any investors. They adopted the mindset to show themselves things to explore, test and learn. The video below shows an example.
From the idea of design object to think instead designing behaviours.
First I needed to understand why I was going to do the workshop and what was the gap I could support as facilitator. The plan was to create contents, activities and my approach based on a design for knowledge, skills and motivation. So I focused on those scenarios rather than a design for habits, communication and environment.
Designers design their way through the problem
Once the participants start learning by doing, they also trust the process and forge their own way to go through. Eventually the thorny issues such as get people talking in the streets, reframe questions and create a storyboard helped them to see new opportunities. Then they transformed data into actionable ideas. However, as facilitator you are a designer as well. Therefore you also design your way through the problem with them.
Lesson Learnt
By focusing on creating a challenging context you might be able to offset the pressure to provide all the interactions; let the learners interact with each other. In terms of content, it is less than you think it is.
Presentation for the Barcamp Penang 2013 unconference on Design thinking and its application in creating great consumer experiences for an online business
Design-Thinking for Applications Development and Knowledge Management
Legal Tech Meets Human-Centered Design
Lee-Sean Huang and V. Mary Abraham
August 2016
Design Thinking in Solving Problem - HCMC Scrum Breakfast - July 27, 2019Scrum Breakfast Vietnam
Did you know that Design Thinking is one of the most advantageous processes in dealing with difficulties?
Particularly true for developers, who always lean on teamwork to solve problems, Design Thinking becomes more important as it helps boost team’s performance to the next level after all.
Join this Scrum Breakfast event now if you are finding a practical and effective problem–solving way!!
– Topic: Design thinking in solving problems
The basic concept of Design Thinking
How the entire Design Thinking process works
How Design Thinking helps in understanding problems from customer’s perspective
How Design Thinking helps in defining and brainstorming solutions
– Speaker: Mr. Nhung Ngo – Scrum Master at Axon Active Vietnam
– Time: 09:00 AM – 11:00 AM | Saturday, 27th July 2019
– Location: Trung Nguyen coffee, 264A Nam Ky Khoi Nghia Str., District 3, HCMC
Come and enjoy this Scrum breakfast event with us now! There are free light breakfast and drinks for everyone.
FIND MORE INFORMATION HERE http://bit.ly/2FTc6XA
UXSG2014 Workshop (Day 1) - Leading UX (Trend Micro)ux singapore
Leading UX - are you kidding me?
Facilitated by
Hsin Olive Eu
Director, HIE
Trend Micro, Taiwan
and
Mike Chou
Staff UX Designer, HIE
Trend Micro, Taiwan
The Hive Think Tank: Machine Learning Applications in Genomics by Prof. Jian ...The Hive
In this The Hive Think Tank talk, Professor Jian Ma introduces machine learning methods that can be used to help tackle some of the most intriguing questions in genomics and biomedicine. He discusses the research projects in his group to study genome structure and function, including algorithms to unravel complex genomic aberrations in cancer genomes and gene regulatory principles encoded in our genome, by utilizing
probabilistic graphical models and deep neural network techniques. The knowledge obtained from such computational methods can greatly enhance our ability to understand disease genomes.
In this The Hive Think Tank talk, Heron team provides an introduction to Heron, how it is being used at Twitter and shares an operating experiences and challenges of running Heron at scale. They recently announced the open sourcing of Heron under the permissive Apache v2.0 license. Heron has been in production nearly 2 years and is widely used by several teams for diverse use cases. Prior to Heron, Twitter used Apache Storm, which we open sourced in 2011. Heron features a wide array of architectural improvements and is backward compatible with the Storm ecosystem for seamless adoption.
The Hive Think Tank - The Microsoft Big Data Stack by Raghu Ramakrishnan, CTO...The Hive
Until recently, data was gathered for well-defined objectives such as auditing, forensics, reporting and line-of-business operations; now, exploratory and predictive analysis is becoming ubiquitous, and the default increasingly is to capture and store any and all data, in anticipation of potential future strategic value. These differences in data heterogeneity, scale and usage are leading to a new generation of data management and analytic systems, where the emphasis is on supporting a wide range of very large datasets that are stored uniformly and analyzed seamlessly using whatever techniques are most appropriate, including traditional tools like SQL and BI and newer tools, e.g., for machine learning and stream analytics. These new systems are necessarily based on scale-out architectures for both storage and computation.
Hadoop has become a key building block in the new generation of scale-out systems. On the storage side, HDFS has provided a cost-effective and scalable substrate for storing large heterogeneous datasets. However, as key customer and systems touch points are instrumented to log data, and Internet of Things applications become common, data in the enterprise is growing at a staggering pace, and the need to leverage different storage tiers (ranging from tape to main memory) is posing new challenges, leading to caching technologies, such as Spark. On the analytics side, the emergence of resource managers such as YARN has opened the door for analytics tools to bypass the Map-Reduce layer and directly exploit shared system resources while computing close to data copies. This trend is especially significant for iterative computations such as graph analytics and machine learning, for which Map-Reduce is widely recognized to be a poor fit.
While Hadoop is widely recognized and used externally, Microsoft has long been at the forefront of Big Data analytics, with Cosmos and Scope supporting all internal customers. These internal services are a key part of our strategy going forward, and are enabling new state of the art external-facing services such as Azure Data Lake and more. I will examine these trends, and ground the talk by discussing the Microsoft Big Data stack.
The Hive Think Tank: Translating IoT into Innovation at Every Level by Prith ...The Hive
In this presentation Prith Banerjee discusses how a sustainable future must become radically more efficient with the way we use energy. He shared how the Internet of Things (IoT) and the convergence of Operational Technology (OT) and Information Technology (IT) are enabling Schneider Electric's innovation at every level, redefining power and automation for a new world of energy which is more electric, decarbonized, decentralized and digitized. Prith shared how, in this new world of energy, Schneider ensures that Life Is On everywhere, for everyone and at every moment. He also shared a set of IoT predictions for the future, based on findings of the company’s recent IoT Survey of 2,500 top business executives.
The Hive Think Tank: The Future Of Customer Support - AI Driven AutomationThe Hive
The Hive Think Tank Panel Discussion moderated by Kate Leggett (Forrester) with panelists: Allan Leinwand (ServiceNow), Nitin Narkhede (Wipro), Jason Smale (Zendesk), Dan Turchin (Neva). The future of customer support is AI-driven virtual agents. Soon, we’ll interact conversationally with bots that know who we are, how we’re impacted, and what we need. Soon, the capabilities of virtual agents will far exceed those of today’s best human agents. We’ll receive support that is more reliable than friends, more accurate than social media, and less frustrating than waiting on hold.
The Hive Think Tank: AI in The Enterprise by Venkat SrinivasanThe Hive
This The Hive Think Tank talk by Venkat Srinivasan, CEO of RAGE Frameworks, focuses on successful applications of AI in the Enterprise. We start with a broad and more inclusive definition of AI in the context of enterprise business processes.
We introduce a taxonomy of AI solution methods that broaden the focus beyond a narrow focus on deep learning based on neural nets. In line with the taxonomy, we present several successful AI applications in use today at major corporations across industries including financial services, manufacturing/retail, professional services, logistics. These applications range from commercial lending, contract review, customer service intelligence, market and competitive intelligence, signals for capital markets, regulatory compliance and others.
The Hive Think Tank: Unpacking AI for Healthcare The Hive
In this The Hive Think Tank talk, Ash Damle, CEO of Lumiata takes a deep dive into Lumiata’s core technological engine - the Lumiata Medical Graph, which applies graph-based machine learning to compute the complex relationships between health data in the same way that a physician would, and how this medical AI engine powers personalization and automation within risk and care management.
Presentation for the San Francisco Chapter of SLA, January 19, 2012. The presentation covers Google +: what it is and how you'd use it to find and share information.
Yes, Google+ is Google's answer to Facebook, but not in the directly competitive sense many journalists assume. Google+ is core to Google's mission "to organize the world's information", and that's a better frame for thinking about this service.
Here are 35 slides to help kickstart a different perspective on what Google+ really is - a "shared interest graph."
Whether your brand is just getting started on Google+ or you’ve been active since the beginning, the new Google+ Playbook is designed to help you get the most from your presence on Google+. The step-by-step guides offer a concise overview of the features and functions of Google+ — from connecting your YouTube channel and posting regular content to helpful tips and best practices for Hangouts, Communities, and more.
- Community Management
- Content Marketing
- Trends & Tools
- Case Studies
Our hashtag #ShababShare
What is شباب شير - Shabab Share ?
Shababshare working on youth networking community in its different forms through the use of several tools from the Internet through the World Wide Web and other tools group
Who is the trainer :
Mohammad Tahhan,
Founder Of Shabab Share | Social Entrepreneur | Social Media & Media Expert | Communication Specialist | Youth Development.
He has 10 years experience working with international & local organizations,mainly in Education, Media, Online Media, and Capacity building.
In addition to that 5 years experience working in Media and Social Media.
Also 6 years experience working as freelance trainer with several NGOs and private sector.
Twitter : https://twitter.com/tahanco - @Tahanco
LinkedIn: https://jo.linkedin.com/in/tahanco
www.facebook.com/MTahanco
For who's interested and want workshops contact us:
www.facebook.com/ShababShare
www.twitter.com/shababshare
Everything You Need To Know About Google PlusSocialMotus
Discover everything important you need to know about getting started with Google Plus, as well as advanced tips and tricks to make you look like a pro. We've created this simple presentation to help you unlock the potential of Google + for your business.
More specifically, you’ll discover:
• Everything you need to know about creating and managing a Google + account
• How to use Google + to market your business and effectively engage with customers
• How to optimize your Google + account for the search engines
• Advanced tips & tricks to make sure your profile stands out and maximize the SEO rewards from using Google +.
Now if you want to Manage, Publish, Monitor, Engage and Measure all your social media channels from one platform..
Visit http://www.SocialMotus.com today to start maximizing your social media efforts
Startup Series: Lean Analytics, Innovation, and Tilting at WindmillsThe Hive
Fifty years ago, a typical company on the S&P 500 stayed there for three-quarters of a century. Today, they last only fifteen years. Technological disruption has run roughshod through the boardrooms of the world.
At the same time, small startups with nothing to lose have become more methodical about iteration, experimentation, and innovation. Fueled by deep investment backing and unfettered by legacy distractions like regulation, customers, and infrastructure, they're turning into Billion-dollar ventures.
From lackluster jobs growth to tech speculation to the disruption of nearly every industry, the death of big companies is the elephant in the room. But can we teach the elephant to dance? Join author, entrepreneur, and Strata conference chair Alistair Croll for a look at how some large organizations are applying data-driven methods, a deliberate portfolio of innovation, and Lean approaches that help them survive—and even thrive—in a changing competitive landscape.
2 hours training on Mobile UX with Farah Nuraini, Interaction Designer at Traveloka, Indonesia
45 min theory: Research, Analysis, Design solutions and Testing
+ 1h15 min of hands-on exercises with the 5 facilitators from Traveloka.
Think tank - Data Culture for a Better BusinessDan Cave
Growth Hacker and Data Punk Daniel Cave talks about how how to put Data at the heart of your business.
What you should track, what you should share and who you should share it with to drive the best business decisions possible.
Modern Perspectives on Recommender Systems and their Applications in MendeleyKris Jack
Presentation given for one of Pearson's Data Research teams. It motivates the use of recommender systems, describes common approaches to building and evaluating them and gives examples of how they are used in Mendeley. Thanks to Maya Hristakeva for creating some of the slides.
Introduction to Digital Life (March 2017)KR_Barker
Many people are surprised to learn that, even though they don’t participate on social media and only use their computers for work, they have a digital life. This is partly because publicly-available information about you is collected from the internet, and this information is used by companies to create records about you. Join Kimberley Barker for an overview of topics such as digital privacy, online reputation management, personal branding, and online identity.
An introduction to the heart, mind, and soul of Product Management: Customer Obsession, Metrics, and Product Sense. Presented at Product School Bellevue.
Web analytics and social media metrics provide you with powerful ways to track how people interact with your content and what they’re saying about your foundation. They help you understand what works (and what doesn’t!) with your constituents and donors.
How can you transform your visitors into happy customers ?
1- Users must care
--> Be unique
--> Define your excitement features
--> Understand your users
2- Users must test
--> Increase trust
--> Reduce fears
--> Trigger an action
3- Users must use
--> Define the final goal
--> Determine the Aha moment
--> Define the mandatory steps
--> Guide users to avoid empty spaces
4- Users must pay
--> Transform free users into premium users
--> Define your prices
--> Display your prices correctly
--> Make payment easier
This is a quick overview of my design process which I can hardly call my own, because most of it is based on the work done by various experts in the field. I have compiled this to make it easier for anyone to get a quick overview of an end to end research to development lifecycle.
Introduction to Digital Life (October 2016)KR_Barker
Many people are surprised to learn that, even though they don’t participate on social media and only use their computers for work, they have a digital life. This is partly because publicly-available information about you is collected from the internet, and this information is used by companies to create records about you. Join Kimberley Barker for an overview of topics such as digital privacy, online reputation management, personal branding, and online identity.
An Introduction to the World of User ResearchMethods
What is user? Why do we do it? How do we do it? User Research Consultants, Dr Jennifer Klatt and Ben Smith from Methods Digital (https://methodsdigital.co.uk/) have kindly put together this slide deck to take you through the basics.
Similar to The Hive Think Tank: Machine Learning at Pinterest by Jure Leskovec (20)
Quantum Computing (IBM Q) - Hive Think Tank Event w/ Dr. Bob Sutor - 02.22.18The Hive
Dr. Bob Sutor is Vice President for AI, Blockchain, and Quantum Solutions at IBM Research. In this role he is the R&D executive leading a large global group of scientists, software engineers, and designers who create and integrate leading edge science and technologies to give IBM's clients the most advanced solutions available. Our work is often mathematically-based and thus includes AI technologies like machine learning, deep learning, text and image analytics, statistics, predictive analytics, and optimization. Sutor co-leads the IBM Research effort to support IBM's commercial blockchain efforts with advanced innovations across a broad range of its embedded technologies. He leads the group developing the next generation software stack and algorithms for quantum computers.
Dr. Sutor has an undergraduate degree from Harvard College and a Ph.D. from Princeton University, both in Mathematics.
The Hive Think Tank: Rendezvous Architecture Makes Machine Learning Logistics...The Hive
Think Tank Event 10/23/2017, hosted by The Hive and presented by Ted Dunning, Chief Application Architect of MapR Technologies and Ellen Friedman of MapR Technologies.
The Hive Think Tank: Talk by Mohandas Pai - India at 2030, How Tech Entrepren...The Hive
Over the next 15 years, India's growth will be fueled by its startups. Today, there are over 20,000 startups in India that have created a value of $80 billion and employ 325,000 people. Over the next ten years, by 2025, there will be 100,000 startups in the country that would have created over $500 billion of value and employ 3.2 million people.
This talk is about India's growth over the next 15 years and the prominent role that entrepreneurs and startups will play in its rapid evolution.
The Hive Think Tank: The Content Trap - Strategist's Guide to Digital ChangeThe Hive
In this The Hive Think Tank talk Harvard Business School Professor of Strategy Prof. Bharat Anand shares his insights on the Digital innovation trends that are shaping the way organizations will act in the future.
In this talk, Professor Anand presents the findings from his forthcoming book. To answer these questions, Anand examines a range of businesses around the world, from Chinese internet giant Tencent to Scandinavian digital trailblazer Schibsted, from The New York Times to The Economist, and from talent management to the future of education.
The Hive Think Tank: Sidechains by Adam Back, President of BlockstreamThe Hive
Over the last couple of years, blockchains have captured a significant mindshare of innovation in financial services, industrial Internet and digital commerce industries. The scope of applications of blockchain as a platform has long surpassed that of its origins in Bitcoin as a cryptocurrency technology. However, none of the new blockchain platforms has been able to reach Bitcoin's levels of scale, security and global reach. There have also been no standards to interoperate between different blockchain platforms for exchange of assets. In order to address these challenges, Sidechains were created as cryptographic systems that securely orchestrate exchange of information between different blockchains by leveraging the scale & maturity of the Bitcoin network. Sidechains are weaving a network of diverse blockchains to bring interoperability and Bitcoin’s scale & maturity. In this talk, Adam Back will talk about its role in building the decentralized world of blockchains.
The Hive Think Tank: Ceph + RocksDB by Sage Weil, Red Hat.The Hive
Rocking the Database World with RocksDB
Sage Weil, Ceph Principal Architect, Red Hat
Sage helped design Ceph as part of his graduate research at the University of California, Santa Cruz. Since then, he has continued to refine the system with the goal of providing a stable next generation distributed storage system for Linux.
Specialties: Distributed system design, storage and file systems, management, software development.
The Hive Think Tank: Rocking the Database World with RocksDBThe Hive
Dhruba Borthakur, Facebook
Dhruba Borthakur is an engineer at Facebook. He has been one of the founding engineer of RocksDB, an open-source key-value store optimized for storing data in flash and main-memory storage. He has been one of the founding architects of the Apache Hadoop Distributed File System and has been instrumental in scaling Facebook's Hadoop cluster to multiples of petabytes. Dhruba has contributed code to the Apache HBase project. Earlier, he contributed to the development of the Andrew File System (AFS). He has an M.S. in Computer Science from the University of Wisconsin, Madison and a B.S. in Computer Science BITS, Pilani, India.
The Hive Think Tank: Rocking the Database World with RocksDBThe Hive
Igor Canadi, Facebook
Igor is a software engineer at Facebook where his job is making databases more awesome. He recently graduated from University of Wisconsin-Madison with Masters degree in Computer Science. During his time at UW-M, he worked with prof. Paul Barford in the area of internet measurement and analysis. Igor got his undergraduate degree from University of Zagreb in Croatia. During his undergraduate years, he founded and developed a local non-profit organization that focuses on educating talented high-school students.
The Hive Think Tank: Stream Processing Systems by Nikita Shamgunov of MemSQLThe Hive
Nikita Shamgunov's presentation was part of a panel discussion on Stream Processing Systems on January 20th, 2016 led by Ben Lorica (O'Reilly Media) with panelists: Jay Kreps (Confluent), Karthik Ramasamy (Twitter), M.C. Srivas (MapR), Ram Sriharsha (Hortonworks).
The Hive Think Tank: "Stream Processing Systems" by Karthik Ramasamy of TwitterThe Hive
Karthik Ramasamy's presentation was part of a panel discussion on Stream Processing Systems on January 20th, 2016 led by Ben Lorica (O'Reilly Media) with panelists: Jay Kreps (Confluent), M.C. Srivas (MapR), Nikita Shamgunov (MemSQL), Ram Sriharsha (Hortonworks)
The Hive Think Tank: "Stream Processing Systems" by M.C. Srivas of MapRThe Hive
M.C. Shivas's presentation was part of a panel discussion on Stream Processing Systems on January 20th, 2016 led by Ben Lorica (O'Reilly Media) with panelists: Jay Kreps (Confluent), Karthik Ramasamy (Twitter), Nikita Shamgunov (MemSQL), Ram Sriharsha (Hortonworks)
Dev Dives: Train smarter, not harder – active learning and UiPath LLMs for do...UiPathCommunity
💥 Speed, accuracy, and scaling – discover the superpowers of GenAI in action with UiPath Document Understanding and Communications Mining™:
See how to accelerate model training and optimize model performance with active learning
Learn about the latest enhancements to out-of-the-box document processing – with little to no training required
Get an exclusive demo of the new family of UiPath LLMs – GenAI models specialized for processing different types of documents and messages
This is a hands-on session specifically designed for automation developers and AI enthusiasts seeking to enhance their knowledge in leveraging the latest intelligent document processing capabilities offered by UiPath.
Speakers:
👨🏫 Andras Palfi, Senior Product Manager, UiPath
👩🏫 Lenka Dulovicova, Product Program Manager, UiPath
Kubernetes & AI - Beauty and the Beast !?! @KCD Istanbul 2024Tobias Schneck
As AI technology is pushing into IT I was wondering myself, as an “infrastructure container kubernetes guy”, how get this fancy AI technology get managed from an infrastructure operational view? Is it possible to apply our lovely cloud native principals as well? What benefit’s both technologies could bring to each other?
Let me take this questions and provide you a short journey through existing deployment models and use cases for AI software. On practical examples, we discuss what cloud/on-premise strategy we may need for applying it to our own infrastructure to get it to work from an enterprise perspective. I want to give an overview about infrastructure requirements and technologies, what could be beneficial or limiting your AI use cases in an enterprise environment. An interactive Demo will give you some insides, what approaches I got already working for real.
UiPath Test Automation using UiPath Test Suite series, part 4DianaGray10
Welcome to UiPath Test Automation using UiPath Test Suite series part 4. In this session, we will cover Test Manager overview along with SAP heatmap.
The UiPath Test Manager overview with SAP heatmap webinar offers a concise yet comprehensive exploration of the role of a Test Manager within SAP environments, coupled with the utilization of heatmaps for effective testing strategies.
Participants will gain insights into the responsibilities, challenges, and best practices associated with test management in SAP projects. Additionally, the webinar delves into the significance of heatmaps as a visual aid for identifying testing priorities, areas of risk, and resource allocation within SAP landscapes. Through this session, attendees can expect to enhance their understanding of test management principles while learning practical approaches to optimize testing processes in SAP environments using heatmap visualization techniques
What will you get from this session?
1. Insights into SAP testing best practices
2. Heatmap utilization for testing
3. Optimization of testing processes
4. Demo
Topics covered:
Execution from the test manager
Orchestrator execution result
Defect reporting
SAP heatmap example with demo
Speaker:
Deepak Rai, Automation Practice Lead, Boundaryless Group and UiPath MVP
Search and Society: Reimagining Information Access for Radical FuturesBhaskar Mitra
The field of Information retrieval (IR) is currently undergoing a transformative shift, at least partly due to the emerging applications of generative AI to information access. In this talk, we will deliberate on the sociotechnical implications of generative AI for information access. We will argue that there is both a critical necessity and an exciting opportunity for the IR community to re-center our research agendas on societal needs while dismantling the artificial separation between the work on fairness, accountability, transparency, and ethics in IR and the rest of IR research. Instead of adopting a reactionary strategy of trying to mitigate potential social harms from emerging technologies, the community should aim to proactively set the research agenda for the kinds of systems we should build inspired by diverse explicitly stated sociotechnical imaginaries. The sociotechnical imaginaries that underpin the design and development of information access technologies needs to be explicitly articulated, and we need to develop theories of change in context of these diverse perspectives. Our guiding future imaginaries must be informed by other academic fields, such as democratic theory and critical theory, and should be co-developed with social science scholars, legal scholars, civil rights and social justice activists, and artists, among others.
The Art of the Pitch: WordPress Relationships and SalesLaura Byrne
Clients don’t know what they don’t know. What web solutions are right for them? How does WordPress come into the picture? How do you make sure you understand scope and timeline? What do you do if sometime changes?
All these questions and more will be explored as we talk about matching clients’ needs with what your agency offers without pulling teeth or pulling your hair out. Practical tips, and strategies for successful relationship building that leads to closing the deal.
Epistemic Interaction - tuning interfaces to provide information for AI supportAlan Dix
Paper presented at SYNERGY workshop at AVI 2024, Genoa, Italy. 3rd June 2024
https://alandix.com/academic/papers/synergy2024-epistemic/
As machine learning integrates deeper into human-computer interactions, the concept of epistemic interaction emerges, aiming to refine these interactions to enhance system adaptability. This approach encourages minor, intentional adjustments in user behaviour to enrich the data available for system learning. This paper introduces epistemic interaction within the context of human-system communication, illustrating how deliberate interaction design can improve system understanding and adaptation. Through concrete examples, we demonstrate the potential of epistemic interaction to significantly advance human-computer interaction by leveraging intuitive human communication strategies to inform system design and functionality, offering a novel pathway for enriching user-system engagements.
DevOps and Testing slides at DASA ConnectKari Kakkonen
My and Rik Marselis slides at 30.5.2024 DASA Connect conference. We discuss about what is testing, then what is agile testing and finally what is Testing in DevOps. Finally we had lovely workshop with the participants trying to find out different ways to think about quality and testing in different parts of the DevOps infinity loop.
Slack (or Teams) Automation for Bonterra Impact Management (fka Social Soluti...Jeffrey Haguewood
Sidekick Solutions uses Bonterra Impact Management (fka Social Solutions Apricot) and automation solutions to integrate data for business workflows.
We believe integration and automation are essential to user experience and the promise of efficient work through technology. Automation is the critical ingredient to realizing that full vision. We develop integration products and services for Bonterra Case Management software to support the deployment of automations for a variety of use cases.
This video focuses on the notifications, alerts, and approval requests using Slack for Bonterra Impact Management. The solutions covered in this webinar can also be deployed for Microsoft Teams.
Interested in deploying notification automations for Bonterra Impact Management? Contact us at sales@sidekicksolutionsllc.com to discuss next steps.
Accelerate your Kubernetes clusters with Varnish CachingThijs Feryn
A presentation about the usage and availability of Varnish on Kubernetes. This talk explores the capabilities of Varnish caching and shows how to use the Varnish Helm chart to deploy it to Kubernetes.
This presentation was delivered at K8SUG Singapore. See https://feryn.eu/presentations/accelerate-your-kubernetes-clusters-with-varnish-caching-k8sug-singapore-28-2024 for more details.
Essentials of Automations: Optimizing FME Workflows with ParametersSafe Software
Are you looking to streamline your workflows and boost your projects’ efficiency? Do you find yourself searching for ways to add flexibility and control over your FME workflows? If so, you’re in the right place.
Join us for an insightful dive into the world of FME parameters, a critical element in optimizing workflow efficiency. This webinar marks the beginning of our three-part “Essentials of Automation” series. This first webinar is designed to equip you with the knowledge and skills to utilize parameters effectively: enhancing the flexibility, maintainability, and user control of your FME projects.
Here’s what you’ll gain:
- Essentials of FME Parameters: Understand the pivotal role of parameters, including Reader/Writer, Transformer, User, and FME Flow categories. Discover how they are the key to unlocking automation and optimization within your workflows.
- Practical Applications in FME Form: Delve into key user parameter types including choice, connections, and file URLs. Allow users to control how a workflow runs, making your workflows more reusable. Learn to import values and deliver the best user experience for your workflows while enhancing accuracy.
- Optimization Strategies in FME Flow: Explore the creation and strategic deployment of parameters in FME Flow, including the use of deployment and geometry parameters, to maximize workflow efficiency.
- Pro Tips for Success: Gain insights on parameterizing connections and leveraging new features like Conditional Visibility for clarity and simplicity.
We’ll wrap up with a glimpse into future webinars, followed by a Q&A session to address your specific questions surrounding this topic.
Don’t miss this opportunity to elevate your FME expertise and drive your projects to new heights of efficiency.
Connector Corner: Automate dynamic content and events by pushing a buttonDianaGray10
Here is something new! In our next Connector Corner webinar, we will demonstrate how you can use a single workflow to:
Create a campaign using Mailchimp with merge tags/fields
Send an interactive Slack channel message (using buttons)
Have the message received by managers and peers along with a test email for review
But there’s more:
In a second workflow supporting the same use case, you’ll see:
Your campaign sent to target colleagues for approval
If the “Approve” button is clicked, a Jira/Zendesk ticket is created for the marketing design team
But—if the “Reject” button is pushed, colleagues will be alerted via Slack message
Join us to learn more about this new, human-in-the-loop capability, brought to you by Integration Service connectors.
And...
Speakers:
Akshay Agnihotri, Product Manager
Charlie Greenberg, Host
Builder.ai Founder Sachin Dev Duggal's Strategic Approach to Create an Innova...Ramesh Iyer
In today's fast-changing business world, Companies that adapt and embrace new ideas often need help to keep up with the competition. However, fostering a culture of innovation takes much work. It takes vision, leadership and willingness to take risks in the right proportion. Sachin Dev Duggal, co-founder of Builder.ai, has perfected the art of this balance, creating a company culture where creativity and growth are nurtured at each stage.
2. Confidential
Pinterest is a visual bookmarking tool
and discovery engine
Users pin images and sites they like onto
boards
Every pin on Pinterest is added by a
human and lives on a board
Users heavily curate their content
What is Pinterest?
3. Confidential
• Image
• URL: http://www.culinaria.com…
• User-generated details
• User-curated pin-board graph
• User-curated annotations
• On-site performance (click actions,
impressions, …)
• Web crawl data
What is a Pin?
8. Confidential
Many parts driven by ML
Personalization
• Pin and board recommendations
• New-user topic recommendations
Notifications
• Email timing, frequency, content
Ads and monetization
• User action prediction
Related pins
• Which pins are related to a given pin
Ranking
• Homefeed pin ranking
ML at Pinterest
9. What interests shall
we recommend to a
new user?
Example ML projects at Pinterest
[Pong Eksombatchai, Dave Cummings, Pei Yin, Dan Frankowski]
12. Confidential
User has just joined, they have no clue what
Pinterest is
• Problem: Product comprehension
We have tens of thousands of interests to
recommend from
• Problem: We cannot score all the interests
Business metric we want to optimize is WAR28
(weekly active repinner after 28 days)
• Problem: What is the right notion of a positive label?
Why is it hard?
13. How to generate
engaging homefeed?
Example ML projects at Pinterest
[Mukund Narasimhan, Yuchen Lie, Dmitry Chechik, Yunsong Guo, …]
14. Confidential
Diverse, Relevant, Endless set of pins to a user
Show pins and content meaningful to a user without a
specific query
Combines content from:
• Users or boards you follow
• Interests you follow
• Recommendations
Homefeed
15. Confidential
Generating candidates
• Find pins that we think you’ll like
Scoring and ranking
• Picking the best of the best among candidates
Blending of different sources
• Followed boards/users/interests, recommendations
Creating final feed
• Doing this for 10s of millions of users multiple times a day
Why is it hard?
22. Confidential
Why is it hard?
Systems challenges
• Billons of pins
• Find related pins of each given pin
Machine learning approach
• Classification vs. Ranking?
Ground-truth labels
• What is a good notion of ground-truth?
• Clicks? How do we de-bias position bias?
Offline evaluation
• What is a good metric for offline evaluation?
Related Pins
23. What “interests” does
a pin belong to?
[Leon Lin, Lingzhi Luo, Ningning Hu, Eugene Ie, Tao Cheng, …]
Example ML projects at Pinterest
25. Confidential
TASK: Given a pin, determine its interest(s)
From Pins to Interests
Black Box
Food&Drink
Lower back tattoos
Canoeing
…
Hair
Geek
26. Confidential
Some interests are specific, others are general
Huge interest size imbalance: 10% to 0.1%
• Problem: Always saying “not my interest” is 99%
correct
Don’t know the interest sizes in the “wild”
• Problem: Overpredict rare, underpredict common
ones
Solution has to scale to 1000s interests and many
languages
• We developed on English, deployed in French
Why is it hard?
28. Confidential
Generating candidates
• Find pins that we think you’ll like
Scoring and ranking
• Picking the best of the best among candidates
Blending of different sources
• Followed boards/users/topics, recommendations
Creating final recommendations
• Doing this for 10s of millions of users multiple times a day
Machine Learning Problems
Problems we’re trying to solve
29. Confidential
No dataset
• We have to create a dataset
• Which users to use? What time period?
No labels
• We have to pick the labels
• What is a good signal for positve/negative label?
• Can “no label” be considered as “negative label”?
Deployment
• We have to serve the model to 100m+ users
• How do we generate, store, and query features?
• How do we score the recommendations?
Many Challenges
30. Know your data
Carefully think about the input data
More is better
Don’t be afraid to try many times!
Evaluation is hard
Move fast but be scientific about it :)
Lessons Learned
1
2
3
What did we learn along the way?
31. Know your data
Learning 1
1
There is no objective dataset
Production changes everything
Make it easy to look at the raw data, raw
results…
Build intuition about the data and what
steps to take next
32. Confidential
• There are lots of subtleties in how training data is
generated
- How the data is sampled matters
- The characteristics of the data changes with time
- Distributions change upon deployment
- We make choices based on computational constraints (ratio of
positive to negative instances, size of data set)
• Varying these have a bigger impact on the final
model than varying algorithms
• More important to examine/vary/test these than (for
example) the regularization parameter
There is no Objective Dataset
33. Confidential
• The data distribution is different
- Need to deal with missing data
- Need to deal with malformed data
- Systems have to work under difficult circumstances
Upstream services may go down, but system should continue
to provide reasonable responses
Defining fallback behavior is important
• Offline/Online consistency takes work
• Investment in monitoring, measurement,
deployment, debugging is crucial
Production Changes Everything
35. Approach: One vs. Rest
Geek
W’s Fashion
Food and Drink
Canoeing
…
Interest
Classifier
Geek Women’s
fashion
Canoeing
Food and drink
Canoeing
Classifier
36. Approach: One vs. Rest
Geek
W’s Fashion
Food and Drink
Canoeing
…
Interest
Classifier
Geek Women’s
fashion
Canoeing
Food and drink
Geek
Classifier
37. Production Data Distribution does not Match
Geek Women’s
fashion
Canoeing
Food and drink
Geek
Classifier
Unlabeled
pins
38. Production Data Distribution does not Match
Geek Women’s
fashion
Canoeing
Food and drink
Geek
Classifier
Carefully think
about biases in
the data
Unlabeled
pins
42. More is better
Learning 2
2
• More is better:
- Models, Data, Features, Experiments
• Hard to tell upfront what will work and
what won’t
- Try lots of things
• Optimize for scale, flexibility,
debuggability
- Simple and consistent systems scale better
43. Confidential
For example:
We started with 39 features…
Quickly expanded to 670,000
features
7x gain in performance (F1 score)!
No manual feature selection.
Let the model select features!
More is better
Classifying pins to interests
Women’s
Fashion
Food &
Drink
Geek
46. Confidential
While scaling up be very careful
• Robust systems work in the presence of errors
- Incorrectly implemented features
- Features go missing
- Models translated incorrectly
- Data missing for a subset of users
• Treating ML systems as black boxes, looking
only at their output is dangerous
- Especially when you are not sure what to look for
- And because errors manifest as slightly lower accuracy
- And because you don't know what accuracy to expect
But: ML Systems Hide Bugs
47. Evaluation is Hard
Learning 3
3
Evaluation is always hard
Not obvious whether an offline metric will
correlate with an online metric
Offline metric is a complex function of
dataset creation, ground-truth labels, and
the ML algorithm
48. Confidential
Training objectives / Offline metrics / Online
metrics can be very different
- Some correlation is expected, but once your models
are sufficiently optimized, they begin to diverge
- Online metrics are the only ones that matter, but are
very expensive
- Offline metric should predict online metric
Naive split of training / testing is suboptimal
- There is often a lot of subjectivity that goes into
training data selection
- More important that the evaluation data reflect reality
than the evaluation data reflect the training data
Evaluation is Hard
49. Confidential
• User features:
• Landing page, demographics, Facebook
• Interest features:
• Topics, annotations, etc.
• Model: User-cross-Interests
• Feature hashing
• What are the labels?
• Not what user follows but interests of pins
user is going to interact with in the future
• Negative labels: Seen but not interacted
• Scoring: Score 1k location-gender
specific interests in real-time
New User Interest
Recommendations
User follows interests
User interacts with pins
Idea: Recommend interests
that user is going to interact
with in the future
50. Confidential
Evaluation
• Number of followed interests (bad)
• Number of pins interacted (good)
• AUC and Precision at top 10
• Baselines: Random, Popularity
In two months we:
• Ran 1,000s of offline experiments
• Trained 1000 of models to find a
useful one
• Generated 2,338 graphs, 148k pin
galleries
New User Interest
Recommendations
51. Evaluation is Hard
Define clear offline success metrics
• Consider many metrics
Build meaningful baselines
Clear offline metrics allow you to
quickly compare solutions and
prune bad directions
52. Confidential
Models can live for a long time
- Long term hold outs (> 1 year)
- Not all affects can be observed in a short timeframe
Models should be independent of infrastructure and
environment
- Infrastructure lifetime and Model lifetime should be independent
- Should be able to deploy models in different environments
Harder to track progress over time
- Changes are not additive
- Only way to determine progress is to compare with older
models
Old Models Never Die
55. Confidential
• Having a repeatable, push button, stable process is
enormously valuable
• Automation encourages experimentation
- Try variations easily
- Reduces temptation to bundle changes
- Easy baseline, good starting point
• Regular retraining is enormously valuable
• A new team member should be able to go through a
documented process and end up with a model
which is on par with production
Automation Pays for Itself
56. Confidential
• We have hundreds of models in production
- Trained by different engineers
- Optimizing for different criteria
- Using different features
- Meant for different purposes
- But running on the same infrastructure
• You need a process for
- Model Storage and Search
- Model Deployment, Documentation and Review
- Keeping Model coupling/dependencies in check
- Tracking experiments, communicating successes and failures
Models Need to be Managed
57. Confidential
• Make everything explicit (via DSL)
- A (linear) model is not just an array of coefficients
- It should list the source/raw-features
- It should contain the feature transforms
- It should contain the score transform/calibration/link function
- It should document how it was built, who built it,
when it was built, and point to instructions to reproduce it
• Config is better than Code
- Create a well documented model specification language
- That is human readable
- But manipulatable by tools (introspection, refactoring, etc.)
• Minimize dependencies on environment
Avoid Implicit Assumptions
58. Confidential
• Infrastructure is critical
• Building high quality systems requires experts
from different domains
- How do ML engineers build models without deep understanding
of the infrastructure?
- How do infrastructure experts build/scale/evolve the system?
• Decoupling infrastructure and modeling is hard but
worth it
- Allows people with different backgrounds to work together
- Requires well thought out interfaces
- Which is rarely achieved through organic evolution
There is more to ML Systems
than ML
59. Confidential
• 100M+ users
Vast, diverse and changing user base makes user modeling a
challenge
Product has to work well for niche as well as mainstream
populations
Optimizing for majority can hurt subgroups
Monitoring needs to be intelligent
• Billions of pieces of content
Modeling is crucial
Need to tradeoff recency, diversity, relevance, and ecosystem
effects
Everything Gets Amplified at
Scale