Businesses Want Results, Not Empathy Maps — #cxtalks Dallas 10 minute talkJeremy Johnson
While design is becoming ever more important in the business world, we’re at a crossroads where if we can't connect customer understanding to actionable themes or business results we’re going to lose our seat at the table. Customer Experience professionals need to become masters at blending customer, business, and technology to give teams a clear path ahead.
Key Takeaways
1. CX Pros need to get really good at understanding design, business AND technology
2. CX Pros need to get good at connecting customer insights to tangible features and products
3. CX Pros need to help design teams connect to business teams in an effective way
UX STRAT 2014: Matthew Holloway, "Design Your Strategy"UX STRAT
Some say that design is to strategy, what the Knight is to Chess, but its well understood to win the game you need to design a successful strategy. With organizations taking design more seriously, and viewing their design < both the people and artifacts, as a critical market differentiator, it is easy to image a seat at the table with your name on it. Design can play a dual role; both in the realization as well as the definition of strategy. Ideally this should make it even easier to promote the value of design‹unfortunately the difference is often lost on most people, most often on designers themselves. When you image sitting there with your CEO, what will you say? What will be your POV?
UX Field Research Toolkit - A Workshop at Big Design - 2017Kelly Moran
Workshop Description:
Looking for practice with in-depth user-experience research methods? You may have read about techniques in the past, but methods must be practiced to be understood. projekt202 has been employing these methodologies with great success since 2003. This workshop is your opportunity to try these tools in a structured environment without pressing deadlines or looming stakeholders. Our experienced research and design professionals will share industry tips and tricks that will help you put theory to practice.
The workshop will be hands-on and interactive; instructional elements will be reinforced with stories of impact to real projects. We will not only cover methods of gathering user data, but the importance of spending time internalizing and analyzing the data through activities such as affinity diagramming. Participants will gain exposure to these important practices in a low-pressure atmosphere and with the guidance of experienced professionals.
Businesses Want Results, Not Empathy Maps — #cxtalks Dallas 10 minute talkJeremy Johnson
While design is becoming ever more important in the business world, we’re at a crossroads where if we can't connect customer understanding to actionable themes or business results we’re going to lose our seat at the table. Customer Experience professionals need to become masters at blending customer, business, and technology to give teams a clear path ahead.
Key Takeaways
1. CX Pros need to get really good at understanding design, business AND technology
2. CX Pros need to get good at connecting customer insights to tangible features and products
3. CX Pros need to help design teams connect to business teams in an effective way
UX STRAT 2014: Matthew Holloway, "Design Your Strategy"UX STRAT
Some say that design is to strategy, what the Knight is to Chess, but its well understood to win the game you need to design a successful strategy. With organizations taking design more seriously, and viewing their design < both the people and artifacts, as a critical market differentiator, it is easy to image a seat at the table with your name on it. Design can play a dual role; both in the realization as well as the definition of strategy. Ideally this should make it even easier to promote the value of design‹unfortunately the difference is often lost on most people, most often on designers themselves. When you image sitting there with your CEO, what will you say? What will be your POV?
UX Field Research Toolkit - A Workshop at Big Design - 2017Kelly Moran
Workshop Description:
Looking for practice with in-depth user-experience research methods? You may have read about techniques in the past, but methods must be practiced to be understood. projekt202 has been employing these methodologies with great success since 2003. This workshop is your opportunity to try these tools in a structured environment without pressing deadlines or looming stakeholders. Our experienced research and design professionals will share industry tips and tricks that will help you put theory to practice.
The workshop will be hands-on and interactive; instructional elements will be reinforced with stories of impact to real projects. We will not only cover methods of gathering user data, but the importance of spending time internalizing and analyzing the data through activities such as affinity diagramming. Participants will gain exposure to these important practices in a low-pressure atmosphere and with the guidance of experienced professionals.
Michael Parler (Vice President) and Jim Powell (Director of Technology) share experiences and insights from Purple, Rock, Scissors (PRPL), a fast-moving digital creative agency located in Orlando Florida.
Learn about the DNA behind the scenes at PRPL, how it recruits digital talent, and how they tackle projects with a goal-driven approach.
Michael & Jim will share insights on the agency’s trajectory, its growing pains, customer stories, and their own thoughts on the latest trends in digital marketing and product innovation.
Presentation given to American Advertising Federation (AAF) Tallahassee.
Customer Experience & User Experience - is the union greater than the sum of ...UXPA International
This presentation will bring to focus CX & UX disciplines and the synergies in their approach to solving customer problems. We will talk about a model where CX & UX disciplines will need to work together through shared processes and deliverables. The cooperation and coexistence of the groups allows for unifying experiences for customers across multiple channels and devices. There are internet retailers that carry your cart status across multiple devices, now imagine it’s a retailer with a brick and mortar along with a digital presence that can carry your cart across all of those channels. The union of CX & UX teams organizationally or from a process and deliverables standpoint can be beneficial for the two groups and the business. We will present the story of UX and CX groups coming together within our company to create organizational change to be focused on customers.
Stop Wasting Your Analytics Budget - edUi 2016Mitch Daniels
When approached with clear intentions, web analytics can be a game-changing part of any online presence. It can inform massive redesigns, drive additional engagement, and spur continued site improvements.
Despite its potential, the full power of analytics is often neutered by a misappropriation of priorities and resources, leading to a stream of sterile, uninspiring reports and dashboards. Learn to recognize these challenges, identify them within your own organization, and confront them head on.
We’ll explore the distinction between ‘interesting’ and ‘actionable’ data, the downsides of monthly reports, and the importance of the 10/90 rule. Finally, we’ll identify a single word that will immediately push your analytics strategy in the right direction: “Why?”.
Here's how we at Melewi do a UX Audit of existing website, web and mobile apps to improve usability and the product's success, based on your business objectives and the target audience.
What is Lean UX? No really. I’ve read some stuff about it and it’s great in theory but I’m finding it hard to implement.
In a practical talk about how to apply the methodology, JD and JC will show you the tools and give you the inside story on how they’re using Lean UX in Westpac to kick goals. How do they test? How do they learn? How do they get the rest of the business to buy into their approach?
Experience Lead, James Caruso, outlines a designer's journey from inception to interaction design, illustrating how Interaction Design (IxD) has the potential to affect all aspects of the entire experience for any project, and delight users while you're at it.
A practical look on design change management and the digitalization process in general.
Juho Paasonen, Head of Design, SC5
ICTexpo 15 fair, Helsinki, Finland, 24th of April, 2015
UX STRAT Europe 2017: David Ruiz, "Developing a Multi-Channel Banking Experie...UX STRAT
UX STRAT Europe 2017 presentation by David Ruiz, Head of Design and CX, Orange Bank: "Developing a Multi-Channel Banking Experience for a Telecom Giant"
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...UX STRAT
US-based gas and electricity utility Dominion has spent several years implementing digital experience enhancements across various business areas and functions such as IVR, mobile outage reporting and bill pay, power-outage maps, online customer service portals, text and email messaging, social media, and the like. Dominion had enhanced and sometimes increased the use of digital to engage with its 2.4 million customers, but the work was not linked by a long-term, unified plan for digital customer experience. Each area of the business had its own processes supported by its own software, and IT systems and staff. Dominion and CapTech defined several critical success factors the company should follow for successful digital experience outcomes, which in turn impact how technology professionals (and others) collaborate and do their jobs. This presentation is a case study describing this transformation, and will describe practical steps for creating a Digital Strategy as well as real-world examples with success and failures.
Top 3 ways to use your UX team - producttank DFW MeetupJeremy Johnson
As a product owner or manager how should you be using your User Experience team? In this quick talk I go over the top three ways to use your UX team to support you in building better products.
How to Grow a Product with a User JourneyBrandon Owens
How to Grow a Product with a User Journey
Brandon Owens - http://linkedin.com/in/brandonowens
Mauricio Estrella - http://linkedin.com/in/mestrella
Too often growth is assumed to be a marketing problem but the overall pace of growth is frequently governed by how well the product converts new users into heavy users.
This presentation highlights how you can create a User Journey to identify the most important parts of a product experience that drive or inhibit growth.
i. How we related a User Journey to Growth
ii. 3 things to focus your teams on for Growth
iii. Then what? User Journey
iv. What is the “aha moment”
v. Things you can do to build a user journey
vi. Final recommendations
Presented at Barcamp Shanghai, Spring 2014
Highlights and summary of long-running programmatic research on data science; practices, roles, tools, skills, organization models, workflow, outlook, etc. Profiles and persona definition for data scientist model. Landscape of org models for data science and drivers for capability planning. Secondary research materials.
Michael Parler (Vice President) and Jim Powell (Director of Technology) share experiences and insights from Purple, Rock, Scissors (PRPL), a fast-moving digital creative agency located in Orlando Florida.
Learn about the DNA behind the scenes at PRPL, how it recruits digital talent, and how they tackle projects with a goal-driven approach.
Michael & Jim will share insights on the agency’s trajectory, its growing pains, customer stories, and their own thoughts on the latest trends in digital marketing and product innovation.
Presentation given to American Advertising Federation (AAF) Tallahassee.
Customer Experience & User Experience - is the union greater than the sum of ...UXPA International
This presentation will bring to focus CX & UX disciplines and the synergies in their approach to solving customer problems. We will talk about a model where CX & UX disciplines will need to work together through shared processes and deliverables. The cooperation and coexistence of the groups allows for unifying experiences for customers across multiple channels and devices. There are internet retailers that carry your cart status across multiple devices, now imagine it’s a retailer with a brick and mortar along with a digital presence that can carry your cart across all of those channels. The union of CX & UX teams organizationally or from a process and deliverables standpoint can be beneficial for the two groups and the business. We will present the story of UX and CX groups coming together within our company to create organizational change to be focused on customers.
Stop Wasting Your Analytics Budget - edUi 2016Mitch Daniels
When approached with clear intentions, web analytics can be a game-changing part of any online presence. It can inform massive redesigns, drive additional engagement, and spur continued site improvements.
Despite its potential, the full power of analytics is often neutered by a misappropriation of priorities and resources, leading to a stream of sterile, uninspiring reports and dashboards. Learn to recognize these challenges, identify them within your own organization, and confront them head on.
We’ll explore the distinction between ‘interesting’ and ‘actionable’ data, the downsides of monthly reports, and the importance of the 10/90 rule. Finally, we’ll identify a single word that will immediately push your analytics strategy in the right direction: “Why?”.
Here's how we at Melewi do a UX Audit of existing website, web and mobile apps to improve usability and the product's success, based on your business objectives and the target audience.
What is Lean UX? No really. I’ve read some stuff about it and it’s great in theory but I’m finding it hard to implement.
In a practical talk about how to apply the methodology, JD and JC will show you the tools and give you the inside story on how they’re using Lean UX in Westpac to kick goals. How do they test? How do they learn? How do they get the rest of the business to buy into their approach?
Experience Lead, James Caruso, outlines a designer's journey from inception to interaction design, illustrating how Interaction Design (IxD) has the potential to affect all aspects of the entire experience for any project, and delight users while you're at it.
A practical look on design change management and the digitalization process in general.
Juho Paasonen, Head of Design, SC5
ICTexpo 15 fair, Helsinki, Finland, 24th of April, 2015
UX STRAT Europe 2017: David Ruiz, "Developing a Multi-Channel Banking Experie...UX STRAT
UX STRAT Europe 2017 presentation by David Ruiz, Head of Design and CX, Orange Bank: "Developing a Multi-Channel Banking Experience for a Telecom Giant"
UX STRAT 2014: Bill Rattner, "Creating a Long-Term, Unified Plan for Digital ...UX STRAT
US-based gas and electricity utility Dominion has spent several years implementing digital experience enhancements across various business areas and functions such as IVR, mobile outage reporting and bill pay, power-outage maps, online customer service portals, text and email messaging, social media, and the like. Dominion had enhanced and sometimes increased the use of digital to engage with its 2.4 million customers, but the work was not linked by a long-term, unified plan for digital customer experience. Each area of the business had its own processes supported by its own software, and IT systems and staff. Dominion and CapTech defined several critical success factors the company should follow for successful digital experience outcomes, which in turn impact how technology professionals (and others) collaborate and do their jobs. This presentation is a case study describing this transformation, and will describe practical steps for creating a Digital Strategy as well as real-world examples with success and failures.
Top 3 ways to use your UX team - producttank DFW MeetupJeremy Johnson
As a product owner or manager how should you be using your User Experience team? In this quick talk I go over the top three ways to use your UX team to support you in building better products.
How to Grow a Product with a User JourneyBrandon Owens
How to Grow a Product with a User Journey
Brandon Owens - http://linkedin.com/in/brandonowens
Mauricio Estrella - http://linkedin.com/in/mestrella
Too often growth is assumed to be a marketing problem but the overall pace of growth is frequently governed by how well the product converts new users into heavy users.
This presentation highlights how you can create a User Journey to identify the most important parts of a product experience that drive or inhibit growth.
i. How we related a User Journey to Growth
ii. 3 things to focus your teams on for Growth
iii. Then what? User Journey
iv. What is the “aha moment”
v. Things you can do to build a user journey
vi. Final recommendations
Presented at Barcamp Shanghai, Spring 2014
Highlights and summary of long-running programmatic research on data science; practices, roles, tools, skills, organization models, workflow, outlook, etc. Profiles and persona definition for data scientist model. Landscape of org models for data science and drivers for capability planning. Secondary research materials.
Business is always in a constant state of flux- more so these days, with disruption happening all around. How do you move from your AS IS state to TO BE architecture in your enterprise transformational journey? What mix and match of people, processes and technology will you blend together, and in what proportion, to drive enterprise value to deliver transformational results? TOGAF has a suite of tools that can help architects to chalk out the architectural roadmap for enterprise success. This talk will also focus on how agility is an underlying thread in this framework, and how value is delivered incrementally, making the process robust and
bankable.
Key Takeaways
Exposes the audience to the features of TOGAF which help plug business technology gaps.
How TOGAF has agility at its core to drive transformational results.
Why it is a good skill and knowledge for a seasoned IT professional to have in their kitty.
Updated for the Vista UX/UI Summit in Dallas, TX
You can view a video of this presentation here: https://www.youtube.com/watch?v=NfASJamxjy4
User Experience has a direct impact on your bottom line, and it’s about time we start telling execs in their own language. I’m sure many of you spend a good amount of time evangelizing what it is that you do, and the value it adds. Over the past 15 years I’ve introduced User Experience to everyone from CEOs to developers — using storytelling, metrics, and case studies you can prove without a doubt the value that you bring.
In this talk I’ll explain what metrics to track, how to position your work, and stories where User Experience directly effected the bottom line.
Top 3 Ways to use your UX Team for Product OwnersJeremy Johnson
You have a UX team, now what? Jeremy goes over the top 3 ways you, as a product owner should be using your UX team, along with insights into the User Experience process.
This talk was given at the North Dallas Agile Meetup on 4/12/17
Intro to Artificial Intelligence w/ Target's Director of PMProduct School
Given that Machine Learning (ML) is on every product enthusiast’s mind, this talk gave a broad view of the investment landscape for future innovation. Director of Product Management at Target, Aarthi Srinivasan, talked about macro AI themes & trends, how you can build your AI team and how to create a ML backed product vision.
Additionally, this talk armed the attendees with enough information to create your Point of View (POV) on how to incorporate AI into your business.
Including the User: How insights drive business #pswud2017Jeremy Johnson
Design is inclusive by nature. The ability to understand people, their needs, and emotions throughout a journey is what User Experience Designers excel at! That said, many organizations still need that nudge to really get out build true empathy for the people they’re building tools, systems, and apps for. This talk will help you ramp up with modern best practices in insights gathering, while helping you build the case to invest in user understanding through showcasing the value to both your business and your brand.
Ved at indbygge teknologi direkte i produkter og services opstår nye muligheder for forretning og nye muligheder for at tilbyde kunderne ekstra værdi. Vi gennemgår, hvordan du identificerer relevante muligheder for din virksomhed - og hvordan du implementerer dem i praksis.
Tete Mensa-Annan, chefarkitekt, Microsoft
Product + UX: How to combine strengths to make something truly great!Jeremy Johnson
With modern organizations finally starting to embrace User Experience as part of their product teams, and product leaders moving to more strategic roles within these teams, how can we combine the strengths of both roles to make something truly great?
Shifting to Hypothesis-Driven Dev at Scale by Squarespace Sr PMProduct School
Main takeaways:
- Start with hypotheses and measurable outcomes instead of features
- Make Personas data driven
- Celebrate the “landings," not just launches
Net Solutions JAVA Development BrochureNet Solutions
Net Solutions a CMMI level 3, award winning outsourced product development company. For building fast, secure and reliable software products and applications. As a leading Java development company we have a highly experienced team with combined technical and business experience of over 12 years
Use of Analytics to recover from COVID19 hit economyAmit Parija
As the world takes a unexpected economic down turn due to the COVID19 pandemic, data sciences and analytics is something business are turning to take quick decisions
Project Report Presentation Template
If you want to buy this presentation template, please visit http://punkl.com
Creating a presentation from scratch can be quite labour-intensive. Starting with a presentation template from Punkl is beneficial. It saves time, provides good visual design and means that you can primarily spend your time and attention on the content of your presentation.
Punkl Presentation Templates save you time, as they're a whole lot quicker than trying to design a deck from scratch. Also, starting with a template means that you can primarily spend your time and attention on the content of your presentation, while the visual style is already designed to be engaging.
Typically, the only elements that are changed while working with a presentation template are colors, typography, copy and any visual assets such as photos for example.
Similar to UX STRAT USA Presentation: Joe Lamantia, Bottomline Technologies (20)
UX STRAT Online 2021 Presentation by Sudha JamtheUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"AIX: Framework for Designing Human-Centric AI"
Sudha Jamthe
Stanford University: Artificial Intelligence Instructor
UX STRAT Online 2021 Presentation by Jessa Parette, Capital OneUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"How to Measure Design Quality"
Jessa Parette
Capital One: Head of Design - Strategy, Research & Systems
UX STRAT Online 2021 Presentation by Rina Tambo JensenUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"How to Incorporate Mixed Methods Research"
Rina Tambo Jensen
UX STRAT Online 2021 Presentation by Gideon Simons, ZinierUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Progressive Design with AI"
Gideon Simons
Zinier: Senior Director of Product Design & User Research
UX STRAT Online 2021 Presentation by Mike Kuniavsky, AccentureUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Niche Manufacturing, AI and Computational Design at Accenture Labs"
Mike Kuniavsky
Accenture: Technology R&D Senior Principal
UX STRAT Online 2021 Presentation by Carolyn Chang and Christine Liao of Link...UX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Designing Human-Centered AI Experiences at LinkedIn"
Carolyn Chang
LinkedIn: Principal User Experience Researcher
Christine Liao
LinkedIn: Product Design Lead
UX STRAT Online 2021 Presentation by Dr. Jofish Kaye, AnthemUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Strategy & Organization for AI & UX in Healthcare"
Dr. Jofish Kaye
Anthem: Senior Director of Interaction Design & AI
UX STRAT Online 2021 Presentation by Carol Smith, Carnegie Mellon UniversityUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Mixed Methods in UX Research in the Fields of Design, Data, and AI"
Carol Smith
Carnegie Mellon: Sr. Research Scientist
UX STRAT Online 2021 Presentation by Dr. Hsien-Hui Tang and Michael T LaiUX STRAT
"Shifting the Value of Experience: From Design to Strategy"
Dr. Hsien-Hui Tang
Tang UX Consultancy: Experience Strategy Expert
Michael T Lai
X Thinking University: Dean
UX STRAT Online 2021 Presentation by Paul-Jervis Heath, Modern HumanUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Finding a Compelling Value Proposition for Emerging Technologies"
Paul-Jervis Heath
Modern Human: Chief Creative Officer & Founding Partner
UX STRAT Online 2021 Presentation by Jos-Marien Jansen, PhilipsUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Mixed Methods in UX Research in the Fields of Design, Data, and AI"
Jos-Marien Jansen
Philips: Sr. Design Researcher
UX STRAT Online 2021 Presentation by Adilakshmi Veerubhotla, IBMUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Design Tools to Get the Most from AI"
Adilakshmi Veerubhotla
IBM: UX Architect
UX STRAT Online 2021 Presentation by Nur Karadeniz, Publicis SapientUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Designing Systemic Transformation"
Nur Karadeniz
Publicis Sapient: Group Director - Industry Head of Experience
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Uncertain Times as Drivers of Innovation"
Remko Vermeulen
Koa Health: VP of Product
UX STRAT Online 2021 Presentation by Maryna Razakhatskaya, ConsultantUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Design Framework for Spatial Immersive Experiences"
Maryna Razakhatskaya
Consultant: Creative Technologist
UX STRAT Online 2021 Presentation by Josephine Scholtes, MicrosoftUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Designing Conversational AI at Microsoft: A Design Toolkit"
Josephine Scholtes
Microsoft: User Experience Consultant
UX STRAT Online 2021 Presentation by Sander Bogers, PhilipsUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Designing Meaningful Human-AI Interactions"
Sander Bogers
Philips: Data-Enabled Design Consultant
UX STRAT Online 2021 Presentation by Veena Sonwalkar, frogUX STRAT
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Crowdsourcing & Outsourcing Research During the Pandemic
Veena Sonwalkar
frog: Assoc. Design Director
These slides are for the following session presented at the UX STRAT Online 2021 Conference:
"Strategic Design Methods for Business Impact"
Angel Brown
Digitas Health: Group Director Experience Strategy
Between Filth and Fortune- Urban Cattle Foraging Realities by Devi S Nair, An...Mansi Shah
This study examines cattle rearing in urban and rural settings, focusing on milk production and consumption. By exploring a case in Ahmedabad, it highlights the challenges and processes in dairy farming across different environments, emphasising the need for sustainable practices and the essential role of milk in daily consumption.
Can AI do good? at 'offtheCanvas' India HCI preludeAlan Dix
Invited talk at 'offtheCanvas' IndiaHCI prelude, 29th June 2024.
https://www.alandix.com/academic/talks/offtheCanvas-IndiaHCI2024/
The world is being changed fundamentally by AI and we are constantly faced with newspaper headlines about its harmful effects. However, there is also the potential to both ameliorate theses harms and use the new abilities of AI to transform society for the good. Can you make the difference?
7 Alternatives to Bullet Points in PowerPointAlvis Oh
So you tried all the ways to beautify your bullet points on your pitch deck but it just got way uglier. These points are supposed to be memorable and leave a lasting impression on your audience. With these tips, you'll no longer have to spend so much time thinking how you should present your pointers.
Dive into the innovative world of smart garages with our insightful presentation, "Exploring the Future of Smart Garages." This comprehensive guide covers the latest advancements in garage technology, including automated systems, smart security features, energy efficiency solutions, and seamless integration with smart home ecosystems. Learn how these technologies are transforming traditional garages into high-tech, efficient spaces that enhance convenience, safety, and sustainability.
Ideal for homeowners, tech enthusiasts, and industry professionals, this presentation provides valuable insights into the trends, benefits, and future developments in smart garage technology. Stay ahead of the curve with our expert analysis and practical tips on implementing smart garage solutions.
Expert Accessory Dwelling Unit (ADU) Drafting ServicesResDraft
Whether you’re looking to create a guest house, a rental unit, or a private retreat, our experienced team will design a space that complements your existing home and maximizes your investment. We provide personalized, comprehensive expert accessory dwelling unit (ADU)drafting solutions tailored to your needs, ensuring a seamless process from concept to completion.
UX STRAT USA Presentation: Joe Lamantia, Bottomline Technologies
1. FLYING BLIND ON A ROCKET CYCLE
PIONEERING EXPERIENCE-CENTERED PRODUCT
STRATEGY FOR EMERGING SPACES
2. JOE LAMANTIA
Currently: VP Design & Development @ Bottomline Technologies
Previous 20 years: end-to-end customer experience, all stages of product and
service development, and digital / business transformation, focusing on
emerging business and technology.
Archetype(s): Sometime Entrepreneur / Proto-academic / Arm-chair Pro Cyclist
https://www.linkedin.com/in/digitaljoelamantia/
@mojoe
JoeLamantia.com [joelamantia.net]
3. !3
Businesses around the world depend on Bottomline Technologies
(NASDAQ: EPAY) solutions to help them make complex business
payments simple, smart and secure, including some of the world’s largest
banks, and private and publicly traded companies.
4. This case study describes building a learning-
driven strategy capability to guide an
adventurous product development group
focused on the new domains of big data
analytics and machine intelligence.
I’ll share the outcomes of our efforts to launch
new products chartered directly around
customer experience value; outline the
methods, tools, and perspectives that powered
product discovery and strategic planning; share
a framework and patterns for identifying and
understanding emerging domains; and review
the application of this toolkit to new situations.
12. BUSINESS STRATEGY IS ABOUT
IDENTIFYING YOUR BUSINESS
OBJECTIVES AND DECIDING WHERE TO
INVEST TO BEST ACHIEVE THOSE
OBJECTIVES.
Marty Cagan
http://svpg.com/business-strategy-vs-product-strategy/
13. THE PRODUCT STRATEGY SPEAKS TO
HOW YOU HOPE TO DELIVER ON THE
BUSINESS STRATEGY.
Marty Cagan
http://svpg.com/business-strategy-vs-product-strategy/
18. OPPORTUNITY ASSESSMENT
“I ASK PRODUCT MANAGERS TO ANSWER TEN FUNDAMENTAL QUESTIONS”
1. Exactly what problem will this solve? (value proposition)
2. For whom do we solve that problem? (target market)
3. How big is the opportunity? (market size)
4. What alternatives are out there? (competitive landscape)
5. Why are we best suited to pursue this? (our differentiator)
6. Why now? (market window)
7. How will we get this product to market? (go-to-market strategy)
8. How will we measure success/make money from this product? (metrics/revenue strategy)
9. What factors are critical to success? (solution requirements)
10.Given the above, what’s the recommendation? (go or no-go)
http://svpg.com/assessing-product-opportunities/
Assessing
Product
Opportunities
by Marty Cagan | Dec 13, 2006
19. PRODUCT DISCOVERY
MODERN PRODUCT DISCOVERY
• Introduction [:26]
• Modern Product Discovery [:54]
• The Evolution of Modern Product Discovery [4:15]
• The Agile Manifesto [7:06]
• The Rise of User Experience Design [8:47]
• The Lean Startup: Eric Ries [9:49]
• The Jobs-To-Be-Done Framework: Clayton Christensen and Anthony Ulwick [10:42]
• OKRs and Design Sprints [12:12]
• The Goal of Modern Product Discovery [14:27]
• Putting Discovery Practices Into Context: The Opportunity Solution Tree [21:32]
• The Future of Product Discovery [29:42]
https://www.producttalk.org/2017/02/evolution-product-discovery/
The Evolution of
Modern Product
Discovery
February 8, 2017 by Teresa Torres 9
Comments
23. PRODUCT STRATEGY CHARTS A DESIRED
SET OF COURSES THROUGH THE SPACE
OF POSSIBLE PRODUCTS FOR A DOMAIN
Joe Lamantia
http://svpg.com/business-strategy-vs-product-strategy/
32. DEEP STRUCTURE
ENTERPRISE / B2B
• Business process
• Activity
• Social structure: Organizational model
• Boundaries
• Regulation
• IT / Systems architecture
• Lifecycle
• Flows: capital, information, people
• Frame: shareholder value, social enterprise
CONSUMER / B2C
• Value scheme: wealth, love,
knowledge, safety
• Demographics
• Boundaries
• Mores
• Culture
• Social structure: community / group
• Frame: active lifestyle, sustainability
34. Information Visibility through Endeca Discovery Applications
MDEX Engine
Rapidly
changing
data and
content
Large volumes of
highly attributed records
Structured and
unstructured
information
Discovery Applications
Intuitive user experience guides
untrained users to discover relationships
in data
Specialized Database
High performance database purpose
built for data-driven search, navigation,
and analytics
Flexible Data Integration
Consolidate structured and unstructured
data to bridge whitespace between
enterprise systems
50. EXPLORING HYPOTHESES ABOUT VALUE:
“AUTOMATION OF RECONCILIATION ACTIVITIES
WILL ENABLE
ACCOUNTS PAYABLE GROUPS IN MID-MARKET
COMPANIES
TO
HANDLE 30% MORE TRANSACTIONS.”
51. PRODUCT DEVELOPMENT IMPACT
INNOVATION OPPORTUNITIES
PRODUCT HYPOTHESES FOR VALIDATION
PRODUCT CONCEPTS FOR PROTOTYPING
PLANNING GUIDANCE (ROADMAP > EPIC > QA)
DELIVERY GUIDANCE: FEATURES AND FUNCTIONS
56. Data Scientist
Square - San Francisco Bay Area
Job Description
Square is hiring a Data Scientist on our Risk team. The Risk team at Square is responsible for enabling growth while mitigating financial loss associated with transactions. We work
closely with our Product and Growth teams to craft a fantastic experience for our buyers and sellers.
Desired Skills & Experience
As a Data Scientist on our Risk team, you will use machine learning and data mining techniques to assess and mitigate the risk of every entity and event in our network. You will
sift through a growing stream of payments, settlements, and customer activities to identify suspicious behavior with high precision and recall. You will explore and understand our
customer base deeply, become an expert in Risk, and contribute to a world-class underwriting system that helps Square provide delightful service to both buyers and sellers.
To accomplish this, you are comfortable writing production code in Java and conducting exploratory data analysis in R and Python. You can take statistical and engineering ideas
from prototype to production. You excel in a small team setting and you apply expert knowledge in engineering and statistics.
Responsibilities
1. Investigate, prototype and productionize features and machine learning models to identify good and bad behavior.
2. Design, build, and maintain robust production machine learning systems.
3. Create visualizations that enable rapid detection of suspicious activity in our user base.
4. Become a domain expert in Risk.
5. Participate in the engineering life-cycle.
6. Work closely with analysts and engineers.
Requirements
1. Ability to find a needle in the haystack. With data.
2. Extensive programming experience in Java and Python or R.
3. Knowledge of one or more of the following: classification techniques in machine learning, data mining, applied statistics, data visualization.
4. Concise verbal and written articulation of complex ideas.
Even Better
1. Contagious passion for Square’s mission.
2. Data mining or machine learning competition experience.
Company Description
Square is a revolutionary service that enables anyone to accept credit cards anywhere. Square offers an easy to use, free credit card reader that plugs into a phone or iPad. It's
simple to sign up. There is no extra equipment, complicated contracts, monthly fees or merchant account required.
Co-founded by Jim McKelvey and Jack Dorsey in 2009, the company is headquartered in San Francisco.
59. WHAT SORT OF PERSON?
▸ They seem different than analysts:
▸ problem set
▸ relationship to discovery tools
▸ skills and professional profile
▸ discovery / analytical methods
▸ perspective
▸ workflow and collaboration
▸ Are they? How?
60. AREAS OF INVESTIGATION
▸ Workflow
▸ Environment
▸ Organizational model
▸ Pain points
▸ Tools
▸ Data landscape
▸ Analytical practices
▸ Project structure
▸ Unmet needs
62. DISCUSSION GUIDE
Can you please walk me through a recent or current project?
a. How was the project initiated?
b. How defined was the business problem in the beginning? Did the problem change?
c. Where/who did you obtain data sets from? How did you make the decision?
d.Describe the data you used: How did the data sets look like? How big were they? Were they structured or unstructured?
e. What tools or techniques did you use to do the analyses? Did they map to the specific steps you mentioned just now?
f. How did you decide these were the tools/techniques to use? To what extent were these decisions made by yourself and to what extent were
they standardized by your group/team?
g. How did you present the results of your analyses? What tools did you use? What do you like and dislike about your current tool set?
h. Which stage of this project was the most challenging? To what extent did the tools satisfy what you intended to do? What features were lacking?
i. How much collaboration was there during each stage of the project?
i. Background and role of collaborators
ii. Collaboration modes
iii. Types of information shared
Thinking about the projects you have worked on, is there a common approach you take to address these problems?
How did you decide on this approach/tools?
63. NEEDS
What are the most common and useful statistical techniques you use during discovery and analysis efforts?
“(1) The most commonly used statistical techniques used to date (in our strategic planning work) are: dimensionality
reduction (partition clustering, multiple correspondence analysis), factor analysis, partition clustering (k-means, k-medoids,
fuzzy clustering), cluster validation techniques (silhouette, dunn’s index, connectivity), multivariate outlier detection, linear
regression, and logistic regression.”
What statistical capabilities or functions would be very useful if provided within Endeca discovery applications, and where
would they be useful?
(2) Techniques that would assist with identifying outliers or invalid data. Much of this work seems to be done by hand. I
believe that we are also getting to the point where we could start using linear regression and splines (for showing trends).”
64.
65. NEEDS
For example, would system-generated descriptive statistical visualizations be useful for whole data sets - or for smaller user-
selected groups of attributes?
“With regards to your last question on visualization, we have put in significant effort to use visualization in our Endeca
installation. We have built visualizations such as tree maps, flow diagrams, sun burst diagrams, scatter plots showing clusters,
and hierarchical edge bundling diagrams to explore our data sets.
Would it be useful for the application to analyze and suggest possible distribution models it sees in the data; for the values of
individual attributes, and/or for larger sets of data?
Our data tends to be qualitative rather than quantitative so this drives much of our visualizations.
So yes, interactive descriptive statistical visualization would be helpful – on the complete data set and individual attributes.”
66. Discovery/Information Needs
Support longer term strategic planning:
•How can we decrease the time-to-install service for new customers
•How can we decrease the time it takes to restore service after a storm causes wide-
spread outages
•How can we decrease operational cost for each department/line of business
•How many call center representatives do I need in my call center
•How much offsite technician headcount do we need based on historical/seasonal
trends balanced against current customer install base and ongoing sales/marketing
efforts?
Evaluate Success:
•How effective was a particular marketing campaign
•How effective is a new training program for call center representatives
•How effective is a self-install approach
Understanding variables that impact KPIs. KPIs include:
•Call center volume
•% successful resolution by support staff
•Time-to-install
•Sales volume
•Sales revenue
Understanding & Explaining Variance using Retrospective Analyses
•Why does Connecticut have a shorter time-to-install than Rhode Island
•Why did 2 identical marketing campaigns in 2 different markets have vastly
different impact on sales
•Is the variance significant, or does it represent random deviation?
Ad-hoc Reporting
•How many calls to the call center needed to be escalated to tier 2 support last
month
•How many new customers complained that a technician was later/didn't show up for
the install appointment
Analyst Profile: Scott – Operations Analyst
Summary
Education
BA Information Systems (Connecticut State College)
MBA Org Leadership (Johnson & Wales)
Scott is a mid-level analyst with a background in Business
Information Systems, and MBA in Organizational
Leadership. He works in a 6-person team at Cox-New England
(Telecommunications). His current role involves conducting data mining
analysis to support operations research and organizational decision
making/strategic planning.
Scott's work supports both sides of the profit equation: operations
research/analysis to support internal cost-cutting and process innovation,
and formative/summative evaluation to help drive effective sales/
marketing efforts to increase revenue. His group is also given target cost
savings goals that they need to help individual departments achieve to
fulfill a cost reduction organizational mandate. His group accomplishes
this by discovering inefficiencies in process through data mining,
predictive modeling and retrospective data analysis.
Cox has highly attributed enterprise data on customers, marketing
campaigns, pricing variants and special offers, demographics, geography
of the area, building and home types, school schedules, weather events,
etc. that describe customer usage patterns, consumption of media
bandwidth, etc. Each of their products (data, cable, phone, wireless) has
different usage profiles that vary along many of the dimensions and
variables listed above. His group is focused on residential customers;
business customers are handled by a separate unit.
67.
68. ‘FIVE THINGS ANALYSTS DO WITH DATA’
▸ Clustering
▸ Dimension Reduction
▸ Anomaly Detection
▸ Characterization
▸ Testing probability model & validation
Source: Frontiers in Massive Data Analysis
http://www.nap.edu/openbook.php?record_id=18374
}
}
Structure of data
Profile of data
} Validity of data
73. Sense Maker Segment
Sense makers need to create and/or employ insights to accomplish
their business goals and satisfy their responsibilities.
These insights emerge from independent and collaborative discovery
efforts that involve direct interaction with discovery applications, and
participation in discovery environments.
Insight Consumer
Analyst
Casual Analyst
Data Scientist
Analytics Manager
Problem Solver
74. Creates data-driven insights, offerings, and resources to transform the organization
Work Experience 10 Years
Education Ph.D. Statistics, MS Bio-Informatics
Job Title Senior Data Scientist
Company LInkedIn
Summarize & Communicate
Review findings with colleagues;
summarize ,visualize, and
communicate key findings to
Insight Consumers/decision makers
Prototype & Experiment
with data driven
feature:
How can we prototype/
evaluate this w/out
disrupting the site?
Gather Data &
Analyze Results
Use descriptive,
inferential, and
predictive statistics
to evaluate results
Analyze & Identify causal/
predictive factors:
Who are the best
candidates to contact for a
job based on recruiter
needs and profile content?
Dana Data Scientist
• Defining and capturing useful measures of
online attention
• Getting all the data analytic tools to work
together properly
• No current workflow support or tools for data
wrangling, analysis, experimentation,, and
prototyping
• Effective tools to help experiment with and
evaluate value /utility of features and
activities for users
• Ability to rapidly prototype data-driven
features w/out risk of online service
disruptions
• Open source data manipulation, mining &
analysis tools including R, Pig, Hadoop, Python,
etc.
• Statistical packages such as SAS, SPSS, etc.
• Custom analytical tools built using open source
components and languages
• Leverage data to support the org mission
• Enhance products & services with data-driven
insights and features
• Use data to identify new opportunities and
prototype/drive new customer offerings
• Create useful data sets/streams, measures, &
resources (e.g., data models, algorithms, etc.
Key Goals
Tools
Pain Points
Wish List
Sample Workflow
Dana is a Senior Data Scientist who has worked at LinkedIn for 5 years.
Dana’s education includes a Ph.D. in Statistics and an MS in Bio
Informatics. Dana’s previous work includes positions in academic research
groups as a doctoral candidate and post-doc, as well as software
engineering roles in the Internet & technology industries.
•Dana works with several other data scientists and her Analytics Manager
on a centralized team
•Dana and her colleagues aim to create data driven insights, features,
resources, and offerings that deliver strategic value to LinkedIn
•Dana works with Analysts on other teams to define and create discovery
tools, data sets, and methods for use by their groups at LinkedIn.
•Dana & team are visible & well established within LinkedIn, and have a
voice in product strategy and operational context; they have a high
degree of autonomy in defining data science projects
•Dana works with Insight Consumers to suggest and determine potential
new data driven offerings to prototype and evaluate.
• How can we leverage data to increase online engagement with LinkedIn?
•How should we measure engagement & what factors drive it?
•What aspects of a personal profile are most likely to encourage /
discourage new connections between people?
•How can we increase people’s activity and contributions to topical
discussion groups?
• What factors drive the effectiveness of our marketing campaigns?
•Why did one of our marketing campaigns work exceptionally well?
• How can leverage data to help recruiters identify and communicate
effectively with qualified and potentially available candidates?
Typical Discovery Scenarios & Problems
Background
Work Context
• Mines, analyzes, & experiments with data to
identify patterns, trends, outliers, causal
factors, predictive models, & opportunities
• Defines and explains newly devised
measurements, predictive models, &
insights
• Compares effectiveness of operations at
achieving company goals for engagement,
growth, data quality
• Produces & explores new data sets
• Collaborates with other data scientists to
capture new data streams
• Prototypes new data driven site features/
offerings
• Runs data based experiments to test/
evaluate models, hypotheses & prototypes
• Communicates & explains analyses to
colleagues & Insight Consumers
I’ll do whatever it takes – wrangle,
extract, manipulate, analyze,
experiment, prototype – to use
data to drive value & innovate
“
”
Activities
75. Perspectives
Analytical
The analytical perspective is the center of definition for all
analytical roles. Contrast with engineers, who "make stuff".
Analytical roles figure things out for some purpose: whether a
model to inform a product prototype or provide insight.
Empirical
The empirical perspective is distinct from the analytical
perspective, and marks 'true' data scientists. This revolves
around framing and testing hypotheses formally and informally,
often requires validation and interrogation of experimental
methods and results by others, expects significant degree of
transparency at (all) stages of the analytical effort.
76. Empirical Method
Experiments
Hypotheses
Results
Questions or
beliefs
Predictions
Conclusions
Insights
Domain
Production
Models
Data Sets
Exploratory ValidationInvestigative TrainingModel Building
Analytical
Methods
Insight
Consumer
Data
Scientist
Articulates
Directs
& applies
Creates & refines
Effected by
Lead to
Tested by
Use / require
Motivate
Creates & refines
Generate
Achieves
Informed by & shares
Inform
Understands
Defines & evolves
Inform
Data
Engineer
Implements
Determines
Applied to validates
Data Sources
Used to define
Applied to
Development
Corpus
External
Sources
Production
Corpus
Mirrors
Applied to
Models
Reference Initial Interim New
Drawn from
Analytical Tool
Algorithm Script Test
Implemented as
Implements
Inform
What is the question?
How will we answer the question?
What data will we use?
What analytical method will we use?
What tools will we use?
What are the results?
What do the results mean?
What did we learn / discover?
Who should we inform?
What is the next question?
Manages
Data ProductsManages
EMPIRICAL DISCOVERY
“a hybrid, purposeful,
applied, augmented, iterative
and serendipitous method for
realizing novel insights for
business, through analysis of
large and diverse data sets.”
Data Science and Empirical Discovery: A New Discipline Pioneering a New
Analytical Method
https://blogs.oracle.com/serendipity/entry/data_science_and_empirical_discovery
78. Analysis Workflow & Activities
• Empirical analysis of subsets of data
–Understand topology of data, boundaries (sets / subsets, complete corpus,
totality of data)
• Outlier identification and profiling
–How significant are outliers to overall topology
»Comparative exclusion and profiling of resulting data subsets to understand their role,
discover principal components
• Find and analyze patterns, areas of interestingness / deserving attention
• Find and analyze central actors / factors (in existing model that produced
source data, in topology of working data, in patterns, etc.)
–ID and understand their impact on local and global data topology and primary metrics if in several ways
/ more than one axis / at the same time
• Discover and analyze relationships amongst central actors
–Understand cycles, trends, changes (dynamic characteristics) for core actors,
topology, patterns and structure
–Understand causal factors
• Codify / create new model reflecting insights & outcomes from experiments
79. Data Science Workflow
• Frame problem / goal of effort
• Identify and extract data to be used in effort from whole corpus / totality of available
data
–Exploratory identification and selection of working data for use in experiments
• Define experiment(s): hypothesis / null hypothesis, methods, success criteria
–Derive insight(s)
–Wrangle, process, visualize, interpret
• Codify / create new model reflecting insights outcomes from experiments
• Validate new model(s)
• Provision training data
• Train new model
• Validation and outcome of training model
• Hand-off for implementation on production systems / as production code
80. THE ESSENCE
▸Empirical perspective
▸Business imperatives drive activities
▸Analytical approach
▸Recipe is always the same
▸Engineering always present
▸Data challenges are paramount
▸consume 60% - 80% of time and effort
▸Data volumes range huge to moderate (PB > MB)
▸Domain often drives analysis
▸Data scientists already have self-service
▸Some new problems, many the same
▸Use ‘advanced’ analytics, not conventional BA
▸Innovate by applying known analyses to new data
▸Current workflow fragmented across tools and data stores
▸Success can be a model, product, insight, infrastructure, tool
81. Model of Analytical Workflow
Articulates common analytical activities
“realistic” - represents wrangling, some iterative dynamics
bounded - does not represent business perspective
Originated by Ben Lorica - O’Reilly
*consistent with our research*
85. THE ESSENCE
▸Empirical perspective
▸Business imperatives drive activities
▸Analytical approach
▸Recipe is always the same
▸Engineering always present
▸Data challenges are paramount
▸consume 60% - 80% of time and effort
▸Data volumes range huge to moderate (PB > MB)
▸Domain often drives analysis
▸Data scientists already have self-service
▸Some new problems, many the same
▸Use ‘advanced’ analytics, not conventional BA
▸Innovate by applying known analyses to new data
▸Current workflow fragmented across tools and data stores
▸Success can be a model, product, insight, infrastructure, tool
87. John is tasked with analyzing 30 years of crime data collected by three different authorities. Accordingly, the data arrive in three different formats: one source is a relational database, another is a comma-separated values (CSV)
file, and the third file contains data copied from various tables within a portable document format (PDF) report. Knowing the structure required for his visualization tool, John first reviews the different data sets to identify potential
problems (step 1 in Figure 1).
The relational database allows him to specify a query and generate a file in an acceptable format. For the comma delimited data, the column headings associated with the data were unclear. Using spreadsheet software he adds a
row of header information at the top to fit the format required by the visualization tool. While updating the header, John notices that the location of a given crime is encoded in one column (as ‘City, State’) in the CSV file and
encoded in two columns (one ‘City’ column and one ‘State’ column) in the relational database.
He decides to split the column in the CSV file into two separate columns. John then opens the text file in the spreadsheet but the spreadsheet does not parse the data as desired. After manually moving data fields to appropriate
columns and some other manipulation (step 2), John finally has consistent columns and now combines the three files into one, but then notices that some columns have inconsistently formatted cells.
The ‘Date’ column is formatted as ‘dd/mm/yy’ in some cells and as ‘mm/dd/yyyy’ in others. John returns to the original files, transforms all the dates to the same format, and recombines the files. John loads the merged data file in a
visualization tool (step 3). The tool immediately gives the error message ‘Empty cells in column 3’; it cannot cope with missing data. John returns to the spreadsheet to fill in missing values using a few spreadsheet formulas (back
to step 2). He edits the data by hand; sometimes he transforms the data (e.g. one state reports data only every other year so he uses an average for the missing years). At other times there is nothing he can do after diagnosing a
new problem (i.e. return to step 1). For example, he finds out that survey question 24 did not exist before 2000, and the most recent year of data from Ohio has not been delivered yet, so he tries to pick the best possible value (e.g.
1) to indicate missing values. John detects other, more nuanced, problems; for example, some cells have a blank space instead of being empty. It took hours to notice that difference. John tries to follow a systematic approach
when evaluating the data, but it is difficult to keep track of what he has inspected and how he has modified the data, especially because he discovers different issues across different files. Even after all of this work, he is not sure if
he has examined all of the variables or overlooked any outliers. After a while, the data file seems good enough and he decides to move on.
It took a few days so it is with a great sense of accomplishment that John finally loads the data for the second time into the visualization tool he wants to use (step 3 again). He constructs several views of the data, including a
geospatial representation of the crimes and a scatterplot of age against crime. As soon as he sees the visualized data he realizes that, unfortunately, data quality issues still persist. Extreme outliers appear in the visualization.
Some outliers seem to be valid data (e.g. data from the District of Columbia are very different from data from every other state).
Others seem suspicious (criminals may vary in age from teenagers to older adults, but apparently babies are also committing crimes in certain states). John iteratively removes those outliers he believes to be dirty data (e.g.
criminals under 7 and over 120 years old). Times eries visualizations indicate that, in 1995, some causes of death disappear abruptly while new ones appear.Two days later, an email exchange with colleagues reveals that the
classification of causes of death was changed that year. John writes a transformation script to merge the data so he can analyze distinct terms referring to the same (or at least similar) cause of death.
Although the ‘real’ analysis is just about to start (step 4), John has made dozens of transformations, repeated the process several times, made important discoveries relating to the quality of the data, and made
many decisions impacting the quality of the final ‘clean’ data. He also used visualization repeatedly while walking through the process, but still does not have results to show to his boss. Finally, he is able to work
with the usable data, and useful insights come to the surface, but updated data sets arrive (step 5). Without proper documentation (step 6) of his transformations, John might be forced to repeat many of the
tedious tasks.
“Research directions in data wrangling: Visualizations and transformations for usable and credible data”
“a process of iterative data exploration and transformation that enables analysis.”
WRANGLING SCENARIO
88. Although the ‘real’ analysis is just about to start (step 4), John has made
dozens of transformations, repeated the process several times, made
important discoveries relating to the quality of the data, and made many
decisions impacting the quality of the final ‘clean’ data.
He also used visualization repeatedly while walking through the process, but
still does not have results to show to his boss.
Finally, he is able to work with the usable data, and useful insights come to the
surface, but updated data sets arrive (step 5).
Without proper documentation (step 6) of his transformations, John might be
forced to repeat many of the tedious tasks.
“Research directions in data wrangling: Visualizations and transformations for usable and credible data”
“a process of iterative data exploration and transformation that enables analysis.”
WRANGLING SCENARIO
89. One or more initial data sets may be used and new versions may
come later. The wrangling and analysis phases overlap.
While wrangling tools tend to be separated from the visual
analysis tools, the ideal system would provide integrated tools
(light yellow). The purple line illustrates a typical iterative process
with multiple back and forth steps.
Much wrangling may need to take place before the data can be loaded
within visualization and analysis tools, which typically
immediately reveals new problems with the data.
Wrangling might take place at all the stages of analysis as users
sort out interesting insights from dirty data, or new data become
available or needed.
At the bottom we illustrate how the data evolves from raw data to
usable data that leads to new insights.
“a process of iterative data exploration and transformation that enables analysis.”
WRANGLING IN THE ANALYTICAL WORKFLOW
91. Discovery in the Analytical Workflow
• Commonly recognizable cycle and focus for discovery activities (subset)
• Explicitly iterative, ad-hoc, dynamic
• Goal = incremental / directional advance in understanding
• Core modes of engagement with data = Explore, Analyze
• Modeling phase does not involve exploration
Discovery
96. The Language of Discovery:
A concrete descriptive language for
human discovery activity in diverse
contexts.
A simple and consistent vocabulary that
is independent of domain, role,
information type, etc.
The Language of Discovery:
A concrete descriptive language for
human discovery activity in diverse
contexts.
A simple and consistent vocabulary that
is independent of domain, role,
information type, etc.
103. Locate
To find a specific (possibly known) thing
e.g. I need to find a new part with particular technical attributes and then source it from the most qualified supplier - Engineering
Verify
‘To confirm or substantiate that an item or set of items meets some specific criterion’
e.g. How can I determine if I am looking at the latest information for a part or supplier? - Supply Chain Specialist
Monitor
‘To maintain awareness of the status of an item or data set for purposes of management or
control’
e.g. I need to monitor at risk/failing customers/dealers so I can prompt my Account Reps to fix the problems - Sales Manager
104. Compare
To examine two or more things to identify similarities & differences
e.g. I need to compare our module set teardowns with competitive teardown information to see if we’re staying competitive for cost, quality and functionality - Engineering
Comprehend
To generate insight by understanding the nature or meaning of something
e.g. I need to analyze and understand consumer-customer-market trends to inform brand strategy & communications plan – Director, Brand Image
Explore
To proactively investigate or examine something for the purpose of knowledge discovery
e.g. I need to understand the cost drivers for this commodity so I can negotiate better terms with my suppliers and forecast business risk based on market indices -
Procurement
105. Analyze
To critically examine the detail of something to identify patterns & relationships
e.g. I need to know the cost drivers for a part such as materials that impact cost. Is the relationship a correlation or step function for a part cost driver? - Engineering
Evaluate
To use judgement to determine the significance or value of something with respect to a specific benchmark
or model
e.g. I need to determine my current state in my prints so I can evaluate if I have price variation to negotiate a better price - Procurement
Synthesize
To generate or communicate insight by integrating diverse inputs to create a novel artifact or composite
view
e.g. I need to prepare a weekly report for my boss (sales mgr) of how things are going - Account Rep
111. Discovery Modes and Activity
Explore
Wrangle
Analyze
Augment
Sensemaking
Transformation
data quality computed / enriched data
New data triggers
new cycles
Cumulative Change
Direction & Momentum
Begin Conclude
Goal: Make data useful for
analysis
Goal: Understand the nature and
usefulness of data for analysis.
Goal: Accumulate insight through
iterative analysis
Goal: Achieve insights by
analyzing data.
112. Working with data
to effect outcomes
Explore
Wrangle
Analyze
Augment
Sensemaking
Transformation
data quality computed / enriched data
New data triggers
new cycles
Cumulative Change
Direction & Momentum
Begin Conclude
Advancing insight
Can’t do this…
…Without these
capabilities
Apparent Mode and Activity Affinities
113. Explore
Wrangle
Analyze
Augment
Sensemaking
Transformation
source data source & enriched data
New data triggers
new cycles
Cumulative incremental progress
Focus of attention: Organization
of the data and quality issues
Focus of attention: Actual &
potential insights
Real wrangling Real analysis
Actual Discovery Modes and Activity Affinities
114. CAPABILITIES FOR VISUAL DISCOVERY & ANALYSIS TOOLS
▸ Explore data corpus
▸via effectively characterized catalog
▸ Explore individual data sets
▸effective preview / sample / subset
▸ Analyze data
▸within ad-hoc data sets, across ad-hoc data sets
▸ Wrangle data
▸within ad-hoc data sets, across ad-hoc data sets
▸ Verify outcomes: insights, models, data products
▸ Synthesize outcomes
▸ distinct types = insights, model, data product (project)
▸ Publish outcomes
▸ distinct types = insight, data product, model (project)
▸ Integrate specialized / external analytical tools {augment}
▸ analysis tools (R, Python), reference models, validation tools
▸ Integrate external workflow tools {enhancing}
▸ e.g. figshare, model management, projects
▸ Support analytical workflow {enhancing}
128. Tools on the Market Now
Explore
Wrangle
Analyze
Augment
Sensemaking
Transformation
data quality computed / enriched data
Cumulative Change
Direction & Momentum
Begin Conclude
Paxata, Trifacta
Beyond Core?
OSS / hand rolled
EID 3.x
Wave 1 wrangling
tools now in market
No good exploration
tool in market
129. Tools on the Market Now
Explore
Wrangle
Analyze
Augment
Sensemaking
Transformation
data quality computed / enriched data
Cumulative Change
Direction & Momentum
Begin Conclude
Alteryx
Datameer
Modest exploration
capabilities
130. Tools on the Market Now
Explore
Wrangle
Analyze
Augment
Sensemaking
Transformation
data quality computed / enriched data
Cumulative Change
Direction & Momentum
Begin Conclude
Alteryx
Modest exploration
capabilities
Qlik
131. Tools on the Market Now
Explore
Wrangle
Analyze
Augment
Sensemaking
Transformation
data quality computed / enriched data
Cumulative Change
Direction & Momentum
Begin Conclude
Tableau, Platfora
Wave 1 visual
analysis tools now in
market
Modest wrangling
capabilities
135. VISUAL DISCOVERY AND ANALYSIS TOOLS: WAVE 1
Definition: traditional discovery & analysis possible on hadoop stores
Value prop = easy access to hadoop stores for analysts w/out data engineer
In / coming to market now: platfora, datameer, clearstory, sisense, etc.
Segment is viable (people understand the need & have the problem)
Tool maturity will increase incrementally, and in customary ways
alignment to workflow particulars
nuanced and compelling UX
broader footprint of supporting capabilities: provenance, publishing, collaboration
integration with ecosystem of related tools for activity
This class of tools competes with & may replace / displace existing non-hadoop native tools that are still rising with the general analytics wave: qlik, tableau,
microstrategy
Firms making new investments (for new stacks) will try / buy this new generation
Firms extending existing investments less likely to buy new
Long view = tools in this segment could ‘eat’ BI marketshare by adding reporting and other structured analytical capabilities that capture customers
who do not have large BI stacks now, begin investing here, and subsequently need BI capability
154. DEEP STRUCTURE <> ANALYTICAL WORKFLOW
CHANGE VECTORS <> BIG DATA TECHNOLOGIES
EARLY SIGNALS <> RISE OF DATA SCIENCE
INFLECTION POINTS <> DATA SCIENCE MOMENT
EMERGING SPACES <> EMPIRICAL DISCOVERY
HOLISTIC EXPERIENCES <> VISUAL DISCOVERY TOOL
156. VISUAL DISCOVERY & ANALYSIS TOOLS: WAVE 2
Definition: Augmented discovery & analysis across full business data corpus
Value prop = deeper insights from more diverse data, faster insights,
effected via a mixed toolkit of (semi)automated analytical techniques (clustering, machine learning, regression / correlation, etc.) enhances and directs analyst
attention
Vectors of augmentation: data types, degree of automation
data = text / lingual, location / spatial, native graph, native stream
automation = which specific activities are augmented, to what degree)
Wave 2 is at the ‘pioneer’ stage: specifics of capability, value, implementation unknown
Limiting factors:
Domain specificity: value of general discovery analytics drops once domain boundaries are reached - need to align specifically to domain view of world
Expect verticalization of all analytics
Low / no tolerance for black boxes - deeper insights require transparency
Analytical literacy: level increasing, but orgs can’t benefit from advanced analytical techniques if not understood & trusted
198. WORKING THE ECOSYSTEM
• Oracle = an ecosystem
• ML = commoditizing
• Someone will ‘generate the electricity’ = provide
ML capability within the Oracle ecosystem
• Everyone’s going to need it…
222. The Language of Discovery
Category: Primary Research, Design Systems
Outcomes: Building on already-published original
applied research into information retrieval and
usage, the language of discovery posits a domain-
independent framework describing the activity
primitives of discovery in terms of ‘modes’.
Succeeding professional and industry publications
outline the application of this descriptive vocabulary
in settings including product design and
development, product strategy, and information
management.
Reference:
• Russell-Rose, T., Lamantia, J. and Burrell, M. 2011. A Taxonomy of
Enterprise Search and Discovery. Proceedings of EuroHCIR 2011,
London, UK. http://ceur-ws.org/Vol-763/paper4.pdf
• Russell-Rose, T., Lamantia, J. and Burrell, M. 2011. A Taxonomy of
Enterprise Search and Discovery. Proceedings of HCIR 2011, California,
USA. https://docs.google.com/a/kent.edu/viewer?
a=v&pid=sites&srcid=ZGVmYXVsdGRvbWFpbnxoY2lyd29ya3Nob3B8
Z3g6NzdmYjc3OWY2ZjQ2Zjg4MQ
• Russell-Rose, T. and Makri, S. 2012 A Model of Consumer Search
Behavior. Proceedings of EuroHCIR 2012, Nijmegen, NL.
• Designing the Search Experience: http://www.amazon.com/Designing-
Search-Experience-Information-Architecture/dp/0123969816
• Presentation - Strata: http://conferences.oreilly.com/strata/
stratany2012/public/schedule/detail/25411
• Presentation - UX Lisbon conference: http://www.joelamantia.com/
user-experience-ux/slides-for-uxlx-talk-the-language-of-discovery-a-
grammar-for-designing-big-data-interactions
223. Domain & Market Study: Data Science
Outcomes: Comprehensive portrait of all major facets of a new
analytical discipline, including its practices, roles,
methodology, tools and technologies, workflows,
organizational models, skillsets, alignment with business, areas
of innovation, and relation to the landscape of business
analytics.
Research outcomes and synthesized insights guided product
design, management, and strategy efforts including;
opportunity identification and profiling, landscape /
competitive modeling, technology lifecycle and evolution
models, product discovery, concept creation and evaluation,
prototyping.
Notable aspects: Consistently delivered insights twelve or
more months ahead of leading industry analysts pursuing
similar agendas.
Artifacts & Synthesis
• Data Science Highlights: http://www.joelamantia.com/user-
research/data-science-highlights-an-investigation-of-the-discipline
• Empirical Discovery Concept and Workflow Model: https://
blogs.oracle.com/serendipity/entry/
empirical_discovery_concept_and_workflow
• Empirical Discovery: A New Discipline https://blogs.oracle.com/
serendipity/entry/data_science_and_empirical_discovery
• Defining Discovery: Core Concepts: https://blogs.oracle.com/
serendipity/entry/defining_discovery_core_concepts
• Discovery and the Age of Insight http://www.joelamantia.com/
language-of-discovery/discovery-and-the-age-of-insight
• Big Data Is Not Enough http://www.joelamantia.com/user-
experience-ux/big-data-is-not-the-insight-slides-from-enterprise-
search-europe
226. DEEP STRUCTURES
ENTERPRISE / B2B
• Business process
• Activity
• Social structure: Organizational model
• Boundaries
• Regulation
• IT / Systems architecture
• Lifecycle
• Flows: capital, information, people
• Frame: shareholder value, social enterprise
CONSUMER / B2C
• Value scheme: wealth, love,
knowledge, safety
• Demographics
• Boundaries
• Mores
• Culture
• Social structure: community / group
• Frame: active lifestyle, sustainability